Principal Data Engineer

5 hours ago

Multan, Punjab, Pakistan Confiz Full time

We are looking for a Principal Data Engineer responsible for leading data engineering teams. He/she will provide guidance, mentorship, and technical expertise to team members, fostering a collaborative and innovative work environment. Collaboration is key for a Principal Data Engineer as he/she will work closely with stakeholders to define project requirements. Therefore, a commitment to collaborative problem solving, sophisticated design, and the creation of quality products is essential.

Responsibilities:
  1. Collaborate with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines to share data effectively across various business systems.
  2. Build & maintain ETL/ELT ingestion pipelines and analytics solutions using cloud technologies.
  3. Ensure the design, code, and procedural aspects of solutions are production-ready, adhering to operational, security, and compliance standards.
  4. Implement monitoring and logging solutions to ensure data pipelines run smoothly and issues are promptly identified.
  5. Ensure all data processing complies with security policies and data protection regulations.
  6. Lead efforts to ensure data accuracy, consistency, and reliability.
  7. Participate in daily project and production delivery meetings, providing technical support for faster issue resolution.
  8. Work with stakeholders to understand their requirements.
Qualifications:
  1. Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field (or equivalent work experience).
  2. 5+ years of experience in data engineering and data warehousing, focusing on building large-scale data pipelines.
  3. 3+ years' experience with Big Data distributed systems such as Microsoft Fabric, Databricks, AWS EMR.
  4. Strong experience developing data pipelines using PySpark and ETL tools like ADF, Talend.
  5. Proficiency in Python and SQL.
  6. Solid understanding of data modeling, ETL processes, and best practices in data warehousing.
  7. Strong problem-solving and critical thinking skills.
  8. Experience writing maintainable unit and integration tests for ingestion pipelines.
  9. Working knowledge of CI/CD pipelines for deployments.
  10. Experience with version control systems like Git.
  11. Knowledge of designing, developing, and managing Kafka-based data pipelines.
  12. Knowledge of security best practices, including encryption of sensitive data at rest and in transit.

We have an exceptional team of over 700 professionals working on innovative enterprise projects and products. Our client base includes Fortune 100 retail and CPG companies, leading store chains, fast-growing fintech firms, and Silicon Valley startups.

Confiz stands out for its focus on processes and culture. We are ISO 9001:2015 (QMS), ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM), and ISO 14001:2015 (EMS) certified. We foster a vibrant culture of learning through collaboration and making the workplace enjoyable.

Join us to work with cutting-edge technologies and contribute to the company's and your own success.

To learn more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/

#J-18808-Ljbffr

  • Principal Software Engineer

    2 hours ago

    Multan, Punjab, Pakistan beBee Careers Full time

    About This OpportunityOur organization seeks a Principal Data Engineer who can drive innovation, provide guidance, and lead cross-functional teams to develop scalable data pipelines and analytics solutions. If you are passionate about harnessing the power of data engineering and have experience designing and implementing large-scale data systems, this could...

  • Principal Quality Enhancement Expert

    1 week ago

    Multan, Punjab, Pakistan beBee Careers Full time

    Job RequirementsA senior-level position that demands academic leadership and management expertise. As an Area Education Manager, you will be responsible for overseeing the entire academic leadership and management of Schools and Principals, driving improvement initiatives in SSR, fee collection, and fleet management, and managing Area Administrator for...

  • Senior Quality Assurance Automation Engineer

    2 weeks ago

    Multan, Punjab, Pakistan Polymer Data Security Full time

    Company DescriptionPolymer data security is a platform to manage sensitive data in SaaS and AI.Polymer's secure data governance framework covers three pillars: data observability, data loss prevention (DLP), and human risk management.Polymer's security fabric is an abstraction layer built on top of this framework that enables enterprise organizations to...

  • Principal Engineer Position

    1 week ago

    Multan, Punjab, Pakistan beBee Careers Full time

    Job Description:This exciting opportunity involves working as a Graduate Engineer, supporting the delivery of complex engineering projects.About the Team:A dynamic and collaborative team environment.Ongoing professional development opportunities.Key Requirements:Strong analytical and problem-solving skills.Excellent communication and teamwork...

  • Data Engineering Lead

    1 hour ago

    Multan, Punjab, Pakistan beBee Careers Full time

    **About the Role**This role focuses on leading data engineering teams and providing guidance, mentorship, and technical expertise to team members. The successful candidate will foster a collaborative and innovative work environment while working closely with stakeholders to define project requirements.

  • School Development Director

    1 week ago

    Multan, Punjab, Pakistan beBee Careers Full time

    Job RoleA vital position that drives academic growth and development. As an Area Education Manager, your responsibilities include leading academic leadership and management of Schools and Principals, improving SSR, fee collection, and fleet management initiatives, and managing Area Administrator for overall administrative duties and Academic data...

  • Academic Leadership Specialist

    1 week ago

    Multan, Punjab, Pakistan beBee Careers Full time

    Job SummaryA prestigious opportunity to lead academic development and strategic growth. As an Area Education Manager, you will oversee the entire academic leadership and management of Schools and Principals. Your role encompasses improvement initiatives in SSR, fee collection, fleet management, and administrative duties.Main ResponsibilitiesResponsible for...

  • Area Education Manager

    1 week ago

    Multan, Punjab, Pakistan The Citizens Foundation Full time

    Overall Area LeadershipResponsible and accountable for the entire academic leadership and management of Schools and entire cohort of Principals.Accountable for ensuring improvement in SSR, fee collection enhancement and day to day fleet management, Responsible for managing Area Administrator to perform overall administrative duties & Academic data management...

  • Enterprise Data Architect

    1 day ago

    Multan, Punjab, Pakistan beBee Careers Full time

    Data Architect RoleWe are looking for a skilled Data Architect to lead the design and implementation of our data solutions. The successful candidate will have a proven track record of developing and maintaining large-scale data architectures.Key Responsibilities:Design and develop data architectures that meet business needs and drive growth.Develop and...

  • Education Manager Professional

    1 week ago

    Multan, Punjab, Pakistan beBee Careers Full time

    Job DescriptionAn exciting opportunity to drive educational excellence and strategic growth. As an Area Education Manager, you will be responsible for the overall academic leadership and management of Schools and Principals. Your key responsibilities include:Main ResponsibilitiesLead overall academic leadership and management of Schools and...