Principal Data Engineer-PySpark

1 week ago

Multan, Punjab, Pakistan Confiz Full time

This role requires a professional with a deep background in data engineering and expertise in designing and implementing cloud-based data warehousing solutions using Azure Synapse. The ideal candidate will be a strategic thinker with a proven record of delivering scalable and efficient data solutions to meet complex business requirements.

Responsibilities:
  1. Design and implement highly scalable, high-performance data warehousing solutions in Azure Synapse.
  2. Analyze and migrate existing data systems to Azure Cloud, optimizing data flow and collection to improve data accuracy and utility.
  3. Contribute to data architecture design and modeling initiatives, ensuring alignment with business needs and compliance with data governance standards.
  4. Consult with stakeholders to define data requirements, deliverables, and timelines, providing technical leadership and guidance throughout project lifecycles.
  5. Implement data security and privacy policies in line with industry best practices and organizational standards.
  6. Optimize data integration pipelines for performance and scalability.
  7. Develop and maintain documentation regarding data architectures, procedures, and solutions.
Qualifications:
  1. Bachelor's or master's degree in computer science, Engineering, Information Technology, or a related field.
  2. 7+ years of experience in data engineering with a focus on cloud-based solutions.
  3. Expertise in Azure Synapse Analytics, including data integration, management, and security.
  4. Proficient with SQL, Python, PySpark, and other scripting languages used in data engineering.
  5. Familiar with Azure IaC (Infrastructure as Code) and CI/CD automation using ARM, Bicep, or Terraform.
  6. Deep knowledge of ELT and ETL processes and experience with Azure Data Factory.
  7. Strong understanding of data modeling (Data Vault 2.0 experience or certification preferred), data warehousing, and data lakes.
  8. Proven experience in consulting or advisory roles in large-scale data solutions in Azure environments.
  9. Experience working directly with clients or stakeholders, translating business needs into technical specifications.
  10. Demonstrated project leadership, coordination, and client relationship management skills.
  11. Microsoft Certified: Azure Data Engineer Associate (preferable).
  12. Microsoft Certified: Azure Solutions Architect Expert (preferable).
  13. Certified Data Vault 2.0 Practitioner (CDVP2) (preferable).

We have an amazing team of 700+ individuals working on highly innovative enterprise projects & products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.

What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015 (QMS), ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM), and ISO 14001:2015 (EMS) certified. We foster a vibrant culture of learning through collaboration and making the workplace fun.

People who work with us engage with cutting-edge technologies while contributing to the company's and their own success.

To learn more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/

#J-18808-Ljbffr

  • Principal Data Engineer

    3 weeks ago

    Multan, Punjab, Pakistan Confiz Full time

    We are looking for a Principal Data Engineer responsible for leading data engineering teams. He/she will provide guidance, mentorship, and technical expertise to team members, fostering a collaborative and innovative work environment. Collaboration is key for a Principal Data Engineer as he/she will work closely with stakeholders to define project...

  • Principal Data Architect

    5 days ago

    Multan, Punjab, Pakistan beBee Careers Full time

    We are seeking a Principal Data Engineer to lead our data engineering teams.Responsibilities:Collaborate with Big Data Solution Architects to design and implement scalable data ingestion pipelines for seamless data sharing across business systems.Develop and maintain ETL/ELT ingestion pipelines and analytics solutions using cloud technologies, ensuring...

  • Data Engineering Leader

    5 days ago

    Multan, Punjab, Pakistan beBee Careers Full time

    We are seeking an experienced Principal Data Engineer to drive our data engineering strategy.About the Role:Lead data engineering teams to design and implement scalable data architectures.Collaborate with stakeholders to define project requirements and deliver high-quality solutions.Ensure data pipelines are secure, reliable, and compliant with industry...

  • Big Data Strategist

    5 days ago

    Multan, Punjab, Pakistan beBee Careers Full time

    As a Principal Data Engineer, you will play a critical role in shaping our data engineering strategy and driving business value through data-driven insights.About the Job:Lead data engineering teams to design and implement scalable data architectures.Collaborate with stakeholders to define project requirements and deliver high-quality solutions.Ensure data...

  • Data Engineer

    2 days ago

    Multan, Punjab, Pakistan beBee Careers Full time

    Cloud Data EngineerThis role requires a data professional with expertise in designing and implementing cloud-based data warehousing solutions using Azure Synapse. The ideal candidate will be a strategic thinker with a proven record of delivering scalable and efficient data solutions to meet complex business requirements.Key Responsibilities:Design and...

  • Senior Data Architect Position

    2 days ago

    Multan, Punjab, Pakistan beBee Careers Full time

    Data Engineering SpecialistThis role requires a skilled data engineer with expertise in designing and implementing cloud-based data warehousing solutions using Azure Synapse. The ideal candidate will be a strategic thinker with a proven record of delivering scalable and efficient data solutions to meet complex business requirements.Key...

  • Cloud Data Warehousing Specialist

    1 day ago

    Multan, Punjab, Pakistan beBee Careers Full time

    Senior Data ArchitectThis role requires a senior data architect with expertise in designing and implementing cloud-based data warehousing solutions using Azure Synapse. The ideal candidate will be a strategic thinker with a proven record of delivering scalable and efficient data solutions to meet complex business requirements.Key Responsibilities:Design and...

  • Senior Data Engineer

    1 day ago

    Multan, Punjab, Pakistan beBee Careers Full time

    Data Engineer LeadWe are looking for a seasoned data engineer to lead the design and implementation of complex data solutions. The successful candidate will have extensive experience in building large-scale data pipelines, expertise in Azure, and strong leadership skills.Design and develop data engineering solutions that meet business requirements.Leverage...

  • Data Solutions Engineer

    6 days ago

    Multan, Punjab, Pakistan beBee Careers Full time

    Seeking a highly skilled Data Architect to lead the design and implementation of scalable, secure data solutions.Design and implement efficient data architectures for integrated systems.Maintain enterprise-wide data models aligned with business objectives.We are looking for an expert in Azure, data modeling, governance, and integration, with strong strategic...

  • Ambitious Area Leader

    2 weeks ago

    Multan, Punjab, Pakistan beBee Careers Full time

    Job Description:Overall Area LeadershipResponsible for the academic leadership and management of schools and entire cohort of Principals.Ensure improvement in student success rates, fee collection enhancement, and daily fleet management. Manage area administrators to perform administrative duties and academic data management.Relationship ManagementMaintain...