Principal Data Engineer-PySpark

3 days ago

Multan, Punjab, Pakistan Confiz Full time

This role requires a professional with a deep background in data engineering and expertise in designing and implementing cloud-based data warehousing solutions using Azure Synapse. The ideal candidate will be a strategic thinker with a proven record of delivering scalable and efficient data solutions to meet complex business requirements.

Responsibilities:
  1. Design and implement highly scalable, high-performance data warehousing solutions in Azure Synapse.
  2. Analyze and migrate existing data systems to Azure Cloud, optimizing data flow and collection to improve data accuracy and utility.
  3. Contribute to data architecture design and modeling initiatives, ensuring alignment with business needs and compliance with data governance standards.
  4. Consult with stakeholders to define data requirements, deliverables, and timelines, providing technical leadership and guidance throughout project lifecycles.
  5. Implement data security and privacy policies in line with industry best practices and organizational standards.
  6. Optimize data integration pipelines for performance and scalability.
  7. Develop and maintain documentation regarding data architectures, procedures, and solutions.
Qualifications:
  1. Bachelor's or master's degree in computer science, Engineering, Information Technology, or a related field.
  2. 7+ years of experience in data engineering with a focus on cloud-based solutions.
  3. Expertise in Azure Synapse Analytics, including data integration, management, and security.
  4. Proficient with SQL, Python, PySpark, and other scripting languages used in data engineering.
  5. Familiar with Azure IaC (Infrastructure as Code) and CI/CD automation using ARM, Bicep, or Terraform.
  6. Deep knowledge of ELT and ETL processes and experience with Azure Data Factory.
  7. Strong understanding of data modeling (Data Vault 2.0 experience or certification preferred), data warehousing, and data lakes.
  8. Proven experience in consulting or advisory roles in large-scale data solutions in Azure environments.
  9. Experience working directly with clients or stakeholders, translating business needs into technical specifications.
  10. Demonstrated project leadership, coordination, and client relationship management skills.
  11. Microsoft Certified: Azure Data Engineer Associate (preferable).
  12. Microsoft Certified: Azure Solutions Architect Expert (preferable).
  13. Certified Data Vault 2.0 Practitioner (CDVP2) (preferable).

We have an amazing team of 700+ individuals working on highly innovative enterprise projects & products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.

What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015 (QMS), ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM), and ISO 14001:2015 (EMS) certified. We foster a vibrant culture of learning through collaboration and making the workplace fun.

People who work with us engage with cutting-edge technologies while contributing to the company's and their own success.

To learn more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/

#J-18808-Ljbffr

  • Principal Software Engineer

    3 weeks ago

    Multan, Punjab, Pakistan Confiz Full time

    Confiz is seeking a Principal Software Engineer to join our Data Platform Delivery team to accelerate data modernization for a global retail client. This role will focus on building secure backend APIs and data integration layers, enabling direct distributor data submissions and driving automated reporting and analytics.Responsibilities:Leads...

  • Area Education Manager

    3 weeks ago

    Multan, Punjab, Pakistan The Citizens Foundation Full time

    3 months ago Be among the first 25 applicantsResponsible and accountable for the entire academic leadership and management of Schools and entire cohort of Principals.Accountable for ensuring improvement in SSR, fee collection enhancement and day to day fleet management, Responsible for managing Area Administrator to perform overall administrative duties &...

  • Data Science

    2 days ago

    Multan, Punjab, Pakistan Corvit Systems Multan Full time

    Data Science & Machine Learning InstructorQualifications: Bachelors or Masters degree in Computer Science, Statistics, or a related field.Job Description: Data Science Position at Corvit Systems Multan.About Company:Corvit Systems is a leading provider of IT training in Multan. We offer courses from world-renowned vendors such as Cisco, Huawei, Juniper,...

  • Advanced Data Analyst Position

    3 days ago

    Multan, Punjab, Pakistan beBeeMachineLearning Full time

    Machine Learning Engineer VacancyWe are seeking a talented Machine Learning Engineer to join our organization in Multan. In this role, you will be responsible for designing and implementing machine learning algorithms and models to solve complex business problems.Main Responsibilities:Design and implement machine learning algorithms and models for various...

  • Machine Learning Engineer

    4 days ago

    Multan, Punjab, Pakistan Abroad Work Full time

    Machine Learning Engineer vacancy in Multan PakistanMachine Learning EngineerWe are seeking a talented Machine Learning Engineer to join our team in Multan. In this role, you will be responsible for designing and implementing machine learning algorithms and models to solve complex business problems. You will work closely with data scientists and software...

  • Lead – Data Platform Operations

    3 weeks ago

    Multan, Punjab, Pakistan Confiz Full time

    We are looking for a strategic and hands-on Operations Lead to ensure the resilience,performance, and cost-effectiveness of our Azure-based data platform. This role combines platform reliability, incident response, SLA ownership, and cost management (FinOps) with deployment oversight and CI/CD ownership. You will act as the single point of contact for...

  • Electrical Engineer

    2 weeks ago

    Multan, Punjab, Pakistan Abroad Work Full time

    Electrical Engineer vacancy in Multan PakistanEntry Level Electrical Engineer - Multan, PakistanEntry Level Electrical Engineer - Multan, PakistanAre you a recent graduate in Electrical Engineering looking for an exciting opportunity to kickstart your career? Look no further Our company is searching for an Entry Level Electrical Engineer to join our team in...

  • TAC Engineer

    3 weeks ago

    Multan, Punjab, Pakistan InstaCom Pvt. Ltd. Full time

    Graduation, BS in IT, BS in Telecommunication, BS in CSINSTACOM was established in 2014 and is the largest Internet & Data Service Provider in Pakistan. We serve thousands of customers in Punjab, offering services to both corporate and consumer sectors.Job Description:We are seeking a Help-Desk Engineer to join our talented team. If you are passionate about...

  • Principal Java/ Spring Boot Developer

    1 week ago

    Multan, Punjab, Pakistan Confiz Full time

    Senior Java DeveloperThe Senior Java Developer will play a critical role in designing, developing, and maintaining scalable and secure applications using Java and Spring Boot. This position requires a seasoned professional with 5+ years of hands-on experience in Java.ResponsibilitiesDesign, develop, and maintain secure and scalable applications in Java and...

  • Help-Desk Engineer

    3 weeks ago

    Multan, Punjab, Pakistan InstaCom Pvt. Ltd. Full time

    INSTACOM was established in 2014 and we are the largest Internet & Data Service Provider in Pakistan. In Punjab, we are serving thousands of customers. We offer services to the corporate and consumer sectors.Job Description:We are looking for a Help-Desk Engineer to join our talented company. If you are passionate about technology and constantly seeking to...