Principal Data Engineer-PySpark

2 weeks ago

Islamabad, Islamabad, Pakistan Confiz Full time

1 month ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

This role requires a professional with a deep background in data engineering and expertise in designing and implementing cloud-based data warehousing solutions using Azure Synapse. The ideal candidate will be a strategic thinker with a proven record of accomplishment of delivering scalable and efficient data solutions to meet complex business requirements.

Responsibilities

  • Design and implement highly scalable, high performance data warehousing solutions in Azure Synapse.
  • Analyze and migrate existing data systems to Azure Cloud, optimizing data flow and collection to improve data accuracy and utility.
  • Contribute to data architecture design and modeling initiatives, ensuring alignment with business needs and compliance with data governance standards.
  • Consult with stakeholders to define data requirements, deliverables, and timelines, providing technical leadership and guidance throughout project lifecycles.
  • Implement data security and privacy policies in line with industry best practices and organizational standards.
  • Optimize data integration pipelines for performance and scalability.
  • Develop and maintain documentation regarding data architectures, procedures, and solutions.

Qualifications
  • Bachelor's or master's degree in computer science, Engineering, Information Technology, or a related field.
  • 7+ years of experience in data engineering with a strong focus on cloud-based solutions.
  • Expertise in Azure Synapse Analytics, including data integration, management, and security.
  • Proficient with SQL, Python, PySpark, and other scripting languages commonly used in data engineering.
  • Familiar with Azure IaC (Infrastructure as Code) and CI/CD automation using ARM, Bicep or Terraform
  • Deep knowledge of ELT (Extract, Load, Transform) and ETL (Extract, Transform, Load) processes and experience with Azure Data Factory.
  • Strong understanding of data modeling (Data Vault 2.0 experience or certification preferred), data warehousing, and data lakes.
  • Proven consulting or advisory roles in the design and deployment of large-scale data solutions in Azure environments.
  • Experience working directly with clients or stakeholders in a consulting capacity, translating business needs into technical specifications and actionable plans.
  • Demonstrated ability to contribute to project leadership, coordinate across client functional groups, and manage client relationships.
  • Microsoft Certified: Azure Data Engineer Associate preferrable
  • Microsoft Certified: Azure Solutions Architect Expert preferrable
  • Certified Data Vault 2.0 Practitioner (CDVP2) preferrable

We have an amazing team of 700+ individuals working on highly innovative enterprise projects & products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.

What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015 (QMS), ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM) and ISO 14001:2015 (EMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.

People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.

To know more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/Seniority level
  • Seniority levelMid-Senior level
Employment type
  • Employment typeFull-time
Job function
  • Job functionInformation Technology
  • IndustriesIT Services and IT Consulting

Referrals increase your chances of interviewing at Confiz by 2x

Associate Software Engineer- Data EngineerL1 Application Support Engineer – Data Science Solutions

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

  • Senior Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBeeData Full time

    About UsWe are a global AI company dedicated to delivering state-of-the-art AI products and solutions to various industries. With over 10 years of experience, we strive to democratize AI and harness the power of global talent from underserved communities.About the RoleThis is a remote full-time position working in the Travel & Hospitality Industry. The...

  • Cloud Data Architect

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBeeData Full time

    This role is a critical component of our organization's data strategy. As a seasoned Data Engineer-PySpark, you will be responsible for designing and implementing cloud-based data warehousing solutions using Azure Synapse.Key ResponsibilitiesDevelop highly scalable and high-performance data warehousing solutions in Azure Synapse to support business growth...

  • Principal Engineer

    1 week ago

    Islamabad, Islamabad, Pakistan Fastn, Inc. Full time

    Principal EngineerLocation: Remote / IslamabadType: Full-timeAbout FastnFastn is on a mission to revolutionize how SaaS companies connect with their customers' environments. Powered by AI, we provide an embedded integration infrastructure that enables SaaS businesses to build, scale, and manage their integration ecosystem effortlessly.With Fastn, companies...

  • Principal Software Engineer

    5 days ago

    Islamabad, Islamabad, Pakistan Creative Chaos Full time

    1 month ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Job SummaryA Principal Software Engineer for Python is an associate at Creative Chaos who is mainly responsible for developing server applications of various software platforms including but not limited to writing Restful APIs to be consumed by client...

  • Data Engineering Lead

    1 week ago

    Islamabad, Islamabad, Pakistan Confiz Full time

    We are seeking a Data Engineering Lead with 8+ years of hands-on experience and a strong background in real-time and batch data processing, containerization, and cloud-based data orchestration. This role is ideal for someone passionate about building robust, scalable, and efficient data pipelines, and who thrives in agile, collaborative environments.Key...

  • Machine Learning Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan LMKR Full time

    Job Summary:The Data Scientist / ML Engineer will support the development of machine learning models and data pipelines. The role focuses on data analysis, feature engineering, and scalable processing using modern data platforms.Responsibilities:Perform data analysis and build machine learning models using Python, Spark, and PySpark.Develop and maintain...

  • Chief Data Engineering Strategist

    1 week ago

    Islamabad, Islamabad, Pakistan beBeeDataEngineer Full time

    As a seasoned leader in data engineering, we seek an individual to spearhead our real-time and batch data processing endeavors. This role is ideal for someone passionate about designing robust, scalable, and efficient data pipelines, and thriving in collaborative environments.Develop strategic plans to build real-time data pipelines using streaming...

  • Data Engineering Lead

    2 weeks ago

    Islamabad, Islamabad, Pakistan Confiz Full time

    Join to apply for the Data Engineering Lead role at ConfizContinue with Google Continue with Google2 days ago Be among the first 25 applicantsJoin to apply for the Data Engineering Lead role at ConfizGet AI-powered advice on this job and more exclusive features.Sign in to access AI-powered advicesContinue with Google Continue with GoogleContinue with Google...

  • Chief Data Engineer

    2 days ago

    Islamabad, Islamabad, Pakistan beBeeData Full time

    Job DescriptionWe are seeking a skilled professional to build and maintain data infrastructure that supports our lending models and operational processes, primarily on AWS.This role offers a unique opportunity to contribute to building the financial backbone of one of Africa's most ambitious digital banks.Key Responsibilities:Develop and operate ETL/ELT...

  • Sr. Data Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan Tekrowe Full time

    Direct message the job poster from TekroweTalent Acquisition Specialist @ Tekrowe Digital | Technical Recruiter | HR Operations | Head Hunter | Employee Engagement | Corporate CommunicationsThe Company Tekrowe Digital, a rapidly growing Software Development and Technology Innovation company in Pakistan, specializes in cutting-edge Web and Mobile...