Principal Data Engineer

1 week ago


Lahore, Punjab, Pakistan Confiz Full time

This role requires a professional with a deep background in data engineering and expertise in designing and implementing cloud-based data warehousing solutions using Azure Synapse. The ideal candidate will be a strategic thinker with a proven record of accomplishment of delivering scalable and efficient data solutions to meet complex business requirements.

Responsibilities:

  1. Design and implement highly scalable, high performance data warehousing solutions in Azure Synapse.
  2. Analyze and migrate existing data systems to Azure Cloud, optimizing data flow and collection to improve data accuracy and utility.
  3. Contribute to data architecture design and modeling initiatives, ensuring alignment with business needs and compliance with data governance standards.
  4. Consult with stakeholders to define data requirements, deliverables, and timelines, providing technical leadership and guidance throughout project lifecycles.
  5. Implement data security and privacy policies in line with industry best practices and organizational standards.
  6. Optimize data integration pipelines for performance and scalability.
  7. Develop and maintain documentation regarding data architectures, procedures, and solutions.

Qualifications

  1. Bachelor's or master's degree in computer science, Engineering, Information Technology, or a related field.
  2. 5 to 7 years of experience in data engineering with a strong focus on cloud-based solutions.
  3. Expertise in Azure Synapse Analytics, including data integration, management, and security.
  4. Proficient with SQL, Python, Spark, and other scripting languages commonly used in data engineering.
  5. Familiar with Azure IaC (Infrastructure as Code) and CI/CD automation using ARM, Bicep or Terraform.
  6. Deep knowledge of ELT (Extract, Load, Transform) and ETL (Extract, Transform, Load) processes and experience with Azure Data Factory.
  7. Strong understanding of data modeling (Data Vault 2.0 experience or certification preferred), data warehousing, and data lakes.
  8. Proven consulting or advisory roles in the design and deployment of large-scale data solutions in Azure environments.
  9. Experience working directly with clients or stakeholders in a consulting capacity, translating business needs into technical specifications and actionable plans.
  10. Demonstrated ability to contribute to project leadership, coordinate across client functional groups, and manage client relationships.
  11. Microsoft Certified: Azure Data Engineer Associate preferable.
  12. Microsoft Certified: Azure Solutions Architect Expert preferable.
  13. Certified Data Vault 2.0 Practitioner (CDVP2) preferable.

We have an amazing team of 700+ individuals working on highly innovative enterprise projects & products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.

What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015 (QMS), ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM) and ISO 14001:2015 (EMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.

People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.

To know more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/

#J-18808-Ljbffr

  • Lahore, Punjab, Pakistan HR POD Careers Full time

    Requirements:Bachelors or master's degree in computer science, Engineering, Information Technology, or a related field.5 to 7 years of experience in data engineering with a strong focus on cloud-based solutions.Expertise in Azure Synapse Analytics, including data integration, management, and security.Proficient with SQL, Python, PySpark, and other scripting...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    Unlocking Business Potential through Cutting-Edge Data Engineering and AnalyticsData Pilot is dedicated to empowering businesses with the data-driven insights they need to drive growth and success. As an Associate Data Architect, you will play a critical role in designing and implementing innovative data architectures that support advanced data engineering...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    Empowering Businesses with Real-Time Insights through Advanced Data ArchitecturesData Pilot is committed to helping organizations unlock the full potential of their data assets and maximize business value through our expert engineering and business acumen. As an Associate Data Architect, you will play a crucial role in designing and implementing scalable,...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    At Data Pilot, we're committed to helping businesses adapt and thrive in today's fast-paced environment by transforming raw data into actionable insights at lightning speed. As an Associate Data Architect, you will be instrumental in enabling our clients to make informed decisions based on real-time and batch analytics.About the Role:Data Architecture...


  • Lahore, Punjab, Pakistan People Full time

    About the job Principal Software Engineer - Node & AngularWe are looking for a highly capable PRINCIPAL SOFTWARE ENGINEER.Job Role and Duties:Backend development in Node or other related technologies.Front-end development in Angular or other related technologies & creation of HTML/CSS.Develop APIs in Node as per standard and optimization.Integrate 3rd Party...


  • Lahore, Punjab, Pakistan Creative Chaos Full time

    Job SummaryA Principal Software Engineer for Python is an associate at Creative Chaos who is mainly responsible for developing server applications of various software platforms including but not limited to writing Restful APIs to be consumed by client applications. A Principal Software Engineer makes sure that the functionality, security, and performance of...


  • Lahore, Punjab, Pakistan Confiz Full time

    We are looking for an experienced data engineer responsible for expanding and optimizing our big data pipelines. You will be working alongside other engineers and developers working on different layers of the infrastructure. Therefore, a commitment to collaborative problem solving, sophisticated design, and the creation of quality products is...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    Associate Data Architect - Analytics & AICompany Overview:At Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert...

  • Data Architect Lead

    2 weeks ago


    Lahore, Punjab, Pakistan Data Pilot Full time

    Data Pilot is a cutting-edge data product development and consulting services company that empowers businesses to unlock the full potential of their data assets. As an Associate Data Architect, you will play a pivotal role in designing and implementing scalable, efficient data architectures that support advanced data engineering and analytics projects.Key...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    At Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert engineering and business acumen.In the dynamic landscape...


  • Lahore, Punjab, Pakistan SDSol Technologies Full time

    Principal Software Engineer / Technical LeadSDSol Technologies is seeking a highly skilled Principal Software Engineer / Technical Lead with a strong background in backend development, frontend technologies, and database management. The ideal candidate must have an overall experience of 8-10 years with a proven track record in managing software development...


  • Lahore, Punjab, Pakistan Bitsclan Full time

    We are seeking a seasoned Principal Software Engineer to lead our software development team. As a key member, you will be responsible for delivering high-quality code and meeting project deadlines.Key Responsibilities:Design, develop, test, and deploy scalable PHP applicationsLiaise with the team to ensure seamless project executionMaintain and improve...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    Transforming Data into Business Insights through Innovative SolutionsAs an Associate Data Architect at Data Pilot, you will have the opportunity to work on cutting-edge data engineering and analytics projects that drive business growth and success. Our team is passionate about harnessing the power of data to deliver exceptional results and drive business...


  • Lahore, Punjab, Pakistan CLUSTOX Full time

    About the job Principal Test Engineer- Automation + ManualWe are currently seeking a highly skilled and experienced Principal Test Engineer to join our dynamic team. As a Principal Test Engineer, you will play a crucial role in ensuring the quality and reliability of our software projects through both automation and manual testing.Key Responsibilities:Lead...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    We're seeking a seasoned professional with a strong background in data engineering and architecture to join our team as an Associate Data Architect. In this role, you will have the opportunity to work on cutting-edge data projects, collaborate with a talented team of engineers and scientists, and drive innovation within the company.About the...


  • Lahore, Punjab, Pakistan Strategic Systems International Full time

    JOB TITLE: Principal Software Engineer (PHP, Laravel, MySQL)DEPARTMENT: Software DevelopmentREPORTS TO: Project DirectorPURPOSE:We are seeking a highly experienced and motivated Senior Full Stack Developer to join our dynamic team. This role is ideal for a technically proficient individual with strong backend and frontend expertise, leadership capabilities,...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    Data Pilot: Unlocking Business Value through Scalable Data ArchitecturesAt Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value...


  • Lahore, Punjab, Pakistan Crebri Engineering Full time

    Principal Designer PositionWe are seeking an experienced principal designer to join our team. The successful candidate will be responsible for leading design teams and developing complex engineering solutions in the oil and gas sector.Key Responsibilities:Minimum 7 to 10 years of relevant experience in engineering design in oil and gas EPC projects.Exposure...


  • Lahore, Punjab, Pakistan Travel Innovation Group Full time

    About the PositionAs a Principal SQA (Automation) Engineer at Travel Innovation Group, you will be responsible for defining test plans for features based on user stories, validating features/user stories against agreed acceptance criteria, and ensuring that developed features meet quality standards.You will work closely with agile teams to ensure the quality...


  • Lahore, Punjab, Pakistan Clustox Inc. Full time

    We are currently seeking a highly skilled and experienced Principal Test Engineer to join our dynamic team. As a Principal Test Engineer, you will play a crucial role in ensuring the quality and reliability of our software projects through both automation and manual testing.Key Responsibilities:Lead and manage a team of test engineers, providing guidance and...