Principal Data Engineer

6 days ago

Islamabad, Islamabad, Pakistan Confiz Full time
Join to apply for the Principal Data Engineer role at Confiz

We are seeking a Principal Data Engineer responsible for leading data engineering teams. The role involves providing guidance, mentorship, and technical expertise to foster a collaborative and innovative work environment. Collaboration with stakeholders to define project requirements is essential, along with a commitment to problem solving, sophisticated design, and quality product creation.

Responsibilities
  • Collaborate with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines for effective data sharing across business systems.
  • Build and maintain ETL/ELT ingestion pipelines and analytics solutions using cloud technologies.
  • Ensure solutions are production-ready, adhering to operational, security, and compliance standards.
  • Implement monitoring and logging to ensure smooth data pipeline operation and prompt issue detection.
  • Ensure data processing complies with security policies and data protection regulations.
  • Lead efforts to ensure data accuracy, consistency, and reliability.
  • Participate in daily project and production meetings, providing technical support for issue resolution.
  • Work closely with stakeholders to understand and meet their requirements.
Qualifications
  • Bachelor's degree in Computer Science, Information Technology, Engineering, or related field (or equivalent experience).
  • 5+ years in data engineering and data warehousing, focusing on large-scale data pipelines.
  • 3+ years' experience with Big Data distributed systems such as Microsoft Fabric, Databricks, AWS EMR.
  • Strong experience with PySpark and ETL tools like ADF, Talend.
  • Proficiency in Python and SQL.
  • Understanding of data modeling, ETL processes, and data warehousing best practices.
  • Strong problem-solving and critical thinking skills.
  • Experience writing maintainable unit and integration tests for pipelines.
  • Knowledge of CI/CD pipelines and version control systems like Git.
  • Experience designing and managing Kafka-based data pipelines.
  • Knowledge of security best practices, including data encryption at rest and in transit.

Confiz boasts a team of over 700 professionals working on innovative enterprise projects, serving Fortune 100 retail and CPG companies, fintech, startups, and more. We emphasize processes and culture, holding multiple ISO certifications, and fostering a vibrant learning environment.

Learn more about us at: https://www.linkedin.com/company/confiz-pakistan/

Additional Details
  • Seniority level: Mid-Senior level
  • Employment type: Full-time
  • Job function: Information Technology
  • Industries: IT Services and IT Consulting
#J-18808-Ljbffr

  • Principal Data Engineer- Azure

    4 weeks ago

    Islamabad, Islamabad, Pakistan CLUSTOX Full time

    About the job Principal Data Engineer- AzureAbout the ProjectWe are a mission-driven team of developers, architects, ML engineers, and data specialists building an innovative cloud-based platform to combat coral reef degradation caused by global warming. By leveraging real-time data pipelines, AI/ML models, and scalable cloud architecture, we aim to deliver...

  • Principal Data Engineer- Azure

    6 days ago

    Islamabad, Islamabad, Pakistan Clustox Full time

    Join to apply for the Principal Data Engineer- Azure role at Clustox.About The ProjectWe are a mission-driven team of developers, architects, ML engineers, and data specialists building an innovative cloud-based platform to combat coral reef degradation caused by global warming. By leveraging real-time data pipelines, AI/ML models, and scalable cloud...

  • Principal Software Engineer

    4 hours ago

    Islamabad, Islamabad, Pakistan Alachisoft Full time

    Principal Software Engineer (.NET & Java)Principal Software Engineer (.NET & Java)This is an on-site job in Islamabad, Pakistan.Alachisoft is currently looking for a Principal Software Engineer to join our highly talented engineering team to help drive the architecture, design, and development of our server software products. This opportunity is for a...

  • Principal Software Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan Creative Chaos Full time

    A Principal Software Engineer for JAVA is an associate at Creative Chaos who is mainly responsible for developing server applications of various software platforms, including writing Restful APIs to be consumed by client applications. A Principal Software Engineer ensures that the functionality, security, and performance of the server application are as per...

  • Principal Software Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan Creative Chaos Full time

    Job SummaryA Principal Software Engineer for .Net is an associate at Creative Chaos who is mainly responsible for developing server applications of various software platforms including but not limited to writing Restful APIs to be consumed by client applications. A Principal Software Engineer makes sure that the functionality, security and performance of the...

  • Principal Software Engineer

    4 hours ago

    Islamabad, Islamabad, Pakistan Creative Chaos Full time

    Job SummaryA Principal Software Engineer for Python is an associate at Creative Chaos who is mainly responsible for developing server applications of various software platforms including but not limited to writing Restful APIs to be consumed by client applications. A Principal Software Engineer makes sure that the functionality, security, and performance of...

  • Principal Software Engineer- React Native

    6 days ago

    Islamabad, Islamabad, Pakistan Creative Chaos Full time

    Principal Software Engineer- React NativePrincipal Software Engineer- React NativeA Principal Software Engineer for React Native is an associate at Creative Chaos who is mainly responsible for developing front-end mobile client applications for various software platforms. A Principal Software Engineer makes sure that the functionality, security, and...

  • Data Engineering Leader

    5 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Job Title: Lead Data ArchitectWe are seeking a Principal Data Engineer responsible for leading data engineering teams. This role involves providing guidance, mentorship, and technical expertise to foster a collaborative and innovative work environment.Collaborate with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion...

  • Data-Driven Software Engineer

    7 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Data Driven Software EngineerIn this role, you will leverage your expertise in backend development with .NET, frontend with React, and cloud services with Azure to build innovative solutions. Your responsibilities will include coordinating technical and business aspects of software development, serving as a principal developer, providing guidance on...

  • Principal Software Engineer

    6 days ago

    Islamabad, Islamabad, Pakistan Creative Chaos Full time

    Job SummaryA Principal Software Engineer for Python at Creative Chaos is responsible for developing server applications across various platforms, including writing RESTful APIs for client consumption. They ensure that the functionality, security, and performance of the server applications meet design specifications and are bug-free. Principal engineers also...