Principal Data Engineer

4 weeks ago

Islamabad, Islamabad, Pakistan Confiz Full time
Join to apply for the Principal Data Engineer role at Confiz

We are seeking a Principal Data Engineer responsible for leading data engineering teams. The role involves providing guidance, mentorship, and technical expertise to foster a collaborative and innovative work environment. Collaboration with stakeholders to define project requirements is essential, along with a commitment to problem solving, sophisticated design, and quality product creation.

Responsibilities
  • Collaborate with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines for effective data sharing across business systems.
  • Build and maintain ETL/ELT ingestion pipelines and analytics solutions using cloud technologies.
  • Ensure solutions are production-ready, adhering to operational, security, and compliance standards.
  • Implement monitoring and logging to ensure smooth data pipeline operation and prompt issue detection.
  • Ensure data processing complies with security policies and data protection regulations.
  • Lead efforts to ensure data accuracy, consistency, and reliability.
  • Participate in daily project and production meetings, providing technical support for issue resolution.
  • Work closely with stakeholders to understand and meet their requirements.
Qualifications
  • Bachelor's degree in Computer Science, Information Technology, Engineering, or related field (or equivalent experience).
  • 5+ years in data engineering and data warehousing, focusing on large-scale data pipelines.
  • 3+ years' experience with Big Data distributed systems such as Microsoft Fabric, Databricks, AWS EMR.
  • Strong experience with PySpark and ETL tools like ADF, Talend.
  • Proficiency in Python and SQL.
  • Understanding of data modeling, ETL processes, and data warehousing best practices.
  • Strong problem-solving and critical thinking skills.
  • Experience writing maintainable unit and integration tests for pipelines.
  • Knowledge of CI/CD pipelines and version control systems like Git.
  • Experience designing and managing Kafka-based data pipelines.
  • Knowledge of security best practices, including data encryption at rest and in transit.

Confiz boasts a team of over 700 professionals working on innovative enterprise projects, serving Fortune 100 retail and CPG companies, fintech, startups, and more. We emphasize processes and culture, holding multiple ISO certifications, and fostering a vibrant learning environment.

Learn more about us at: https://www.linkedin.com/company/confiz-pakistan/

Additional Details
  • Seniority level: Mid-Senior level
  • Employment type: Full-time
  • Job function: Information Technology
  • Industries: IT Services and IT Consulting
#J-18808-Ljbffr

  • Principal Data Systems Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    **Job Summary**We are seeking an experienced Principal Data Engineer to lead our data engineering team. The successful candidate will have a strong background in data warehousing, ETL processes, and big data distributed systems.Key Responsibilities:Design, prototype, implement, and optimize data ingestion pipelines for effective data sharing across business...

  • Principal Data Engineer- Azure

    4 weeks ago

    Islamabad, Islamabad, Pakistan Clustox Full time

    Join to apply for the Principal Data Engineer- Azure role at Clustox.About The ProjectWe are a mission-driven team of developers, architects, ML engineers, and data specialists building an innovative cloud-based platform to combat coral reef degradation caused by global warming. By leveraging real-time data pipelines, AI/ML models, and scalable cloud...

  • Principal Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan Fastn, Inc. Full time

    Principal EngineerLocation: Remote / IslamabadType: Full-timeAbout FastnFastn is on a mission to revolutionize how SaaS companies connect with their customers' environments. Powered by AI, we provide an embedded integration infrastructure that enables SaaS businesses to build, scale, and manage their integration ecosystem effortlessly.With Fastn, companies...

  • Principal Software Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan Alachisoft Full time

    Principal Software Engineer (.NET & Java)Principal Software Engineer (.NET & Java)This is an on-site job in Islamabad, Pakistan.Alachisoft is currently looking for a Principal Software Engineer to join our highly talented engineering team to help drive the architecture, design, and development of our server software products. This opportunity is for a...

  • Principal Software Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan Creative Chaos Full time

    Job SummaryA Principal Software Engineer for Python is an associate at Creative Chaos who is mainly responsible for developing server applications of various software platforms including but not limited to writing Restful APIs to be consumed by client applications. A Principal Software Engineer makes sure that the functionality, security, and performance of...

  • Principal Software Engineer- React Native

    4 weeks ago

    Islamabad, Islamabad, Pakistan Creative Chaos Full time

    Principal Software Engineer- React NativePrincipal Software Engineer- React NativeA Principal Software Engineer for React Native is an associate at Creative Chaos who is mainly responsible for developing front-end mobile client applications for various software platforms. A Principal Software Engineer makes sure that the functionality, security, and...

  • Principal Software Engineer

    4 weeks ago

    Islamabad, Islamabad, Pakistan Creative Chaos Full time

    Job SummaryA Principal Software Engineer for Python at Creative Chaos is responsible for developing server applications across various platforms, including writing RESTful APIs for client consumption. They ensure that the functionality, security, and performance of the server applications meet design specifications and are bug-free. Principal engineers also...

  • Principal Software Engineer

    5 days ago

    Islamabad, Islamabad, Pakistan Confiz Full time

    Confiz is seeking a Principal Software Engineer to join our Data Platform Delivery team to accelerate data modernization for a global retail client. This role will focus on building secure backend APIs and data integration layers, enabling direct distributor data submissions and driving automated reporting and analytics.ResponsibilitiesLeads multidimensional...

  • Principal Data Scientist

    7 days ago

    Islamabad, Islamabad, Pakistan Confiz Limited Full time

    We are seeking a highly skilled Data Scientist with 5-8 years of experience to drive data-driven insights, develop predictive models, and build scalable data preparation pipelines. The ideal candidate should be proficient in Python or R, statistical analysis, and traditional machine learning techniques to solve complex business problems. This role requires...

  • Principal Data Architect

    1 week ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    About the RoleWe are seeking a Data Engineer with experience to design, develop, and maintain data pipelines that enable efficient data processing and analytics.The ideal candidate will have expertise in SQL, data modeling, and Oracle Data Integrator (ODI) and work closely with data analysts, BI developers, and business teams to ensure reliable and...