Principal Data Engineer

3 weeks ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

• Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and integrate data from various sources
• Implement real-time data streaming and batch processing solutions to support diverse business needs
• Build and optimize data storage solutions, including data lakes, data warehouses, and databases
• Ensure data systems and pipelines are scalable, secure, and performant
• Clean, transform, and prepare raw data into usable formats for analytics and machine learning
• Collaborate with Data Scientists and Analysts to define data requirements and deliver solutions
• Monitor the performance and reliability of data pipelines and systems, implementing improvements where necessary
• Troubleshoot and resolve data-related issues, ensuring minimal downtime
• Implement and enforce data quality checks, validation processes, and monitoring mechanisms
• Collaborate with Data Governance teams to ensure data complies with organizational standards and policies
• Work closely with cross-functional teams, including Data Architects, Analysts, and Business Teams, to understand requirements and deliver data solutions
• Provide technical expertise and guidance on data engineering best practices
• Stay updated on emerging tools, technologies, and industry trends
• Evaluate and recommend technologies to enhance data engineering capabilities
  
  
  • Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and integrate data from various sources
  • Implement real-time data streaming and batch processing solutions to support diverse business needs
  • Build and optimize data storage solutions, including data lakes, data warehouses, and databases
  • Ensure data systems and pipelines are scalable, secure, and performant
  • Clean, transform, and prepare raw data into usable formats for analytics and machine learning
  • Collaborate with Data Scientists and Analysts to define data requirements and deliver solutions
  • Monitor the performance and reliability of data pipelines and systems, implementing improvements where necessary
  • Troubleshoot and resolve data-related issues, ensuring minimal downtime
  • Implement and enforce data quality checks, validation processes, and monitoring mechanisms
  • Collaborate with Data Governance teams to ensure data complies with organizational standards and policies
  • Work closely with cross-functional teams, including Data Architects, Analysts, and Business Teams, to understand requirements and deliver data solutions
  • Provide technical expertise and guidance on data engineering best practices
  • Stay updated on emerging tools, technologies, and industry trends
  • Evaluate and recommend technologies to enhance data engineering capabilities
    
    
  Requirements
  • Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field
  • 7 to 8 years of experience as a Data Engineer or in a similar role, with expertise in building and maintaining data pipelines and infrastructure
  • Hands-on experience with big data tools, cloud platforms, and data integration techniques
  • Expertise in SQL and working with relational and NoSQL databases
  • Experience with data orchestration tools (e.g., ODI, SSIS, Apache Airflow, dbt, Prefect)
  • Proficiency in programming languages like Python, Java, or Scala
  • Familiarity with data processing frameworks (e.g., Apache Spark, Kafka)
  • Strong problem-solving and analytical skills
  • Excellent communication and collaboration abilities
  • Ability to work in a fast-paced, team-oriented environment
    
    
  Benefits
  • Competitive salary
  • Fuel Card
  • Health benefits
  • Professional development opportunities
  • Inclusive work culture & much more
  Seniority level
  • Seniority levelMid-Senior level
  Employment type
  • Employment typeFull-time
  Job function
  • Job functionOther
  • IndustriesIT Services and IT Consulting

Referrals increase your chances of interviewing at Pakistan Single Window (PSW) by 2x

Karachi Division, Sindh, Pakistan 3 hours ago

Karachi Division, Sindh, Pakistan 3 months ago

Karachi Division, Sindh, Pakistan 4 months ago

Principal Software Support Engineer-II (L3)

Karachi Division, Sindh, Pakistan 5 days ago

Senior Software Engineer I - AI (Contract)

Karachi Division, Sindh, Pakistan 6 months ago

Senior Software Engineer- D365 Development

Karachi Division, Sindh, Pakistan 5 days ago

Karachi Division, Sindh, Pakistan 4 hours ago

Karachi Division, Sindh, Pakistan 5 months ago

Full Stack Software Engineer (.NET Core & Angular)

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

---