Data Engineer

2 days ago

Lahore, Punjab, Pakistan beBee Careers Full time

Job Title: Data Engineer - Pipeline Optimization Specialist

We are seeking a skilled Data Engineer to join our team in monitoring, troubleshooting, and optimizing AWS-based data pipelines to ensure data integrity and pipeline continuity.

About the Role

This position operates in rotational shifts (24/7) with alternate weekends off to provide continuous coverage. As a Data Engineer, you will work with various services including AWS Glue, Lambda, Step Functions, Athena, Redshift, and Airflow.

Key Responsibilities:
  • Monitor and support AWS data pipelines using two or more of AWS Glue, Lambda, Step Functions, Athena, Redshift, or Airflow.
  • Investigate job failures, analyze CloudWatch logs, and collaborate with L2/L3 teams to implement corrective actions.
  • Re-run failed jobs and retry data ingestion processes while ensuring data consistency.
  • Work closely with engineers and architects to escalate and resolve complex issues.
  • Maintain documentation of troubleshooting steps, common issues, and resolutions.
  • Participate in incident response and recovery procedures as needed.
  • Provide technical support for production data pipelines, ensuring SLAs are met.
Requirements:
  • Bachelor's degree in Computer Science, Data Science, Information Technology, or a related field.
  • Up to 2+ years of experience in Data Processing / ETL.
  • Hands-on experience with two or more of AWS Glue, Athena, Lambda, Step Functions, Redshift.
  • Proficiency in Python and SQL for data querying and processing.
  • Familiarity with PySpark and ETL development.
  • Experience in monitoring and debugging AWS Glue jobs, Step Functions, and Lambda logs.
  • Strong analytical and problem-solving skills to diagnose and resolve data processing failures.
  • Ability to work independently while effectively collaborating with cross-functional teams.
  • AWS certifications such as AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect Associate.
  • Excellent communication and interpersonal skills.
Career Path Opportunities:
  • Senior Data Engineer (L2/L3 Support / ETL Development)
  • Big Data Engineer / AWS Data Architect
  • Data Engineering Lead / Architect
Why This Role Matters

In this critical role, you will play a key part in maintaining the reliability and performance of our data pipelines. Your expertise will be essential in identifying and resolving complex technical issues, ensuring business continuity and customer satisfaction.

With a strong focus on collaboration and knowledge sharing, you will have opportunities to grow and develop your skills, working alongside experienced professionals who are passionate about delivering innovative solutions.

  • Data Engineer

    36 minutes ago

    Lahore, Punjab, Pakistan DOT LABS Full time

    Job Title: Senior Data EngineerGet AI-powered advice on this job and more exclusive features.At Dot Labs, we are seeking a talented Senior Data Engineer to join our growing team.Forward your resume to: careers@dotlabs.aiLocation: DHA Phase 2Timing: 10:00 AM - 7:00 PM (Onsite)Job DescriptionAs a Senior Data Engineer, you will collaborate closely with data...

  • Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Systems Limited Full time

    Senior Data Engineer:Systems Limited is looking for a Senior Data Engineer with expertise in PySpark, Airflow, and Databricks to join our growing team.Responsibilities:Design, build, and maintain scalable data pipelines using PySpark for ETL/ELT processing, ensuring data is ingested, transformed, and loaded efficiently across multiple platforms.Use Apache...

  • Data Engineer

    5 days ago

    Lahore, Punjab, Pakistan PRG Pakistan Full time

    We are seeking a skilled Data Engineer with AI/ML expertise to design, build, and optimize scalable data pipelines that power machine learning models and AI-driven applications. You will work closely with data scientists, analysts, and software engineers to ensure efficient data ingestion, transformation, and storage—enabling real-time analytics and AI...

  • Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan Strategic Systems International Full time

    JOB TITLE: Data EngineerDEPARTMENT: Software DevelopmentREPORTS To: Team Lead / Project ManagerPURPOSE:The Data Engineer will be responsible for supporting data engineering and cloud-related tasks, ensuring efficient data processing and troubleshooting in production environments. This role is ideal for individuals with a strong problem-solving mindset, a...

  • QA Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Data Wise Full time

    Job Description:We are seeking a highly skilled test and quality assurance engineer to join our dynamic team. The ideal candidate will possess extensive experience in software testing and development. The QA testing engineer will play a crucial role in enhancing our software quality and performance by applying advanced testing strategies and will collaborate...

  • Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan Tkxel Full time

    Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe are seeking a skilled and experienced Data Engineer with expertise in PySpark and Azure Data...

  • Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Prime System Solutions Full time

    Education Requirements, Skills, and KnowledgeGood problem solving and decision-making skills; ability to understand and analyze complex issuesSelf-motivated, detail orientated, highly organized and able to handle a variety of tasks and responsibilities in an efficient manner with a high level of qualityExceptional analytical and conceptual thinking...

  • Data Engineering Leader

    1 week ago

    Lahore, Punjab, Pakistan NorthBay Solutions Full time

    At NorthBay Solutions LLC, we are seeking an experienced Data Engineering Leader to join our team. As a key member of our organization, you will be responsible for designing and developing cutting-edge Big Data technologies to build critical, highly complex distributed systems from scratch.Key Responsibilities:Design and develop using Big Data...

  • Senior Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Devsinc Full time

    Devsinc is seeking a talented Senior Data Engineer to join our dynamic team. The ideal candidate will possess a deep understanding of data architecture and engineering principles, along with hands-on experience in developing, optimizing, and maintaining data pipelines and databases. This role is crucial to support our data-driven initiatives and to enhance...

  • Cloud Data Engineer

    14 hours ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    About the RoleWe are seeking an experienced Data Engineer to lead our data engineering efforts and drive business growth through data-driven insights.Key ResponsibilitiesLead data engineering projects to create scalable and extensible data architectures.Develop and implement ETL processes to support our growing user base.Collaborate with cross-functional...