Data Pipeline Optimization Specialist

1 day ago


Lahore, Punjab, Pakistan beBee Careers Full time

Job Title: Data Engineer

Job Description: We are looking for an experienced Data Engineer to join our team. The successful candidate will be responsible for monitoring, troubleshooting and optimizing AWS-based data pipelines.

Responsibilities:

  • Monitor and troubleshoot AWS data pipelines.
  • Analyze job failures and implement corrective actions.
  • Re-run failed jobs and ensure data consistency.
  • Work with L2/L3 engineers and data architects to resolve complex issues.
  • Maintain documentation of troubleshooting steps and resolutions.

Requirements:

  • Bachelor's degree in Computer Science, Data Science, Information Technology or a related field.
  • Up to 2+ years of experience in Data Processing / ETL.
  • Hands-on experience with AWS Glue, Athena, Lambda or Step Functions.
  • Proficiency in Python and SQL.
  • Familiarity with PySpark and ETL development.
  • Strong analytical and problem-solving skills.
  • Ability to work independently and collaboratively.
  • AWS certifications such as AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect Associate.


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Job SummaryWe are seeking a skilled AWS Data Engineer to join our team. This role involves monitoring, troubleshooting, and optimizing AWS-based data pipelines while ensuring data integrity and pipeline continuity.


  • Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a skilled Data Engineer to design, build, and maintain robust and scalable data pipelines. The ideal candidate will play a critical role in developing systems that process and analyze data efficiently, enabling data-driven decision-making across the organization.Key Responsibilities:Develop ETL pipelines to ingest, transform, and load large...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    About the RoleThis position is responsible for monitoring, troubleshooting, and supporting AWS data pipelines using various tools such as AWS Glue, Lambda, Step Functions, Athena, Redshift, or Airflow.

  • Data Engineer

    1 day ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a highly skilled data engineer to expand and optimize our big data pipelines.Collaborate with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines so that data is shared effectively across various business systems.Build ETL/ELT Ingestion pipelines and analytics solutions using cloud and...

  • Data Engineer

    21 hours ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking an experienced data engineer to expand and optimize our big data pipelines.The successful candidate will work alongside other engineers and developers on different layers of the infrastructure, requiring a commitment to collaborative problem-solving, sophisticated design, and quality products.Design, prototype, implement, and optimize data...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    The ideal candidate will be an experienced IT Operations Expert with expertise in DevOps practices, containerization, data pipeline development, and troubleshooting intricate data workflows. They will work closely with the IT operations team to ensure smooth functioning of data workflows and provide support for our cloud-based infrastructure.Key...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Designing and Building Cloud-Based Data SolutionsWe are seeking an experienced Data Engineer to design and build cloud-based data solutions to support business decisions. As a Data Engineer, you will be responsible for managing datasets and related data pipelines, contributing to the data product roadmap, and ensuring that data products meet high standards...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Senior Data Infrastructure SpecialistThe ideal candidate will have a strong background in data warehouse and platform infrastructures, big data technologies, and large-scale data processing and ETL pipelines. They will be responsible for designing, developing, and maintaining robust data infrastructure to ensure the availability, scalability, and reliability...

  • Big Data Specialist

    2 weeks ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    Job OverviewWe are seeking a skilled Big Data Specialist to design and implement big data pipelines using tools like Apache Spark, Hadoop, or Kafka. The ideal candidate will have hands-on experience with large datasets from multiple sources and be able to optimize data processing for performance and scalability.


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Data Pipeline Expert PositionWe are seeking a highly skilled Data Pipeline Expert to join our team. As a key member of the data engineering team, you will be responsible for designing, developing, and implementing data pipelines using AWS services such as Glue, Lambda, Step Functions, Athena, Redshift, or Airflow.Responsibilities:Design and develop efficient...