Advanced Data Pipeline Specialist

20 hours ago


Karachi, Sindh, Pakistan beBee Careers Full time
Job Title:

Data Engineer – L2 Support Specialist

About the Role:

We are seeking an experienced Data Engineer to join our team in a Level 2 support capacity. This role involves monitoring, troubleshooting, and optimizing AWS-based data pipelines to ensure data integrity and pipeline continuity.

Key Responsibilities:
  • Monitor and troubleshoot AWS data pipelines using various tools such as AWS Glue, Lambda, Step Functions, Athena, Redshift, or Airflow.
  • Investigate job failures, analyze CloudWatch logs, and collaborate with teams to implement corrective actions.
  • Re-run failed jobs and retry data ingestion processes while maintaining data consistency.
  • Work closely with engineers and data architects to escalate and resolve complex issues.
  • Maintain documentation of troubleshooting steps, common issues, and resolutions.
  • Participate in incident response and recovery procedures as needed.
  • Provide technical support for production data pipelines, ensuring service-level agreements are met.
Requirements:
  • Bachelor's degree in Computer Science, Data Science, Information Technology, or a related field.
  • Up to 2+ years of experience in data processing / ETL.
  • Hands-on experience with AWS services such as AWS Glue, Athena, Lambda, Step Functions, and Redshift.
  • Proficiency in Python and SQL for data querying and processing (preferred).
  • Familiarity with PySpark and ETL development (a plus).
  • Strong analytical and problem-solving skills to diagnose and resolve data processing failures.
  • Ability to work independently while effectively collaborating with cross-functional teams.
  • AWS certifications such as AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect Associate (preferred but not mandatory).
Career Growth Opportunities:
  • Senior Data Engineer
  • Big Data Engineer / AWS Data Architect
  • Data Engineering Lead / Architect
Why Choose Us:

This is a great opportunity for a skilled Data Engineer to grow their career and take on new challenges in a dynamic and fast-paced environment.



  • Karachi, Sindh, Pakistan beBee Careers Full time

    Job Title: Pipeline Integrity SpecialistJob Description:Cathodic protection systems play a crucial role in maintaining the integrity of transmission and distribution pipelines. As a Pipeline Integrity Specialist, you will be responsible for designing and implementing corrosion monitoring and cathodic protection systems to ensure the longevity of these...


  • Karachi, Sindh, Pakistan beBee Careers Full time

    We are seeking a skilled Data Engineer to join our team and play a key role in designing, developing, and maintaining scalable data pipelines.Key ResponsibilitiesData Ingestion and Integration: Design, develop, and maintain ETL/ELT pipelines to ingest, transform, and integrate data from various sources, ensuring scalability, security, and performance.Data...


  • Karachi, Sindh, Pakistan beBee Careers Full time

    About the RoleAs a Senior Data Engineer, you will be responsible for designing, developing, and maintaining our data infrastructure, pipelines, and lakehouse. You'll collaborate closely with stakeholders to craft data solutions aligned with business needs, leveraging cloud-based technologies and addressing data infrastructure issues.This is a critical role...


  • Karachi, Sindh, Pakistan beBee Careers Full time

    AI Data Support Job DescriptionThe successful candidate will be responsible for building and maintaining an automated data pipeline, which involves collecting, processing, and storing data in a well-structured file system or database. They will also work closely with the AI team to understand data requirements for different projects.


  • Karachi, Sindh, Pakistan beBee Careers Full time

    Data Insights Specialist\A successful Data Analyst should have a Bachelor’s degree in Computer Science or Engineering and at least 2-3 years of experience in data science.\Analytical skills and the ability to identify trends, patterns, and insights from data.Design, develop, and implement data analysis tools and techniques.Enter and edit data in work...


  • Karachi, Sindh, Pakistan beBee Careers Full time

    Corrosion Control Specialist RoleThis role requires a specialist in Corrosion Control (CC) activities on the pipeline network.The position involves ensuring the integrity of the pipeline network by maintaining CC systems.Main Responsibilities:Coordinate with government departments/agencies for permissions to carry out CC jobs.Perform maintenance and...


  • Karachi, Sindh, Pakistan beBee Careers Full time

    Pipeline Engineer JobWe are seeking a skilled Pipeline Engineer to direct various engineering activities related to the planning, design, construction, and maintenance of distribution pipeline networks.Main Responsibilities:Collaborate with site engineers to develop engineering plans, specifications, and designs for distribution pipeline systems in...


  • Karachi, Sindh, Pakistan beBee Careers Full time

    Senior Data EngineerDesign, develop and maintain scalable data infrastructure, pipelines and lakehouse for reliable software delivery.This role demands:Minimum 7 years of experience in Data EngineeringAdvanced Data Warehouse ExpertiseProficiency in Git and Collaboration ExperienceAble to work onsite or remotelyKey ResponsibilitiesArchitect and develop data...


  • Karachi, Sindh, Pakistan beBee Careers Full time

    Senior Mechanical Engineer - Pipeline SpecialistA career opportunity has arisen for a seasoned Mechanical Engineer to join our team as a Senior Pipeline Specialist. This role demands expertise in oil and gas industry practices, particularly in pipeline maintenance and repair.Key Responsibilities:Responsible for planning, executing, and overseeing R&M...


  • Karachi, Sindh, Pakistan beBee Careers Full time

    Job Title:Cathodic Protection SpecialistJob Description:Pipeline Integrity Management RoleThe purpose of this position is to ensure the protection of assets, including transmission pipelines. This involves conducting detailed inspections at Corrosion Control Transmission (CCT) stations, test points, and pipeline construction projects.Ensure CCT stations...