Data Pipeline Optimization Expert

24 hours ago


Karachi, Sindh, Pakistan beBee Careers Full time
Key Responsibilities
  • Monitor and troubleshoot AWS data pipelines using AWS Glue, Lambda, Step Functions, Athena, Redshift, or Airflow
  • Investigate job failures, analyze CloudWatch logs, and collaborate with L2/L3 teams to implement corrective actions
  • Re-run failed jobs and retry data ingestion processes while ensuring data consistency


  • Karachi, Sindh, Pakistan beBee Careers Full time

    Data Pipeline ArchitectureThe ideal candidate will design and develop optimal data pipeline architectures to meet business requirements. This includes creating efficient data flow processes, assembling complex data sets, and preparing ETL processing based on business needs.Responsibilities:Design and implement data pipeline architecture.Work with...


  • Karachi, Sindh, Pakistan beBee Careers Full time

    About the RoleWe are looking for a Big Data Pipeline Developer to join our team. As a Big Data Pipeline Developer, you will design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and integrate data from various sources.Key ResponsibilitiesDesign and implement data storage solutions, including data lakes, data warehouses, and...

  • Data Engineer

    23 hours ago


    Karachi, Sindh, Pakistan beBee Careers Full time

    Job Title: Data Engineer - Real-Time Data PipelinesWe are seeking a skilled Data Engineer to join our team and help us expand and optimize our data and data pipeline architecture. As a Data Engineer, you will be responsible for monitoring Snowflake jobs and alerts, re-running or taking action on jobs as needed. You will also work with cross-functional teams...


  • Karachi, Sindh, Pakistan beBee Careers Full time

    We are seeking a highly skilled Data Engineer to join our team. This role involves monitoring, troubleshooting, and optimizing AWS-based data pipelines while ensuring data integrity and pipeline continuity.


  • Karachi, Sindh, Pakistan beBee Careers Full time

    AI Project Support Specialist:We need a skilled Data Collection and Preparation Specialist to assist our AI-driven projects by collecting, processing, and preparing large datasets from various public sources. This role requires developing and maintaining an automated data pipeline to ensure optimal data quality for AI applications.Main Responsibilities:Data...

  • Data Engineer Expert

    2 weeks ago


    Karachi, Sindh, Pakistan beBee Careers Full time

    Job SummaryThe ideal candidate will design, develop, and maintain scalable data pipelines to ingest, transform, and integrate data from various sources. They will also implement real-time data streaming and batch processing solutions to support diverse business needs.Key Responsibilities:Data Pipeline Development: Develop efficient ETL/ELT pipelines that...


  • Karachi, Sindh, Pakistan beBee Careers Full time

    Job SummaryThis is an exciting opportunity for a Gas Pipeline Optimization Specialist to join our team. The successful candidate will be responsible for developing and implementing strategies to optimize gas distribution and pipeline infrastructure, as well as monitoring and analyzing gas consumption patterns and customer demand.Key ResponsibilitiesDevelop...


  • Karachi, Sindh, Pakistan beBee Careers Full time

    This role is responsible for designing, implementing, and maintaining efficient data pipelines on the AWS platform. The successful candidate will possess expertise in AWS services and be able to analyze and troubleshoot complex data processing issues.Responsibilities:Design, develop, and deploy scalable data pipelines using AWS servicesAnalyze system logs,...


  • Karachi, Sindh, Pakistan beBee Careers Full time

    Data Engineering Expert WantedAs a Senior Big Data Engineer, you will design and develop complex ETL jobs and pipelines using cutting-edge technologies like Hadoop, Spark, and Kafka.


  • Karachi, Sindh, Pakistan beBee Careers Full time

    Sales Hub Customization and Data Migration ExpertWe require a seasoned expert to customize and optimize our HubSpot Sales Hub to improve sales performance.The ideal candidate will have extensive experience with HubSpot Sales Hub implementation and customization, as well as expertise in data migration from Excel to HubSpot.They will configure custom...