AWS Data Pipeline Specialist

4 days ago


Karachi, Sindh, Pakistan NorthBay Solutions LLC Full time

Job Description

We are seeking an experienced AWS data pipeline specialist to join our team at NorthBay Solutions LLC. This role involves monitoring, troubleshooting, and optimizing AWS-based data pipelines while ensuring data integrity and pipeline continuity.

You will work with AWS Glue, Lambda, Step Functions, and other AWS data services to investigate job failures, re-run ETL jobs, and support production workloads. This position operates in rotational shifts (24/7) with alternate weekends off to provide continuous coverage.

Responsibilities
  1. Develop and maintain efficient AWS data pipelines using AWS Glue, Lambda, and Step Functions.
  2. Investigate job failures and implement corrective actions to ensure data consistency.
  3. Collaborate with cross-functional teams to resolve complex issues and improve pipeline performance.
  4. Participate in incident response and recovery procedures as needed.
  5. Ensure that production data pipelines meet defined SLAs.
Requirements
  • Bachelor's degree in Computer Science, Data Science, or a related field.
  • At least 2 years of experience in data processing/ETL.
  • Hands-on experience with AWS Glue, Lambda, and Step Functions.
  • Proficiency in Python and SQL for data querying and processing.
  • Familiarity with PySpark and ETL development.
  • Excellent analytical and problem-solving skills.
  • Ability to work collaboratively with cross-functional teams.


  • Karachi, Sindh, Pakistan NorthBay Solutions Full time

    Senior AWS Data Pipeline SpecialistWe are seeking an experienced Senior AWS Data Pipeline Specialist to join our team at NorthBay Solutions. As a key member of our data engineering team, you will design, build, and maintain scalable, efficient, and reliable data pipelines using Amazon Web Services (AWS). Your primary responsibilities will include monitoring...


  • Karachi, Sindh, Pakistan NorthBay Solutions Full time

    Data Engineer Job SummaryWe are seeking an experienced Data Engineer to join our team at NorthBay Solutions. As a key member of our data engineering team, you will design, build, and maintain scalable, efficient, and reliable data pipelines using Amazon Web Services (AWS). Your primary responsibilities will include monitoring and troubleshooting data...


  • Karachi, Sindh, Pakistan NorthBay Solutions Full time

    Job DescriptionAs a Senior AWS Data Processor at NorthBay Solutions, you will play a critical role in the success of our team by designing, building, and maintaining scalable, efficient, and reliable data pipelines using Amazon Web Services (AWS). Your primary responsibilities will include monitoring and troubleshooting data pipelines, investigating job...


  • Karachi, Sindh, Pakistan NorthBay Solutions Full time

    We are seeking a Level 2 AWS Data Engineer to join our team. This role involves monitoring, troubleshooting, and optimizing AWS-based data pipelines while ensuring data integrity and pipeline continuity. You will work with AWS Glue, Lambda, Step Functions, and other AWS data services to investigate job failures, re-run ETL jobs, and support production...


  • Karachi, Sindh, Pakistan NorthBay Solutions LLC Full time

    Job OverviewWe are seeking a Level 2 AWS Data Engineer to join our team. This role involves monitoring, troubleshooting, and optimizing AWS-based data pipelines while ensuring data integrity and pipeline continuity. You will work with AWS Glue, Lambda, Step Functions, and other AWS data services to investigate job failures, re-run ETL jobs, and support...


  • Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    Required Skills and QualificationsDatabase Proficiency: Proficiency in SQL and NoSQL databases.Data Pipeline Tools: Experience with data pipeline and ETL tools (e.g., Apache Kafka, Airflow).Programming Languages: Strong programming skills in Python, Java, or Scala.Cloud Platforms: Familiarity with cloud platforms (AWS, Azure, GCP) and big data technologies...


  • Karachi, Sindh, Pakistan Horizon Technologies Full time

    Horizon Technologies is seeking a highly skilled Data Engineer Specialist to join our team. This individual will be responsible for designing, building, and maintaining large-scale data systems on AWS.We are looking for someone with strong analytical skills, expertise in programming languages such as Python, R, and SQL, and experience in building ETL/ELT...


  • Karachi, Sindh, Pakistan Dee4tech Full time

    SAP Finance and Supply Chain Management ProfessionalThis key position requires an expert in SAP finance and supply chain management with experience in implementing and optimizing SAP systems on AWS. The successful candidate will have strong analytical and business skills and be able to work effectively in a team environment.Main Tasks:Implement and Configure...

  • Big Data Expert

    1 week ago


    Karachi, Sindh, Pakistan Horizon Technologies Full time

    Job SummaryHiring for the position of Cloud Data Architect at Horizon Technologies!About UsHorizon Technologies is a cutting-edge technology firm that leverages innovative solutions to drive business growth. As a Cloud Data Architect, you will play a key role in shaping our cloud strategy and architecting scalable data platforms.About the RoleThis role...

  • Data Engineer

    1 week ago


    Karachi, Sindh, Pakistan Horizon Technologies Full time

    We are seeking an experienced Data Engineer to join our team. The Data Engineer will be responsible for extracting, transforming, and loading data from various sources into data lakes and data warehouses using AWS Glue while ensuring the efficiency and alignment of data systems with business goals. The ideal candidate should have strong analytical skills,...

  • Data Engineer

    3 days ago


    Karachi, Sindh, Pakistan NorthBay Solutions Full time

    Job OverviewWe are seeking a highly skilled Data Engineer - L2 Support to join NorthBay Solutions. This role involves monitoring, troubleshooting, and optimizing AWS-based data pipelines while ensuring data integrity and pipeline continuity. The successful candidate will work with various AWS data services, including Glue, Lambda, Step Functions, Athena,...


  • Karachi, Sindh, Pakistan ONE Technology Services Full time

    We are seeking an AWS DevOps Specialist to join our team at ONE Technology Services. The ideal candidate will have experience with AWS services and be skilled in cloud architecture, automation, and deployment.About the Job:In this role, you will work closely with our development and operations teams to design, develop, and maintain cloud-based systems and...

  • Cloud Data Engineer

    4 days ago


    Karachi, Sindh, Pakistan NorthBay Solutions LLC Full time

    Job OverviewWe are seeking a skilled AWS data engineer to join our team at NorthBay Solutions LLC. This role involves monitoring, troubleshooting, and optimizing AWS-based data pipelines while ensuring data integrity and pipeline continuity.You will work with AWS Glue, Lambda, Step Functions, and other AWS data services to investigate job failures, re-run...

  • Data Architect

    4 days ago


    Karachi, Sindh, Pakistan NorthBay Solutions LLC Full time

    About the JobWe are seeking a highly skilled senior ETL developer to join our team at NorthBay Solutions LLC. This role involves designing, developing, and maintaining efficient ETL processes using AWS Glue, Lambda, and Step Functions.You will work closely with data architects and L2/L3 engineers to develop and implement data pipelines that ensure data...

  • Data Engineer

    1 week ago


    Karachi, Sindh, Pakistan Arpatech (Pvt) Ltd Full time

    Job Summary:We are seeking a highly skilled Data Engineer to design, build, and maintain the infrastructure required to manage and process large volumes of data. The ideal candidate will work closely with cross-functional teams to ensure the efficient flow, security, and availability of data, enabling analytics, reporting, and AI-driven decision-making.Key...


  • Karachi, Sindh, Pakistan Al Nafi International College Full time

    Position Overview:We are seeking a highly skilled and experienced Senior Big Data Specialist/Analyst to join our innovative team. This role is crucial for managing complex data pipelines, integrating data from multiple microservices, and creating actionable dashboards for senior management. The position emphasizes leveraging AIOps processes and procedures,...

  • Devops Engineer AWS

    7 days ago


    Karachi, Sindh, Pakistan ONE Technology Services Full time

    ONE Technology Services: We are looking for multiple platforms experienced DevOps Engineer (AWS) for one of our partners in the US to join our fast-paced development team. Overall, you will work closely with the entire technology team.We are looking for people who have experience in dealing with International Customers. We are much focused on accuracy,...


  • Karachi, Sindh, Pakistan NorthBay Solutions LLC Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, and be part of the growth and development of it, participate in a...


  • Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    Job OverviewBlueBerry Tech inc is seeking a skilled Senior Data Engineer to lead the development of internal tools and shape work environments. As a key member of our team, you will be responsible for managing CI/CD pipelines to ensure reliable software delivery.The ideal candidate will have a strong understanding of Infrastructure as Code (IaC) principles...


  • Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    As a Senior DevOps Engineer, you will lead the development of internal tools, shape work environments, and seamlessly integrate IT operations. Your focus on managing CI/CD pipelines ensures reliable software delivery while collaborative efforts tackle technical challenges and optimize system performance. This role requires a strong understanding of...