Senior AWS Data Processor

3 days ago


Karachi, Sindh, Pakistan NorthBay Solutions Full time
Job Description

As a Senior AWS Data Processor at NorthBay Solutions, you will play a critical role in the success of our team by designing, building, and maintaining scalable, efficient, and reliable data pipelines using Amazon Web Services (AWS). Your primary responsibilities will include monitoring and troubleshooting data pipelines, investigating job failures, and collaborating with cross-functional teams to implement corrective actions. You will also be responsible for re-running failed jobs, retrying data ingestion processes, and maintaining documentation of troubleshooting steps, common issues, and resolutions. In addition, you will participate in incident response and recovery procedures as needed and provide technical support for production data pipelines, ensuring service level agreements (SLAs) are met.

Key Responsibilities
  1. Design, build, and maintain scalable, efficient, and reliable data pipelines using AWS services.
  2. Monitor and troubleshoot data pipelines using AWS Glue, Lambda, Step Functions, Athena, Redshift, or Airflow.
  3. Investigate job failures, analyze CloudWatch logs, and collaborate with L2/L3 teams to implement corrective actions.
  4. Re-run failed jobs and retry data ingestion processes while ensuring data consistency.
  5. Maintain documentation of troubleshooting steps, common issues, and resolutions.
  6. Participate in incident response and recovery procedures as needed.
  7. Provide technical support for production data pipelines, ensuring SLAs are met.

Requirements
  • Bachelor's degree in Computer Science, Data Science, Information Technology, or a related field.
  • Up to 2+ years of experience in Data Processing / ETL.
  • Hands-on experience with any two of AWS Glue, Athena, Lambda, Step Functions, Redshift.
  • Proficiency in Python and SQL for data querying and processing (preferred).
  • Familiarity with PySpark and ETL development (a plus).
  • Experience in monitoring and debugging AWS Glue jobs, Step Functions, and Lambda logs (a plus).
  • Strong analytical and problem-solving skills to diagnose and resolve data processing failures.
  • Ability to work independently while effectively collaborating with cross-functional teams.
  • AWS certifications such as AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect Associate (preferred but not mandatory).
  • Excellent communication and interpersonal skills.
  • Prior experience in L1/L2 support (a plus).

Career Advancement Opportunities
  • Senior Data Engineer (L2/L3 Support / ETL Development)
  • Big Data Engineer / AWS Data Architect
  • Data Engineering Lead / Architect


  • Karachi, Sindh, Pakistan NorthBay Solutions Full time

    Data Engineer Job SummaryWe are seeking an experienced Data Engineer to join our team at NorthBay Solutions. As a key member of our data engineering team, you will design, build, and maintain scalable, efficient, and reliable data pipelines using Amazon Web Services (AWS). Your primary responsibilities will include monitoring and troubleshooting data...


  • Karachi, Sindh, Pakistan NorthBay Solutions Full time

    We are seeking a Level 2 AWS Data Engineer to join our team. This role involves monitoring, troubleshooting, and optimizing AWS-based data pipelines while ensuring data integrity and pipeline continuity. You will work with AWS Glue, Lambda, Step Functions, and other AWS data services to investigate job failures, re-run ETL jobs, and support production...


  • Karachi, Sindh, Pakistan NorthBay Solutions LLC Full time

    Job OverviewWe are seeking a Level 2 AWS Data Engineer to join our team. This role involves monitoring, troubleshooting, and optimizing AWS-based data pipelines while ensuring data integrity and pipeline continuity. You will work with AWS Glue, Lambda, Step Functions, and other AWS data services to investigate job failures, re-run ETL jobs, and support...


  • Karachi, Sindh, Pakistan NorthBay Solutions LLC Full time

    Job DescriptionWe are seeking an experienced AWS data pipeline specialist to join our team at NorthBay Solutions LLC. This role involves monitoring, troubleshooting, and optimizing AWS-based data pipelines while ensuring data integrity and pipeline continuity.You will work with AWS Glue, Lambda, Step Functions, and other AWS data services to investigate job...


  • Karachi, Sindh, Pakistan NorthBay Solutions LLC Full time

    Career Advancement OpportunitiesWe offer career advancement opportunities for our employees, including:Senior Data Engineer (L2/L3 Support / ETL Development)Big Data Engineer / AWS Data ArchitectData Engineering Lead / ArchitectAbout UsNorthBay Solutions LLC is a leading provider of cloud-based solutions. We are committed to delivering high-quality services...


  • Karachi, Sindh, Pakistan DataQ Health Full time

    Job DescriptionWe are seeking a talented Senior Laravel Developer to join our team at DataQ Health. As a key member of our development team, you will be responsible for designing, developing, and maintaining complex software applications.ResponsibilitiesDesign and develop software applications using Laravel and AWS.Implement efficient data storage and...


  • Karachi, Sindh, Pakistan Dee4tech Full time

    SAP Finance and Supply Chain Management ProfessionalThis key position requires an expert in SAP finance and supply chain management with experience in implementing and optimizing SAP systems on AWS. The successful candidate will have strong analytical and business skills and be able to work effectively in a team environment.Main Tasks:Implement and Configure...


  • Karachi, Sindh, Pakistan NorthBay Solutions Full time

    Senior AWS Data Pipeline SpecialistWe are seeking an experienced Senior AWS Data Pipeline Specialist to join our team at NorthBay Solutions. As a key member of our data engineering team, you will design, build, and maintain scalable, efficient, and reliable data pipelines using Amazon Web Services (AWS). Your primary responsibilities will include monitoring...


  • Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.BlueBerry Tech Inc., a leading player in the Information Technology and Services industry, is dedicated to advancing businesses through innovative digital solutions. We are located in Karachi and serve as digital transformation partners for startups and...


  • Karachi, Sindh, Pakistan Healthcare DME Full time

    Join Our TeamWe're expanding our team and looking for talented professionals to support our USA-based healthcare clients. If you're ready for the next big step in your career, explore these exciting roles:Available Positions:Medical BillerMedical Order ProcessorAdministratorQualifications:Attention to Detail & AccuracyProficiency in MS OfficeStrong Time...


  • Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    As a Senior DevOps Engineer, you will lead the development of internal tools, shape work environments, and seamlessly integrate IT operations. Your focus on managing CI/CD pipelines ensures reliable software delivery while collaborative efforts tackle technical challenges and optimize system performance. This role requires a strong understanding of...


  • Karachi, Sindh, Pakistan NorthBay Solutions LLC Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, and be part of the growth and development of it, participate in a...

  • Data Engineer

    3 days ago


    Karachi, Sindh, Pakistan NorthBay Solutions Full time

    Job OverviewWe are seeking a highly skilled Data Engineer - L2 Support to join NorthBay Solutions. This role involves monitoring, troubleshooting, and optimizing AWS-based data pipelines while ensuring data integrity and pipeline continuity. The successful candidate will work with various AWS data services, including Glue, Lambda, Step Functions, Athena,...

  • Data Engineer

    1 week ago


    Karachi, Sindh, Pakistan Horizon Technologies Full time

    We are seeking an experienced Data Engineer to join our team. The Data Engineer will be responsible for extracting, transforming, and loading data from various sources into data lakes and data warehouses using AWS Glue while ensuring the efficiency and alignment of data systems with business goals. The ideal candidate should have strong analytical skills,...

  • AWS AI/ML Engineer

    2 weeks ago


    Karachi, Sindh, Pakistan Cubitrek Full time

    We are a team of creative thinkers, problem solvers, and enthusiastic individuals committed to providing our customers with the best solutions. At Cubitrek, we value diversity, creativity, and the spirit of collaboration.We seek an experienced AWS AI/ML Engineer to design, build, and deploy AI solutions using Amazon Bedrock. The ideal candidate has strong...


  • Karachi, Sindh, Pakistan Horizon Technologies Full time

    Horizon Technologies is seeking a highly skilled Data Engineer Specialist to join our team. This individual will be responsible for designing, building, and maintaining large-scale data systems on AWS.We are looking for someone with strong analytical skills, expertise in programming languages such as Python, R, and SQL, and experience in building ETL/ELT...

  • Big Data Expert

    1 week ago


    Karachi, Sindh, Pakistan Horizon Technologies Full time

    Job SummaryHiring for the position of Cloud Data Architect at Horizon Technologies!About UsHorizon Technologies is a cutting-edge technology firm that leverages innovative solutions to drive business growth. As a Cloud Data Architect, you will play a key role in shaping our cloud strategy and architecting scalable data platforms.About the RoleThis role...


  • Karachi, Sindh, Pakistan Al Nafi International College Full time

    Position Overview:We are seeking a highly skilled and experienced Senior Big Data Specialist/Analyst to join our innovative team. This role is crucial for managing complex data pipelines, integrating data from multiple microservices, and creating actionable dashboards for senior management. The position emphasizes leveraging AIOps processes and procedures,...


  • Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    Job OverviewBlueBerry Tech inc is seeking a skilled Senior Data Engineer to lead the development of internal tools and shape work environments. As a key member of our team, you will be responsible for managing CI/CD pipelines to ensure reliable software delivery.The ideal candidate will have a strong understanding of Infrastructure as Code (IaC) principles...

  • Data Architect

    4 days ago


    Karachi, Sindh, Pakistan NorthBay Solutions LLC Full time

    About the JobWe are seeking a highly skilled senior ETL developer to join our team at NorthBay Solutions LLC. This role involves designing, developing, and maintaining efficient ETL processes using AWS Glue, Lambda, and Step Functions.You will work closely with data architects and L2/L3 engineers to develop and implement data pipelines that ensure data...