AWS ETL Developer

2 weeks ago


Lahore, Punjab, Pakistan Tech Bridge Consultancy Full time

Certifications: AWS Certified Solutions Architect, AWS Certified Data Analytics, or equivalent AWS certifications (Mandatory)

Job Summary:

We are seeking a highly skilled Senior AWS/ETL Developer with a strong background in designing, building, and optimizing data pipelines and data warehousing solutions. The ideal candidate will have hands-on experience with AWS cloud services, ETL processes, and modern data architectures such as Data Warehouses and Lakehouses. Proficiency in tools like AWS Glue, AWS Lambda, PySpark, and Python is essential.

Key Responsibilities:

  • Design and Develop ETL Pipelines: Build and optimize ETL workflows for data ingestion, transformation, and loading processes using AWS Glue, Lambda, PySpark, and Python. Automate and monitor end-to-end data pipelines for efficiency and reliability.
  • Data Warehouse and Lakehouse Development: Design and implement scalable solutions using AWS Redshift, S3, and other data storage services. Support modern data lake and lakehouse architectures for structured and unstructured data.
  • Data Integration and Processing: Integrate data from diverse sources into AWS platforms. Develop transformation logic to meet business requirements and optimize performance.
  • Collaborate with Cross-Functional Teams: Work closely with data analysts, architects, and business stakeholders to understand data needs and deliver solutions. Participate in code reviews, design discussions, and team meetings to ensure quality.
  • Performance Optimization and Troubleshooting: Monitor and tune ETL processes for optimal performance. Troubleshoot issues related to data processing, pipeline failures, and query performance.
  • Documentation and Best Practices: Document ETL processes, data models, and architecture. Follow best practices for code quality, testing, and deployment automation.

Required Skills:

  • Strong experience in building ETL solutions using AWS Glue, Lambda, and Step Functions.
  • Proficiency in PySpark and Python for data transformation and automation.
  • Hands-on experience with AWS services: S3, Redshift, Athena, EMR, Glue, Lambda.
  • Knowledge of Data Warehousing concepts, Lakehouse architectures, and modern data solutions.
  • Ability to optimize large-scale data processing workflows.
  • Experience in version control tools like Git and CI/CD pipelines.
  • Familiarity with SQL and query optimization techniques.
  • Strong problem-solving and troubleshooting skills.

Preferred Skills:

  • Experience with AWS Lake Formation, Kinesis, and Quick Sight.
  • Exposure to streaming data frameworks.
  • Knowledge of infrastructure-as-code tools like Cloud Formation or Terraform.
  • Familiarity with machine learning workflows on AWS.

Qualifications:

  • Bachelor's degree in Computer Science, Information Technology, or related field.
  • Minimum 3-5 years of hands-on experience in AWS cloud-based ETL development.
  • AWS Certification (e.g., Solutions Architect, Data Analytics) is mandatory.
Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Business Development and Sales

Industries

Software Development

#J-18808-Ljbffr

  • Lahore, Punjab, Pakistan NorthBay Solutions Full time

    Get AI-powered advice on this job and more exclusive features.Job OverviewWe are seeking a Level 2 AWS Data Engineer to join our team. This role involves monitoring, troubleshooting, and optimizing AWS-based data pipelines while ensuring data integrity and pipeline continuity. You will work with AWS Glue, Lambda, Step Functions, and other AWS data services...


  • Lahore, Punjab, Pakistan NorthBay Solutions Full time

    Job OverviewWe are seeking a highly skilled Data Engineer to join our team at NorthBay Solutions. As an L2 support specialist, you will be responsible for monitoring and troubleshooting AWS-based data pipelines, ensuring data integrity and pipeline continuity.You will work with various AWS services such as Glue, Lambda, Step Functions, and Athena to...


  • Lahore, Punjab, Pakistan NorthBay Solutions Full time

    Job DescriptionNorthBay Solutions is looking for a highly skilled Data Engineer to join our team. As a member of our L2 support team, you will be responsible for monitoring and troubleshooting AWS-based data pipelines.You will work closely with our L2/L3 engineers and data architects to identify and resolve complex issues. We require rotating shifts (24/7)...


  • Lahore, Punjab, Pakistan Arbisoft Full time

    We are looking for a Cloud-Based Data Systems Specialist to design, develop, and maintain scalable data pipelines using Python and SQL at Arbisoft.Job ResponsibilitiesCreate efficient ETL processes to clean, enrich, and transfer data across systems and cloud environments.Collaborate with data scientists, analysts, and stakeholders to ensure data quality and...


  • Lahore, Punjab, Pakistan Tkxel LLC Full time

    About Tkxel LLCTkxel LLC is a leading provider of software development services based in Reston, Virginia. We deliver innovative software solutions that help leading enterprises worldwide achieve their business objectives.Job SummaryWe are seeking an accomplished Senior Data Engineer to join our team. As a critical component of our data infrastructure team,...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    About the RoleNorthBay Solutions LLC is seeking a seasoned Senior Big Data Engineer to lead our data engineering efforts.This role involves designing and developing large-scale ETL pipelines in AWS-based environments, as well as collaborating with the team to develop cutting-edge Big Data and Cloud technologies.Key Responsibilities:Design and develop complex...


  • Lahore, Punjab, Pakistan TecBrix Cloud LLC Full time

    We are seeking an experienced AWS Solutions Architect to join our team at TecBrix Cloud LLC. The successful candidate will have a strong understanding of cloud computing concepts and experience with designing, implementing, and managing cloud-based solutions on AWS.The AWS Solutions Architect will work closely with development, QA, and operations teams to...

  • AWS Cloud Engineer

    7 days ago


    Lahore, Punjab, Pakistan NorthBay Solutions Full time

    Get AI-powered advice on this job and more exclusive features.Job Title: AWS Cloud Engineer (L1 Support)Department: Managed ServicesJob OverviewNorthBay is looking for AWS Cloud Engineers to be part of a dynamic team. As an AWS Cloud Engineer with L1 Support responsibilities, you will play a crucial role in deploying, managing, and supporting cloud-based...


  • Lahore, Punjab, Pakistan FiveRivers, Technologies Pvt Ltd. Full time

    We're FiveRivers, Technologies Pvt Ltd., a pioneering company in analytics innovation. Our mission is to harness the power of technology to drive business success. As a Senior Backend Engineer, you'll be part of our journey to revolutionize data processing.Your RoleLead the migration of our analytics platform to a SQL-driven process, leveraging your...


  • Lahore, Punjab, Pakistan Arbisoft Full time

    We are seeking a talented Data Engineer to join our dynamic team at Arbisoft. The ideal candidate has hands-on experience with Python, SQL, and AWS data services.Data Engineering RoleDesign, develop, and maintain scalable data pipelines using Python and SQL.Implement ETL processes to clean, enrich, and transfer data across systems and cloud...


  • Lahore, Punjab, Pakistan Tkxel Full time

    Key Skills and QualificationsBachelor's degree in Computer Science, Finance, Accounting, or a related field.Minimum of 3 years of experience in development and system administration.Hands-on experience with ETL processes and data integration.Strong understanding of financial concepts and accounting principles.Experience in finance and accounting reporting,...


  • Lahore, Punjab, Pakistan Arbisoft Full time

    Arbisoft is hiring a Senior Data Engineer to lead the design, development, and maintenance of scalable data pipelines using Python and SQL.Data Engineering Team LeadLead the design, development, and maintenance of scalable data pipelines using Python and SQL.Implement ETL processes to clean, enrich, and transfer data across systems and cloud...


  • Lahore, Punjab, Pakistan NorthBay Solutions Full time

    Job SummaryNorthBay Solutions is seeking a talented Data Engineer to join our team. As a member of our L2 support team, you will be responsible for monitoring and troubleshooting AWS-based data pipelines.You will work closely with our L2/L3 engineers and data architects to identify and resolve complex issues. We require rotating shifts (24/7) with alternate...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    Job DetailsNorthBay Solutions LLC is seeking a highly skilled Senior Big Data Engineer to join our team.The ideal candidate will have experience in data engineering and a passion for Big Data, with a strong understanding of the ETL cycle and distributed processing technologies.Key Responsibilities:Design and develop complex ETL jobs and pipelines in...

  • AWS Cloud Expert

    7 days ago


    Lahore, Punjab, Pakistan Emenac Inc. Full time

    At Emenac Inc., we believe in empowering our clients to achieve their business goals through innovative IT solutions.We are seeking a highly skilled AWS Cloud Expert to join our team in Lahore. The successful candidate will be responsible for designing and implementing cloud-based solutions, ensuring scalability, security, and reliability.The ideal candidate...


  • Lahore, Punjab, Pakistan Tkxel LLC Full time

    About UsTkxel LLC is a renowned software development company located in Reston, Virginia. We specialize in delivering cutting-edge software solutions that cater to the diverse needs of leading enterprises worldwide.Job SummaryWe are seeking an accomplished Senior Data Engineer to join our talented team. As a critical component of our data infrastructure...

  • Data Architect Lead

    1 hour ago


    Lahore, Punjab, Pakistan Tkxel LLC Full time

    About Tkxel LLCTkxel LLC is a leading software development company based in Reston, Virginia. Our mission is to deliver innovative software solutions that empower businesses worldwide to grow and succeed.Job OverviewWe are seeking an experienced Senior Data Engineer to join our dynamic team. As a key member of our data infrastructure team, you will design,...


  • Lahore, Punjab, Pakistan Tkxel LLC Full time

    About Our CompanyTkxel LLC is a software development company based in Reston, Virginia. We provide innovative software solutions to leading enterprises worldwide, helping them achieve their business objectives through technology.Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data infrastructure...


  • Lahore, Punjab, Pakistan Arbisoft Full time

    We are seeking a motivated Data Engineer to join our dynamic team. The ideal candidate has hands-on experience with Python, SQL, and AWS data services. This role involves designing, maintaining, and optimizing data pipelines, supporting ETL processes, and ensuring the integrity of our data infrastructure. It's an excellent opportunity for someone passionate...


  • Lahore, Punjab, Pakistan SopnoTec Full time

    At SopnoTec, we're seeking a skilled DevOps Engineer to manage and scale our AWS infrastructure.The ideal candidate will have strong hands-on experience with AWS services and architecture.You'll be responsible for optimizing deployments, automating workflows, and ensuring the performance, security, and reliability of our systems.Key Responsibilities:Build...