Large Scale Data Pipeline Developer

13 hours ago


Lahore, Punjab, Pakistan Tkxel LLC Full time
About Tkxel LLC

Tkxel LLC is a leading provider of software development services based in Reston, Virginia. We deliver innovative software solutions that help leading enterprises worldwide achieve their business objectives.

Job Summary

We are seeking an accomplished Senior Data Engineer to join our team. As a critical component of our data infrastructure team, you will be responsible for designing, developing, and deploying large-scale data pipelines using cloud-based technologies.

Main Responsibilities:
  • Data Pipeline Development: Design and implement scalable ETL/ELT pipelines using AWS services such as Glue, EMR, and Athena.
  • Data Warehousing: Design and manage data warehouses using cloud technologies, integrating with S3, RDS, and DynamoDB.
  • Big Data Processing: Utilize PySpark on AWS EMR for distributed data processing, ensuring the effective transformation of raw data into actionable insights.
  • Database Administration: Manage both SQL and NoSQL databases, ensuring efficient storage, retrieval, and querying of data.
Requirements
  • Minimum 5 years of experience as a Data Engineer, with a strong emphasis on cloud-based data warehousing and ETL pipelines.
  • Proficiency with AWS services including EMR, Athena, Glue, Step Functions, ElasticSearch, RDS, Redshift, DynamoDB, and S3.
  • Advanced SQL skills and experience with relational databases like PostgreSQL, MySQL, and NoSQL databases like MongoDB and DynamoDB.
  • Hands-on experience in Python for data processing and automation, with knowledge of AWS CLI.


  • Lahore, Punjab, Pakistan Techscale Full time

    Data Engineer OpportunityWe are looking for a talented Data Engineer to join our team at Techscale. As a Data Engineer, you will design, develop, and optimize data pipelines and analytics workflows using Python and Databricks.ResponsibilitiesDesign and implement data ingestion and transformation pipelines from various data sources.Optimize data storage and...


  • Lahore, Punjab, Pakistan FiveRivers, Technologies Pvt Ltd. Full time

    We're seeking a talented Senior Backend Engineer to join our team at FiveRivers, Technologies Pvt Ltd. As a key member of our analytics innovation team, you'll play a crucial role in scaling our data pipeline architecture using the latest AWS technologies.ResponsibilitiesTranslate our existing analytics platform to a SQL-driven process, ensuring seamless...


  • Lahore, Punjab, Pakistan Absm Pvt. Ltd Full time

    Absm Pvt. Ltd invites applications for the position of Software Project Manager.Job DescriptionThis role involves leading the development of large-scale software projects from inception to delivery, ensuring timely completion and high-quality results.Key ResponsibilitiesDevelop technical proposals and project plans.Design and implement software projects,...


  • Lahore, Punjab, Pakistan Walee Full time

    The ideal candidate is a seasoned MERN stack architect with expertise in cloud and DevOps practices. At Walee, we require a professional who can lead the design and development of complex client service architectures, leveraging cloud automation, data science, and DevOps practices.Main Tasks:Orchestrate the architecture and design of large-scale...

  • Senior Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan Tkxel Full time

    Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe are seeking an experienced Data Engineer to design, develop, and optimize our client data...


  • Lahore, Punjab, Pakistan Tkxel Full time

    Cloud Data Engineer Job Description:Tkxel, a leading software development company, seeks a highly skilled Cloud Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing and developing scalable data pipelines using PySpark and Azure Data Factory.Responsibilities:Develop efficient data workflows using...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    About the RoleNorthBay Solutions LLC is seeking a seasoned Senior Big Data Engineer to lead our data engineering efforts.This role involves designing and developing large-scale ETL pipelines in AWS-based environments, as well as collaborating with the team to develop cutting-edge Big Data and Cloud technologies.Key Responsibilities:Design and develop complex...

  • Data Architect Lead

    13 hours ago


    Lahore, Punjab, Pakistan Tkxel LLC Full time

    About Tkxel LLCTkxel LLC is a leading software development company based in Reston, Virginia. Our mission is to deliver innovative software solutions that empower businesses worldwide to grow and succeed.Job OverviewWe are seeking an experienced Senior Data Engineer to join our dynamic team. As a key member of our data infrastructure team, you will design,...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    At Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert engineering and business acumen.In the dynamic landscape...


  • Lahore, Punjab, Pakistan Big Data Inc Full time

    Full Stack Java DeveloperWe are looking for a skilled Full Stack Java Developer to join our Lahore Office team. The incumbent will be responsible for designing, developing, and delivering effective solutions for resource allocation.Description:The Mid-level Full Stack Java Developer will design, test, and implement the latest open source software,...


  • Lahore, Punjab, Pakistan Tkxel LLC Full time

    About UsTkxel LLC is a renowned software development company located in Reston, Virginia. We specialize in delivering cutting-edge software solutions that cater to the diverse needs of leading enterprises worldwide.Job SummaryWe are seeking an accomplished Senior Data Engineer to join our talented team. As a critical component of our data infrastructure...


  • Lahore, Punjab, Pakistan NorthBay Solutions Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, and be part of the growth and development of it, participate in a...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, participate in a large variety of exciting and challenging projects,...


  • Lahore, Punjab, Pakistan Data Pilot Full time

    Associate Data Architect - Analytics & AICompany Overview:At Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert...

  • Big Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan Arbisoft Full time

    Software Engineering - Arbisoft, Lahore, Islamabad, KarachiWe are looking for a skilled Big Data Engineer with 5+ years of experience in building scalable data solutions. The ideal candidate will have strong coding skills (preferably in Python or Java) and experience in managing the end-to-end development lifecycle—from development to deployment in...


  • Lahore, Punjab, Pakistan Prime System Solutions Full time

    RequirementsTo be successful in this role, you will need to have:Bachelor's Degree in Computer Science, Information Systems, Engineering, or a related field (or equivalent experience).Expertise in SQL for data manipulation, optimization, and query building.Knowledge of programming languages such as Python or .NET for data processing and automation...

  • Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan Systems Limited Full time

    Systems Limited is looking for a Senior Data Engineer with expertise in PySpark, Airflow, and Databricks to join our growing team.Responsibilities:Design, build, and maintain scalable data pipelines using PySpark for ETL/ELT processing, ensuring data is ingested, transformed, and loaded efficiently across multiple platforms.Use Apache Airflow to automate,...


  • Lahore, Punjab, Pakistan Big Data Inc Full time

    Job DescriptionBig Data Inc, a leading technology firm, is seeking an experienced Full Stack Java Developer to join our Lahore office. The ideal candidate will possess strong technical skills and the ability to work independently with minimal supervision.About the RoleWe are looking for a skilled Full Stack Java Developer who can design, develop, and...

  • Data Architect Lead

    8 hours ago


    Lahore, Punjab, Pakistan NorthBay Solutions Full time

    We are seeking a highly experienced Senior Big Data Engineer to join our team at NorthBay Solutions. As a key member of our data engineering group, you will play a vital role in designing and developing cutting-edge big data solutions using Hadoop, Spark, and other emerging technologies.Your primary responsibilities will include:Designing and developing...


  • Lahore, Punjab, Pakistan NorthBay Solutions Full time

    Job DescriptionNorthBay Solutions is looking for a highly skilled Data Engineer to join our team. As a member of our L2 support team, you will be responsible for monitoring and troubleshooting AWS-based data pipelines.You will work closely with our L2/L3 engineers and data architects to identify and resolve complex issues. We require rotating shifts (24/7)...