Senior Data Engineer

3 weeks ago


Lahore, Punjab, Pakistan kisaangroup Full time

Expert Talent Sourcer | Building Strong Candidate Relationships | Data-Driven Recruitment Strategies | Emotional Intelligence

Waseela is a catalyst for change, empowering rural communities to drive Pakistan's economy forward. Through data-driven, research-backed projects, we address critical challenges in our rural economy and unlock opportunities for sustainable growth.

Our focus is on creating a lasting impact at the grassroots level, building resilient communities and fostering a prosperous Pakistan. We achieve this through our dynamic brands:

  • The Market

Work with us to enable the rural communities of Pakistan

Role Summary:

We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable data pipelines using AWS. The ideal candidate will have extensive experience in batch and real-time data ingestion, orchestration using tools like Apache Airflow or Dagster, and implementing fault-tolerant alerting and logging mechanisms. This role is critical in ensuring the reliability and efficiency of our data infrastructure, enabling seamless data flow across our systems.

Responsibilities:

  • Design, develop, and maintain scalable and robust data pipelines for batch and real-time data processing.
  • Work with cloud-based platforms (AWS or GCP) to build efficient and cost-effective data infrastructure.
  • Implement and manage orchestration workflows using Apache Airflow, Dagster, or similar tools.
  • Ensure data quality, integrity, and security across all pipelines.
  • Set up logging, monitoring, and alerting mechanisms to proactively identify and resolve issues.
  • Optimize data storage solutions, ensuring performance and scalability.
  • Collaborate with cross-functional teams including data scientists, analysts, and software engineers to support data-driven decision-making.
  • Automate and streamline data engineering processes to improve efficiency and reliability.
  • Lead the migration of existing data workloads to cloud platforms, ensuring minimal disruption and optimal performance.
  • Mentor junior engineers and promote best practices in data engineering across the organization.

Must Have Qualifications:

  • Strong proficiency in AWS (Glue, Lambda, S3, Redshift, Kinesis) or GCP (BigQuery, Dataflow, Pub/Sub, Cloud Functions).
  • Hands-on experience with batch and real-time data processing frameworks such as Apache Spark, Flink, or Kafka.
  • Expertise in workflow orchestration tools like Apache Airflow, Dagster, or similar.
  • Proficiency in programming languages such as Python, Scala, or Java.
  • Strong understanding of observability principles, including setting up monitoring, logging, and alerting using tools like Prometheus, CloudWatch, Datadog, or Splunk.
  • Excellent problem-solving skills and ability to work in a fast-paced, agile environment.
  • Strong communication skills and ability to collaborate effectively with both technical and non-technical stakeholders.

Experience:

  • 5+ years of experience in data engineering, specializing in scalable data pipeline development.
  • Experience with SQL and NoSQL databases, data modeling, and ETL frameworks.
  • Experience with containerization and orchestration (Docker, Kubernetes).

Seniority level: Mid-Senior level

Employment type: Full-time

Job function: Information Technology

Industries: Business Consulting and Services

#J-18808-Ljbffr

  • Lahore, Punjab, Pakistan Data Pilot Full time

    At Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert engineering and business acumen.In the dynamic landscape...

  • Senior Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan Devsinc Full time

    Devsinc is seeking a talented Senior Data Engineer to join our dynamic team. The ideal candidate will possess a deep understanding of data architecture and engineering principles, along with hands-on experience in developing, optimizing, and maintaining data pipelines and databases. This role is crucial to support our data-driven initiatives and to enhance...


  • Lahore, Punjab, Pakistan FINCA Impact Finance Full time

    Senior Data Engineer FINCA Impact Finance , Pakistan The Senior Data Engineer takes an active part in development and support tasks related to Enterprise Data Warehouse (EDW), Data Lake, and BI/analytical solutions, which integrate data from 20 countries and provide support for decision-making. As a member of the EDW Development Team, the Senior Data...

  • Senior Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan Devsinc, LLC Full time

    Devsinc is seeking a talented Senior Data Engineer to join our dynamic team. The ideal candidate will possess a deep understanding of data architecture and engineering principles, along with hands-on experience in developing, optimizing, and maintaining data pipelines and databases. This role is crucial to support our data-driven initiatives and to enhance...


  • Lahore, Punjab, Pakistan Avanceon Limited Full time

    Join to apply for the Senior Big Data Engineer (Azure) role at Avanceon Middle East & South Asia.As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    NorthBay Solutions LLC is hiring a skilled Senior Data Engineer for Cloud Platforms. As a Senior Big Data Engineer, you will be responsible for designing and developing cloud-based Big Data solutions using AWS services such as EMR, Glue, Lambda, and Athena.About the Job:Develop and manage complex ETL jobs and pipelines in AWS-based environments.Collaborate...


  • Lahore, Punjab, Pakistan Tkxel LLC Full time

    Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe are seeking an experienced and highly skilled Senior Data Engineer to join our dynamic team....

  • Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan Systems Limited Full time

    Senior Data Engineer:Systems Limited is looking for a Senior Data Engineer with expertise in PySpark, Airflow, and Databricks to join our growing team.Responsibilities:Design, build, and maintain scalable data pipelines using PySpark for ETL/ELT processing, ensuring data is ingested, transformed, and loaded efficiently across multiple platforms.Use Apache...


  • Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, participate in a large variety of exciting and challenging projects,...


  • Lahore, Punjab, Pakistan NorthBay Solutions Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, and be part of the growth and development of it, participate in a...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    About the RequirementsBachelor's degree: In Computer Science or a related field.Experience: 8+ years in data engineering, with hands-on experience in Apache NiFi, Databricks, Delta Lake, Azure Synapse Analytics, Azure Data Lake Storage, Azure Data Factory, and Power BI.Proven track record: In managing and troubleshooting complex data pipelines, with a focus...


  • Lahore, Punjab, Pakistan FINCA Impact Finance Full time

    Senior Data EngineerThe Enterprise Data Team at FINCA Impact Finance seeks a highly skilled Senior Data Engineer to join their team. As a key member of the EDW Development Team, this individual will play a pivotal role in designing and deploying databases, stored procedures, complex queries, and SSIS/automation jobs that integrate data from 20 countries and...

  • Data Engineer

    4 weeks ago


    Lahore, Punjab, Pakistan Devsinc Full time

    Design, implement, and maintain data pipelines to ensure seamless flow of data from various sources to storage systemsWork with large, complex datasets to ensure high performance, availability, and scalability of data systemsCollaborate with data scientists, analysts, and other engineering teams to deliver insights and business value from structured and...


  • Lahore, Punjab, Pakistan Devsinc Full time

    We are looking for a talented Senior Software Developer Data Engineering to contribute to the development and maintenance of our data infrastructure. As a key member of our team, you will play a critical role in designing, developing, and optimizing scalable data pipelines and ETL processes.Main Responsibilities:Developing and Optimizing Data Infrastructure...

  • Senior .NET Developer

    2 weeks ago


    Lahore, Punjab, Pakistan Data Magnetics Full time

    About the JobWe are seeking a highly skilled Senior .NET Developer to join our team at Data Magnetics Technologies. As a key member of our engineering team, you will be responsible for designing and developing innovative software solutions using C# with .NET Core MVC and Visual Studio.Your primary focus will be on writing high-quality APIs and UI components...

  • Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan Crypthon Technologies Full time

    We're looking for a Data Engineer who thrives on building scalable data solutions, designing robust pipelines, and transforming complex data into actionable insights.Responsibilities:Build and maintain data pipelines and architectureCollaborate with teams to define data requirementsOptimize systems for performance and scalabilityWork with big data tools and...


  • Lahore, Punjab, Pakistan Data Wise Full time

    About the Team:Data Wise is looking for a software quality engineering manager to lead our quality assurance team. The ideal candidate will have a solid background in software testing, with expertise in automation and quality engineering.Responsibilities:Develop and implement automated test frameworks and scripts using Selenium and Playwright.Mentor and...


  • Lahore, Punjab, Pakistan Devsinc Full time

    We're Devsinc, a leader in the field of artificial intelligence, and we're searching for a highly skilled Senior Data Science Engineer to lead our AI initiatives. With a strong background in building and implementing AI and machine learning applications, you will design and implement scalable solutions that integrate advanced models into various...

  • Cloud Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan Devsinc, LLC Full time

    We are seeking a Senior Data Engineer to lead our data team. The successful candidate will have extensive experience in designing and implementing large-scale data architectures, as well as collaborating with cross-functional teams to ensure seamless data integration.Main Responsibilities:Data Architecture: Develop and implement data architectures that...

  • Senior Data Engineer

    4 weeks ago


    Lahore, Punjab, Pakistan Arbisoft Full time

    We are seeking a motivated Data Engineer to join our dynamic team. The ideal candidate has hands-on experience with Python, SQL, and AWS data services. This role involves designing, maintaining, and optimizing data pipelines, supporting ETL processes, and ensuring the integrity of our data infrastructure. It's an excellent opportunity for someone passionate...