
Senior Data Engineer
2 days ago
Expert Talent Sourcer | Building Strong Candidate Relationships | Data-Driven Recruitment Strategies | Emotional Intelligence
Waseela is a catalyst for change, empowering rural communities to drive Pakistan's economy forward. Through data-driven, research-backed projects, we address critical challenges in our rural economy and unlock opportunities for sustainable growth.
Our focus is on creating a lasting impact at the grassroots level, building resilient communities and fostering a prosperous Pakistan. We achieve this through our dynamic brands:
- The Market
Work with us to enable the rural communities of Pakistan
Role Summary:
We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable data pipelines using AWS. The ideal candidate will have extensive experience in batch and real-time data ingestion, orchestration using tools like Apache Airflow or Dagster, and implementing fault-tolerant alerting and logging mechanisms. This role is critical in ensuring the reliability and efficiency of our data infrastructure, enabling seamless data flow across our systems.
Responsibilities:
- Design, develop, and maintain scalable and robust data pipelines for batch and real-time data processing.
- Work with cloud-based platforms (AWS or GCP) to build efficient and cost-effective data infrastructure.
- Implement and manage orchestration workflows using Apache Airflow, Dagster, or similar tools.
- Ensure data quality, integrity, and security across all pipelines.
- Set up logging, monitoring, and alerting mechanisms to proactively identify and resolve issues.
- Optimize data storage solutions, ensuring performance and scalability.
- Collaborate with cross-functional teams including data scientists, analysts, and software engineers to support data-driven decision-making.
- Automate and streamline data engineering processes to improve efficiency and reliability.
- Lead the migration of existing data workloads to cloud platforms, ensuring minimal disruption and optimal performance.
- Mentor junior engineers and promote best practices in data engineering across the organization.
Must Have Qualifications:
- Strong proficiency in AWS (Glue, Lambda, S3, Redshift, Kinesis) or GCP (BigQuery, Dataflow, Pub/Sub, Cloud Functions).
- Hands-on experience with batch and real-time data processing frameworks such as Apache Spark, Flink, or Kafka.
- Expertise in workflow orchestration tools like Apache Airflow, Dagster, or similar.
- Proficiency in programming languages such as Python, Scala, or Java.
- Strong understanding of observability principles, including setting up monitoring, logging, and alerting using tools like Prometheus, CloudWatch, Datadog, or Splunk.
- Excellent problem-solving skills and ability to work in a fast-paced, agile environment.
- Strong communication skills and ability to collaborate effectively with both technical and non-technical stakeholders.
Experience:
- 5+ years of experience in data engineering, specializing in scalable data pipeline development.
- Experience with SQL and NoSQL databases, data modeling, and ETL frameworks.
- Experience with containerization and orchestration (Docker, Kubernetes).
Seniority level: Mid-Senior level
Employment type: Full-time
Job function: Information Technology
Industries: Business Consulting and Services
#J-18808-Ljbffr-
Associate Data Architect
2 weeks ago
Lahore, Punjab, Pakistan Data Pilot Full timeAssociate Data Architect - Analytics & AICompany Overview:At Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert...
-
Associate Data Architect
1 week ago
Lahore, Punjab, Pakistan Data Pilot Full timeAt Data Pilot, we're more than just a data product development and consulting services company – we're your strategic partner on the journey from data to decisions. Our mission is simple: to help businesses unlock the full potential of their data assets and maximize business value through our expert engineering and business acumen.In the dynamic landscape...
-
Senior Data Engineering Specialist
4 days ago
Lahore, Punjab, Pakistan NorthBay Solutions LLC Full timeAbout the RoleNorthBay Solutions LLC is seeking a seasoned Senior Big Data Engineer to lead our data engineering efforts.This role involves designing and developing large-scale ETL pipelines in AWS-based environments, as well as collaborating with the team to develop cutting-edge Big Data and Cloud technologies.Key Responsibilities:Design and develop complex...
-
Senior Big Data Engineer
7 days ago
Lahore, Punjab, Pakistan Avanceon Limited Full timeJoin to apply for the Senior Big Data Engineer (Azure) role at Avanceon Middle East & South Asia.As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention...
-
Data Engineer
2 weeks ago
Lahore, Punjab, Pakistan Systems Limited Full timeSystems Limited is looking for a Senior Data Engineer with expertise in PySpark, Airflow, and Databricks to join our growing team.Responsibilities:Design, build, and maintain scalable data pipelines using PySpark for ETL/ELT processing, ensuring data is ingested, transformed, and loaded efficiently across multiple platforms.Use Apache Airflow to automate,...
-
Senior Data Engineer
2 weeks ago
Lahore, Punjab, Pakistan Tkxel Full timeTkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe are seeking an experienced Data Engineer to design, develop, and optimize our client data...
-
Data Engineer
2 weeks ago
Lahore, Punjab, Pakistan Avanceon Limited Full timeJoin to apply for the Data Engineer role at Avanceon Middle East & South Asia.About Us?Avanceon is a multinational corporation which specializes in automation, control systems integration, energy management solutions, and support services. With offices in Dubai, Qatar, Saudi Arabia, and Pakistan, it has established a significant market presence. Over its...
-
Senior Big Data Engineer
5 days ago
Lahore, Punjab, Pakistan NorthBay Solutions LLC Full timeWe are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, participate in a large variety of exciting and challenging projects,...
-
Data Engineer
5 days ago
Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full timeCompany OverviewAvanceon Middle East & South Asia is a leading provider of technology solutions, committed to delivering exceptional services to our clients. Our team of experts works tirelessly to stay ahead of the curve in the ever-evolving world of data storage and processing.Job DescriptionAs a Senior Big Data Engineer at Avanceon Middle East & South...
-
Data Engineer
7 days ago
Lahore, Punjab, Pakistan Devsinc Full timeDesign, implement, and maintain data pipelines to ensure seamless flow of data from various sources to storage systemsWork with large, complex datasets to ensure high performance, availability, and scalability of data systemsCollaborate with data scientists, analysts, and other engineering teams to deliver insights and business value from structured and...
-
Senior Data Engineer
7 days ago
Lahore, Punjab, Pakistan Arbisoft Full timeWe are seeking a motivated Data Engineer to join our dynamic team. The ideal candidate has hands-on experience with Python, SQL, and AWS data services. This role involves designing, maintaining, and optimizing data pipelines, supporting ETL processes, and ensuring the integrity of our data infrastructure. It's an excellent opportunity for someone passionate...
-
Senior Data Engineering Position
4 days ago
Lahore, Punjab, Pakistan Tkxel Full timeData Engineer Role:We are seeking a seasoned Data Engineer with expertise in PySpark and Azure Data Factory to drive the development of our data infrastructure. As a key contributor, you will design, develop, and maintain scalable data pipelines to support business growth and innovation.Responsibilities:Develop efficient data workflows using PySpark and...
-
Data Engineering Team Lead
4 days ago
Lahore, Punjab, Pakistan NorthBay Solutions LLC Full timeJob DetailsNorthBay Solutions LLC is seeking a highly skilled Senior Big Data Engineer to join our team.The ideal candidate will have experience in data engineering and a passion for Big Data, with a strong understanding of the ETL cycle and distributed processing technologies.Key Responsibilities:Design and develop complex ETL jobs and pipelines in...
-
Data Engineering Leader
2 days ago
Lahore, Punjab, Pakistan kisaangroup Full timeAbout UsKisaan Group is a catalyst for change, empowering rural communities to drive Pakistan's economy forward.We address critical challenges in our rural economy and unlock opportunities for sustainable growth through data-driven, research-backed projects.Our focus is on creating a lasting impact at the grassroots level, building resilient communities and...
-
Senior Software Engineer
2 days ago
Lahore, Punjab, Pakistan kisaangroup Full timeAbout Our CompanyKisaan Group aims to create a lasting impact at the grassroots level, building resilient communities and fostering a prosperous Pakistan through data-driven initiatives.We empower rural communities in Pakistan by addressing critical challenges in our rural economy and unlocking opportunities for sustainable growth.We focus on developing...
-
Senior Data Architect
3 hours ago
Lahore, Punjab, Pakistan LeapSofts Full timeOur CompanyWelcome to LeapSofts, a tech company specializing in cutting-edge AI, web, and software development solutions. Our team is dedicated to delivering tailor-made strategies for businesses to thrive in the digital landscape.What you'll doAs a Data Architect in Marketing Technology, you will play a pivotal role in designing and implementing scalable...
-
Senior Data Engineering Professional
6 days ago
Lahore, Punjab, Pakistan Confiz Full timeWe are seeking a highly skilled data engineer to expand and optimize our big data pipelines using Azure services.About You:You have a strong understanding of data engineering concepts, including data warehousing, publishing, and visualization.You have experience in designing, prototyping, implementing, and optimizing data ingestion pipelines.You have...
-
Big Data Engineer Lead
4 days ago
Lahore, Punjab, Pakistan NorthBay Solutions LLC Full timeJob DescriptionWe are seeking a highly skilled Senior Big Data Engineer to join our team at NorthBay Solutions LLC.The ideal candidate will have experience in data engineering and a passion for Big Data, with a strong understanding of the ETL cycle and distributed processing technologies.Key Responsibilities:Design and develop Big Data solutions using...
-
Data Engineering Leadership Position
2 days ago
Lahore, Punjab, Pakistan FINCA Impact Finance Full timeSenior Data Engineer Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at FINCA Impact Finance, Pakistan.About the RoleThe successful candidate will be responsible for designing, developing, and implementing database systems, tools, and applications using the Microsoft SQL Server platform. This includes development and...
-
Data Engineer
20 hours ago
Lahore, Punjab, Pakistan Strategic Systems International Full timeJOB TITLE: Data EngineerDEPARTMENT: Software DevelopmentREPORTS To: Team Lead / Project ManagerPURPOSE:The Data Engineer will be responsible for supporting data engineering and cloud-related tasks, ensuring efficient data processing and troubleshooting in production environments. This role is ideal for individuals with a strong problem-solving mindset, a...