Senior Data Engineer

3 weeks ago

Lahore, Punjab, Pakistan Seanode Full time

We're looking for a Senior Data Engineer with strong experience in building, scaling, and optimizing large-scale data pipelines to support high-performance AI systems. You'll be responsible for designing and maintaining data infrastructure that ingests, transforms, and serves data at terabyte-scale (10TB+ per source) across multiple domains.

You will work closely with our AI/ML team to ensure they have reliable, clean, and performant data to train and deploy machine learning models. You should be a problem-solver who understands the importance of resilient data systems and can thrive in a high-scale, fast-paced environment.

Key Responsibilities

- Design, implement, and maintain high-throughput data pipelines that process large volumes of structured and unstructured data (10TB+ per source).

- Develop scalable and fault-tolerant ETL/ELT workflows using best practices for data quality, partitioning, and reprocessing.

- Collaborate with AI and Data Science teams to understand data requirements and deliver highly available and query-optimized datasets.

- Optimize data processing performance using techniques such as file format tuning (e.g., Parquet/ORC), indexing, column pruning, partitioning, and resource-aware scheduling.

- Build monitoring and alerting around pipelines to ensure robustness under load and prevent data quality regressions or pipeline failures.

- Implement data versioning, lineage tracking, and governance to ensure transparency and reproducibility.

- Work with infrastructure engineers to fine-tune cluster performance, autoscaling, and data storage costs.

- Contribute to evolving the data platform's architecture to support new business use cases and improve scalability.

Must-Have Skills & Tools

- Programming Languages: Python, SQL, (Java/Scala is a plus)

- Cloud Platforms: AWS (preferred), GCP or Azure

- Experience with services like S3, EMR, Glue, Redshift, Athena or equivalents

- Data Warehouses & Lakes: Snowflake, BigQuery, Databricks, or similar

- Streaming/Data Ingestion: Kafka, Kinesis, Apache Flink (nice to have)

- Strong experience in pipeline performance optimization and debugging under large data loads

- Deep understanding of data partitioning strategies, backfilling, deduplication, and error handling

Nice-to-Have

- Experience supporting machine learning pipelines and feature stores

- Knowledge of data governance, compliance, and anonymization techniques

- Familiarity with containerization (Docker) and orchestration (Kubernetes)

What We Offer

- Work on cutting-edge AI data systems that directly impact product innovation

- Collaborate with a passionate and technically deep team

- Flexible remote work options

- Competitive compensation and benefits

- Opportunity to influence infrastructure decisions at scale

Seniority level
  • Seniority levelMid-Senior level
Employment type
  • Employment typeFull-time
Job function
  • Job functionInformation Technology
  • IndustriesTechnology, Information and Internet

Referrals increase your chances of interviewing at Seanode by 2x

Get notified about new Senior Data Engineer jobs in Lahore, Punjab, Pakistan.

Software Engineer - Supplier/Data Experience

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

  • Senior Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan nexaquanta Full time

    1 day ago Be among the first 25 applicantsDirect message the job poster from NexaQuantaTechnical and Non-Technical Recruiter | Payroll Executive | HR Operations | Talent Acquisition | HR Generalist | Sr. HR Officer | Employees Relation…Role DescriptionWe are looking for a highly motivated and skilled Data Engineer with around 4 years of experience to join...

  • Data Engineer, Senior

    2 weeks ago

    Lahore, Punjab, Pakistan Ekho Full time

    Ekho is a profitable US-based ML/AI startup building agentic systems to automatically clean, enrich, and orchestrate CRM data. Our leadership team has scaled startups to millions of dollars in revenue, has worked at leading tech companies such as Adobe and Square, and cares deeply about team culture. We're looking for data nerds, who are genuinely curious,...

  • Senior Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan Devsinc Full time

    Devsinc is seeking a talented Senior Data Engineer to join our dynamic team. The ideal candidate will possess a deep understanding of data architecture and engineering principles, along with hands-on experience in developing, optimizing, and maintaining data pipelines and databases. This role is crucial to support our data-driven initiatives and to enhance...

  • Data Engineer

    1 week ago

    Lahore, Punjab, Pakistan Algo Full time

    Get AI-powered advice on this job and more exclusive features.Responsibilities:Design, build, and maintain efficient and scalable ETL/ELT data pipelines using tools like Azure Data Factory or Apache Airflow.Develop, test, and deploy Python-based data processing solutions.Work with Snowflake, Databricks, and other data warehousing technologies to support data...

  • Data Engineer

    1 week ago

    Lahore, Punjab, Pakistan Ekho Full time

    Ekho is a profitable US-based ML/AI startup building agentic systems to automatically clean, enrich, and orchestrate CRM data. Our leadership team has scaled startups to millions of dollars in revenue, has worked at leading tech companies such as Adobe and Square, and cares deeply about team culture. We're looking for data nerds, who are genuinely curious,...

  • Senior Data Engineering Expert

    1 week ago

    Lahore, Punjab, Pakistan beBeeDataEngineering Full time $120,000 - $150,000

    Our organization seeks a Senior Data Engineering Expert to design and develop complex data pipelines using Big Data technologies.">Build scalable data workflows with tools such as Ab Initio, Informatica, DBT, and Apache Spark.">The ideal candidate will have hands-on experience in distributed data processing, data modeling within cloud environments like AWS,...

  • Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan HR POD Careers Full time

    Data Engineer (Onsite, Lahore, Remittance Salary)Join to apply for the Data Engineer (Onsite, Lahore, Remittance Salary) role at HR POD CareersData Engineer (Onsite, Lahore, Remittance Salary)1 day ago Be among the first 25 applicantsJoin to apply for the Data Engineer (Onsite, Lahore, Remittance Salary) role at HR POD CareersGet AI-powered advice on this...

  • Senior Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan Stallions Full time

    About the Role:We are seeking a Senior Data Engineer with hands-on expertise in Microsoft Dynamics 365 Finance & Operations (F&O) and Azure Data Engineering tools to lead complex data migration and integration initiatives. This role requires a technically strong, solutions-oriented professional who can design robust ETL pipelines, manage end-to-end data...

  • Junior Data Engineer

    5 days ago

    Lahore, Punjab, Pakistan Devsinc Full time

    Get AI-powered advice on this job and more exclusive features.Devsinc is looking for a motivated and enthusiastic Junior Data Engineer to join our growing team. In this role, you will have the opportunity to learn from experienced professionals while contributing to the design, development, and maintenance of data pipelines and data systems. Your primary...

  • Sr. Data Engineer

    1 week ago

    Lahore, Punjab, Pakistan Mavericks United Full time

    Get AI-powered advice on this job and more exclusive features.Location: Green Forts 2, Lahore (Onsite)About the Role:We are looking for a Senior Data Engineer who is a hands-on leader in building scalable data pipelines and infrastructure for AI/ML applications. You will architect and implement modern data solutions to power large-scale machine learning...