Senior Data Engineer

3 weeks ago

Lahore, Punjab, Pakistan Maqsood Labs Full time

About the role

We're modernising our analytics platform around Google Cloud. Your mission is to land data from high-volume MySQL systems into BigQuery, model it for self-service reporting, and build production-grade ML pipelines. You'll own everything from ingestion and orchestration to cost governance and data quality.

Key responsibilities:Area What you'll drive

Data ingestion & modelling (transformation)

Design and maintain robust MySQL → GCS → BigQuery pipelines (full + incremental). Implement partitioning, clustering, and materialised views for speed and economy.

Pipeline orchestration

Build DAGs in Airflow/Cloud Composer; automate testing, CI/CD, and deployment with Terraform and Cloud Build.

Machine-learning workflows

Develop end-to-end Machine Learning Pipelines (data prep, training, validation, registry, deployment) and integrate to BigQuery ML for rapid prototyping.

Data quality & observability

Establish automated validation gates, freshness SLAs, lineage, and alerting.

FinOps & security

Optimise slot reservations, query costs and storage lifecycle; enforce IAM least privilege, encryption, and compliance (GDPR, UAE PDPL).

Stakeholder enablement

Translate ad-hoc analytics/ML needs into technical plans; document clearly and mentor analysts & junior engineers.

Must-have skills

  • Expert SQL with BigQuery optimisation (partition, cluster, materialised views).
  • Proficient Python (pandas or Polars) for transformation and scripting.
  • Demonstrated MySQL → GCS → BigQuery ingestion (full & CDC).
  • DAG-based orchestration with Airflow / Cloud Composer (or equivalent).
  • Infrastructure-as-Code using Terraform or Deployment Manager.
  • ML Pipelines & MLOps best-practice (experiment tracking, registry, CI/CD).
  • Automated data-quality gates, freshness SLAs, and lineage.
  • Cost-optimisation dashboards; slot & reservation tuning.

Nice-to-have / future-proof skills

  • Streaming patterns (Pub/Sub → Dataflow → BigQuery).
  • dbt or Dataform for SQL-first transformations.
  • Cloud Run / Cloud Functions for lightweight services.
  • Gen-AI assisted pipeline code-gen; OpenLineage integration.
  • Proven mentorship, on-call ownership, and stakeholder communication.

Experience & education

  • 5+ years in data engineering or similar roles, with at least 2 years on GCP.
  • Bachelor's or Master's in Computer Science, Engineering, or related field (or equivalent experience).
  • Relevant certifications a plus (e.g., Google Pro
#J-18808-Ljbffr

  • Senior Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Mavericks United Full time

    Direct message the job poster from Mavericks UnitedHR Executive l Technical Recruiter I Talent Acquisition SpecialistThe ideal candidate's favorite words are learning, data, scale, and agility. You will leverage your strong collaboration skills and ability to extract valuable insights from highly complex data sets to ask the right questions and find the...

  • Senior Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan nexaquanta Full time

    1 day ago Be among the first 25 applicantsDirect message the job poster from NexaQuantaTechnical and Non-Technical Recruiter | Payroll Executive | HR Operations | Talent Acquisition | HR Generalist | Sr. HR Officer | Employees Relation…Role DescriptionWe are looking for a highly motivated and skilled Data Engineer with around 4 years of experience to join...

  • Senior Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan S4Digital Full time

    We're actively hiring for AWS Senior Data Engineer - Lahore.Client Company Introduction:Our client company specializes in Data, AI, and Cloud Engineering.Duties/Responsibilities:Extract data from multiple sources.Perform data cleaning, cleansing, and transformation.Build data systems and pipelines.Conduct complex data analysis and report on results.Load data...

  • Senior Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan Mavericks United Full time

    4 days ago Be among the first 25 applicantsDirect message the job poster from Mavericks United35k+ | HR Lead @ Mavericks | Talent Acquisition Specialist | Tech & Non-Tech Recruitment | People Managment | Employer & Employee Branding | HR Ops |…The Role:Mavericks United is looking for a highly skilled Data Engineer to join our on-site team. This role is...

  • Senior Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Devsinc, LLC Full time

    Devsinc is seeking a talented Senior Data Engineer to join our dynamic team. The ideal candidate will possess a deep understanding of data architecture and engineering principles, along with hands-on experience in developing, optimizing, and maintaining data pipelines and databases. This role is crucial to support our data-driven initiatives and to enhance...

  • Senior ETL Data Engineer

    3 days ago

    Lahore, Punjab, Pakistan NorthBay - Pakistan Full time

    3 weeks ago Be among the first 25 applicantsJob Title: Senior ETL Data Engineer (Ab Initio / Informatica)Experience: 4+ YearsLocation: Lahore / Karachi / Islamabad (Hybrid)Job Type: Full-TimeAbout The RoleWe are looking for a highly skilled Senior ETL Data Engineer (Ab Initio / Informatica) with strong experience in building robust data pipelines, working...

  • Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan NETSOL Technologies Inc. Full time

    4 days ago Be among the first 25 applicantsDirect message the job poster from NETSOL Technologies Inc.Manager Talent Acquisition@ NETSOL Technologies Inc. | International RecruitmentKey Responsibilities:Design and implement ETL/ELT pipelines, data lakes, and data warehouses to support client-specific use cases.Lead the development of Proof of Concepts (POCs)...

  • Senior Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Tkxel LLC Full time

    Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe are seeking an experienced and highly skilled Senior Data Engineer to join our dynamic team....

  • Senior Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan Manafa Technologies Full time

    Join to apply for the Senior Data Engineer (8+ Years) role at Manafa Technologies.About Us:At Manafa Technologies, we are dedicated to revolutionizing the fintech landscape by empowering small and medium-sized enterprises (SMEs) across Saudi Arabia. Our vision is to be the most accessible lending partner for SMEs, always just one click away from fulfilling...

  • Data Engineer

    1 week ago

    Lahore, Punjab, Pakistan DOT LABS Full time

    Get AI-powered advice on this job and more exclusive features.Direct message the job poster from DOT LABSHuman Resources Executive @Dot Labs | Talent Acquisition | Technical Recruitment | Performance Management | Training & Development | Employee…At Dot Labs, we are seeking a talented Associate Data Engineer to join our growing team.Forward your resume to...