Senior Data Engineer

7 days ago

Islamabad, Islamabad, Pakistan SOFTOO Full time
Job Summary

We are seeking a Senior Data Engineer to design and implement the backbone of our data infrastructure for a large-scale Television Audience Measurement (TAM) platform.

About the Role

This role is central to building efficient, reliable, and scalable pipelines that move, transform, and manage data collected from thousands of edge devices and processed through our backend systems.

Key Responsibilities:
  • Design, develop, and maintain data pipelines for ingesting, validating, and transforming telemetry and audio signature data.
  • Work with tools like Kafka, Airflow, rsync, PostgreSQL, and MongoDB to orchestrate and manage data flow.
  • Collaborate with the TAM box collection system and headend systems to ensure seamless ingestion.
  • Implement efficient batch data workflows for daily audience analytics, panel metrics, and report generation.
  • Develop modular data processing scripts and transformations in Python and Bash.
  • Ensure high reliability, correctness, and fault tolerance in all data movement processes.
  • Implement logging, retry logic, and monitoring to track pipeline health and data anomalies.
  • Support data scientists by preparing clean, structured datasets and integrating model outputs into downstream systems.
Requirements:
  • 6+ years of experience in data engineering, backend development, or similar fields.
  • Strong proficiency with ETL pipelines, time-series data, and batch processing systems.
  • Advanced skills in Python and Bash for scripting and automation.
  • Experience with Kafka, Airflow, PostgreSQL, and MongoDB (or similar alternatives).
  • Solid understanding of data structures, data integrity, schema management, and storage optimization.
  • Comfortable working in Linux environments with on-prem infrastructure and physical servers.
  • Experience writing and optimizing SQL queries, views, and stored procedures.

  • Senior Data Engineer

    1 week ago

    Islamabad, Islamabad, Pakistan SOFTOO Full time

    4 days ago Be among the first 25 applicantsDirect message the job poster from SOFTOOWe are seeking a Senior Data Engineer to design and implement the backbone of our data infrastructure for a large-scale Television Audience Measurement (TAM) platform. This role is central to building efficient, reliable, and scalable pipelines that move, transform, and...

  • Senior Data Engineer

    5 hours ago

    Islamabad, Islamabad, Pakistan Tekrowe Full time

    5 days ago Be among the first 25 applicantsDirect message the job poster from TekroweTalent Acquisition Specialist @ Tekrowe Digital | Technical Recruiter | HR Operations | Head Hunter | Employee Engagement | Corporate CommunicationsThe Company Tekrowe Digital, a rapidly growing Software Development and Technology Innovation company in Pakistan, specializes...

  • Senior Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan Tekrowe Full time

    3 days ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Direct message the job poster from TekroweTalent Acquisition Specialist @ Tekrowe Digital | Technical Recruiter | HR Operations | Head Hunter | Employee Engagement | Corporate CommunicationsThe Company Tekrowe Digital, a rapidly growing Software...

  • Senior Data Engineer

    4 weeks ago

    Islamabad, Islamabad, Pakistan Mobilink Bank Full time

    Department: Digital BankingReports To: Head DWH Reporting & AnalyticsJob Grade: AVPTotal Positions: 01Job Location: Head Office, IslamabadWhat is Senior Data Engineer - MMBL?We are seeking a hands-on Data Engineer with strong experience in Spark-based processing, object storage platforms, and data modeling to build and maintain MMBL's Medallion Architecture...

  • Senior Data Engineer

    4 days ago

    Islamabad, Islamabad, Pakistan Cloudpso Full time

    Job DetailsJob timings: Mon - Fri 6 PM - 3 AM Pakistan timeJob Location: Islamabad I-9/3 (Onsite)Experience: Over 5 yearsResponsibilitiesAble to work on complex data-intensive projects.Good understanding of Python, Spark best practices, and commonly used modules based on work experience, creating self-contained, reusable, and testable modules and...

  • Senior Data Engineer

    4 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Senior Data Engineer Wanted: We need a skilled professional to lead our data engineering efforts and help us make a difference in the world.This is a unique opportunity to work on complex data projects, develop innovative solutions, and contribute to a mission-driven team.The ideal candidate will have:A strong background in data engineering and Azure cloud...

  • Data Engineer

    4 days ago

    Islamabad, Islamabad, Pakistan Leed | Pakistan Full time

    Direct message the job poster from Leed | PakistanCertified Human Resources Professional -CHRPCompany Description:Leed Pakistan is a software development company established in 2020, headquartered in Canada, with development offices in Germany and Pakistan. Despite our rapid growth to 50+ professionals, we prioritize quality and customer care. We work with...

  • Senior Data Engineer

    1 week ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Data Engineering ExpertiseWe are seeking a highly skilled Data Engineer II to join our team. This role requires strong proficiency in data architecture and demonstrated experience in data product development. The ideal candidate will have advanced proficiency in Python and SQL for data transformation and analytics. A deep understanding of RBAC security...

  • Data Engineering Leadership Position

    1 week ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Senior Data Engineer Role OverviewWe are seeking a talented Senior Data Engineer to join our growing Data & Analytics team. The successful candidate will play a key role in developing high-quality Data Lakehouse products and solutions.

  • Senior Big Data Engineer

    1 week ago

    Islamabad, Islamabad, Pakistan NorthBay Solutions Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, and be part of the growth and development of it, participate in a...