Senior Data Engineer

4 weeks ago

Islamabad, Islamabad, Pakistan SOFTOO Full time
Job Summary

We are seeking a Senior Data Engineer to design and implement the backbone of our data infrastructure for a large-scale Television Audience Measurement (TAM) platform.

About the Role

This role is central to building efficient, reliable, and scalable pipelines that move, transform, and manage data collected from thousands of edge devices and processed through our backend systems.

Key Responsibilities:
  • Design, develop, and maintain data pipelines for ingesting, validating, and transforming telemetry and audio signature data.
  • Work with tools like Kafka, Airflow, rsync, PostgreSQL, and MongoDB to orchestrate and manage data flow.
  • Collaborate with the TAM box collection system and headend systems to ensure seamless ingestion.
  • Implement efficient batch data workflows for daily audience analytics, panel metrics, and report generation.
  • Develop modular data processing scripts and transformations in Python and Bash.
  • Ensure high reliability, correctness, and fault tolerance in all data movement processes.
  • Implement logging, retry logic, and monitoring to track pipeline health and data anomalies.
  • Support data scientists by preparing clean, structured datasets and integrating model outputs into downstream systems.
Requirements:
  • 6+ years of experience in data engineering, backend development, or similar fields.
  • Strong proficiency with ETL pipelines, time-series data, and batch processing systems.
  • Advanced skills in Python and Bash for scripting and automation.
  • Experience with Kafka, Airflow, PostgreSQL, and MongoDB (or similar alternatives).
  • Solid understanding of data structures, data integrity, schema management, and storage optimization.
  • Comfortable working in Linux environments with on-prem infrastructure and physical servers.
  • Experience writing and optimizing SQL queries, views, and stored procedures.

  • Senior Data Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan Tekrowe Full time

    5 days ago Be among the first 25 applicantsDirect message the job poster from TekroweTalent Acquisition Specialist @ Tekrowe Digital | Technical Recruiter | HR Operations | Head Hunter | Employee Engagement | Corporate CommunicationsThe Company Tekrowe Digital, a rapidly growing Software Development and Technology Innovation company in Pakistan, specializes...

  • Senior Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Senior Data EngineerThis senior-level position involves overseeing the development and maintenance of our data infrastructure. It requires extensive experience in designing, building, and scaling data pipelines as well as managing technical data products for client reporting. The ideal candidate should have 7+ years of experience in building and scaling data...

  • Senior Data Engineer

    4 weeks ago

    Islamabad, Islamabad, Pakistan Cloudpso Full time

    Job DetailsJob timings: Mon - Fri 6 PM - 3 AM Pakistan timeJob Location: Islamabad I-9/3 (Onsite)Experience: Over 5 yearsResponsibilitiesAble to work on complex data-intensive projects.Good understanding of Python, Spark best practices, and commonly used modules based on work experience, creating self-contained, reusable, and testable modules and...

  • Senior Data Engineer

    3 days ago

    Islamabad, Islamabad, Pakistan S&P Global Full time

    Join to apply for the Senior Data Engineer role at S&P Global1 day ago Be among the first 25 applicantsJoin to apply for the Senior Data Engineer role at S&P GlobalDirect message the job poster from S&P GlobalSeasoned Technical Recruiter | Building high-performing Teams | Searching for Innovative Minds | Talent Advisor | Mentor | Certified DEI...

  • Senior Data Engineering Opportunities

    3 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Unlock Data Engineering OpportunitiesWe are seeking a skilled Senior Data Engineer to join our team. In this role, you will have the opportunity to work on challenging projects that align with business objectives.About the RoleThe Senior Data Engineer will assist in the design and development of scalable data solutions. This will involve working closely with...

  • Data Engineer

    4 weeks ago

    Islamabad, Islamabad, Pakistan Leed | Pakistan Full time

    Direct message the job poster from Leed | PakistanCertified Human Resources Professional -CHRPCompany Description:Leed Pakistan is a software development company established in 2020, headquartered in Canada, with development offices in Germany and Pakistan. Despite our rapid growth to 50+ professionals, we prioritize quality and customer care. We work with...

  • Senior Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan Ciklum India Full time

    Ciklum is looking for a Senior Data Engineer to join our team full-time in Pakistan.We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer...

  • Data Engineering Specialist

    7 days ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team. As a key member of the engineering team, you will play a crucial role in designing and developing large-scale data-intensive projects.Key Responsibilities:Design and develop complex data pipelines using Spark and Python.Collaborate with cross-functional teams to...

  • Senior Data Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan Confiz Limited Full time

    We are looking for a Data Engineer with 2-4 years of experience to design, build, and maintain data pipelines that enable efficient data processing and analytics. The ideal candidate will have expertise in SQL, data modeling, and Oracle Data Integrator (ODI) and will work closely with data analysts, BI developers, and business teams to ensure reliable and...

  • Cloud Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Senior Cloud Data Architect PositionWe are seeking a highly skilled Senior Cloud Data Architect to join our team and contribute to the development of a cloud-based platform focused on marine conservation.The ideal candidate will have experience with designing and optimizing data systems using Azure cloud services and possess expertise in Python, PySpark,...