Data Ingestion Manager

4 days ago

Islamabad, Islamabad, Pakistan beBeeDataIngestionManager Full time $120,000 - $150,000
Job Opportunity

We are seeking a highly skilled professional to lead the design, development, and management of our enterprise-grade event-driven architecture. The role will be responsible for managing Kafka, MQ systems, and other streaming/data ingestion platforms, ensuring scalability, reliability, and performance to support large-scale digital payments ecosystems.

The successful candidate will have strong expertise in Apache Kafka (Confluent/OSS), including cluster setup, scaling, partitioning, replication, security (Kerberos/SASL/ACLs). They will also have hands-on experience with ActiveMQ / RabbitMQ / IBM MQ or equivalent.

The manager will oversee the reliability, performance tuning, and security of Kafka/MQ clusters in production, as well as collaborate with cross-functional teams to design high-throughput, low-latency solutions. Leadership and people management skills are essential for driving teams and aligning with business goals.

Key responsibilities include:

  • Leading the architecture, deployment, and operations of Kafka clusters, ActiveMQ/RabbitMQ, and other messaging platforms.
  • Managing real-time data ingestion pipelines to support payments, transactions, analytics, and fraud detection use cases.
  • Defining and implementing best practices for event-driven microservices, schema management, and message governance.
  • Overseeing monitoring, observability, and alerting frameworks (e.g., Prometheus, Grafana, ELK, Confluent Control Center).

Additional requirements include 5+ years of IT experience with at least 3+ years in managing Kafka/Event Streaming platforms, solid understanding of event-driven architecture, pub-sub, and messaging patterns, and proficiency in data ingestion frameworks (Kafka Connect, Flume, NiFi, Debezium, etc.). Experience working in high-transaction financial services/fintech environments is a strong plus.

Required Skills and Qualifications

Essential Requirements

  • Expertise in Apache Kafka (Confluent/OSS) - cluster setup, scaling, partitioning, replication, security (Kerberos/SASL/ACLs).
  • Hands-on experience with ActiveMQ / RabbitMQ / IBM MQ or equivalent.
  • Solid understanding of event-driven architecture, pub-sub, and messaging patterns.
  • Proficiency in data ingestion frameworks (Kafka Connect, Flume, NiFi, Debezium, etc.).
  • Experience working in high-transaction financial services/fintech environments.
  • Leadership and people management skills with the ability to drive teams and align with business goals.

Preferred Qualifications

  • Bachelor's or Master's in Computer Science, Software Engineering, or Information Technology.
  • Relevant certifications in Kafka, Event Streaming, or Cloud Platforms.
Benefits

We offer a unique professional culture, a flourishing lifestyle, and continuous learning and development opportunities. Our core values include qualities essential for a positive organizational culture - truthfully guiding entrepreneurial and innovative mindsets, harnessing professional and interpersonal collaboration, and fostering across-the-board customer obsession.

  • Senior Data Ingestion Specialist

    1 week ago

    Islamabad, Islamabad, Pakistan beBeeDataIngestionManager Full time $90,000 - $120,000

    Job SummaryWe are seeking an experienced Event Streaming and Data Ingestion Manager to lead the design, development, and management of our enterprise-grade event-driven architecture.The role will be responsible for managing Kafka, MQ systems, and other streaming/data ingestion platforms, ensuring scalability, reliability, and performance to support a...

  • Data Architect Leader

    4 days ago

    Islamabad, Islamabad, Pakistan beBeeCloud Full time 15,000,000 - 25,000,000

    Event Streaming Leadership OpportunityGrade Level: L3We are seeking an exceptional leader to spearhead the design, development, and management of our enterprise-grade event-driven architecture.The ideal candidate will be responsible for overseeing the scalability, reliability, and performance of Kafka, MQ systems, and other streaming/data ingestion platforms...

  • Data Engineer

    6 days ago

    Islamabad, Islamabad, Pakistan ieng Group Full time 70,000 - 120,000 per year

    Job Title:Data EngineerJob Code:Section:O&MGrade:Reports To:AI/ML Team LeadRole and Responsibilities· Design, develop, and manage scalable, reliable, and efficient data pipelines for ingesting and transforming structured and unstructured data.· Work with diverse data formats such as Parquet, JSON, and CSV for data ingestion, processing, and...

  • Data Scientist/Engineer

    7 days ago

    Islamabad, Islamabad, Pakistan SwipBox Full time $125,000 - $175,000 per year

    Job Summary:We are looking for a skilledData Engineer/Data Scientistwith strong Python programming and analytical skills, who can work across the data pipeline from ingestion and processing to modelling and reporting. The ideal candidate has experience handling large-scale (big) datasets, building predictive models, working with live and runtime data (e.g.,...

  • Senior Data Architect

    4 days ago

    Islamabad, Islamabad, Pakistan beBeeData Full time $180,000 - $200,000

    We're seeking a highly skilled Senior Data Scientist to lead the design and implementation of scalable data architectures aligned with strategic goals, especially those supporting Machine Learning (ML) and Generative AI (GenAI).About the RoleIn this position, you'll drive innovation by developing and executing data ingestion and processing workflows for text...

  • Principal Data Architecture Specialist

    4 days ago

    Islamabad, Islamabad, Pakistan beBeeDataEngineer Full time 12,000,000 - 15,000,000

    Senior ETL Data EngineerWe are seeking a highly skilled Senior ETL Data Engineer to lead our data engineering team. The ideal candidate should have hands-on expertise in building robust data pipelines, working with large-scale datasets, and leveraging modern Big Data and cloud technologies.Key Responsibilities:Design and develop complex ETL pipelines and...

  • Big Data Engineer

    7 days ago

    Islamabad, Islamabad, Pakistan Datamatics Technologies Full time $90,000 - $120,000 per year

    Job Title: Big Data Engineer Job Summary: We are looking for a highly skilled Big Data Engineer to spearhead the development of a scalable Big Data Platform. The ideal candidate will have extensive experience with Kafka, Flink, Spark, Python, and Talend, along with expertise in Apache Ranger, Prometheus, and strong SQL skills. This role involves designing...

  • Chief Data Infrastructure Specialist

    1 week ago

    Islamabad, Islamabad, Pakistan beBeeData Full time $125,000 - $175,000

    Job TitleWe are seeking a seasoned Data Engineer to spearhead the development and maintenance of our data infrastructure. This is a remote full-time position responsible for designing, building, testing, optimizing and maintaining the infrastructure and code required for data integration, storage, processing, pipelines and analytics (BI, visualization and...

  • Building Scalable Data Solutions

    1 week ago

    Islamabad, Islamabad, Pakistan beBeeDataScientist Full time $90,000 - $120,000

    Our team is seeking a seasoned Senior Data Scientist to join our ranks. As a key member of our Data and AI Engineering Team, you will play a vital role in creating innovative and scalable data solutions. Our team specializes in cloud technologies, particularly AWS and Snowflake, with a focus on data security and governance. We prioritize collaboration,...

  • Database Administrator

    7 days ago

    Islamabad, Islamabad, Pakistan SOFTOO Full time $125,000 - $175,000 per year

    OverviewWe are hiring aSenior Database Engineerto design, optimize, and manage the data storage layer of our data analytics platform. This role is critical in ensuring the performance, reliability, and scalability of our data infrastructure — which supports ingesting and processing over a terabyte of telemetry data daily from thousands of edge devices.You...