Senior Data Ingestion Specialist

2 days ago

Islamabad, Islamabad, Pakistan beBeeDataIngestionManager Full time $90,000 - $120,000
Job Summary

We are seeking an experienced Event Streaming and Data Ingestion Manager to lead the design, development, and management of our enterprise-grade event-driven architecture.

The role will be responsible for managing Kafka, MQ systems, and other streaming/data ingestion platforms, ensuring scalability, reliability, and performance to support a large-scale digital payments ecosystem.

This position reports to Chief Technology Officer.

Key Responsibilities
  • Lead the architecture, deployment, and operations of Kafka clusters, ActiveMQ/RabbitMQ, and other messaging platforms.
  • Manage real-time data ingestion pipelines to support payments, transactions, analytics, and fraud detection use cases.
  • Define and implement best practices for event-driven microservices, schema management, and message governance.
  • Oversee the reliability, performance tuning, and security of Kafka/MQ clusters in production.
  • Collaborate with cross-functional teams (application, data, DevOps, and security) to design high-throughput, low-latency solutions.
  • Lead a team of engineers, providing mentorship, technical guidance, and performance management.
  • Establish monitoring, observability, and alerting frameworks (e.g., Prometheus, Grafana, ELK, Confluent Control Center).
  • Drive capacity planning, scaling strategies, and disaster recovery for messaging platforms.
  • Manage vendor relationships, licensing, and support for platforms like Confluent Kafka.
  • Ensure compliance with regulatory and security requirements.
Requirements

To be successful in this role, you will need:

  • 5+ years of IT experience with at least 3+ years in managing Kafka/Event Streaming platforms.
  • Strong expertise in Apache Kafka (Confluent/OSS) - cluster setup, scaling, partitioning, replication, security (Kerberos/SASL/ACLs).
  • Hands-on experience with ActiveMQ / RabbitMQ / IBM MQ or equivalent.
  • Solid understanding of event-driven architecture, pub-sub, and messaging patterns.
  • Proficiency in data ingestion frameworks (Kafka Connect, Flume, NiFi, Debezium, etc.).
  • Experience with stream processing technologies (Kafka Streams, Apache Flink, Spark Streaming, ksqlDB).
  • Strong knowledge of cloud-native platforms (AWS MSK, Azure Event Hub, GCP Pub/Sub).
  • Familiarity with containerization & orchestration (Docker, Kubernetes, OpenShift).
  • Strong skills in monitoring & troubleshooting Kafka/MQ clusters.
  • Experience working in high-transaction financial services/fintech environments is a strong plus.
  • Leadership and people management skills with the ability to drive teams and align with business goals.
Benefits

This role offers:

  • A competitive salary package.
  • Ongoing professional development opportunities.
  • A dynamic and inclusive work environment.
  • The opportunity to work on complex projects and contribute to the company's success.
About Us

We are a leading employer in the industry, committed to delivering innovative solutions that meet the needs of our customers.

We value diversity and inclusion, and strive to create a work environment that is respectful and supportive of all employees.

  • Chief Data Infrastructure Specialist

    2 days ago

    Islamabad, Islamabad, Pakistan beBeeData Full time $125,000 - $175,000

    Job TitleWe are seeking a seasoned Data Engineer to spearhead the development and maintenance of our data infrastructure. This is a remote full-time position responsible for designing, building, testing, optimizing and maintaining the infrastructure and code required for data integration, storage, processing, pipelines and analytics (BI, visualization and...

  • Senior ETL Data Engineer

    6 days ago

    Islamabad, Islamabad, Pakistan NorthBay - Pakistan Full time

    2 months ago Be among the first 25 applicantsJob Title: Senior ETL Data Engineer (Ab Initio / Informatica)Experience: 4+ YearsLocation: Lahore / Karachi / Islamabad (Hybrid)Job Type: Full-TimeAbout The RoleWe are looking for a highly skilled Senior ETL Data Engineer (Ab Initio / Informatica) with strong experience in building robust data pipelines, working...

  • Building Scalable Data Solutions

    1 day ago

    Islamabad, Islamabad, Pakistan beBeeDataScientist Full time $90,000 - $120,000

    Our team is seeking a seasoned Senior Data Scientist to join our ranks. As a key member of our Data and AI Engineering Team, you will play a vital role in creating innovative and scalable data solutions. Our team specializes in cloud technologies, particularly AWS and Snowflake, with a focus on data security and governance. We prioritize collaboration,...

  • Data Specialist

    4 weeks ago

    Islamabad, Islamabad, Pakistan RWS Group Full time

    Data Specialist - Urdu (Hiring Globally)Data Specialist - Urdu (Hiring Globally)We are looking for Data Specialist to support the improvement of AI-generated content in Urdu.Job Type: FreelanceStart Date: ImmediatelyDuration: To be confirmedSchedule: Flexible, work at your own availabilityRate: $6/hourHelp Shape the Future of AIAre you a student, recent...

  • Senior Data Scientist

    2 days ago

    Islamabad, Islamabad, Pakistan S&P Global Full time

    Seasoned Technical Recruiter | Building high-performing Teams | Searching for Innovative Minds | Talent Advisor | Mentor | Certified DEI Professional…About The RoleGrade Level (for internal use): 10Team OverviewOur Data and AI Engineering Team consists of skilled professionals focused on creating innovative and scalable data solutions. We specialise in...

  • Data Center Engineer

    4 weeks ago

    Islamabad, Islamabad, Pakistan Smart Solutions Technologies - SST Full time

    Background on Technical Environment for this roleEDC (Enterprise Data Center) is a global organization responsible for the Firm's enterprise data center portfolio, one of several towers under the Core Infrastructure (CI) division.EDC is accountable for the provisioning and management of the Firm's data centers from initial requirements, construction and...

  • Data Entry Specialist

    4 days ago

    Islamabad, Islamabad, Pakistan beBeeDataEntry Full time 250,000 - 450,000

    Remote Data Entry SpecialistBachelor's degree in Computer Science or related field, or equivalent experienceJob Description:A remote data entry specialist is responsible for accurately and efficiently entering data into various databases using Google applications, MS Word, and MS Excel.Responsibilities:Enter, update, and maintain accurate databases using...

  • Data Warehouse Specialist

    4 weeks ago

    Islamabad, Islamabad, Pakistan Netsolace It Full time

    Data Warehouse Specialist Netsolace It, Pakistan The Data Warehouse Specialist will be responsible for the design, development, testing, maintenance, and support of the data warehouse. This role includes developing data warehouse and business intelligence solutions using Microsoft Business Intelligence tools and underlying technologies. The individual will...

  • Data Entry Specialist

    2 days ago

    Islamabad, Islamabad, Pakistan beBeeDataEntry Full time 250,000 - 500,000

    Job Title: Data Entry SpecialistWe are seeking a skilled professional to compile and verify data, ensuring accuracy by appropriately formatting it. This involves preparing documents for entry and transcribing from paper formats into computer files using manual entry or scanners.Job RequirementsA strong understanding of Microsoft Excel or similar database...

  • Senior Data Scientist

    5 days ago

    Islamabad, Islamabad, Pakistan S&P Global, Inc. Full time

    About the Role:Grade Level (for internal use):10Team OverviewOur Data and AI Engineering Team consists of skilled professionals focused on creating innovative and scalable data solutions. We specialise in cloud technologies, especially AWS and Snowflake, and prioritise data security and governance. Collaboration is key, as we work closely with Data...