Data Platform Engineer

20 hours ago

Pakistan VentureDive Full time 1,200,000 - 2,400,000 per year
Job Brief
We are seeking a skilled Data Platform Engineer with hands-on experience in Kafka, Message Queues (MQ), and Redis to design, implement, and maintain high-performance messaging and caching systems. The engineer will support real-time data streaming, asynchronous communication, and in-memory data platforms that connect critical business applications and databases. This role focuses on ensuring reliability, scalability, and low latency across data pipelines and middleware infrastructure in Telecom and Digital Financial Services (DFS) environments.

VentureDive Overview
Founded in 2012 by veteran technology entrepreneurs from MIT and Stanford, VentureDive is the fastest-growing technology company in the region that develops and invests in products and solutions that simplify and improve the lives of people worldwide. We aspire to create a technology organization and an entrepreneurial ecosystem in the region that is recognized as second to none in the world.

Key Responsibilities:
  • Deploy, configure, and manage Apache Kafka clusters, topics, partitions, and consumer groups for event-driven and streaming architectures.
  • Install and maintain Message Queue (MQ) systems such as RabbitMQ or ActiveMQ for asynchronous data
  • flow between microservices and databases.
  • Manage and optimize Redis instances for caching, session storage, and high-speed data retrieval.
  • Define and implement replication, retention, and partitioning strategies for Kafka topics.
  • Design and manage streaming data integration between Kafka/MQ systems and RDBMS/NoSQL databases.
  • Implement High Availability (HA) and Disaster Recovery (DR) configurations for Kafka, MQ, and Redis.
  • Collaborate with development and database teams to create event-driven data pipelines and optimize message throughput.
  • Monitor and tune performance using Prometheus, Grafana, or ELK Stack.
  • Secure Kafka and MQ infrastructures using SASL, TLS, and role-based access controls.
  • Automate operational workflows and deployments using Bash or Python scripting.
  • Maintain detailed technical documentation, SOPs, and deployment diagrams.
Required Experience & Qualification:
  • 2–4 years of experience in Kafka, MQ, and Redis administration and support.
  • Strong understanding of Kafka architecture — brokers, topics, producers, consumers, and partitions.
  • Proficiency with RabbitMQ or ActiveMQ configuration, clustering, and queue management.
  • Experience with Redis clustering, Sentinel, persistence (RDB/AOF), and replication.
  • Familiarity with Kafka Connect, MirrorMaker, and Schema Registry for data integration and replication.
  • Knowledge of message delivery semantics (at-most-once, at-least-once, exactly-once).
  • Strong Linux administration skills (Red Hat, Oracle Linux, CentOS, SUSE).
  • Understanding of networking, load balancing, and distributed system principles.
  • Hands-on experience with monitoring and alerting tools such as Prometheus or Grafana.
  • Scripting and automation proficiency in Bash or Python.
Preferred Qualifications
  • Experience with cloud-based messaging and caching services (AWS MSK, Azure Event Hubs, AWS ElastiCache, Google Pub/Sub).
  • Familiarity with Kafka Streams, Flink, or Spark Streaming.
  • Exposure to database integration for near real-time replication or event capture.
  • Certifications in Kafka, Redis, or MQ technologies are a plus.
Soft Skills
  • Strong analytical and problem-solving mindset.
  • Excellent communication and teamwork abilities.
  • Proactive, detail-oriented, and highly reliable under pressure.
  • Ability to handle complex, high-throughput production systems independently.
Education
  •  Bachelor's degree in Computer Science, Information Technology, or related field.
What we look for beyond required skills
In order to thrive at VentureDive, you
…are intellectually smart and curious
…have the passion for and take pride in your work
…deeply believe in VentureDive's mission, vision, and values
…have a no-frills attitude
…are a collaborative team player
…are ethical and honest

Are you ready to put your ideas into products and solutions that will be used by millions?
You will find VentureDive to be a quick pace, high standards, fun and a rewarding place to work at. Not only will your work reach millions of users world-wide, you will also be rewarded with competitive salaries and benefits. If you think you have what it takes to be a VenDian, come join us ... we're having a ball    

#LI-Hybrid

  • Data Engineer

    19 hours ago

    Pakistan Pavago Full time 1,200,000 - 3,600,000 per year

    Job Title: Data EngineerPosition Type: Full-Time, RemoteWorking Hours: U.S. client business hours (with flexibility for pipeline monitoring and data refresh cycles)About the Role:Our client is seeking a Data Engineer to design, build, and maintain reliable data pipelines and infrastructure that deliver clean, accessible, and actionable data. This role...

  • Data Engineer

    2 weeks ago

    Pakistan soum Full time 900,000 - 1,200,000 per year

    Role: Data EngineerLocation: Egypt, Uzbekistan, and Pakistan (Remote)Work Week: Sunday – ThursdayWork Timings: 9:00 AM – 6:00 PM (Saudi Arabian Time Zone)Overview:We're seeking a Data Engineer to design, build, and maintain the data infrastructure that underpins our analytics, ML models, and decision-making processes. You'll be responsible for building...

  • Senior Backend Engineer – Platform

    20 hours ago

    Pakistan Obizworks-Offshore Business Consultants Full time 3,000,000 - 3,600,000 per year

    As a Senior Backend Engineer, Platform, you will be a key contributor to the design,development, and evolution of our core platform. You will have a significant impact on thescalability, reliability, and performance of our systems, enabling us to deliver innovative solutionsto the healthcare industry. Your responsibilities will include:● Platform...

  • Data Engineer

    20 hours ago

    Lahore, Punjab, , Pakistan Jugnu Full time 1,200,000 - 2,400,000 per year

    Position: Data EngineerLocation: Lahore, Pakistan Workclosely with the BI, Product Development and Business Development teams todeliver on data needs.PerformETL process; design,develop and maintains data storage systems Identifyand address gaps in existing data architecture framework, logs and processesDesignand build data solutions that support company...

  • Mid Level Data engineer

    19 hours ago

    Pakistan Team Zeta (Hiring Agency) Full time 4,800,000 - 5,400,000 per year

    Zeta Corp is looking for Data engineer for one of our US Client which is belong to E Learning platform .This is a full time for a Data Engineer at our US client The Senior Data Engineer will be responsible for data engineering, data modeling, ETL processes, data warehousing, and data analytics on a day-to-day basis.· Bachelor's degree in Information...

  • Full Stack Engineer: Platform

    19 hours ago

    Pakistan Pareto Full time 500,000 - 1,200,000 per year

    About usAt Pareto.AI, we're on a mission to enable top talent around the world to participate in the development of cutting-edge AI models.In coming years, AI models will transform how we work and create thousands of new AI training jobs for skilled talent around the world. We've joined forces with top AI and crowd researchers at Anthropic, Character.AI,...

  • Data Engineer

    20 hours ago

    Pakistan TenX Full time 500,000 - 1,500,000 per year

    1. JOB SUMMARY:Data Engineers are responsible for designing and creating the data warehouse and all related extraction, transformation, and load of data functions. He should be able to analyze and digest what a business wants to accomplish with its data, and design the best possible ETL/BI process around those goals.2. DESCRIPTION:Data Warehouse /ETL-...

  • AVP - Technology - Data Pak - TECH - Data

    20 hours ago

    Pakistan Mashreq Bank Full time 1,200,000 - 3,600,000 per year

    DescriptionData & Analytics Driven Organization: One Data and Finance Reporting Function drive the vision to transform the Bank into a Data Driven Organization (DDO) using latest tools and technologies in Data space. RBG Data team is a stream within One Data Organization driving this agenda for Retail Banking function.Principal Data Engineer/Lead Data...

  • Data Engineer PK

    20 hours ago

    Remote, IS, Pakistan Wizdaa Full time $100,000 - $120,000 per year

    Job description Let's be direct: We're looking for a technical powerhouse. If you're the developer who:Is the clear technical leader on your teamConsistently solves problems others can't crackShips complex features in half the time it takes othersWrites code so clean it could be published as a tutorialTakes pride in elevating the entire codebaseThen we want...

  • Data Analyst II

    2 weeks ago

    Pakistan Motive Full time 30,000 - 60,000 per year

    Who we are:Motive empowers the people who run physical operations with tools to make their work safer, more productive, and more profitable. For the first time ever, safety, operations and finance teams can manage their drivers, vehicles, equipment, and fleet related spend in a single system. Combined with industry leading AI, the Motive platform gives you...