Senior Data Engineer

4 weeks ago

Karachi, Sindh, Pakistan metroConnections, Inc. Full time

The incumbent will be responsible for designing, building, and optimizing scalable data analytics systems and pipelines, impacting the efficiency, reliability, and performance of data-driven solutions to enable high-quality insights and informed decision-making across the organization.

RESPONSIBILITIES
  • Design and implement scalable data ingestion and processing workflows using Apache NiFi and Apache Spark.
  • Optimize and maintain analytical databases such as Vertica and ClickHouse for high-performance querying on large datasets.
  • Administer and tune MySQL Server and MongoDB to ensure reliability, availability, and optimal performance.
  • Develop robust data models for both OLTP and OLAP systems to support analytics and operational use cases.
  • Build and manage distributed data architectures integrated with microservices, ensuring seamless and secure data access.
  • Apply advanced query optimization and data lifecycle management practices to enhance overall system efficiency.
  • Managing the complexity of designing and maintaining scalable data pipelines and distributed systems that can reliably process and serve 100 M+ row datasets across diverse platforms.
  • Ensuring optimal performance and availability of analytical databases (e.g., Vertica, ClickHouse) while balancing cost, speed, and storage efficiency in high-demand environments.
  • Integrating data workflows within microservice-based architectures, while maintaining data consistency, security, and low-latency access across teams and systems.

Required Qualification

  • Bachelor's degree in Computer Science, Data Science, Data Engineering, Software Engineering, or other related fields.

Required Experience

  • At least 5 years of professional experience in data engineering or software development with focus on large scale data solutions.

Required Skills

  • Hands-on experience with Apache NiFi or Apache Spark for data ingestion and processing.
  • Strong experience in MySQL Server and MongoDB database administration and optimization.
  • In-depth understanding of Linux-based environments and shell scripting.
  • Strong knowledge of data modeling principles for both OLTP and OLAP systems.
  • Experience in building and optimizing distributed datastores for high availability and performance.
  • Familiarity with microservice architectures and their integration with data platforms.
  • Expertise in query optimization techniques to enhance system performance.
16 Raffles Quay, #16-02, Hong Leong Building, Singapore 048581
#J-18808-Ljbffr

  • Senior Data Engineer

    1 week ago

    Karachi, Sindh, Pakistan Logiciel Services, Llc Full time

    - Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field Master's preferred .- 3–5 years of experience in data engineering, with proven expertise in governance frameworks, metadata management, and knowledge graph / ontologies .- Demonstrated experience with tools/platforms such as Apache Atlas, Neo4j, Spark, Kafka,...

  • Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan Pakistan Single Window (PSW) Full time

    Develop and implement data pipelines that extract, load and transform data from various sources: This includes using ELT tools and technologies to clean, transform, and integrate data from differentsystems using Oracle Data IntegratorDesign and develop data models that store data in a way that is efficient and scalable: This includesusing data modelling...

  • Data Engineer

    3 weeks ago

    Karachi, Sindh, Pakistan NorthBay - Pakistan Full time

    Job Title: Data EngineerJob Title: Data EngineerLocation: Karachi, Lahore , Islamabad (Hybrid)Experience: 5+ YearsJob Type: Full-TimeJob OverviewWe are looking for a highly skilled and experienced Data Engineer with a strong foundation in Big Data, distributed computing, and cloud-based data solutions. This role demands a strong understanding of end-to-end...

  • Senior ETL Data Engineer

    1 week ago

    Karachi, Sindh, Pakistan NorthBay Solutions Full time

    Job Title: Senior ETL Data Engineer (Ab Initio / Informatica)Experience: 4+ YearsLocation: Lahore / Karachi / Islamabad (Hybrid)Job Type: Full-TimeAbout the Role:We are looking for a highly skilled Senior ETL Data Engineer (Ab Initio / Informatica) with strong experience in building robust data pipelines, working with large-scale datasets, and leveraging...

  • Senior Data Warehouse Engineer I

    2 weeks ago

    Karachi, Sindh, Pakistan Careem Full time

    Join to apply for the Senior Data Warehouse Engineer I role at Careem1 day ago Be among the first 25 applicantsJoin to apply for the Senior Data Warehouse Engineer I role at CareemAbout the CompanyCareem is building the Everything App for the greater Middle East, making it easier than ever to move around, order food and groceries, manage payments, and more....

  • Senior Data Engineer Database Consolidation

    4 weeks ago

    Karachi, Sindh, Pakistan Awesome Technologies Inc. Full time

    Hiring: Senior Data Engineer Database Consolidation & OptimizationLocation: Shahrah-e-Faisal, Karachi | Shift: 6 PM 3 AM | Hybrid | Full-timeWere looking for a Senior Data Engineer with 3+ years of relevant experience to lead a large-scale database consolidation project reducing ~290 databases to 6065.Key Requirements:Strong SQL (T-SQL preferred)Deep...

  • Intermediate Data Enginer

    3 weeks ago

    Karachi, Sindh, Pakistan Autonomous Full time

    Direct message the job poster from AutonomousWe're looking for a data engineer who can transform raw data into clean, reliable insights. If you know why a dimension table belongs in a star schema, can spot a broken DAG before breakfast, and can confidently explain it all on a 9 a.m. PST Zoom call, you might be the one we're looking for.Key...

  • Data Engineer

    4 days ago

    Karachi, Sindh, Pakistan Horizon Tech Full time

    We are seeking an experienced Data Engineer to join our team. The Data Engineer will be responsible for extracting, transforming, and loading data from various sources into data lakes and data warehouses using AWS while ensuring the efficiency and alignment of data systems with business goals. The ideal candidate should have strong analytical skills,...

  • Data Engineer

    4 days ago

    Karachi, Sindh, Pakistan HR Ways Full time

    About the job Data Engineer - Karachi, PakistanClient company introduction:The company is a growing consultancy specializing in data analytics, providing high-quality, impactful data solutions to UK-based clients.Job Description:The Data Engineer will play a pivotal role in shaping company's data capabilities, working on projects for UK-based clients....

  • Senior Software Engineer

    6 days ago

    Karachi, Sindh, Pakistan Astrikdigital Full time

    Senior Software Engineer – IFRS9, ECL, EIR Models & AI DevelopmentAstrik is hiring a highly skilled Senior Software Engineer with 6–8 years of experience to join our financial technology team. This is a full-time opportunity for a tech-savvy individual with expertise in IFRS9 ECL, EIR modeling, and AI/ML development. The ideal candidate will have a...