Senior Data Engineer

3 days ago

Karachi, Sindh, Pakistan metroConnections, Inc. Full time

The incumbent will be responsible for designing, building, and optimizing scalable data analytics systems and pipelines, impacting the efficiency, reliability, and performance of data-driven solutions to enable high-quality insights and informed decision-making across the organization.

RESPONSIBILITIES
  • Design and implement scalable data ingestion and processing workflows using Apache NiFi and Apache Spark.
  • Optimize and maintain analytical databases such as Vertica and ClickHouse for high-performance querying on large datasets.
  • Administer and tune MySQL Server and MongoDB to ensure reliability, availability, and optimal performance.
  • Develop robust data models for both OLTP and OLAP systems to support analytics and operational use cases.
  • Build and manage distributed data architectures integrated with microservices, ensuring seamless and secure data access.
  • Apply advanced query optimization and data lifecycle management practices to enhance overall system efficiency.
  • Managing the complexity of designing and maintaining scalable data pipelines and distributed systems that can reliably process and serve 100 M+ row datasets across diverse platforms.
  • Ensuring optimal performance and availability of analytical databases (e.g., Vertica, ClickHouse) while balancing cost, speed, and storage efficiency in high-demand environments.
  • Integrating data workflows within microservice-based architectures, while maintaining data consistency, security, and low-latency access across teams and systems.

Required Qualification

  • Bachelor's degree in Computer Science, Data Science, Data Engineering, Software Engineering, or other related fields.

Required Experience

  • At least 5 years of professional experience in data engineering or software development with focus on large scale data solutions.

Required Skills

  • Hands-on experience with Apache NiFi or Apache Spark for data ingestion and processing.
  • Strong experience in MySQL Server and MongoDB database administration and optimization.
  • In-depth understanding of Linux-based environments and shell scripting.
  • Strong knowledge of data modeling principles for both OLTP and OLAP systems.
  • Experience in building and optimizing distributed datastores for high availability and performance.
  • Familiarity with microservice architectures and their integration with data platforms.
  • Expertise in query optimization techniques to enhance system performance.
16 Raffles Quay, #16-02, Hong Leong Building, Singapore 048581
#J-18808-Ljbffr

  • Senior Quality Assurance Automation Engineer

    3 weeks ago

    Karachi, Sindh, Pakistan Polymer Runtime Data Security Full time

    Senior Quality Assurance Automation EngineerDirect message the job poster from Polymer Runtime Data SecuritySQA Engineer | Codeception | Selenium with Java | Maven | TestNG | POM | API Tester | Ad Tester | UI Tester | Web App Automation | Good knowledge of…Company DescriptionPolymer Runtime Data Security revolutionizes data security with a unique blend of...

  • Senior Data Engineer

    3 weeks ago

    Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    As a Senior DevOps Engineer, you will lead the development of internal tools, shape work environments, and seamlessly integrate IT operations. Your focus on managing CI/CD pipelines ensures reliable software delivery while collaborative efforts tackle technical challenges and optimize system performance. This role requires a strong understanding of...

  • Senior Data Engineer

    3 weeks ago

    Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.BlueBerry Tech Inc., a leading player in the Information Technology and Services industry, is dedicated to advancing businesses through innovative digital solutions. We are located in Karachi and serve as digital transformation partners for startups and...

  • Senior ETL Data Engineer

    1 week ago

    Karachi, Sindh, Pakistan NorthBay - Pakistan Full time

    3 weeks ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Job Title: Senior ETL Data Engineer (Ab Initio / Informatica)Experience: 4+ YearsLocation: Lahore / Karachi / Islamabad (Hybrid)Job Type: Full-TimeAbout The RoleWe are looking for a highly skilled Senior ETL Data Engineer (Ab Initio / Informatica) with...

  • Data Engineering

    1 week ago

    Karachi, Sindh, Pakistan Xloop Digital Full time

    Senior Data Engineer Karachi Full timeRemoteWe are seeking an experienced Senior Data Engineer with strong expertise in Informatica Cloud to joinour data engineering team. In this role, you will be responsible for designing, developing, and optimizinghigh-performance data pipelines and ensuring seamless data integration across cloud platforms. Yourtechnical...

  • Data Engineer

    9 hours ago

    Karachi, Sindh, Pakistan NorthBay - Pakistan Full time

    Job Title: Data EngineerJob Title: Data EngineerLocation: Karachi, Lahore , Islamabad (Hybrid)Experience: 5+ YearsJob Type: Full-TimeJob OverviewWe are looking for a highly skilled and experienced Data Engineer with a strong foundation in Big Data, distributed computing, and cloud-based data solutions. This role demands a strong understanding of end-to-end...

  • Senior Data Engineer Database Consolidation

    3 days ago

    Karachi, Sindh, Pakistan Awesome Technologies Inc. Full time

    Hiring: Senior Data Engineer Database Consolidation & OptimizationLocation: Shahrah-e-Faisal, Karachi | Shift: 6 PM 3 AM | Hybrid | Full-timeWere looking for a Senior Data Engineer with 3+ years of relevant experience to lead a large-scale database consolidation project reducing ~290 databases to 6065.Key Requirements:Strong SQL (T-SQL preferred)Deep...

  • Principal Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan Pakistan Single Window (PSW) Full time

    3 weeks ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Design, develop, and maintain scalable ETL/ELT pipelines to ingest, transform, and integrate data from various sourcesImplement real-time data streaming and batch processing solutions to support diverse business needsBuild and optimize data storage...

  • Data Engineer– Palantir

    1 week ago

    Karachi, Sindh, Pakistan NorthBay - Pakistan Full time

    3 weeks ago Be among the first 25 applicantsLocation: RemoteExperience: 8+ years in Data Architecture, including 3+ years with Ontology Modeling and Palantir FoundryType: Full timeJob SummaryWe are seeking a highly skilled Data Architect with deep expertise in Ontology modeling and hands-on experience with Palantir Foundry. The ideal candidate will play a...

  • Intermediate Data Enginer

    9 hours ago

    Karachi, Sindh, Pakistan Autonomous Full time

    Direct message the job poster from AutonomousWe're looking for a data engineer who can transform raw data into clean, reliable insights. If you know why a dimension table belongs in a star schema, can spot a broken DAG before breakfast, and can confidently explain it all on a 9 a.m. PST Zoom call, you might be the one we're looking for.Key...