Senior Data Engineer

3 weeks ago

Karachi, Sindh, Pakistan metroConnections, Inc. Full time

The incumbent will be responsible for designing, building, and optimizing scalable data analytics systems and pipelines, impacting the efficiency, reliability, and performance of data-driven solutions to enable high-quality insights and informed decision-making across the organization.

RESPONSIBILITIES
  • Design and implement scalable data ingestion and processing workflows using Apache NiFi and Apache Spark.
  • Optimize and maintain analytical databases such as Vertica and ClickHouse for high-performance querying on large datasets.
  • Administer and tune MySQL Server and MongoDB to ensure reliability, availability, and optimal performance.
  • Develop robust data models for both OLTP and OLAP systems to support analytics and operational use cases.
  • Build and manage distributed data architectures integrated with microservices, ensuring seamless and secure data access.
  • Apply advanced query optimization and data lifecycle management practices to enhance overall system efficiency.
  • Managing the complexity of designing and maintaining scalable data pipelines and distributed systems that can reliably process and serve 100 M+ row datasets across diverse platforms.
  • Ensuring optimal performance and availability of analytical databases (e.g., Vertica, ClickHouse) while balancing cost, speed, and storage efficiency in high-demand environments.
  • Integrating data workflows within microservice-based architectures, while maintaining data consistency, security, and low-latency access across teams and systems.

Required Qualification

  • Bachelor's degree in Computer Science, Data Science, Data Engineering, Software Engineering, or other related fields.

Required Experience

  • At least 5 years of professional experience in data engineering or software development with focus on large scale data solutions.

Required Skills

  • Hands-on experience with Apache NiFi or Apache Spark for data ingestion and processing.
  • Strong experience in MySQL Server and MongoDB database administration and optimization.
  • In-depth understanding of Linux-based environments and shell scripting.
  • Strong knowledge of data modeling principles for both OLTP and OLAP systems.
  • Experience in building and optimizing distributed datastores for high availability and performance.
  • Familiarity with microservice architectures and their integration with data platforms.
  • Expertise in query optimization techniques to enhance system performance.
16 Raffles Quay, #16-02, Hong Leong Building, Singapore 048581
#J-18808-Ljbffr

  • Senior Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    As a Senior DevOps Engineer, you will lead the development of internal tools, shape work environments, and seamlessly integrate IT operations. Your focus on managing CI/CD pipelines ensures reliable software delivery while collaborative efforts tackle technical challenges and optimize system performance. This role requires a strong understanding of...

  • Senior Data Engineer

    3 days ago

    Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.BlueBerry Tech Inc., a leading player in the Information Technology and Services industry, is dedicated to advancing businesses through innovative digital solutions. We are located in Karachi and serve as digital transformation partners for startups and...

  • senior data engineer

    2 weeks ago

    Karachi, Sindh, Pakistan IRD Global Full time

    Direct message the job poster from IRD GlobalLooking for an Opportunity in the field of Data Analysis | Microsoft Excel Dashboard | MS Excel | MS SQL | SEP Oral | | Senior Assistant | Junior…Job DescriptionDepartmentDigital TransformationReporting ToHead of Digital TransformationEmployment TypeFull-time (Contractual)LocationKarachi, PakistanJob PurposeThe...

  • Senior Data Analytics Engineer

    2 days ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Senior Data Engineer Job Description:">We are looking for a highly skilled Senior Data Engineer to join our team. The ideal candidate will have a strong background in data engineering and a passion for designing and building scalable data analytics systems.">Your Key Responsibilities:">">Data Ingestion and Processing: Design and implement scalable data...

  • Senior Data Engineer Role

    7 days ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Data Engineering ExpertWe are looking for a seasoned Senior Data Engineer to drive our data engineering efforts.ResponsibilitiesData Architecture: Collaborate with cross-functional teams to design and implement data architectures that meet business needs.ETL Process Management: Develop and maintain scalable ETL processes to ensure high-quality data...

  • Data Engineering Expert

    7 days ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Senior Data Engineer RoleWe are seeking an experienced Senior Data Engineer to join our team and drive our data engineering initiatives.Main ResponsibilitiesData Engineering Strategy: Collaborate with cross-functional teams to develop and implement data engineering strategies that meet business needs.ETL Process Development: Design, develop, and maintain...

  • Data Systems Engineer

    7 days ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Senior Big Data DeveloperThe ideal candidate will have extensive experience in data engineering, with a strong focus on Big Data technologies such as Hadoop, Spark, and Hive. You will be responsible for designing and developing cutting-edge Big Data solutions that can handle large-scale datasets and distributed computing frameworks.

  • Data Engineering Specialist

    3 days ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Job Title: Senior Data Engineer">About the Role:">We are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, building, and optimizing scalable data analytics systems and pipelines.">Your Key Responsibilities:">">Design and implement scalable data ingestion and processing workflows...

  • Data Engineer

    1 week ago

    Karachi, Sindh, Pakistan HR Ways - Hiring Tech Talent Full time

    1 day ago Be among the first 25 applicantsThe company is a growing consultancy specializing in data analytics, providing high-quality, impactful data solutions to UK-based clients.Job Description:The Data Engineer will play a pivotal role in shaping company's data capabilities, working on projects for UK-based clients. Joining a new and dynamic team, this...

  • Senior Data Systems Engineer

    7 days ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Data Engineering ExpertiseWe are seeking a highly skilled Principal Data Engineer to build and optimize data storage solutions, including data lakes, data warehouses, and databases. The ideal candidate will have expertise in real-time data streaming and batch processing solutions to support diverse business needs.