Senior Data Engineer

2 days ago

Karachi, Sindh, Pakistan metroConnections, Inc. Full time

The incumbent will be responsible for designing, building, and optimizing scalable data analytics systems and pipelines, impacting the efficiency, reliability, and performance of data-driven solutions to enable high-quality insights and informed decision-making across the organization.

RESPONSIBILITIES
  • Design and implement scalable data ingestion and processing workflows using Apache NiFi and Apache Spark.
  • Optimize and maintain analytical databases such as Vertica and ClickHouse for high-performance querying on large datasets.
  • Administer and tune MySQL Server and MongoDB to ensure reliability, availability, and optimal performance.
  • Develop robust data models for both OLTP and OLAP systems to support analytics and operational use cases.
  • Build and manage distributed data architectures integrated with microservices, ensuring seamless and secure data access.
  • Apply advanced query optimization and data lifecycle management practices to enhance overall system efficiency.
  • Managing the complexity of designing and maintaining scalable data pipelines and distributed systems that can reliably process and serve 100 M+ row datasets across diverse platforms.
  • Ensuring optimal performance and availability of analytical databases (e.g., Vertica, ClickHouse) while balancing cost, speed, and storage efficiency in high-demand environments.
  • Integrating data workflows within microservice-based architectures, while maintaining data consistency, security, and low-latency access across teams and systems.

Required Qualification

  • Bachelor's degree in Computer Science, Data Science, Data Engineering, Software Engineering, or other related fields.

Required Experience

  • At least 5 years of professional experience in data engineering or software development with focus on large scale data solutions.

Required Skills

  • Hands-on experience with Apache NiFi or Apache Spark for data ingestion and processing.
  • Strong experience in MySQL Server and MongoDB database administration and optimization.
  • In-depth understanding of Linux-based environments and shell scripting.
  • Strong knowledge of data modeling principles for both OLTP and OLAP systems.
  • Experience in building and optimizing distributed datastores for high availability and performance.
  • Familiarity with microservice architectures and their integration with data platforms.
  • Expertise in query optimization techniques to enhance system performance.
16 Raffles Quay, #16-02, Hong Leong Building, Singapore 048581
#J-18808-Ljbffr

  • Senior Data Engineer

    1 day ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Senior Data Engineer PositionWe are seeking an experienced Senior Big Data Engineer to join our team. The ideal candidate will have a solid understanding of data engineering and a passion for working with large-scale datasets.

  • Senior Data Engineer

    3 weeks ago

    Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred.BlueBerry Tech Inc., a leading player in the Information Technology and Services industry, is dedicated to advancing businesses through innovative digital solutions. We are located in Karachi and serve as digital transformation partners for startups and...

  • Senior Data Engineer Lead

    1 day ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Senior Data Engineer PositionThis Senior Data Engineer role involves creating and maintaining efficient, scalable data systems and pipelines that drive business growth through informed decision-making.Main Responsibilities:Data System Development: Design and develop scalable data ingestion and processing systems using Apache NiFi and Apache Spark.Distributed...

  • Senior Data Infrastructure Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Job DescriptionThe Senior Data Infrastructure Engineer will be responsible for designing, developing, and maintaining large-scale data systems and pipelines to meet the needs of our organization.Main ResponsibilitiesDevelop and maintain scalable data pipelines using ETL/ELT processesImplement data quality checks, validation processes, and monitoring...

  • Senior Data Engineer Position

    1 day ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    This job offers a unique opportunity to work with a dynamic team of engineers and analysts to build cutting-edge data solutions. As a Senior Data Professional, you will play a key role in shaping our company's data architecture strategy, designing and implementing scalable data architectures, and ensuring data quality, reliability, and accessibility across...

  • Data Engineering Expert

    1 day ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Data Engineering Expert WantedAs a Senior Big Data Engineer, you will design and develop complex ETL jobs and pipelines using cutting-edge technologies like Hadoop, Spark, and Kafka.

  • Senior Data Infrastructure Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    About the RoleWe are looking for a highly skilled Senior Data Infrastructure Engineer to join our team. As a key member of our infrastructure team, you will be responsible for designing, implementing, and managing large-scale data infrastructure systems in the cloud.The ideal candidate will have extensive experience with database administration, data...

  • Lead Azure Data Engineer

    3 weeks ago

    Karachi, Sindh, Pakistan Minhas Technologies Full time

    Freelance IT Recruiter | Talent Acquisition Partner | People ServicesJob Description:We are looking for a highly skilled Python Core Engineer with expertise in Azure Data Engineering. The ideal candidate should have:Strong Python core engineering experience (not just development).Hands-on experience with Azure data engineering tools and services.Proficiency...

  • Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan Office Field Full time

    Job Title: Data EngineerOffice Field is looking for a Data Engineer to join our growing team. Get AI-powered advice on this job and access more exclusive features.Responsibilities:Create and maintain optimal data pipeline architecture.Assemble large, complex data sets that meet business requirements.Evaluate data flows and prepare ETL processing based on...

  • Data Engineer

    4 weeks ago

    Karachi, Sindh, Pakistan Enterprise64 Full time

    OverviewEnterprise64 is a U.S.-based technology company that creates digital solutions for startups to Fortune 500 companies in the United States, Europe, and the United Arab Emirates. We are growing rapidly across all our global offices and have career opportunities for tech professionals who are looking to work in a fast-growing company, work in a fun...