senior data engineer

18 hours ago

Karachi, Sindh, Pakistan IRD Global Full time

Direct message the job poster from IRD Global

Looking for an Opportunity in the field of Data Analysis | Microsoft Excel Dashboard | MS Excel | MS SQL | SEP Oral | | Senior Assistant | Junior…

Job Description

Department

Digital Transformation

Reporting To

Head of Digital Transformation

Employment Type

Full-time (Contractual)

Location

Karachi, Pakistan

Job Purpose

The incumbent will be responsible for designing, building, and optimizing scalable data analytics systems and pipelines, impacting the efficiency, reliability, and performance of data-driven solutions to enable high-quality insights and informed decision-making across the organization.

Responsibilities

  • Design and implement scalable data ingestion and processing workflows using Apache NiFi and Apache Spark.
  • Optimize and maintain analytical databases such as Vertica and ClickHouse for high-performance querying on large datasets.
  • Administer and tune MySQL Server and MongoDB to ensure reliability, availability, and optimal performance.
  • Develop robust data models for both OLTP and OLAP systems to support analytics and operational use cases.
  • Build and manage distributed data architectures integrated with microservices, ensuring seamless and secure data access.
  • Apply advanced query optimization and data lifecycle management practices to enhance overall system efficiency.
  • Manage the complexity of designing and maintaining scalable data pipelines and distributed systems that can reliably process and serve 100 M+ row datasets across diverse platforms.
  • Ensure optimal performance and availability of analytical databases (e.g., Vertica, ClickHouse) while balancing cost, speed, and storage efficiency in high-demand environments.
  • Integrate data workflows within microservice-based architectures, while maintaining data consistency, security, and low-latency access across teams and systems.

Required Knowledge, Skills & Abilities (KSA)

Required Qualification

  • Bachelor's degree in Computer Science, Data Science, Data Engineering, Software Engineering, or other related fields.

Required Experience

  • At least 5 years of professional experience in data engineering or software development with focus on large scale data solutions.

Required Skills

  • Hands-on experience with Apache NiFi or Apache Spark for data ingestion and processing.
  • Strong experience in MySQL Server and MongoDB database administration and optimization.
  • In-depth understanding of Linux-based environments and shell scripting.
  • Strong knowledge of data modeling principles for both OLTP and OLAP systems.
  • Experience in building and optimizing distributed datastores for high availability and performance.
  • Familiarity with microservice architectures and their integration with data platforms.
  • Expertise in query optimization techniques to enhance system performance.
Seniority level
  • Mid-Senior level
Employment type
  • Full-time
Job function
  • Information Technology
Industries
  • Hospitals and Health Care

Referrals increase your chances of interviewing at IRD Global by 2x

Sign in to set job alerts for "Senior Data Engineer" roles.

Karachi Division, Sindh, Pakistan 2 months ago

Karachi Division, Sindh, Pakistan 1 month ago

Senior Data Scientist, IgniteTech (Remote) - $60,000/year USD

Karachi Division, Sindh, Pakistan 1 day ago

Karachi Division, Sindh, Pakistan 22 hours ago

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

  • Senior Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Senior Data Engineer PositionWe are seeking an experienced Senior Big Data Engineer to join our team. The ideal candidate will have a solid understanding of data engineering and a passion for working with large-scale datasets.

  • Senior Data Engineer

    2 days ago

    Karachi, Sindh, Pakistan BlueBerry Tech inc Full time

    As a Senior DevOps Engineer, you will lead the development of internal tools, shape work environments, and seamlessly integrate IT operations. Your focus on managing CI/CD pipelines ensures reliable software delivery while collaborative efforts tackle technical challenges and optimize system performance. This role requires a strong understanding of...

  • Senior Data Engineer Lead

    2 weeks ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Senior Data Engineer PositionThis Senior Data Engineer role involves creating and maintaining efficient, scalable data systems and pipelines that drive business growth through informed decision-making.Main Responsibilities:Data System Development: Design and develop scalable data ingestion and processing systems using Apache NiFi and Apache Spark.Distributed...

  • Senior Data Engineer Position

    2 weeks ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    This job offers a unique opportunity to work with a dynamic team of engineers and analysts to build cutting-edge data solutions. As a Senior Data Professional, you will play a key role in shaping our company's data architecture strategy, designing and implementing scalable data architectures, and ensuring data quality, reliability, and accessibility across...

  • Data Engineering Expert

    2 weeks ago

    Karachi, Sindh, Pakistan beBee Careers Full time

    Data Engineering Expert WantedAs a Senior Big Data Engineer, you will design and develop complex ETL jobs and pipelines using cutting-edge technologies like Hadoop, Spark, and Kafka.

  • Senior Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan metroConnections, Inc. Full time

    The incumbent will be responsible for designing, building, and optimizing scalable data analytics systems and pipelines, impacting the efficiency, reliability, and performance of data-driven solutions to enable high-quality insights and informed decision-making across the organization.RESPONSIBILITIESDesign and implement scalable data ingestion and...

  • Data Engineer

    3 weeks ago

    Karachi, Sindh, Pakistan Office Field Full time

    Job Title: Data EngineerOffice Field is looking for a Data Engineer to join our growing team. Get AI-powered advice on this job and access more exclusive features.Responsibilities:Create and maintain optimal data pipeline architecture.Assemble large, complex data sets that meet business requirements.Evaluate data flows and prepare ETL processing based on...

  • Data Engineer

    6 days ago

    Karachi, Sindh, Pakistan 1 Sol Digital Services (SMC) Pvt Ltd. Full time

    20 hours ago Be among the first 25 applicantsCompany: 1Sol Digital Services (SMC-Pvt) LtdExperience: 3–5 yearsOpen Positions: 3–5Salary Range: PKR 100,000 to 350,000 or above (based on experience and skillset)Note: This is a full-time, on-site role based in Karachi (Shahrah-e-Faisal) . Candidates from outside Karachi are welcome to apply if they are...

  • Spreadsheet, VBA, Apps Script Developer and Designer

    2 weeks ago

    Karachi, Sindh, Pakistan Data Ikseer Full time

    Spreadsheet, VBA, Apps Script Developer and DesignerThis role focuses on using advanced tools in Excel, Google Sheets, and Power BI to create automated workflows, clean data, and deliver insightful dashboards. Success involves developing user-friendly systems that enhance productivity and support data-driven decisions, aligning with organizational...

  • Senior Data Scientist

    2 weeks ago

    Karachi, Sindh, Pakistan Lumida Wealth Full time

    Get AI-powered advice on this job and more exclusive features.We are looking for a skilled Senior Data Scientist and leader to join our rapidly growing startup, Lumida Wealth, based in New York City.About the Role:This role focuses on asset classes including equities, digital assets, and macro. You will work closely with our CIO and engineering team to build...