Data Pipeline Developer

6 days ago


Lahore, Punjab, Pakistan beBee Careers Full time

Data Pipeline Developer - DevOps Expert

">

We are looking for a talented Data Pipeline Developer to join our team and develop, maintain, and optimize data pipelines for high-performance processing. The ideal candidate will possess expertise in DevOps practices, containerization, data pipeline development, and troubleshooting intricate data workflows.

Key Responsibilities:
  • Develop and maintain data pipelines using GCP infrastructure.
  • Optimize SQL queries and Python or R-based scripts for high-performance processing.
  • Manage and maintain databases (Redshift, PostgreSQL, MS SQL).
  • Work with Kubernetes (K8s) for container orchestration and resource management.
  • Utilize Docker and Argo for containerization and workflow orchestration.
  • Support Tableau users by ensuring efficient data access and integration.
  • Troubleshoot and optimize ETL processes, including Pentaho/Carte workflows.
  • Debug and enhance Java-based components when required.
Required Skills:
  • 4-5 years of experience in DevOps and data engineering roles.
  • Strong experience with GCP infrastructure, including cloud networking, IAM, and compute resources.
  • Proficiency in Python for scripting, automation, and debugging.
  • Hands-on experience with SQL query optimization across multiple database engines.
  • Experience managing Kubernetes clusters and containerized workloads.
  • Strong understanding of Docker and Argo Workflows.
  • Familiarity with Tableau for data visualization and reporting.
  • Experience with Pentaho/Carte for ETL process debugging.
  • Basic Java knowledge for troubleshooting integrations.
Bonus Skills:
  • Experience with AWS services related to data processing and orchestration.
  • Familiarity with additional BI tools and ETL platforms.
  • Experience working in hybrid cloud environments.
Benefits:
  • Provident Fund and Medical Allowances
  • Professional Training and Certifications
  • Paid Time Off
  • Semi-Annual Performance Bonus and Awards


  • Lahore, Punjab, Pakistan beBee Careers Full time

    This is an excellent opportunity for someone passionate about data engineering and eager to grow with cutting-edge technologies.As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines.You will work closely with data scientists, analysts, and stakeholders to ensure data quality and availability.Key...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a skilled professional to design, build, and optimize scalable data pipelines that power machine learning models and AI-driven applications. You will work closely with data scientists, analysts, and software engineers to ensure efficient data ingestion, transformation, and storage—enabling real-time analytics and AI solutions.Key...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Data Pipeline Optimization ExpertThis role involves collaborating with Big Data Solution Architects to design, build, and maintain scalable data pipelines that meet business needs. The successful candidate will possess strong problem-solving skills, proficiency in Python and SQL, and experience with distributed systems such as Microsoft Fabric, Databricks,...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    We're seeking an experienced data engineer to expand and optimize our big data pipelines. You will work alongside other engineers and developers on various layers of the data warehouse.The ideal candidate has a strong commitment to collaborative problem solving, sophisticated design, and quality products.

  • Senior Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    We need a talented Data Engineer to help us drive business growth through data-driven insights.About the RoleIn this role, you will be responsible for designing and implementing data pipelines that meet the needs of our business. This includes developing automations and workflows to streamline data processing and integration, as well as collaborating with...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Job Summary">We are seeking a highly motivated and responsible data engineer to join our dynamic team. This role requires hands-on experience in building scalable data pipelines, managing structured and unstructured databases, and supporting end-to-end data operations.">Key Responsibilities">">Design, develop, and manage reliable and scalable data...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Data Engineer RoleThis role involves designing, building, and maintaining efficient and scalable data pipelines using various tools and technologies.The ideal candidate will work closely with cross-functional teams to set up and maintain data infrastructure that supports both engineering and analytical needs.Key responsibilities include:Designing and...

  • AWS Data Engineer

    6 days ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    Job Overview:We are seeking a skilled professional to monitor, troubleshoot, and optimize AWS-based data pipelines. This role involves ensuring data integrity and pipeline continuity while working with various AWS services.

  • Data Engineer

    1 day ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking an experienced Data Engineer with a strong background in SQL and PySpark development to join our team.This is a key role that involves designing and managing data pipelines using Azure Synapse Analytics, Delta Lake, and SQL environments.The ideal candidate will have:Extensive experience with SQL, including query writing and troubleshooting in...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Data Pipeline Support SpecialistThe successful candidate will work closely with cross-functional teams to resolve complex issues related to data processing and ETL development. Hands-on experience with AWS services such as Glue, Lambda, Step Functions, Athena, Redshift, or Airflow is required.Responsibilities include monitoring data pipelines,...