Data Pipeline Expert

13 hours ago


Lahore, Punjab, Pakistan beBee Careers Full time

Senior Data Engineer

  • We are seeking a seasoned data engineer to expand and optimize our large-scale data pipelines. You will collaborate with other engineers and developers on various aspects of the data warehouse.

Responsibilities:
  1. Collaborate with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines for seamless data sharing across business systems.
  2. Create and maintain ETL/ELT Ingestion pipelines and analytics solutions using cloud technologies.
  3. E nsure that the design, code, and procedural aspects of solutions meet production-ready standards, adhering to operational, security, and compliance requirements.
  4. Participate in daily project and production delivery meetings, providing technical support for prompt issue resolution.
  5. Work closely with stakeholders to understand their needs.
Qualifications:
  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field (or equivalent work experience).
  • At least 3 years of experience in data engineering and data warehousing, focusing on building large-scale data pipelines.
  • 2+ years' experience with Big Data Distributed systems such as Microsoft Fabric, Databricks, AWS EMR.
  • Strong expertise in developing data pipelines using PySpark and ETL tools like ADF, Talend.
  • Proficiency in Python & SQL.
  • Strong problem-solving and critical thinking skills.
  • Experience in writing effective unit and integration tests for ingestion pipelines.
  • Working knowledge of CI/CD pipelines for deployments.
  • Experience with version control systems like Git.
  • Knowledge of security best practices, including encryption of sensitive data, encryption at rest, and encryption in transit.

We have a diverse team of over 700 individuals working on innovative projects. Our customer base includes leading retail and CPG companies, fast-growth fintech, and multiple startups.

We prioritize processes and culture. We foster a collaborative environment and strive to make the workplace enjoyable.

Candidates who join us engage with cutting-edge technologies while contributing to their growth and success.



  • Lahore, Punjab, Pakistan beBee Careers Full time

    Data Pipeline Optimization ExpertThis role involves collaborating with Big Data Solution Architects to design, build, and maintain scalable data pipelines that meet business needs. The successful candidate will possess strong problem-solving skills, proficiency in Python and SQL, and experience with distributed systems such as Microsoft Fabric, Databricks,...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Data Pipeline Developer - DevOps Expert">We are looking for a talented Data Pipeline Developer to join our team and develop, maintain, and optimize data pipelines for high-performance processing. The ideal candidate will possess expertise in DevOps practices, containerization, data pipeline development, and troubleshooting intricate data workflows.Key...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Cloud Engineering SpecialistWe are seeking an experienced Cloud Engineering Specialist to provide support for DevOps and data engineering tasks within our cloud-based infrastructure. The ideal candidate will possess expertise in cloud practices, containerization, data pipeline development, and troubleshooting intricate data workflows.About the Role:Provide...

  • Data Engineer

    7 days ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking an experienced Data Engineer with a strong background in SQL and PySpark development to join our team.This is a key role that involves designing and managing data pipelines using Azure Synapse Analytics, Delta Lake, and SQL environments.The ideal candidate will have:Extensive experience with SQL, including query writing and troubleshooting in...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Data Pipeline Support SpecialistThe successful candidate will work closely with cross-functional teams to resolve complex issues related to data processing and ETL development. Hands-on experience with AWS services such as Glue, Lambda, Step Functions, Athena, Redshift, or Airflow is required.Responsibilities include monitoring data pipelines,...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a skilled professional to design, build, and optimize scalable data pipelines that power machine learning models and AI-driven applications. You will work closely with data scientists, analysts, and software engineers to ensure efficient data ingestion, transformation, and storage—enabling real-time analytics and AI solutions.Key...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    We're seeking an experienced data engineer to expand and optimize our big data pipelines. You will work alongside other engineers and developers on various layers of the data warehouse.The ideal candidate has a strong commitment to collaborative problem solving, sophisticated design, and quality products.


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Job Summary">We are seeking a highly motivated and responsible data engineer to join our dynamic team. This role requires hands-on experience in building scalable data pipelines, managing structured and unstructured databases, and supporting end-to-end data operations.">Key Responsibilities">">Design, develop, and manage reliable and scalable data...

  • AWS Data Engineer

    2 weeks ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    Job Overview:We are seeking a skilled professional to monitor, troubleshoot, and optimize AWS-based data pipelines. This role involves ensuring data integrity and pipeline continuity while working with various AWS services.

  • Senior Data Engineer

    19 hours ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    Job Title: Data Pipeline EngineerWe are seeking a highly skilled and motivated data pipeline engineer to join our dynamic team.This role involves designing, developing, and maintaining scalable data pipelines using Python and SQL. The ideal candidate will have hands-on experience with ETL processes, data warehousing concepts, and cloud-based data services...