Data Pipeline Developer

2 weeks ago


Lahore, Punjab, Pakistan beBee Careers Full time

The ideal candidate will be an experienced IT Operations Expert with expertise in DevOps practices, containerization, data pipeline development, and troubleshooting intricate data workflows. They will work closely with the IT operations team to ensure smooth functioning of data workflows and provide support for our cloud-based infrastructure.

Key Responsibilities:
  • Provide DevOps support with a focus on GCP infrastructure, ensuring seamless integration of services.
  • Collaborate with the data engineering team to design, implement, and maintain scalable data pipelines.
  • Debug and optimize SQL queries and scripts, as well as manage databases (Redshift, PostgreSQL, MS SQL).
  • Work with Kubernetes for container orchestration and resource management, and utilize Docker and Argo for workflow orchestration.
  • Support users by ensuring efficient data access and integration using Tableau.
Requirements:
  • 4-5 years of experience in DevOps and data engineering roles.
  • Strong experience with GCP infrastructure, including cloud networking, IAM, and compute resources.
  • Proficiency in Python scripting, automation, and debugging.
  • Familiarity with multiple database engines for SQL query optimization.
  • Hands-on experience with Kubernetes clusters and containerized workloads.
Benefits:
  • Opportunities for Professional Growth and Development
  • Competitive Salary and Benefits Package
  • Paid Time Off
  • Semi-Annual Performance Bonus and Awards


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Key Responsibilities:Design, develop, and deploy machine learning models using Databricks and Apache SparkImplement data preprocessing, feature engineering, and training pipelinesOur ideal candidate has a strong analytical mindset, excellent communication skills, and the ability to thrive in a fast-paced environment.


  • Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a skilled Data Engineer to join our team and contribute to the design, development, and maintenance of large-scale data pipelines.The ideal candidate will have hands-on experience with AWS Redshift, AWS Data Lake, and Snowflake, as well as strong SQL skills and understanding of database concepts.This role involves working closely with data...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Azure Data Engineers lead the design, implementation, and optimization of data ingestion pipelines.Main Responsibilities:Designing and implementing data ingestion pipelines.Developing analytics solutions using cloud and on-premises technologies.Maintaining operational, security, and compliance standards.Providing technical support for issue resolution during...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a skilled Data Engineer to design, build, and maintain robust and scalable data pipelines. The ideal candidate will play a critical role in developing systems that process and analyze data efficiently, enabling data-driven decision-making across the organization.Key Responsibilities:Develop ETL pipelines to ingest, transform, and load large...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Data Pipeline Expert PositionWe are seeking a highly skilled Data Pipeline Expert to join our team. As a key member of the data engineering team, you will be responsible for designing, developing, and implementing data pipelines using AWS services such as Glue, Lambda, Step Functions, Athena, Redshift, or Airflow.Responsibilities:Design and develop efficient...

  • Data Engineer

    1 day ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a highly skilled data engineer to expand and optimize our big data pipelines.Collaborate with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines so that data is shared effectively across various business systems.Build ETL/ELT Ingestion pipelines and analytics solutions using cloud and...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Job SummaryWe are seeking a skilled AWS Data Engineer to join our team. This role involves monitoring, troubleshooting, and optimizing AWS-based data pipelines while ensuring data integrity and pipeline continuity.

  • Data Engineer

    1 day ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking an experienced Data Engineer to join our team. As a key member of the data engineering team, you will be responsible for building and maintaining large-scale data pipelines that support business intelligence and analytics use cases.Requirements3-4 years of experience working as a Data Engineer in a production environment.Hands-on experience...

  • Data Engineer

    20 hours ago


    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking an experienced data engineer to expand and optimize our big data pipelines.The successful candidate will work alongside other engineers and developers on different layers of the infrastructure, requiring a commitment to collaborative problem-solving, sophisticated design, and quality products.Design, prototype, implement, and optimize data...


  • Lahore, Punjab, Pakistan beBee Careers Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have expertise in designing and developing efficient and scalable data pipelines using tools like Airbyte, Airflow, and dbt.The successful candidate will have hands-on experience with data engineering tools and platforms, including Snowflake, Airbyte, Airflow,...