Data Pipeline Specialist

1 day ago


Hyderabad City Taluka, Pakistan beBee Careers Full time

About the Role:

">

In this role, you will be responsible for designing, developing, and maintaining scalable data pipelines on Google Cloud Platform (GCP). You will work closely with cross-functional teams to ensure that data pipelines are designed, developed, and delivered on time, within budget, and to the required quality standards.

Key Responsibilities:

">
  1. Data Pipeline Development: Design and develop scalable data pipelines on GCP to process large-scale data sets.
  2. ETL Process Management: Build and maintain ETL processes for data ingestion, transformation, and loading into data warehouses.
  3. Data Orchestration: Ensure the reliability and performance of data pipelines by implementing Apache Airflow for orchestration.
  4. Collaboration: Collaborate with stakeholders to gather and translate requirements into technical solutions.
  5. Scripting and Application Development: Develop scripts and applications in Python and PySpark to handle large-scale data processing tasks.
  6. Deployment and Management: Use GitHub, Jenkins, Terraform, and Ansible to deploy and manage code in production.
  7. Troubleshooting: Troubleshoot and resolve issues related to data pipelines, ensuring high availability and scalability.


  • Hyderabad City Taluka, Pakistan beBee Careers Full time

    This role requires a deep understanding of concepts such as dimensions, facts and slowly changing dimensions (SCDs) in data warehousing projects. The ideal candidate will have experience with developing scripts and applications in Python and PySpark to handle large-scale data processing tasks.Key Skills and Qualifications:Strong knowledge of data warehousing...


  • Hyderabad City Taluka, Pakistan beBee Careers Full time

    We are looking for a skilled Senior Software Engineer to join our team and contribute to the design and development of scalable data pipelines on Google Cloud Platform (GCP).Key Skills and Qualifications:Experience working with GCP services, including Dataproc, BigQuery, Dataflow, Cloud Storage, and Pub/Sub.Strong understanding of data warehousing concepts,...


  • Hyderabad City Taluka, Pakistan beBee Careers Full time

    Senior Data Visualization SpecialistWe are seeking an experienced professional to join our team in the role of Senior Data Visualization Specialist. This position requires a strong background in data visualization, with expertise in developing and maintaining complex data models, frontend, and business intelligence reports.The ideal candidate will have...


  • Hyderabad City Taluka, Pakistan beBee Careers Full time

    As a Senior Software Engineer, you will be responsible for designing and developing scalable data pipelines on Google Cloud Platform (GCP). This includes optimizing and automating data workflows using various tools and technologies, such as Dataproc, BigQuery, Dataflow, Cloud Storage, and Pub/Sub.You will also be responsible for building and maintaining ETL...


  • Hyderabad City Taluka, Pakistan beBee Careers Full time

    About the RoleThe Quality Assurance Specialist - Data Engineering will be responsible for ensuring the highest level of data quality and integrity throughout our organization.Key Responsibilities:Data validation and testing: Conduct data validation and testing to ensure accuracy and integrity of data.SQL and database knowledge: Apply proficiency in SQL to...


  • Hyderabad City Taluka, Pakistan beBee Careers Full time

    About Our Ideal CandidateWe are seeking a highly skilled Principal Data Engineer to join our team and lead the development of our data management systems. As a key member of our Engineering Team, you will be responsible for designing, building, and maintaining large-scale data infrastructure that meets the needs of our business.ResponsibilitiesDesign and...


  • Hyderabad City Taluka, Pakistan beBee Careers Full time

    We are seeking a highly skilled professional to fill the role of Senior Software Engineer. This position involves designing, developing and maintaining scalable data pipelines on Google Cloud Platform (GCP). The ideal candidate will have experience with optimizing and automating data workflows using various tools and technologies.Key Responsibilities:Design...

  • Senior Data Engineer

    21 hours ago


    Hyderabad City Taluka, Pakistan beBee Careers Full time

    We are seeking a highly skilled and experienced professional to fill the role of Senior Software Engineer. This position requires strong technical expertise in designing, developing, and maintaining scalable data pipelines on Google Cloud Platform (GCP).Responsibilities:Design and develop scalable data pipelines using GCP services.Optimize and automate data...


  • Hyderabad City Taluka, Pakistan beBee Careers Full time

    About the Role:">As a Senior Software Engineer, you will play a critical role in designing, developing, and maintaining scalable data pipelines on Google Cloud Platform (GCP). You will be responsible for optimizing and automating data workflows using Dataproc, BigQuery, Dataflow, Cloud Storage, and Pub/Sub. Additionally, you will build and maintain ETL...

  • Cloud Data Architect

    21 hours ago


    Hyderabad City Taluka, Pakistan beBee Careers Full time

    We are searching for a highly motivated and technically proficient software engineer to join our team and take on the challenge of designing, developing, and maintaining scalable data pipelines on Google Cloud Platform (GCP).Main Responsibilities:Design and develop robust data pipelines that can scale to meet the needs of our organization.Collaborate with...