Airflow Engineer

1 day ago

Hyderabad City Taluka, Pakistan beBee Careers Full time

We are seeking a highly skilled Airflow Engineer to join our team. The successful candidate will have expertise in Airflow DAGs, task dependencies, sensors, hooks, and operators, as well as solid understanding of ETL processes, data pipelines, and scheduling optimization.

About the Role

The Airflow Engineer will be responsible for designing, developing, and implementing software utilizing an agile project cycle to deliver value quickly. They will also lead and work with other software engineers on design best practices and conduct code reviews to ensure high-quality deliverables.

Responsibilities
  • Develop and maintain ETL processes, data pipelines, and scheduling optimization to ensure timely and accurate data delivery.
  • Collaborate with cross-functional teams to identify and implement optimal solutions for complex engineering problems.
  • Design and develop software components using containerization technologies such as Docker and orchestration tools like Kubernetes.
  • Integrate Oracle EBS with Airflow, including working with APIs, stored procedures, and direct database access.
Requirements
  • Strong proficiency in Apache Airflow, workflow orchestration, and scheduling.
  • Proficiency in Python for scripting and automation.
  • Hands-on experience in integrating Oracle EBS with Airflow, including working with APIs, stored procedures, and direct database access.
  • Proficiency in containerization technologies such as Docker and orchestration tools like Kubernetes.
  • Expertise in Airflow DAGs, task dependencies, sensors, hooks, and operators.
  • Solid understanding of ETL processes, data pipelines, and scheduling optimization.
  • Strong knowledge of relational databases (PostgreSQL, MySQL, Oracle, etc.) and proficiency in writing efficient SQL queries and stored procedures.
  • Experience working with Containerized deployments (Docker, Kubernetes) for Airflow.
  • Familiarity with Airflow Security configurations, logging, and monitoring.
  • Understanding of CI/CD pipelines for Airflow DAG deployments.
  • Excellent communication skills (verbal and written) and the ability to collaborate effectively with cross-functional teams.
  • 5+ years of professional experience in backend development, preferably in enterprise or high-scale environments.
  • Bachelor's or master's degree in computer science, Engineering, or equivalent practical experience.

  • Airflow Solutions Specialist

    2 weeks ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Key ResponsibilitiesYou will maintain and continuously improve your technical expertise in Airflow and Astronomer's managed Airflow Platform. This includes staying up to date with the latest releases and features while focusing on those that have a greater impact on customers.Responsibilities Include:Working with customers to educate and guide them on...

  • Solutions Engineer for DataOps

    2 weeks ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    About the JobWe are looking for a highly skilled Solutions Engineer to join our team. As a Solutions Engineer, you will be responsible for maintaining and improving technical expertise in Airflow and Astronomer's managed Airflow Platform.Your Key Responsibilities:Staying up to date with the latest releases and features of Airflow and Astronomer's managed...

  • Solutions Engineer

    2 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Data Engineering Solutions SpecialistWe're seeking a highly skilled Data Engineering Solutions Specialist to join our Global Services Delivery Team. In this role, you will be responsible for delivering various use cases where Airflow is implemented across our customers.Our ideal candidate has 3-6 years of experience in data-engineering, working with Apache...

  • Data Engineering Expert

    2 weeks ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    About the RoleAs a Solutions Engineer, you will be part of our Global Services Delivery Team and involved in delivering various use cases where Airflow is implemented across customers. These organizations range from seed-stage startups to Fortune 500 enterprises, all benefiting from your expertise as a Solutions Engineer to implement Apache Airflow in a...

  • Data Engineering Solutions Professional

    2 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Data Engineering Solutions ExpertAre you passionate about data engineering? Do you want to be part of a team that delivers exceptional results? We're looking for a Data Engineering Solutions Expert to join our Global Services Delivery Team.In this role, you will work closely with customers to understand their data engineering needs and provide tailored...

  • Solutions Engineer, Data Engineering

    2 days ago

    Hyderabad City Taluka, Pakistan Astronomer Full time

    Astronomer designed Astro, an industry-leading, orchestration-first DataOps platform for data teams. Powered by Airflow, Astro accelerates building reliable data products that unlock insights, unleash AI value, and drive data-driven applications.We're a globally-distributed and rapidly growing venture-backed team of learners, innovators and collaborators....

  • Data Engineering Solutions Specialist

    2 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Data Engineering Solutions ProfessionalWe're seeking a highly skilled Data Engineering Solutions Professional to join our Global Services Delivery Team. In this role, you will be responsible for delivering various use cases where Airflow is implemented across our customers.Our ideal candidate has 3-6 years of experience in data-engineering, working with...

  • Data Engineering Solutions Expert

    2 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Solutions Engineer - Data EngineeringAstronomer's industry-leading, orchestration-first DataOps platform empowers data teams to build reliable data products. Powered by Airflow, this platform accelerates unlocking insights, unleashing AI value, and driving data-driven applications.We're a globally-distributed team of learners, innovators, and collaborators....

  • Senior Software Engineer

    1 day ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Confiz is seeking a highly skilled Senior Software Engineer to join our team as we intensify the pace of innovation and support future growth through technology solutions.Job SummaryThe Senior Software Engineer will be responsible for supporting mission-critical Integrations between source data with financial SaaS, utilizing expertise in Apache Airflow,...

  • Cloud Data Pipeline Architect

    2 weeks ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Job DescriptionWe are seeking a skilled Solutions Engineer to join our team. As a Solutions Engineer, you will work closely with customers to deliver high-quality Airflow implementations that meet their needs.Your Key Tasks:Maintaining and improving technical expertise in Airflow and Astronomer's managed Airflow Platform.Collaborating with team members to...