Data Engineer

4 days ago

Hyderabad City Taluka, Pakistan beBee Careers Full time
Job Description

We are seeking an experienced Data Engineer to design, develop, and maintain scalable data solutions. This role involves working with distributed data platforms, cloud infrastructure, and modern data engineering tools to enable efficient data processing, storage, and analytics.

Detailed Responsibilities
  • Data Platform Development: Design, develop, and maintain data pipelines and workflows on distributed data platforms such as BigQuery or Hadoop/EMR/DataProc.
  • Cloud Integration: Build and optimize cloud-based solutions using AWS or GCP to process and store large-scale datasets.
  • Workflow Orchestration: Design and manage workflows and data pipelines using Apache Airflow to ensure scalability, reliability, and maintainability.
  • Containerization and Orchestration: Deploy and manage containerized applications using Kubernetes for efficient scalability and resource management.
  • Event Streaming: Work with Kafka to implement reliable and scalable event streaming systems for real-time data processing.
  • Programming and Automation: Write clean, efficient, and maintainable code in Python and SQL to automate data processing, transformation, and analytics tasks.
  • Database Management: Design and optimize relational and non-relational databases to support high-performance querying and analytics.
  • System Monitoring & Troubleshooting: Participate in the on-call rotation to monitor systems, address incidents, and ensure the reliability of production environments.
  • Collaboration: Work closely with cross-functional teams, including data scientists, analysts, and product managers, to understand data requirements and deliver solutions that meet business objectives.
Key Requirements
  • Primary Technologies: Big Query, Hadoop/EMR/DataProc, SnowFlake, Teradata, AWS, GCP, Kubernetes, Kafka, Python, SQL.
  • Bachelor's degree in computer science, Engineering, or a related field (or equivalent work experience).
  • 3+ years of experience in data engineering or related roles.
  • Familiarity with CI/CD pipelines for automated deployments.
  • Knowledge of data governance, security, and compliance best practices.
  • Experience with DevOps practices and tools.
What We Offer
  • A global team of talented individuals working on innovative projects.
  • An opportunity to contribute to the success of the company and personal growth.
  • A dynamic work environment that encourages collaboration and learning.

  • Data Engineering Lead

    4 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Data Engineering LeadWe are seeking an experienced data engineering leader to join our team. As a Sr Manager-Analytics Engineering, you will play a pivotal role in driving the data and analytics strategy across various streaming and Studio data domains.Responsibilities:Lead and mentor a team of analytics engineers.Design, review, and develop analytical...

  • AWS Data Engineer

    7 days ago

    Hyderabad City Taluka, Pakistan GSPANN Technologies, Inc Full time

    Data Engineer, Redshift, Snowflake, SQL, Python, PySparkDescriptionGSPANN is hiring a skilled Data Engineer to design and maintain a robust data platform. You'll build scalable data pipelines, integrate multiple data sources, and collaborate with teams to deliver effective data solutions. Proficiency in SQL, Python, AWS data pipelines, and experience in the...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad City Taluka, Pakistan Backbase Full time

    The Job in shortWe are seeking a Senior Data Engineer to lead the design, development, and maintenance of our Data as a Service (DaaS) platform on Azure. Your expertise in data engineering will enable our clients to perform big data analytics, machine learning, and AI workloads on data ingested from multiple sources, ensuring high security and compliance....

  • Senior Data Engineer

    4 weeks ago

    Hyderabad City Taluka, Pakistan Warner Bros. Discovery, Inc. Full time

    Welcome to Warner Bros. Discovery… the stuff dreams are made of.Who We Are…When we say, "the stuff dreams are made of," we're not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD's vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life,...

  • Senior Software Engineer

    4 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Data Engineering ExpertiseAs a Staff Software Engineer on our Tools and Frameworks team, you will be responsible for leveraging your expertise in data engineering to help us develop tools that streamline engineering processes and empower developers to build better applications and experiences faster. You'll have the opportunity to shape the future of our...

  • Senior Data Systems Engineer

    4 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Job Title: Senior Data EngineerAbout the ExperienceWe are seeking a highly skilled Senior Data Engineer to join our team. With over 10 years of experience in software development, and with data structures/algorithms, you will be responsible for designing and building data models, integrating data from many sources, building ETL and data-flow pipelines, and...

  • Data Platform Solutions Engineer

    3 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Cloud Data Engineering RoleWe are seeking a highly skilled Cloud Data Engineer to join our team. As a Senior Data Platform Engineer, you will be responsible for designing and implementing data platforms that meet the needs of our business. This includes working with data scientists, analysts, and engineers to identify requirements and deliver high-quality...

  • Data Engineer Specialist

    4 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    About the RoleThis is an exciting opportunity for a skilled Data Engineer to join our fast-paced team. As a key member of the team, you will be responsible for designing and developing the data platform to meet the needs of the business.Responsibilities:Develop and maintain data integrations, including direct digital marketing, social channels, etc.Work...

  • Senior Data Engineering Specialist

    4 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    As a Senior Big Data Engineer, you will be responsible for designing, developing, creating, modifying, and validating embedded and cloud edge software, applications, and/or specialized utility programs.">You will collaborate with systems, hardware, architecture, test engineers, and other teams to design system-level software solutions and obtain information...

  • Senior Data Engineer

    4 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Senior Engineer, Data ArchitectWe're seeking a skilled Senior Software Engineer to join our team as a key contributor in shaping the future of real-time data technology. As a member of our collaborative team, you'll be empowered to own projects end-to-end and drive growth through innovation.The role involves working on small, agile teams to develop systems...