
Senior Data Engineer
20 hours ago
About the Role:
">As a Senior Software Engineer, you will play a critical role in designing, developing, and maintaining scalable data pipelines on Google Cloud Platform (GCP). You will be responsible for optimizing and automating data workflows using Dataproc, BigQuery, Dataflow, Cloud Storage, and Pub/Sub. Additionally, you will build and maintain ETL processes for data ingestion, transformation, and loading into data warehouses.
Key Responsibilities:
">- Data Pipeline Development: Design and develop scalable data pipelines on GCP to process large-scale data sets.
- Workflow Automation: Optimize and automate data workflows using Dataproc, BigQuery, Dataflow, Cloud Storage, and Pub/Sub.
- ETL Process Management: Build and maintain ETL processes for data ingestion, transformation, and loading into data warehouses.
- Data Orchestration: Ensure the reliability and performance of data pipelines by implementing Apache Airflow for orchestration.
- Collaboration: Collaborate with stakeholders to gather and translate requirements into technical solutions.
- Data Warehousing: Work on multiple data warehousing projects, applying a thorough understanding of concepts such as dimensions, facts, and slowly changing dimensions (SCDs).
- Scripting and Application Development: Develop scripts and applications in Python and PySpark to handle large-scale data processing tasks.
- SQL Query Optimization: Write optimized SQL queries for data analysis and transformations.
- Deployment and Management: Use GitHub, Jenkins, Terraform, and Ansible to deploy and manage code in production.
- Troubleshooting: Troubleshoot and resolve issues related to data pipelines, ensuring high availability and scalability.
-
Senior Data Architect
2 weeks ago
Hyderabad City Taluka, Pakistan beBee Careers Full timeJob SummaryWe are seeking a highly skilled Senior Data Architect to lead the engineering and development of complex data management systems. The ideal candidate will have expertise in data modeling, architecture, and governance.
-
Senior Data Engineer
20 hours ago
Hyderabad City Taluka, Pakistan beBee Careers Full timeData Engineer RoleAs a Senior Data Engineer, you will play a crucial role in designing and developing the data platform to efficiently address various data needs across the business. Your primary responsibilities will include building software across our entire cutting-edge data platform, including event-driven and batch data processing, storage, and serving...
-
Senior Data Engineering Manager
23 hours ago
Hyderabad City Taluka, Pakistan beBee Careers Full timeSenior Manager, Data EngineeringAbout the RoleWe are seeking a Senior Manager of Business Intelligence & Data Engineering to lead and develop a high-performing team of engineers. This role will be broad and multi-tiered, covering all aspects of the Business Intelligence (BI) ecosystem.Key ResponsibilitiesLead the design and development of scalable,...
-
Senior Data Quality Engineer
22 hours ago
Hyderabad City Taluka, Pakistan beBee Careers Full timeAs a Senior Data Validation Engineer, you will play a key role in driving the development of our data validation strategy. You will work closely with cross-functional teams to design and implement data validation frameworks that ensure the quality and accuracy of our data.This is a highly collaborative role that requires strong communication and...
-
Senior Data Engineer
23 hours ago
Hyderabad City Taluka, Pakistan beBee Careers Full timeWe are seeking a highly skilled professional to fill the role of Senior Software Engineer. This position involves designing, developing and maintaining scalable data pipelines on Google Cloud Platform (GCP). The ideal candidate will have experience with optimizing and automating data workflows using various tools and technologies.Key Responsibilities:Design...
-
Senior Data Engineer
3 weeks ago
Hyderabad City Taluka, Pakistan FANATICS INC Full timeJob Overview:We are looking for a Senior Data Engineer with a deep understanding of Apache Spark (Scala & PySpark), Kafka Streams (Java), AWS services, Snowflake, Apache Iceberg, Tableau, and Data Lake architectures. As a senior member of our team, you will be responsible for leading the design, implementation, and optimization of large-scale data systems,...
-
Senior Data Engineer
6 days ago
Hyderabad City Taluka, Pakistan Backbase Full timeThe Job in shortWe are seeking a Senior Data Engineer to lead the design, development, and maintenance of our Data as a Service (DaaS) platform on Azure. Your expertise in data engineering will enable our clients to perform big data analytics, machine learning, and AI workloads on data ingested from multiple sources, ensuring high security and compliance....
-
Senior Data Engineer
17 hours ago
Hyderabad City Taluka, Pakistan beBee Careers Full timeWe are seeking a highly skilled and experienced professional to fill the role of Senior Software Engineer. This position requires strong technical expertise in designing, developing, and maintaining scalable data pipelines on Google Cloud Platform (GCP).Responsibilities:Design and develop scalable data pipelines using GCP services.Optimize and automate data...
-
Senior Software Engineer Data
7 days ago
Hyderabad City Taluka, Pakistan beBee Careers Full timeJob DescriptionWe are looking for a talented Senior Software Engineer to join our team. As a key contributor, you will work closely with cross-functional teams to develop tools that help our community of developers save time and energy by streamlining engineering processes.The successful candidate will have a strong understanding of algorithm and data...
-
Senior Data Engineer
7 days ago
Hyderabad City Taluka, Pakistan Warner Bros. Discovery, Inc. Full timeWelcome to Warner Bros. Discovery… the stuff dreams are made of.Who We Are…When we say, "the stuff dreams are made of," we're not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD's vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life,...