Senior Data Engineer

1 week ago


Hyderabad City Taluka, Pakistan Backbase Full time

The Job in short

We are seeking a Senior Data Engineer to lead the design, development, and maintenance of our Data as a Service (DaaS) platform on Azure. Your expertise in data engineering will enable our clients to perform big data analytics, machine learning, and AI workloads on data ingested from multiple sources, ensuring high security and compliance. The ideal candidate will have a strong background in data engineering, cloud data platforms, ETL processes, and data governance. This role requires deep expertise in Azure Synapse, Spark, Databricks, and Delta Lake, along with a solid understanding of data regulations and compliance.

Meet the job

  1. Data Platform Architecture & Implementation: Design, implement, and maintain secure and scalable data infrastructure in Azure.
  2. Data Pipelines & ETL Processing: Develop and manage data pipelines for extracting, transforming, and loading (ETL) data from various sources into the Data Lakehouse using Azure Data Factory and Databricks.
  3. Data Governance & Compliance: Ensure data consistency, quality, and governance, adhering to regulatory and compliance requirements.
  4. Data Security & Compliance: Secure data platforms and ensure compliance with security frameworks (e.g., NIST, CIS, ISO 27001).
  5. Big Data Processing: Implement and optimize big data processing solutions using Azure Synapse, Spark, and Databricks.
  6. Data Lakehouse Management: Manage the Data Lakehouse environment, including Delta Lake, to support data analytics and machine learning workloads.
  7. Streaming Data Processing: Develop and maintain secure streaming data pipelines using Azure Event Hubs and other streaming endpoints.
  8. Data Sharing & Integration: Implement secure data sharing within and outside the organization using Delta Sharing.
  9. Data Analytics & Visualization: Enable data scientists and analysts by providing high-quality data for dashboards, AI/ML applications, and other data consumers.

How about you

Required Qualifications:

  1. 5+ years of experience in data engineering, preferably in Azure Synapse, Spark, or Databricks.
  2. Strong hands-on experience in data pipeline development and ETL processes.
  3. Expertise in Data Lakehouse concepts and Delta Lake.
  4. Deep understanding of data domains, regulations, and compliance requirements.
  5. Experience in data governance and ensuring data quality.
  6. Strong scripting and automation skills (Python, PowerShell).
  7. Solid understanding of cloud data platforms and services in Azure.

Preferred Qualifications:

  1. Azure data certifications (e.g., DP-200, DP-201).
  2. Knowledge of secure data practices and compliance standards (e.g., NIST, CIS, ISO 27001).

Why Join Us?

  1. Work with cutting-edge Azure data technologies.
  2. Influence and drive data engineering best practices in a fast-paced, cloud-first environment.
  3. Opportunity for continuous learning and professional development.
  4. Competitive salary, benefits, and flexible work arrangements.

How to Apply: If you are passionate about data engineering, data security, and automation, we encourage you to apply Submit your resume and a cover letter detailing your relevant experience.

#J-18808-Ljbffr

  • Hyderabad City Taluka, Pakistan Warner Bros. Discovery, Inc. Full time

    About the RoleAs a Senior Analytics Engineer at Warner Bros. Discovery, you will be responsible for leading data pipeline and data strategy efforts for the Data & Analytics organization at Max.You will design and implement data models that support flexible querying and data visualization, partner with product stakeholders to understand business questions and...


  • Hyderabad City Taluka, Pakistan Warner Bros. Discovery, Inc. Full time

    Job DescriptionWe are looking for a Senior Manager, Analytics Engineering to join our team at Warner Bros. Discovery, Inc. The ideal candidate will have a strong background in data engineering, experience in leading high-performing teams, and excellent analytical and communication skills.The successful candidate will be responsible for designing, reviewing,...

  • Senior Data Engineer

    2 weeks ago


    Hyderabad City Taluka, Pakistan Warner Bros. Discovery, Inc. Full time

    Welcome to Warner Bros. Discovery… the stuff dreams are made of.Who We Are…When we say, "the stuff dreams are made of," we're not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD's vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life,...


  • Hyderabad City Taluka, Pakistan Warner Bros. Discovery, Inc. Full time

    Company OverviewWarner Bros. Discovery is a premier global media and entertainment company that offers audiences the world's most differentiated and complete portfolio of content, brands, and franchises across television, film, streaming, and gaming.The company combines Warner Media's premium entertainment, sports, and news assets with Discovery's leading...


  • Hyderabad City Taluka, Pakistan Warner Bros. Discovery, Inc. Full time

    About the RoleWarner Bros. Discovery, Inc. is seeking a highly experienced Senior Manager, Analytics Engineering to lead our team of data engineers in developing innovative data solutions that drive business growth.The ideal candidate will have extensive experience in engineering management, leading high-performing teams to deliver state-of-the-art analytics...


  • Hyderabad City Taluka, Pakistan Softobiz Full time

    At Softobiz Technologies Pvt. Ltd., we are seeking a highly skilled Senior Engineer with expertise in Elastic tools and certifications in either Elastic Certified Engineer or Elastic Certified Observability Engineer.About the RoleWe require an individual with strong background in data modelling, querying, and data extraction.Proficiency in bulk document...


  • Hyderabad City Taluka, Pakistan SingleStore Full time

    Senior Software Engineer, Engine (Data Ingestion) -Position OverviewSingleStore Software Engineers are at the forefront of real-time technology that's revolutionizing how companies run their businesses every day. With release cycles throughout the year, our engineers are accustomed to moving quickly in a rapid production environment. To do this successfully,...


  • Hyderabad City Taluka, Pakistan techcarrot Full time

    About TechcarrotTechcarrot is a leading technology company dedicated to empowering businesses through innovative data solutions. Our team of experts works tirelessly to deliver cutting-edge data insights that drive informed decision-making and fuel growth.We are passionate about harnessing the power of data to unlock new opportunities and create lasting...


  • Hyderabad City Taluka, Pakistan Warner Bros. Discovery, Inc. Full time

    Role OverviewAs a Senior Manager, Analytics Engineering, you will play a pivotal role in driving the data and analytics strategy across various streaming and Studio data domains, including commerce, product, and content analytics. You will lead a team of highly skilled data and analytics engineers to build and maintain state-of-the-art analytics...


  • Hyderabad City Taluka, Pakistan HSBC Full time

    Some careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC, and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest banking and...


  • Hyderabad City Taluka, Pakistan HSBC Full time

    Some careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest banking and...


  • Hyderabad City Taluka, Pakistan Astronomer Full time

    Astronomer designed Astro, an industry-leading, orchestration-first DataOps platform for data teams. Powered by Airflow, Astro accelerates building reliable data products that unlock insights, unleash AI value, and drive data-driven applications.We're a globally-distributed and rapidly growing venture-backed team of learners, innovators, and collaborators....


  • Hyderabad City Taluka, Pakistan Softobiz Full time

    We seek a talented Senior Engineer with expertise in Elastic tools and certifications in either Elastic Certified Engineer or Elastic Certified Observability Engineer to join our team at Softobiz Technologies Pvt. Ltd.ResponsibilitiesData Modelling: Design and implement effective data models using log aggregation tools.Bulk Document Indexing: Develop and...

  • Staff data Engineer

    7 days ago


    Hyderabad City Taluka, Pakistan Warner Bros. Discovery, Inc. Full time

    Welcome to Warner Bros. Discovery… the stuff dreams are made of.Who We Are…When we say, "the stuff dreams are made of," we're not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD's vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life,...


  • Hyderabad City Taluka, Pakistan DigitalOcean LLC Full time

    We are seeking a highly motivated Cloud Data Engineering Manager to join our team at DigitalOcean LLC. As a manager, you will lead a team of engineers to design, develop, and maintain cloud-based data engineering solutions that support our organization's strategic goals.Key Responsibilities:Team Leadership: Lead a team of engineers to design, develop, and...


  • Hyderabad City Taluka, Pakistan Astronomer Full time

    Astronomer designed Astro, an industry-leading, orchestration-first DataOps platform for data teams. Powered by Airflow, Astro accelerates building reliable data products that unlock insights, unleash AI value, and drive data-driven applications.We're a globally-distributed and rapidly growing venture-backed team of learners, innovators and collaborators....

  • Presales Engineer

    23 hours ago


    Hyderabad City Taluka, Pakistan Astronomer Full time

    We're a remote-first company with a hybrid work model, working at least 3 days per week at our Office in Hyderabad. Our mission is to empower data teams to bring mission-critical analytics, AI, and software to life. As a Presales Engineer at Astronomer, you'll be a key partner to our clients, guiding them in deploying powerful data workflows to accelerate...


  • Hyderabad City Taluka, Pakistan techcarrot Full time

    Data EngineerAs a Data Engineer in our team, you will be responsible for assessing complex new data sources and quickly turning these into business insights. You also will support the implementation and integration of these new data sources into our Azure Data platform.Responsibilities:You are detailed reviewing and analyzing structured, semi-structured and...

  • Technical Consultant

    23 hours ago


    Hyderabad City Taluka, Pakistan Astronomer Full time

    Astronomer values diversity and is an equal opportunity employer. We don't discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. Our team is a remote-first company with a hybrid work model, working at least 3 days per week at our Office in Hyderabad.About this...


  • Hyderabad City Taluka, Pakistan Warner Bros. Discovery, Inc. Full time

    Warner Bros. Discovery is committed to fostering an inclusive and diverse work environment that values creativity, collaboration, and continuous learning.We are seeking a highly skilled Data Science Expert to join our team of experts in driving business decisions through data-driven insights.The successful candidate will be responsible for designing,...