Senior Data Engineer

3 weeks ago

Hyderabad City Taluka, Pakistan Backbase Full time

The Job in short

We are seeking a Senior Data Engineer to lead the design, development, and maintenance of our Data as a Service (DaaS) platform on Azure. Your expertise in data engineering will enable our clients to perform big data analytics, machine learning, and AI workloads on data ingested from multiple sources, ensuring high security and compliance. The ideal candidate will have a strong background in data engineering, cloud data platforms, ETL processes, and data governance. This role requires deep expertise in Azure Synapse, Spark, Databricks, and Delta Lake, along with a solid understanding of data regulations and compliance.

Meet the job

  1. Data Platform Architecture & Implementation: Design, implement, and maintain secure and scalable data infrastructure in Azure.
  2. Data Pipelines & ETL Processing: Develop and manage data pipelines for extracting, transforming, and loading (ETL) data from various sources into the Data Lakehouse using Azure Data Factory and Databricks.
  3. Data Governance & Compliance: Ensure data consistency, quality, and governance, adhering to regulatory and compliance requirements.
  4. Data Security & Compliance: Secure data platforms and ensure compliance with security frameworks (e.g., NIST, CIS, ISO 27001).
  5. Big Data Processing: Implement and optimize big data processing solutions using Azure Synapse, Spark, and Databricks.
  6. Data Lakehouse Management: Manage the Data Lakehouse environment, including Delta Lake, to support data analytics and machine learning workloads.
  7. Streaming Data Processing: Develop and maintain secure streaming data pipelines using Azure Event Hubs and other streaming endpoints.
  8. Data Sharing & Integration: Implement secure data sharing within and outside the organization using Delta Sharing.
  9. Data Analytics & Visualization: Enable data scientists and analysts by providing high-quality data for dashboards, AI/ML applications, and other data consumers.

How about you

Required Qualifications:

  1. 5+ years of experience in data engineering, preferably in Azure Synapse, Spark, or Databricks.
  2. Strong hands-on experience in data pipeline development and ETL processes.
  3. Expertise in Data Lakehouse concepts and Delta Lake.
  4. Deep understanding of data domains, regulations, and compliance requirements.
  5. Experience in data governance and ensuring data quality.
  6. Strong scripting and automation skills (Python, PowerShell).
  7. Solid understanding of cloud data platforms and services in Azure.

Preferred Qualifications:

  1. Azure data certifications (e.g., DP-200, DP-201).
  2. Knowledge of secure data practices and compliance standards (e.g., NIST, CIS, ISO 27001).

Why Join Us?

  1. Work with cutting-edge Azure data technologies.
  2. Influence and drive data engineering best practices in a fast-paced, cloud-first environment.
  3. Opportunity for continuous learning and professional development.
  4. Competitive salary, benefits, and flexible work arrangements.

How to Apply: If you are passionate about data engineering, data security, and automation, we encourage you to apply Submit your resume and a cover letter detailing your relevant experience.

#J-18808-Ljbffr

  • Senior Data Engineer

    2 weeks ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    We are currently seeking an experienced professional to join our team as a Senior Software Engineer - Senior Consultant Specialist.Responsibilities:Develop and maintain data pipelines using SQL, Python, and/or R.Perform data cleaning and pre-processing to ensure data accuracy and usability.Create compelling and actionable data visualizations and reports for...

  • Senior Data Systems Engineer

    4 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Job Title: Senior Data EngineerAbout the ExperienceWe are seeking a highly skilled Senior Data Engineer to join our team. With over 10 years of experience in software development, and with data structures/algorithms, you will be responsible for designing and building data models, integrating data from many sources, building ETL and data-flow pipelines, and...

  • Senior Data Engineer

    5 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Senior Engineer, Data ArchitectWe're seeking a skilled Senior Software Engineer to join our team as a key contributor in shaping the future of real-time data technology. As a member of our collaborative team, you'll be empowered to own projects end-to-end and drive growth through innovation.The role involves working on small, agile teams to develop systems...

  • Senior Data Scientist – Engineering

    3 hours ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    We are seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and developing a cutting-edge data platform that meets the complex data needs of our business.Job ResponsibilitiesYour primary focus will be on:Building software across our entire data platform, including...

  • Senior Data Engineer

    4 weeks ago

    Hyderabad City Taluka, Pakistan Warner Bros. Discovery, Inc. Full time

    Welcome to Warner Bros. Discovery… the stuff dreams are made of.Who We Are…When we say, "the stuff dreams are made of," we're not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD's vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life,...

  • Senior Data Engineering Specialist

    5 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    As a Senior Big Data Engineer, you will be responsible for designing, developing, creating, modifying, and validating embedded and cloud edge software, applications, and/or specialized utility programs.">You will collaborate with systems, hardware, architecture, test engineers, and other teams to design system-level software solutions and obtain information...

  • Data Engineer and Analytics Leader

    4 hours ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Data Engineering and Analytics Leadership RoleThis senior leadership position involves overseeing the development and implementation of data engineering and analytics strategies. The role requires expertise in analytical tools, frameworks, and cloud platforms.Key responsibilities include designing and reviewing analytical solutions, building and maintaining...

  • Senior Software Engineer

    5 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Data Engineering ExpertiseAs a Staff Software Engineer on our Tools and Frameworks team, you will be responsible for leveraging your expertise in data engineering to help us develop tools that streamline engineering processes and empower developers to build better applications and experiences faster. You'll have the opportunity to shape the future of our...

  • Senior Big Data Engineer

    5 days ago

    Hyderabad City Taluka, Pakistan Qualcomm Technologies, Inc Full time

    Company: Qualcomm India Private LimitedJob Area: Engineering Group, Engineering Group > Software EngineeringGeneral Summary:As a leading technology innovator, Qualcomm pushes the boundaries of what's possible to enable next-generation experiences and drives digital transformation to help create a smarter, connected future for all. As a Qualcomm Software...

  • Senior Data Analytics Lead

    4 hours ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Job OverviewWe are seeking an experienced Senior Machine Learning Engineer to lead a team of data scientists and engineers in embedding AI and analytics into business decision processes.Engage with clients to understand their business context.