Senior Data Engineer

4 days ago

Hyderabad City Taluka, Pakistan Backbase Full time

The Job in short

We are seeking a Senior Data Engineer to lead the design, development, and maintenance of our Data as a Service (DaaS) platform on Azure. Your expertise in data engineering will enable our clients to perform big data analytics, machine learning, and AI workloads on data ingested from multiple sources, ensuring high security and compliance. The ideal candidate will have a strong background in data engineering, cloud data platforms, ETL processes, and data governance. This role requires deep expertise in Azure Synapse, Spark, Databricks, and Delta Lake, along with a solid understanding of data regulations and compliance.

Meet the job

  1. Data Platform Architecture & Implementation: Design, implement, and maintain secure and scalable data infrastructure in Azure.
  2. Data Pipelines & ETL Processing: Develop and manage data pipelines for extracting, transforming, and loading (ETL) data from various sources into the Data Lakehouse using Azure Data Factory and Databricks.
  3. Data Governance & Compliance: Ensure data consistency, quality, and governance, adhering to regulatory and compliance requirements.
  4. Data Security & Compliance: Secure data platforms and ensure compliance with security frameworks (e.g., NIST, CIS, ISO 27001).
  5. Big Data Processing: Implement and optimize big data processing solutions using Azure Synapse, Spark, and Databricks.
  6. Data Lakehouse Management: Manage the Data Lakehouse environment, including Delta Lake, to support data analytics and machine learning workloads.
  7. Streaming Data Processing: Develop and maintain secure streaming data pipelines using Azure Event Hubs and other streaming endpoints.
  8. Data Sharing & Integration: Implement secure data sharing within and outside the organization using Delta Sharing.
  9. Data Analytics & Visualization: Enable data scientists and analysts by providing high-quality data for dashboards, AI/ML applications, and other data consumers.

How about you

Required Qualifications:

  1. 5+ years of experience in data engineering, preferably in Azure Synapse, Spark, or Databricks.
  2. Strong hands-on experience in data pipeline development and ETL processes.
  3. Expertise in Data Lakehouse concepts and Delta Lake.
  4. Deep understanding of data domains, regulations, and compliance requirements.
  5. Experience in data governance and ensuring data quality.
  6. Strong scripting and automation skills (Python, PowerShell).
  7. Solid understanding of cloud data platforms and services in Azure.

Preferred Qualifications:

  1. Azure data certifications (e.g., DP-200, DP-201).
  2. Knowledge of secure data practices and compliance standards (e.g., NIST, CIS, ISO 27001).

Why Join Us?

  1. Work with cutting-edge Azure data technologies.
  2. Influence and drive data engineering best practices in a fast-paced, cloud-first environment.
  3. Opportunity for continuous learning and professional development.
  4. Competitive salary, benefits, and flexible work arrangements.

How to Apply: If you are passionate about data engineering, data security, and automation, we encourage you to apply Submit your resume and a cover letter detailing your relevant experience.

#J-18808-Ljbffr

  • Senior Data Architect

    2 weeks ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Job SummaryWe are seeking a highly skilled Senior Data Architect to lead the engineering and development of complex data management systems. The ideal candidate will have expertise in data modeling, architecture, and governance.

  • Senior Data Engineer

    2 weeks ago

    Hyderabad City Taluka, Pakistan FANATICS INC Full time

    Job Overview:We are looking for a Senior Data Engineer with a deep understanding of Apache Spark (Scala & PySpark), Kafka Streams (Java), AWS services, Snowflake, Apache Iceberg, Tableau, and Data Lake architectures. As a senior member of our team, you will be responsible for leading the design, implementation, and optimization of large-scale data systems,...

  • Senior Software Engineer Data

    5 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Job DescriptionWe are looking for a talented Senior Software Engineer to join our team. As a key contributor, you will work closely with cross-functional teams to develop tools that help our community of developers save time and energy by streamlining engineering processes.The successful candidate will have a strong understanding of algorithm and data...

  • Senior Data Engineer

    5 days ago

    Hyderabad City Taluka, Pakistan Warner Bros. Discovery, Inc. Full time

    Welcome to Warner Bros. Discovery… the stuff dreams are made of.Who We Are…When we say, "the stuff dreams are made of," we're not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD's vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life,...

  • Senior Data Engineering Lead

    6 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    About the JobWe are looking for an experienced Senior Manager to join our engineering team. As a key member of the team, you will be responsible for building and managing real-time data processing pipelines, creating tools and frameworks that enhance data processing, and promoting a culture of experimentation and innovation.The ideal candidate will have...

  • Senior Data Engineer

    5 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Unlock the Power of Big DataWe are seeking a skilled Data Engineer to join our team. As a key member, you will be responsible for designing and developing our data platform to efficiently address various data needs across the business.The ideal candidate will have expertise in building and managing large volume data processing (both streaming and batch)...

  • Senior Software Engineer, Data Ingestion

    4 weeks ago

    Hyderabad City Taluka, Pakistan SingleStore Full time

    Senior Software Engineer, Engine (Data Ingestion) -Position OverviewSingleStore Software Engineers are at the forefront of real-time technology that's revolutionizing how companies run their businesses every day. With release cycles throughout the year, our engineers are accustomed to moving quickly in a rapid production environment. To do this successfully,...

  • Data Platform Engineering Manager

    2 weeks ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    We are seeking a highly skilled Data Platform Engineering Manager to join our team. As a senior member of our engineering organization, you will be responsible for leading the design and implementation of our data platform, ensuring it is efficient, cost-effective, and scalable.The ideal candidate will have a strong technical background in distributed...

  • Senior Manager, Data Engineering

    2 weeks ago

    Hyderabad City Taluka, Pakistan FANATICS INC Full time

    JOB DESCRIPTIONWe are seeking a passionate and experienced Senior Manager of Business Intelligence & Data Engineering to lead and develop a high-performing team of engineers. The scope of this role will be broad and multi-tiered, covering all aspects of the Business Intelligence (BI) ecosystem - designing, building, and maintaining robust data pipelines,...

  • Senior Big Data Engineer

    3 weeks ago

    Hyderabad City Taluka, Pakistan Qualcomm Technologies, Inc Full time

    Company: Qualcomm India Private LimitedJob Area: Engineering Group, Engineering Group > Software EngineeringGeneral Summary:As a leading technology innovator, Qualcomm pushes the boundaries of what's possible to enable next-generation experiences and drives digital transformation to help create a smarter, connected future for all. As a Qualcomm Software...