Azure Databricks Engineer

5 days ago


Hyderabad City Taluka, Pakistan GSPANN Technologies, Inc Full time

2 months ago Be among the first 25 applicants

Azure Databricks, SQL, Data Warehouse, Python, PySpark

Description

GSPANN is hiring a Azure Databricks Engineer. As we march ahead on a tremendous growth trajectory, we seek passionate and talented professionals to join our growing family.

Location: Hyderabad / Gurugram / Pune

Role Type: Full Time

Published On: 11 September 2024

Experience: 6+ Years

Share this job

Description

GSPANN is hiring a Azure Databricks Engineer. As we march ahead on a tremendous growth trajectory, we seek passionate and talented professionals to join our growing family.

Role and Responsibilities

  • Manage Databricks clusters, including provisioning, configuration, and optimization.
  • Manage Databricks users in workspace and services used by them such as notebooks, sql, workflows, mlflow etc.
  • Integrate Azure services like Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics with Databricks for a comprehensive data processing solution.
  • Write high-performance Spark code for data manipulation and analysis.
  • Monitor and troubleshoot Databricks jobs and pipelines for performance and stability.
  • Monitor usage of Databricks workspaces and generate reports.
  • Collaborate with data analysts, data scientists, and software engineers to design and implement data solutions.
  • Stay up-to-date on the latest advancements in Azure and Databricks technologies.

Skills And Experience
  • Proven experience of 5 Plus years working with Microsoft Azure and Azure Databricks.
  • Good understanding of data warehousing and data lake concepts.
  • Experience with Apache Spark for large-scale data processing.
  • Proficiency in programming languages like Python (PySpark).
  • Experience with SQL and relational databases.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Ability to work independently and as part of a team.
Seniority level
  • Seniority levelMid-Senior level
Employment type
  • Employment typeFull-time
Job function
  • Job functionEngineering and Information Technology

Referrals increase your chances of interviewing at GSPANN Technologies, Inc by 2x

Azure Data Engineer with Palantir Foundry Expertise

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

  • Hyderabad City Taluka, Pakistan Epergne Solutions Full time

    Job Title: Azure Data Engineer with Palantir Foundry ExpertiseLocation: Noida/Gurgaon/Hyderabad/Bangalore/PuneExperience Level: 7+ years (Data Engineering), 2+ years (Palantir Foundry)Role Overview:We are looking for a highly skilled Azure Data Engineer with hands-on expertise in Palantir Foundry to support critical data integration and application...

  • Cloud Data Engineer

    4 days ago


    Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time

    About the RoleA data engineer with expertise in cloud-based big data processing and analytics is sought after to join our team. In this position, you will be responsible for designing, implementing, and maintaining large-scale data processing systems using Azure Databricks and related technologies.


  • Hyderabad City Taluka, Pakistan Backbase Full time

    The Job in ShortAt Backbase we aim to deliver a turn-key Data as a Service (DaaS) platform built on top of the Azure Databricks technology. The DaaS platform will enable customers from Backbase to run analytical, AI and ML workloads on data stored in the Engagement Banking Platform without affecting the operational state of the systems.We expect you to have...


  • Hyderabad City Taluka, Pakistan Softobiz Full time

    Job Title: Azure DevSecOps EngineerExperience: 6 to 8 yearsSummary Of PositionWe seek a skilled DevSecOps Engineer focusing on security and DevOps to join our growing team. In this role, you will play a critical part in managing and improving the security aspect of our products, mainly working with Microsoft Azure but may be required to assist with AWS. The...


  • Hyderabad City Taluka, Pakistan HSBC Full time

    Some careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfill your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support, and rewards that will take you further.HSBC is one of the largest banking and...


  • Hyderabad City Taluka, Pakistan Reckitt Benckiser Full time

    We are ReckittHome to the world's best loved and trusted hygiene, health, and nutrition brands. Our purpose defines why we exist: to protect, heal and nurture in the relentless pursuit of a cleaner, healthier world. We are a global team united by this purpose.Join us in our fight to make access to the highest quality hygiene, wellness, and nourishment a...


  • Hyderabad City Taluka, Pakistan beBeeCloudInfrastructureEngineer Full time

    Are you looking for a challenging opportunity to leverage your technical expertise and drive innovation in cloud infrastructure engineering? We are seeking an experienced Chief Cloud Infrastructure Engineer to join our team.The ideal candidate will possess strong technical skills, a passion for cloud computing, and the ability to work collaboratively in a...


  • Hyderabad City Taluka, Pakistan beBee Careers Full time

    Senior DevOps EngineerWe are seeking a highly skilled Senior DevOps Engineer to join our team. The ideal candidate will possess deep technical expertise in DevOps practices, cloud infrastructure, automation, CI/CD pipelines, and infrastructure design.The successful candidate will excel at identifying inefficiencies and implementing solutions that transform...


  • Hyderabad City Taluka, Pakistan beBeeDeveloper Full time

    Job Title: Experienced Full Stack Developer Needed for Complex ApplicationsAre you a skilled developer with expertise in Node.js and React.js? We are looking for a seasoned professional to lead our engineering team and drive technical direction. As a Technical Lead, you will be responsible for ensuring high code quality, delivering scalable solutions, and...


  • Hyderabad City Taluka, Pakistan beBeeCloudEngineering Full time

    Senior Cloud Engineering LeaderWe're seeking a skilled Senior Cloud Engineering Leader to join our team. This role is ideal for someone with expertise in cloud infrastructure, containerization, and orchestration.This senior leadership position will oversee the design and development of cloud infrastructure offerings and platform tools.You'll work closely...