Azure Databricks Engineer

4 weeks ago


Hyderabad City Taluka, Pakistan GSPANN Technologies, Inc Full time

2 months ago Be among the first 25 applicants

Azure Databricks, SQL, Data Warehouse, Python, PySpark

Description

GSPANN is hiring a Azure Databricks Engineer. As we march ahead on a tremendous growth trajectory, we seek passionate and talented professionals to join our growing family.

Location: Hyderabad / Gurugram / Pune

Role Type: Full Time

Published On: 11 September 2024

Experience: 6+ Years

Share this job

Description

GSPANN is hiring a Azure Databricks Engineer. As we march ahead on a tremendous growth trajectory, we seek passionate and talented professionals to join our growing family.

Role and Responsibilities

  • Manage Databricks clusters, including provisioning, configuration, and optimization.
  • Manage Databricks users in workspace and services used by them such as notebooks, sql, workflows, mlflow etc.
  • Integrate Azure services like Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics with Databricks for a comprehensive data processing solution.
  • Write high-performance Spark code for data manipulation and analysis.
  • Monitor and troubleshoot Databricks jobs and pipelines for performance and stability.
  • Monitor usage of Databricks workspaces and generate reports.
  • Collaborate with data analysts, data scientists, and software engineers to design and implement data solutions.
  • Stay up-to-date on the latest advancements in Azure and Databricks technologies.

Skills And Experience
  • Proven experience of 5 Plus years working with Microsoft Azure and Azure Databricks.
  • Good understanding of data warehousing and data lake concepts.
  • Experience with Apache Spark for large-scale data processing.
  • Proficiency in programming languages like Python (PySpark).
  • Experience with SQL and relational databases.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Ability to work independently and as part of a team.
Seniority level
  • Seniority levelMid-Senior level
Employment type
  • Employment typeFull-time
Job function
  • Job functionEngineering and Information Technology

Referrals increase your chances of interviewing at GSPANN Technologies, Inc by 2x

Azure Data Engineer with Palantir Foundry Expertise

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

  • Hyderabad City Taluka, Pakistan GSPANN Technologies, Inc Full time

    Azure Databricks, SQL, Data Warehouse, Python, PySparkDescriptionGSPANN is hiring a Azure Databricks Engineer. As we march ahead on a tremendous growth trajectory, we seek passionate and talented professionals to join our growing family.Location: Hyderabad / Gurugram / PuneRole Type: Full TimePublished On: 11 September 2024Experience: 6+ YearsShare this...


  • Hyderabad City Taluka, Pakistan beBeeData Full time 1,500,000 - 2,000,000

    Job Description:Azure Databricks Engineers play a pivotal role in designing and implementing cutting-edge data solutions for our organization. They are responsible for managing Databricks clusters, including provisioning, configuration, and optimization.Key Responsibilities:Manage Databricks clusters for optimal performance.Configure and manage user access...

  • Azure AI

    2 weeks ago


    Hyderabad City Taluka, Pakistan ECS ME Full time

    Job SummaryWe are seeking an Azure Certified AI & MLOps Engineer with deep expertise in AI/ML use case development, MLOps, and cloud-based deployments, especially within the real estate and construction domains. The ideal candidate will be adept at designing predictive and generative AI models, managing scalable pipelines using Docker and Azure, and...

  • Azure Data Engineers

    2 weeks ago


    Hyderabad City Taluka, Pakistan GSPANN Technologies, Inc Full time

    GSPANN is hiring Azure Data Engineers with expertise in Site Reliability Engineering (SRE) to optimize and automate large-scale data applications. The role involves ensuring system reliability and performance using Azure Data Factory, Databricks, Cosmos DB, and Power BI.Role and ResponsibilitiesDevelop a deep understanding of the business and analyze the...


  • Hyderabad City Taluka, Pakistan Epergne Solutions Full time

    Job Title: Azure Data Engineer with Palantir Foundry ExpertiseLocation: Noida/Gurgaon/Hyderabad/Bangalore/PuneExperience Level: 7+ years (Data Engineering), 2+ years (Palantir Foundry)Role Overview:We are looking for a highly skilled Azure Data Engineer with hands-on expertise in Palantir Foundry to support critical data integration and application...

  • Lead Data Engineer

    7 days ago


    Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time 15,000,000 - 25,000,000

    Explore a leading role in technology innovation at JPMorganChase.As a pioneering engineer, you will play a pivotal part in shaping the future of our company's technology products. As a key technical contributor, you will be responsible for developing and implementing essential technology solutions across diverse technical domains, supporting various business...

  • Senior Data Engineer

    2 weeks ago


    Hyderabad City Taluka, Pakistan beBeeDatabricks Full time 800,000 - 1,200,000

    Job OverviewWe aim to deliver a turn-key Data as a Service platform built on top of Azure Databricks technology.This platform enables customers to run analytical, AI and ML workloads on data stored in the Engagement Banking Platform without affecting its operational state.Our expectation is that you have proven expertise with installing, maintaining and...

  • AI and Cloud Expert

    2 weeks ago


    Hyderabad City Taluka, Pakistan beBeeMLOPS Full time 1,000,000 - 1,500,000

    Job OpportunityWe are seeking a skilled Azure AI & MLOps Professional to join our team of experts in AI/ML use case development, MLOps, and cloud-based deployments.Key Responsibilities:Develop predictive and generative AI models utilizing machine learning frameworksManage scalable pipelines using containerization techniques and cloud-based...


  • Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time ₹18,000,000 - ₹24,000,000

    Azure Data Engineer OpportunityWe are seeking a highly skilled Azure Data Engineer with expertise in Palantir to support mission-critical data integration and application development initiatives.Key Responsibilities:Design, develop, and maintain scalable data pipelines using Azure services.Collaborate with cross-functional teams to integrate data from...


  • Hyderabad City Taluka, Pakistan JP Morgan Chase Full time

    You're ready to gain the skills and experience needed to grow within your role and advance your career — and we have the perfect software engineering opportunity for you.As a Software Engineer II at JPMorganChase within the Corporate Technology, you are part of an agile team that works to enhance, design, and deliver the software components of the firm's...