Azure Databricks Engineer

7 days ago

Hyderabad City Taluka, Pakistan GSPANN Technologies, Inc Full time

2 months ago Be among the first 25 applicants

Azure Databricks, SQL, Data Warehouse, Python, PySpark

Description

GSPANN is hiring a Azure Databricks Engineer. As we march ahead on a tremendous growth trajectory, we seek passionate and talented professionals to join our growing family.

Location: Hyderabad / Gurugram / Pune

Role Type: Full Time

Published On: 11 September 2024

Experience: 6+ Years

Share this job

Description

GSPANN is hiring a Azure Databricks Engineer. As we march ahead on a tremendous growth trajectory, we seek passionate and talented professionals to join our growing family.

Role and Responsibilities

  • Manage Databricks clusters, including provisioning, configuration, and optimization.
  • Manage Databricks users in workspace and services used by them such as notebooks, sql, workflows, mlflow etc.
  • Integrate Azure services like Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics with Databricks for a comprehensive data processing solution.
  • Write high-performance Spark code for data manipulation and analysis.
  • Monitor and troubleshoot Databricks jobs and pipelines for performance and stability.
  • Monitor usage of Databricks workspaces and generate reports.
  • Collaborate with data analysts, data scientists, and software engineers to design and implement data solutions.
  • Stay up-to-date on the latest advancements in Azure and Databricks technologies.

Skills And Experience
  • Proven experience of 5 Plus years working with Microsoft Azure and Azure Databricks.
  • Good understanding of data warehousing and data lake concepts.
  • Experience with Apache Spark for large-scale data processing.
  • Proficiency in programming languages like Python (PySpark).
  • Experience with SQL and relational databases.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Ability to work independently and as part of a team.
Seniority level
  • Seniority levelMid-Senior level
Employment type
  • Employment typeFull-time
Job function
  • Job functionEngineering and Information Technology

Referrals increase your chances of interviewing at GSPANN Technologies, Inc by 2x

Azure Data Engineer with Palantir Foundry Expertise

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

  • Azure Databricks/Senior Business Analyst

    6 days ago

    Hyderabad City Taluka, Pakistan HSBC Full time

    OverviewSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest...

  • Senior Databricks Developer

    6 days ago

    Hyderabad City Taluka, Pakistan beBeeDatabricks Full time 6,000,000 - 8,000,000

    Job Title: Senior Databricks DeveloperWe are seeking a highly skilled Senior Databricks Developer to join our team. The ideal candidate will have experience in designing and deploying large-scale data solutions using Databricks.The successful candidate will work with our data engineering, science, and analyst teams to design and optimize data workflows. They...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad City Taluka, Pakistan techcarrot Full time

    OverviewAs a Data Engineer in our team, you will be responsible for assessing complex new data sources and quickly turning these into business insights. You also will support the implementation and integration of these new data sources into our Azure Data platform.ResponsibilitiesYou are detailed reviewing and analyzing structured, semi-structured and...

  • Azure Data Engineers

    3 weeks ago

    Hyderabad City Taluka, Pakistan GSPANN Technologies, Inc Full time

    OverviewGSPANN Technologies, Inc is hiring Azure Data Engineers with expertise in Site Reliability Engineering (SRE) to optimize and automate large-scale data applications. The role focuses on ensuring system reliability and performance using Azure data services such as Azure Data Factory, Azure Databricks, Azure Cosmos DB, and Power...

  • Azure Data Engineer with Palantir Foundry Expertise

    2 weeks ago

    Hyderabad City Taluka, Pakistan Epergne Solutions Full time

    Job Title: Azure Data Engineer with Palantir Foundry ExpertiseLocation: Noida/Gurgaon/Hyderabad/Bangalore/PuneExperience Level: 7+ years (Data Engineering), 2+ years (Palantir Foundry)Role Overview:We are looking for a highly skilled Azure Data Engineer with hands-on expertise in Palantir Foundry to support critical data integration and application...

  • Data Engineer

    1 week ago

    Hyderabad City Taluka, Pakistan techcarrot Full time

    OverviewAs a Data Engineer in our team, you will be responsible for assessing complex new data sources and quickly turning these into business insights. You will support the implementation and integration of these new data sources into our Azure Data platform.ResponsibilitiesYou are detailed reviewing and analyzing structured, semi-structured and...

  • Databricks Platform, Engineering

    2 weeks ago

    Hyderabad City Taluka, Pakistan Qualcomm Technologies, Inc Full time

    OverviewCompany: Qualcomm India Private Limited. Job Area: Information Technology Group, Information Technology Group > IT Management.Data Platform, Engineering and Operations lead will play a pivotal role in shaping the future of our data capabilities as part of strategic and critical Enterprise Data Transformation (EDT) program. We're seeking a visionary,...

  • Databricks Platform, Engineering

    1 week ago

    Hyderabad City Taluka, Pakistan Qualcomm Technologies, Inc Full time

    OverviewCompany: Qualcomm India Private Limited. Job Area: Information Technology Group, Information Technology Group > IT Management.Data Platform, Engineering and Operations lead will play a pivotal role in shaping the future of our data capabilities as part of strategic and critical Enterprise Data Transformation (EDT) program. We're seeking a visionary,...

  • Data Engineering Consultant

    1 week ago

    Hyderabad City Taluka, Pakistan beBeeData Full time 1,200,000 - 1,800,000

    Job OverviewA strategic role for a highly skilled data engineer consultant to design, develop and optimize scalable data architectures utilizing Azure Databricks, PySpark and Prophesy.Key Responsibilities:Define data requirements and strategies to drive business growth.Design, develop and maintain efficient data pipelines.Collaborate with cross-functional...

  • Senior Data Engineer for Data Strategy Development

    2 weeks ago

    Hyderabad City Taluka, Pakistan beBeeDataProfessional Full time 1,500,000 - 2,500,000

    Job Opportunity:We are seeking an experienced data professional to support critical data integration and application development initiatives.The ideal candidate will have a strong foundation in Python, SQL, and PySpark, along with proven experience in working across data pipelines, ontologies, and security configurations within the Palantir ecosystem.This...