Azure Databricks Engineer

3 weeks ago


Hyderabad City Taluka, Pakistan GSPANN Technologies, Inc Full time

Azure Databricks, SQL, Data Warehouse, Python, PySpark

Description

GSPANN is hiring a Azure Databricks Engineer. As we march ahead on a tremendous growth trajectory, we seek passionate and talented professionals to join our growing family.

Location: Hyderabad / Gurugram / Pune

Role Type: Full Time

Published On: 11 September 2024

Experience: 6+ Years

Share this job

Description

GSPANN is hiring a Azure Databricks Engineer. As we march ahead on a tremendous growth trajectory, we seek passionate and talented professionals to join our growing family.

Role and Responsibilities

  • Manage Databricks clusters, including provisioning, configuration, and optimization.
  • Manage Databricks users in workspace and services used by them such as notebooks, sql, workflows, mlflow etc.
  • Integrate Azure services like Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics with Databricks for a comprehensive data processing solution.
  • Write high-performance Spark code for data manipulation and analysis.
  • Monitor and troubleshoot Databricks jobs and pipelines for performance and stability.
  • Monitor usage of Databricks workspaces and generate reports.
  • Collaborate with data analysts, data scientists, and software engineers to design and implement data solutions.
  • Stay up-to-date on the latest advancements in Azure and Databricks technologies.

Skills And Experience
  • Proven experience of 5 Plus years working with Microsoft Azure and Azure Databricks.
  • Good understanding of data warehousing and data lake concepts.
  • Experience with Apache Spark for large-scale data processing.
  • Proficiency in programming languages like Python (PySpark).
  • Experience with SQL and relational databases.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Ability to work independently and as part of a team.
#J-18808-Ljbffr
  • Azure Data Engineers

    4 weeks ago


    Hyderabad City Taluka, Pakistan GSPANN Technologies, Inc Full time

    GSPANN is hiring Azure Data Engineers with expertise in Site Reliability Engineering (SRE) to optimize and automate large-scale data applications. The role involves ensuring system reliability and performance using Azure Data Factory, Databricks, Cosmos DB, and Power BI.Role and ResponsibilitiesDevelop a deep understanding of the business and analyze the...


  • Hyderabad City Taluka, Pakistan Epergne Solutions Full time

    Job Title: Azure Data Engineer with Palantir Foundry ExpertiseLocation: Noida/Gurgaon/Hyderabad/Bangalore/PuneExperience Level: 7+ years (Data Engineering), 2+ years (Palantir Foundry)Role Overview:We are looking for a highly skilled Azure Data Engineer with hands-on expertise in Palantir Foundry to support critical data integration and application...


  • Hyderabad City Taluka, Pakistan techcarrot Full time

    Skills:Advancedworking knowledge and experience with relational and non-relational databases.Experience buildingand optimizing Big Data pipelines, architectures, and datasets.Strong analyticskills related to working with structured and unstructured datasets.Hands-on experiencein Azure Databricks utilizing Spark to develop ETL pipelines.Strong proficiency...


  • Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time $100,000 - $150,000

    Data Engineering Expert WantedWe are seeking a skilled Data Engineer to join our team. As a data engineering expert, you will be responsible for designing and implementing scalable and efficient data pipelines using Azure Databricks and Spark.This is a key role in our organization, and we need someone who can collaborate with cross-functional teams to deploy...


  • Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time 1,500,000 - 2,000,000

    We are seeking a highly skilled Data Engineer to fill a position with our organization. The ideal candidate will have advanced working knowledge and experience with relational and non-relational databases, as well as hands-on experience in Azure Databricks utilizing Spark to develop Extract Transform Load pipelines.Key Responsibilities:Built and optimized...


  • Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time $80,000 - $150,000

    We are looking for a highly skilled Data Engineer to develop large-scale data pipelines and create actionable insights.Key Responsibilities:Data Pipeline Development: Design, develop and deploy data pipelines using Azure Databricks and Spark to extract insights from structured and unstructured datasets.Collaboration: Work with cross-functional teams to...


  • Hyderabad City Taluka, Pakistan beBeeDataSpecialist Full time 2,000,000 - 3,000,000

    Unlock Your Potential as a Data ExpertJob DescriptionCareers that truly stand out are those that allow professionals to grow and develop their expertise. We offer opportunities for growth in exciting new directions.We are seeking an experienced professional to join our team as a Consultant Specialist. In this role, you will be responsible for designing,...


  • Hyderabad City Taluka, Pakistan beBeeAzure Full time 800,000 - 1,600,000

    About the Role\We are seeking a highly skilled Azure Infrastructure Engineer to support a major enterprise cloud and data modernization initiative.\The engineer will be responsible for designing, deploying, and managing secure, scalable, and resilient Azure infrastructure to support modern data services, including Master Data Management (MDM) platforms.\This...


  • Hyderabad City Taluka, Pakistan HSBC Full time

    Some careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest banking and...


  • Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time 800,000 - 1,200,000

    Job Title:","This role involves optimizing and automating large-scale data applications, ensuring system reliability and performance using various Azure services. We are seeking a skilled professional to develop a deep understanding of the business and analyze the end-to-end customer journey.","Key Responsibilities:","","Collaborate with stakeholders to...