Azure Databricks Engineer

2 weeks ago


Hyderabad City Taluka, Pakistan GSPANN Technologies, Inc Full time

Azure Databricks, SQL, Data Warehouse, Python, PySpark

Description

GSPANN is hiring an Azure Databricks Engineer. As we continue on a significant growth trajectory, we seek passionate and talented professionals to join our expanding team.

Location: Hyderabad / Gurugram / Pune

Role Type: Full Time

Published On: 11 September 2024

Experience: 6+ Years

Role and Responsibilities
  • Manage Databricks clusters, including provisioning, configuration, and optimization.
  • Manage Databricks users in workspace and services used by them such as notebooks, SQL, workflows, MLflow, etc.
  • Integrate Azure services like Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics with Databricks for comprehensive data processing solutions.
  • Write high-performance Spark code for data manipulation and analysis.
  • Monitor and troubleshoot Databricks jobs and pipelines for performance and stability.
  • Monitor usage of Databricks workspaces and generate reports.
  • Collaborate with data analysts, data scientists, and software engineers to design and implement data solutions.
  • Stay updated on the latest advancements in Azure and Databricks technologies.
Skills and Experience
  • Proven experience of 5+ years working with Microsoft Azure and Azure Databricks.
  • Good understanding of data warehousing and data lake concepts.
  • Experience with Apache Spark for large-scale data processing.
  • Proficiency in programming languages like Python (PySpark).
  • Experience with SQL and relational databases.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Ability to work independently and as part of a team.
#J-18808-Ljbffr

  • Hyderabad City Taluka, Pakistan beBee Careers Full time

    We are seeking a highly skilled Databricks Engineer to support our team.About the RoleThis role involves working with high-performance data processing and designing comprehensive data solutions using Azure services.The ideal candidate will have experience with Microsoft Azure, Apache Spark, and Python (PySpark) programming language.Key...


  • Hyderabad City Taluka, Pakistan GSPANN Technologies, Inc Full time

    Azure Data Factory, Azure, Azure API Management, Azure Databricks, Azure DevOps, Azure Data Lake, SQL, Synapse Data Warehouse, Azure CosmosDB, Power BI, Site Reliability Engineering (SRE)DescriptionGSPANN is hiring Azure Data Engineers with expertise in Site Reliability Engineering (SRE) to optimize and automate large-scale data applications. The role...

  • Azure AI

    5 days ago


    Hyderabad City Taluka, Pakistan ECS ME Full time

    Job SummaryWe are seeking an Azure Certified AI & MLOps Engineer with deep expertise in AI/ML use case development, MLOps, and cloud-based deployments, especially within the real estate and construction domains. The ideal candidate will be adept at designing predictive and generative AI models, managing scalable pipelines using Docker and Azure, and...


  • Hyderabad City Taluka, Pakistan beBee Careers Full time

    Designing and delivering a secure, scalable, and cost-efficient Data as a Service platform on Azure Databricks technology requires expertise in installing and scaling Databricks clusters.As a Senior System Engineer, you'll be part of a cross-functional team building and maintaining this platform from scratch. Your day-to-day job involves building and...

  • Azure Certified AI

    5 days ago


    Hyderabad City Taluka, Pakistan beBee Careers Full time

    We're looking for an experienced AI & MLOps Engineer to help us design predictive and generative AI models, manage scalable pipelines using Docker and Azure, and integrate complex datasets across SQL, vector, and graph databases.About the Role:Create impactful AI-driven solutions that streamline processes and enhance decision-makingWork closely with business...


  • Hyderabad City Taluka, Pakistan beBee Careers Full time

    Job DescriptionData Engineers are responsible for developing a deep understanding of business requirements and analyzing end-to-end customer journeys. They will work closely with stakeholders to design, build, and maintain large-scale data applications using Azure technologies such as Data Factory, Databricks, Cosmos DB, and Power BI.Key...

  • AI & MLOps Engineer

    5 days ago


    Hyderabad City Taluka, Pakistan beBee Careers Full time

    We are seeking a highly skilled Azure Certified AI & MLOps Engineer to join our team. The ideal candidate will have deep expertise in AI/ML use case development, MLOps, and cloud-based deployments.">Must-Have Skills:Azure AI Engineer Associate certificationProficiency in Python and AI/ML frameworks (TensorFlow, PyTorch, Scikit-learn)Strong hands-on...

  • Cloud Engineer

    6 days ago


    Hyderabad City Taluka, Pakistan beBee Careers Full time

    To create a turn-key Data as a Service (DaaS) platform on Azure Databricks technology, we need experts who can install, scale, and maintain Databricks clusters.As a Senior System Engineer, you'll join a cross-functional team building and maintaining this platform from scratch. Your main task is to build and maintain the performance and reliability of the...


  • Hyderabad City Taluka, Pakistan beBee Careers Full time

    Job Description:We are seeking a skilled Azure Databricks Engineer to manage our data processing solutions.The ideal candidate will have experience with Microsoft Azure and Apache Spark for large-scale data processing.The successful candidate will be responsible for managing Databricks clusters, integrating Azure services, and monitoring Databricks jobs and...


  • Hyderabad City Taluka, Pakistan beBee Careers Full time

    AI/ML EngineerWe are seeking a skilled AI/ML engineer with deep expertise in designing and implementing predictive and generative models, managing scalable pipelines using Docker and Azure cloud services. The ideal candidate will be adept at integrating complex datasets across SQL, vector, and graph databases, and working closely with business stakeholders...