
Azure Databricks Engineer
3 weeks ago
Azure Databricks, SQL, Data Warehouse, Python, PySpark
Description
GSPANN is hiring a Azure Databricks Engineer. As we march ahead on a tremendous growth trajectory, we seek passionate and talented professionals to join our growing family.
Location: Hyderabad / Gurugram / Pune
Role Type: Full Time
Published On: 11 September 2024
Experience: 6+ Years
Share this job
Description
GSPANN is hiring a Azure Databricks Engineer. As we march ahead on a tremendous growth trajectory, we seek passionate and talented professionals to join our growing family.
Role and Responsibilities
- Manage Databricks clusters, including provisioning, configuration, and optimization.
- Manage Databricks users in workspace and services used by them such as notebooks, sql, workflows, mlflow etc.
- Integrate Azure services like Azure Data Factory, Azure Data Lake Storage, and Azure Synapse Analytics with Databricks for a comprehensive data processing solution.
- Write high-performance Spark code for data manipulation and analysis.
- Monitor and troubleshoot Databricks jobs and pipelines for performance and stability.
- Monitor usage of Databricks workspaces and generate reports.
- Collaborate with data analysts, data scientists, and software engineers to design and implement data solutions.
- Stay up-to-date on the latest advancements in Azure and Databricks technologies.
- Proven experience of 5 Plus years working with Microsoft Azure and Azure Databricks.
- Good understanding of data warehousing and data lake concepts.
- Experience with Apache Spark for large-scale data processing.
- Proficiency in programming languages like Python (PySpark).
- Experience with SQL and relational databases.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
- Ability to work independently and as part of a team.
-
Azure Data Engineers
4 weeks ago
Hyderabad City Taluka, Pakistan GSPANN Technologies, Inc Full timeGSPANN is hiring Azure Data Engineers with expertise in Site Reliability Engineering (SRE) to optimize and automate large-scale data applications. The role involves ensuring system reliability and performance using Azure Data Factory, Databricks, Cosmos DB, and Power BI.Role and ResponsibilitiesDevelop a deep understanding of the business and analyze the...
-
Hyderabad City Taluka, Pakistan Epergne Solutions Full timeJob Title: Azure Data Engineer with Palantir Foundry ExpertiseLocation: Noida/Gurgaon/Hyderabad/Bangalore/PuneExperience Level: 7+ years (Data Engineering), 2+ years (Palantir Foundry)Role Overview:We are looking for a highly skilled Azure Data Engineer with hands-on expertise in Palantir Foundry to support critical data integration and application...
-
Data Engineer- Offshore
1 week ago
Hyderabad City Taluka, Pakistan techcarrot Full timeSkills:Advancedworking knowledge and experience with relational and non-relational databases.Experience buildingand optimizing Big Data pipelines, architectures, and datasets.Strong analyticskills related to working with structured and unstructured datasets.Hands-on experiencein Azure Databricks utilizing Spark to develop ETL pipelines.Strong proficiency...
-
Senior Data Pipeline Architect
5 days ago
Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time $100,000 - $150,000Data Engineering Expert WantedWe are seeking a skilled Data Engineer to join our team. As a data engineering expert, you will be responsible for designing and implementing scalable and efficient data pipelines using Azure Databricks and Spark.This is a key role in our organization, and we need someone who can collaborate with cross-functional teams to deploy...
-
Senior Data Pipeline Architect
1 week ago
Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time 1,500,000 - 2,000,000We are seeking a highly skilled Data Engineer to fill a position with our organization. The ideal candidate will have advanced working knowledge and experience with relational and non-relational databases, as well as hands-on experience in Azure Databricks utilizing Spark to develop Extract Transform Load pipelines.Key Responsibilities:Built and optimized...
-
Highly Skilled Data Engineer Wanted
3 days ago
Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time $80,000 - $150,000We are looking for a highly skilled Data Engineer to develop large-scale data pipelines and create actionable insights.Key Responsibilities:Data Pipeline Development: Design, develop and deploy data pipelines using Azure Databricks and Spark to extract insights from structured and unstructured datasets.Collaboration: Work with cross-functional teams to...
-
Unlock Your Potential as a Data Expert
2 days ago
Hyderabad City Taluka, Pakistan beBeeDataSpecialist Full time 2,000,000 - 3,000,000Unlock Your Potential as a Data ExpertJob DescriptionCareers that truly stand out are those that allow professionals to grow and develop their expertise. We offer opportunities for growth in exciting new directions.We are seeking an experienced professional to join our team as a Consultant Specialist. In this role, you will be responsible for designing,...
-
Azure Infrastructure Lead
1 week ago
Hyderabad City Taluka, Pakistan beBeeAzure Full time 800,000 - 1,600,000About the Role\We are seeking a highly skilled Azure Infrastructure Engineer to support a major enterprise cloud and data modernization initiative.\The engineer will be responsible for designing, deploying, and managing secure, scalable, and resilient Azure infrastructure to support modern data services, including Master Data Management (MDM) platforms.\This...
-
Python - Data Engineer/Consultant Specialist
2 days ago
Hyderabad City Taluka, Pakistan HSBC Full timeSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest banking and...
-
Cloud-Based Data Expert
5 days ago
Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time 800,000 - 1,200,000Job Title:","This role involves optimizing and automating large-scale data applications, ensuring system reliability and performance using various Azure services. We are seeking a skilled professional to develop a deep understanding of the business and analyze the end-to-end customer journey.","Key Responsibilities:","","Collaborate with stakeholders to...