
Senior Data Engineer Azure Databricks Lead
2 days ago
As a Senior Data Engineer Azure Databricks, you will be responsible for designing, building, and maintaining high-performance, large-scale, complex data architectures. Your primary focus will be on ensuring efficient data processing and analytics through innovative solutions.
The ideal candidate will have a strong background in Python, SQL, PySpark, Azure, Databricks, Synapse, Azure Data Lake, DevOps, and cloud-based large-scale data applications. They will also possess excellent programming skills in languages such as Python (must have), Scala, and proficiency in writing efficient and optimized code for data integration, migration, storage, processing, and manipulation.
You will work closely with cross-functional teams to understand data requirements and develop data solutions that meet business needs. Your expertise in designing and implementing efficient ELT/ETL processes in Azure and Databricks will be highly valued.
Some of your key responsibilities will include architecting, designing, developing, testing, and maintaining big data products. You will construct and fine-tune Apache Spark jobs and clusters within the Databricks platform, migrate out of Azure Synapse to Azure Data Lake or other technologies, and assess best practices and design schemas that match business needs for delivering a modern analytics solution.
In addition to these responsibilities, you will provide guidance and mentorship to junior team members, maintain clear and comprehensive documentation of solutions, and promote and enforce best practices in data engineering, data governance, and data quality.
A willingness to stay updated with the latest services, Data Engineering trends, and best practices in the field is essential.
-
Data Engineering Innovator
2 days ago
Islamabad, Islamabad, Pakistan beBee Careers Full timeIn this role, you will be responsible for designing, building, and maintaining high-performance, large-scale, complex data architectures as a Senior Data Engineer Azure Databricks. Your primary focus will be on ensuring efficient data processing and analytics through innovative solutions.The ideal candidate will have a strong background in Python, SQL,...
-
Principal Data Engineer- Azure
3 weeks ago
Islamabad, Islamabad, Pakistan CLUSTOX Full timeAbout the job Principal Data Engineer- AzureAbout the ProjectWe are a mission-driven team of developers, architects, ML engineers, and data specialists building an innovative cloud-based platform to combat coral reef degradation caused by global warming. By leveraging real-time data pipelines, AI/ML models, and scalable cloud architecture, we aim to deliver...
-
Principal Data Engineer- Azure
4 weeks ago
Islamabad, Islamabad, Pakistan Clustox Inc. Full timeAbout the ProjectWe are a mission-driven team of developers, architects, ML engineers, and data specialists building an innovative cloud-based platform to combat coral reef degradation caused by global warming. By leveraging real-time data pipelines, AI/ML models, and scalable cloud architecture, we aim to deliver actionable insights for marine...
-
Cloud-Based Data Architect
2 days ago
Islamabad, Islamabad, Pakistan beBee Careers Full timeWe are seeking a seasoned Data Architect to lead our team in designing and implementing cutting-edge data solutions. As a Senior Data Engineer Azure Databricks, you will play a pivotal role in shaping our company's data strategy and driving innovation in data engineering.Your expertise in cloud-based large-scale data applications, specifically in Azure and...
-
Senior Software Consultant
2 days ago
Islamabad, Islamabad, Pakistan beBee Careers Full timeWe are seeking a highly motivated software professional to work closely with our CTO, Software Engineering and Data Science teams to deliver exceptional results and drive product innovation forward.About the RoleThe ideal candidate will have 5+ years of experience in Python, AWS/Azure & Databricks. Key responsibilities include:Designing and implementing...
-
Large Scale Data Solutions Designer
2 days ago
Islamabad, Islamabad, Pakistan beBee Careers Full timeWe are looking for a highly skilled Data Engineer to join our team as a Senior Data Engineer Azure Databricks. In this role, you will be responsible for designing, building, and maintaining high-performance, large-scale, complex data architectures. Your primary focus will be on ensuring efficient data processing and analytics through innovative solutions.The...
-
Cloud Data Engineer
2 weeks ago
Islamabad, Islamabad, Pakistan beBee Careers Full timeJob DescriptionThis is an exciting opportunity to contribute to a growing data and analytics team. As a Data Engineer – Azure & AI Integration, you will be responsible for developing and maintaining scalable data pipelines, implementing machine learning workflows, and ensuring a robust data architecture leveraging the Azure ecosystem.Main...
-
Senior Cloud Engineer
2 days ago
Islamabad, Islamabad, Pakistan beBee Careers Full timeCloud AI EngineerThe ideal candidate will have expertise in working with cloud environments (AWS, Azure, GCP, Databricks) and Linux, including Lambda/Serverless, SQS, SNS, S3, and EC2, as well as experience deploying Transformer-based models into production.
-
Cloud Data Engineer
2 weeks ago
Islamabad, Islamabad, Pakistan Nisum Full time2 weeks ago Be among the first 25 applicantsJob DescriptionNisum is a leading global digital commerce firm headquartered in California, with services spanning digital strategy and transformation, insights and analytics, blockchain, business agility, and custom software development. Founded in 2000 with the customer-centric motto "Building Success Together,"...
-
Senior Data Pipeline Developer
2 weeks ago
Islamabad, Islamabad, Pakistan beBee Careers Full timeAbout the JobThis role involves working on a high-profile project that requires designing, building, and maintaining large-scale data processing systems. As a member of the data and analytics team, you will work closely with other professionals to develop and implement cutting-edge technologies.Key Responsibilities:Develop and maintain data pipelines using...