Senior Data Engineer Azure Databricks Lead

2 days ago


Islamabad, Islamabad, Pakistan beBee Careers Full time
About the Role
As a Senior Data Engineer Azure Databricks, you will be responsible for designing, building, and maintaining high-performance, large-scale, complex data architectures. Your primary focus will be on ensuring efficient data processing and analytics through innovative solutions.

The ideal candidate will have a strong background in Python, SQL, PySpark, Azure, Databricks, Synapse, Azure Data Lake, DevOps, and cloud-based large-scale data applications. They will also possess excellent programming skills in languages such as Python (must have), Scala, and proficiency in writing efficient and optimized code for data integration, migration, storage, processing, and manipulation.

You will work closely with cross-functional teams to understand data requirements and develop data solutions that meet business needs. Your expertise in designing and implementing efficient ELT/ETL processes in Azure and Databricks will be highly valued.

Some of your key responsibilities will include architecting, designing, developing, testing, and maintaining big data products. You will construct and fine-tune Apache Spark jobs and clusters within the Databricks platform, migrate out of Azure Synapse to Azure Data Lake or other technologies, and assess best practices and design schemas that match business needs for delivering a modern analytics solution.

In addition to these responsibilities, you will provide guidance and mentorship to junior team members, maintain clear and comprehensive documentation of solutions, and promote and enforce best practices in data engineering, data governance, and data quality.

A willingness to stay updated with the latest services, Data Engineering trends, and best practices in the field is essential.

  • Islamabad, Islamabad, Pakistan beBee Careers Full time

    In this role, you will be responsible for designing, building, and maintaining high-performance, large-scale, complex data architectures as a Senior Data Engineer Azure Databricks. Your primary focus will be on ensuring efficient data processing and analytics through innovative solutions.The ideal candidate will have a strong background in Python, SQL,...


  • Islamabad, Islamabad, Pakistan CLUSTOX Full time

    About the job Principal Data Engineer- AzureAbout the ProjectWe are a mission-driven team of developers, architects, ML engineers, and data specialists building an innovative cloud-based platform to combat coral reef degradation caused by global warming. By leveraging real-time data pipelines, AI/ML models, and scalable cloud architecture, we aim to deliver...


  • Islamabad, Islamabad, Pakistan Clustox Inc. Full time

    About the ProjectWe are a mission-driven team of developers, architects, ML engineers, and data specialists building an innovative cloud-based platform to combat coral reef degradation caused by global warming. By leveraging real-time data pipelines, AI/ML models, and scalable cloud architecture, we aim to deliver actionable insights for marine...


  • Islamabad, Islamabad, Pakistan beBee Careers Full time

    We are seeking a seasoned Data Architect to lead our team in designing and implementing cutting-edge data solutions. As a Senior Data Engineer Azure Databricks, you will play a pivotal role in shaping our company's data strategy and driving innovation in data engineering.Your expertise in cloud-based large-scale data applications, specifically in Azure and...


  • Islamabad, Islamabad, Pakistan beBee Careers Full time

    We are seeking a highly motivated software professional to work closely with our CTO, Software Engineering and Data Science teams to deliver exceptional results and drive product innovation forward.About the RoleThe ideal candidate will have 5+ years of experience in Python, AWS/Azure & Databricks. Key responsibilities include:Designing and implementing...


  • Islamabad, Islamabad, Pakistan beBee Careers Full time

    We are looking for a highly skilled Data Engineer to join our team as a Senior Data Engineer Azure Databricks. In this role, you will be responsible for designing, building, and maintaining high-performance, large-scale, complex data architectures. Your primary focus will be on ensuring efficient data processing and analytics through innovative solutions.The...

  • Cloud Data Engineer

    2 weeks ago


    Islamabad, Islamabad, Pakistan beBee Careers Full time

    Job DescriptionThis is an exciting opportunity to contribute to a growing data and analytics team. As a Data Engineer – Azure & AI Integration, you will be responsible for developing and maintaining scalable data pipelines, implementing machine learning workflows, and ensuring a robust data architecture leveraging the Azure ecosystem.Main...


  • Islamabad, Islamabad, Pakistan beBee Careers Full time

    Cloud AI EngineerThe ideal candidate will have expertise in working with cloud environments (AWS, Azure, GCP, Databricks) and Linux, including Lambda/Serverless, SQS, SNS, S3, and EC2, as well as experience deploying Transformer-based models into production.

  • Cloud Data Engineer

    2 weeks ago


    Islamabad, Islamabad, Pakistan Nisum Full time

    2 weeks ago Be among the first 25 applicantsJob DescriptionNisum is a leading global digital commerce firm headquartered in California, with services spanning digital strategy and transformation, insights and analytics, blockchain, business agility, and custom software development. Founded in 2000 with the customer-centric motto "Building Success Together,"...


  • Islamabad, Islamabad, Pakistan beBee Careers Full time

    About the JobThis role involves working on a high-profile project that requires designing, building, and maintaining large-scale data processing systems. As a member of the data and analytics team, you will work closely with other professionals to develop and implement cutting-edge technologies.Key Responsibilities:Develop and maintain data pipelines using...