Azure Data Engineering Specialist

3 days ago


Hyderabad City Taluka, Pakistan techcarrot Full time

Data Engineering Specialist

We are looking for a skilled data engineer to join our team. As a data engineer in Techcarrot, you will be responsible for assessing complex new data sources and turning them into business insights. You will support the implementation and integration of these new data sources into our Azure Data platform.

Job Description:
  • Review and analyze structured, semi-structured, and unstructured data sources for quality, completeness, and business value.
  • Design, architect, implement, and test rapid prototypes that demonstrate the value of the data and present them to diverse audiences.
  • Participate in early-stage design and feature definition activities.
  • Implement robust data pipelines using Microsoft, Databricks Stack.
  • Create reusable and scalable data pipelines.
  • Collaborate with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.
  • Effectively convey complex data insights to non-technical stakeholders.
  • Work collaboratively in cross-functional teams and manage multiple projects simultaneously.
Requirements:
  1. Advanced working knowledge and experience with relational and non-relational databases.
  2. Experience building and optimizing Big Data pipelines, architectures, and datasets.
  3. Strong analytic skills related to working with structured and unstructured datasets.
  4. Hands-on experience in Azure Databricks utilizing Spark to develop ETL pipelines.
  5. Strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages.
  6. Strong experience in Azure Data Lake Storage Gen2, Azure Data Factory, Databricks, Event Hub, Azure Synapse.
  7. Familiarity with several of the following technologies: Event Hub, Docker, Azure Kubernetes Service, Azure DWH, API Azure, Azure Function, Power BI, Azure Cognitive Services.
  8. Experience deploying data pipelines through Azure DevOps.


  • Hyderabad City Taluka, Pakistan techcarrot Full time

    Data EngineerAs a Data Engineer in our team, you will be responsible for assessing complex new data sources and quickly turning these into business insights. You also will support the implementation and integration of these new data sources into our Azure Data platform.Responsibilities:You are detailed reviewing and analyzing structured, semi-structured and...


  • Hyderabad City Taluka, Pakistan techcarrot Full time

    Cloud Data Solutions ArchitectTechcarrot is seeking a highly skilled cloud data solutions architect to join our team. As a cloud data solutions architect in Techcarrot, you will be responsible for designing and implementing complex data solutions on the cloud. You will work closely with our data engineering team to ensure seamless integration of data...


  • Hyderabad City Taluka, Pakistan techcarrot Full time

    Job Overview:Techcarrot is seeking a highly skilled Data Engineer to join our team and play a key role in managing and transforming data in Azure cloud environments. As a Data Engineer, you will be responsible for developing robust data pipelines using Azure Data Factory (ADF), Databricks, and Python for data ingestion, transformation, and loading.Main...


  • Hyderabad City Taluka, Pakistan Backbase Full time

    The Job in shortWe are seeking a Senior Data Engineer to lead the design, development, and maintenance of our Data as a Service (DaaS) platform on Azure. Your expertise in data engineering will enable our clients to perform big data analytics, machine learning, and AI workloads on data ingested from multiple sources, ensuring high security and compliance....

  • Big Data Engineer

    3 days ago


    Hyderabad City Taluka, Pakistan techcarrot Full time

    Big Data Engineer - Cloud PlatformWe are seeking a highly skilled big data engineer to join our team. As a big data engineer in Techcarrot, you will be responsible for designing and implementing complex big data solutions on the cloud. You will work closely with our data engineering team to ensure seamless integration of big data solutions into our Azure...


  • Hyderabad City Taluka, Pakistan techcarrot Full time

    Job Description:We are looking for a talented Data Engineer to join our team at Techcarrot. In this role, you will be responsible for designing and implementing data pipelines using Azure Data Factory (ADF) and Databricks. You will also work on integrating SAP IS-Auto data into Azure-based data platforms and ensuring data quality and governance.Main...


  • Hyderabad City Taluka, Pakistan techcarrot Full time

    Data Engineer Role at TechcarrotAs a data engineer in our team, you will be responsible for assessing complex new data sources and turning them into business insights. You will support the implementation and integration of these new data sources into our Azure Data platform.About the Job:You will review and analyze structured, semi-structured, and...


  • Hyderabad City Taluka, Pakistan techcarrot Full time

    Job Requirements:To succeed in this role, you must have strong experience in Azure Data Factory (ADF), Databricks, and Azure Synapse. Additionally, proficiency in Python for data processing, automation, and scripting is required. You should also have advanced knowledge of SQL, T-SQL, or PL/SQL for data manipulation and experience integrating SAP IS-Auto as a...


  • Hyderabad City Taluka, Pakistan DigitalOcean LLC Full time

    We are seeking a highly motivated Cloud Data Engineering Manager to join our team at DigitalOcean LLC. As a manager, you will lead a team of engineers to design, develop, and maintain cloud-based data engineering solutions that support our organization's strategic goals.Key Responsibilities:Team Leadership: Lead a team of engineers to design, develop, and...


  • Hyderabad City Taluka, Pakistan Astronomer Full time

    Astronomer designed Astro, an industry-leading, orchestration-first DataOps platform for data teams. Powered by Airflow, Astro accelerates building reliable data products that unlock insights, unleash AI value, and drive data-driven applications.We're a globally-distributed and rapidly growing venture-backed team of learners, innovators and collaborators....


  • Hyderabad City Taluka, Pakistan techcarrot Full time

    Requirements:To excel in this role, you must have strong experience in Azure Data Factory (ADF), Databricks, and Azure Synapse. Additionally, proficiency in Python for data processing, automation, and scripting is required. You should also have advanced knowledge of SQL, T-SQL, or PL/SQL for data manipulation and experience integrating SAP IS-Auto as a data...


  • Hyderabad City Taluka, Pakistan HSBC Full time

    Our team at HSBC is dedicated to delivering cutting-edge banking and financial services solutions. We're seeking a skilled professional to join us as a Consultant Specialist.In this role, you will be responsible for providing end-to-end support across the delivery and run lifecycle of software development, testing, and operational activities. You'll work...

  • Senior Data Engineer

    2 weeks ago


    Hyderabad City Taluka, Pakistan Warner Bros. Discovery, Inc. Full time

    Welcome to Warner Bros. Discovery… the stuff dreams are made of.Who We Are…When we say, "the stuff dreams are made of," we're not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD's vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life,...


  • Hyderabad City Taluka, Pakistan HSBC Full time

    Some careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC, and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest banking and...


  • Hyderabad City Taluka, Pakistan HSBC Full time

    About HSBCWe are one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories.We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.Our team is currently seeking an experienced...


  • Hyderabad City Taluka, Pakistan Warner Bros. Discovery, Inc. Full time

    About the RoleAs a Senior Analytics Engineer at Warner Bros. Discovery, you will be responsible for leading data pipeline and data strategy efforts for the Data & Analytics organization at Max.You will design and implement data models that support flexible querying and data visualization, partner with product stakeholders to understand business questions and...


  • Hyderabad City Taluka, Pakistan Softobiz Full time

    At Softobiz Technologies Pvt. Ltd., we are seeking a highly skilled Senior Engineer with expertise in Elastic tools and certifications in either Elastic Certified Engineer or Elastic Certified Observability Engineer.About the RoleWe require an individual with strong background in data modelling, querying, and data extraction.Proficiency in bulk document...


  • Hyderabad City Taluka, Pakistan Astronomer Full time

    Astronomer designed Astro, an industry-leading, orchestration-first DataOps platform for data teams. Powered by Airflow, Astro accelerates building reliable data products that unlock insights, unleash AI value, and drive data-driven applications.We're a globally-distributed and rapidly growing venture-backed team of learners, innovators, and collaborators....


  • Hyderabad City Taluka, Pakistan HSBC Full time

    Some careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest banking and...


  • Hyderabad City Taluka, Pakistan Warner Bros. Discovery, Inc. Full time

    About the RoleWarner Bros. Discovery, Inc. is seeking a highly experienced Senior Manager, Analytics Engineering to lead our team of data engineers in developing innovative data solutions that drive business growth.The ideal candidate will have extensive experience in engineering management, leading high-performing teams to deliver state-of-the-art analytics...