Azure Data Engineer(2)

2 days ago

Hyderabad City Taluka, Pakistan techcarrot Full time
Job Description

Data Engineer

As a Data Engineer in our team, you will be responsible for assessing complex new data sources and quickly turning these into business insights. You will support the implementation and integration of these new data sources into our Azure Data platform.

Responsibilities:
  1. Review and analyze structured, semi-structured, and unstructured data sources for quality, completeness, and business value.
  2. Design, architect, implement, and test rapid prototypes that demonstrate data value and present them to diverse audiences.
  3. Participate in early-stage design and feature definition activities.
  4. Implement robust data pipelines using the Microsoft and Databricks stack.
  5. Create reusable and scalable data pipelines.
  6. Collaborate with team members across multiple engineering teams to support the integration of prototypes into core intelligence products.
  7. Convey complex data insights effectively to non-technical stakeholders.
  8. Manage multiple projects collaboratively in cross-functional teams.
Skills:
  1. Advanced knowledge and experience with relational and non-relational databases.
  2. Experience building and optimizing Big Data pipelines, architectures, and datasets.
  3. Strong analytical skills with structured and unstructured datasets.
  4. Hands-on experience with Azure Databricks and Spark for ETL pipelines.
  5. Proficiency in data analysis, manipulation, and statistical modeling using Spark, Python, Scala, SQL, or similar tools.
  6. Experience with Azure Data Lake Storage Gen2, Azure Data Factory, Databricks, Event Hub, Azure Synapse.
  7. Familiarity with technologies like Event Hub, Docker, Azure Kubernetes Service, Azure DWH, API Azure, Azure Function, Power BI, Azure Cognitive Services.
  8. Azure DevOps experience for deploying data pipelines via CI/CD.
Qualifications and Experience:
  1. Minimum 5-7 years of practical experience as a Data Engineer.
  2. Bachelor's degree in computer science, software engineering, information technology, or a related field.
  3. Experience with the Azure cloud stack.
#J-18808-Ljbffr

  • Azure Data Engineer- Offshore

    4 weeks ago

    Hyderabad City Taluka, Pakistan techcarrot Full time

    Data EngineerAs a Data Engineer in our team, you will be responsible for assessing complex new data sources and quickly turning these into business insights. You also will support the implementation and integration of these new data sources into our Azure Data platform.Responsibilities:You are detailed reviewing and analyzing structured, semi-structured and...

  • Lead Azure Data Platform Developer

    1 day ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Senior Data EngineerWe are seeking a Senior Data Engineer to lead the design, development, and maintenance of our Data as a Service (DaaS) platform on Azure.This role is ideal for someone with expertise in data engineering, data security, and automation. The successful candidate will have experience in designing, implementing, and maintaining secure and...

  • Data Engineer for Cloud Data Platforms

    1 day ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Job SummaryWe seek a skilled Data Engineer to design, implement, and integrate complex data sources into our Azure Data platform.About the RoleThe Data Engineer will work closely with cross-functional teams to develop rapid prototypes that demonstrate data value and present them to diverse audiences.Responsibilities:Data Analysis: Review and analyze...

  • Data Engineering Leader

    2 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Data Engineering Leadership OpportunityWe are seeking an experienced Senior Data Engineer to lead the design, development, and maintenance of our cloud-based data infrastructure on Azure.Key Responsibilities:Data Platform Architecture & Implementation: Design, implement, and maintain secure and scalable data infrastructure in Azure.Data Pipelines & ETL...

  • Data Engineering Leader

    5 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    About the RoleThe Senior Data Engineer will be responsible for leading the design, development, and maintenance of our Data as a Service (DaaS) platform on Azure. This includes designing and implementing secure and scalable data infrastructure, developing and managing data pipelines, and ensuring data consistency, quality, and governance.Requirements5+ years...

  • Senior Data Engineer

    5 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Job DescriptionWe are seeking a Senior Data Engineer to lead the design, development, and maintenance of our Data as a Service (DaaS) platform on Azure. The ideal candidate will have a strong background in data engineering, cloud data platforms, ETL processes, and data governance.Key ResponsibilitiesData Platform Architecture & Implementation: Design,...

  • Engineer - AWS/Azure DevOps

    3 weeks ago

    Hyderabad City Taluka, Pakistan Qualcomm Technologies, Inc Full time

    Company: Qualcomm India Private LimitedJob Area: Engineering Group, Engineering Group > Software EngineeringGeneral Summary:2+ years of experience in AWS/Azure DevOps engineering.It's essential to be proficient with source control management tools such as Git, GitHub, and Perforce (P4). Familiarity with navigating and managing public cloud environments like...

  • Azure Data Solutions Specialist

    2 weeks ago

    Hyderabad City Taluka, Pakistan techcarrot Full time

    Job SummaryWe are seeking an experienced Azure Data Solutions Specialist to join our team and play a key role in designing and implementing scalable data pipelines, optimizing ETL processes, and developing efficient data models.

  • Data Engineer Leader

    5 days ago

    Hyderabad City Taluka, Pakistan beBee Careers Full time

    Job DescriptionWe are seeking a highly skilled and experienced Senior Staff Engineer to lead the design, development, and maintenance of cloud-based platforms and data pipelines.Your expertise in cloud technologies, big data, and software development will be instrumental in creating a platform that can handle massive data volumes and deliver real-time...

  • Cloud Data Platform Engineer

    1 week ago

    Hyderabad City Taluka, Pakistan Backbase Full time

    About the RoleWe are seeking a highly skilled Senior System Engineer to join our team and contribute to building an enterprise-grade "Data as a Service" platform from scratch.This role involves designing, implementing, and maintaining the infrastructure of our Data platform on public cloud (Azure). You will work closely with cross-functional teams to ensure...