Data Engineer

1 week ago

Hyderabad City Taluka, Pakistan techcarrot Full time
Overview

As a Data Engineer in our team, you will be responsible for assessing complex new data sources and quickly turning these into business insights. You will support the implementation and integration of these new data sources into our Azure Data platform.


Responsibilities
  • You are detailed reviewing and analyzing structured, semi-structured and unstructured data sources for quality, completeness, and business value.
  • You design, architect, implement and test rapid prototypes that demonstrate value of the data and present them to diverse audiences.
  • You participate in early state design and feature definition activities.
  • Responsible for implementing robust data pipeline using Microsoft, Databricks Stack.
  • Responsible for creating reusable and scalable data pipelines.
  • You are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.
  • You have strong communication skills to effectively convey complex data insights to non-technical stakeholders.

Skills
  • Advanced working knowledge and experience with relational and non-relational databases.
  • Advanced working knowledge and experience with API data providers.
  • Experience building and optimizing Big Data pipelines, architectures, and datasets.
  • Strong analytic skills related to working with structured and unstructured datasets.
  • Hands-on experience in Azure Databricks utilizing Spark to develop ETL pipelines.
  • Strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages.
  • Strong experience in Azure Data Lake Storage Gen2, Azure Data Factory, Databricks, Event Hub, Azure Synapse.
  • Familiarity with several of the following technologies: Event Hub, Docker, Azure Kubernetes Service, Azure DWH, API Azure, Azure Function, Power BI, Azure Cognitive Services.
  • Azure DevOps experience to deploy the data pipelines through CI/CD.

Qualifications and Experience
  • Minimum 5-7 years of practical experience as Data Engineer.
  • Bachelor's degree in computer science, software engineering, information technology, or a related field.
  • Azure cloud stack in-production experience.

#J-18808-Ljbffr

  • Principal Data Engineer

    1 week ago

    Hyderabad City Taluka, Pakistan beBeeData Full time 10,000,000 - 15,000,000

    Data Engineering OpportunityWe are seeking an experienced Data Engineer to drive business growth through data-driven insights. The ideal candidate will possess a strong background in designing, implementing, and maintaining large-scale data pipelines.

  • Azure Data Engineers

    3 weeks ago

    Hyderabad City Taluka, Pakistan GSPANN Technologies, Inc Full time

    OverviewGSPANN Technologies, Inc is hiring Azure Data Engineers with expertise in Site Reliability Engineering (SRE) to optimize and automate large-scale data applications. The role focuses on ensuring system reliability and performance using Azure data services such as Azure Data Factory, Azure Databricks, Azure Cosmos DB, and Power...

  • Staff Data Engineer

    2 weeks ago

    Hyderabad City Taluka, Pakistan FANATICS INC Full time

    OverviewJoin our dynamic Digital Marketing Data Engineering team at Fanatics, where you'll play a critical role in shaping the big data ecosystem that powers our eCommerce and Digital Marketing platforms. As a full-time Staff Data Engineer, you'll design, build, and optimize scalable data pipelines and architectures, ensuring seamless data flow and effective...

  • Staff Data Engineer

    2 weeks ago

    Hyderabad City Taluka, Pakistan FANATICS INC Full time

    OverviewJoin our dynamic Digital Marketing Data Engineering team at Fanatics, where you'll play a critical role in shaping the big data ecosystem that powers our eCommerce and Digital Marketing platforms. As a full-time Staff Data Engineer, you'll design, build, and optimize scalable data pipelines and architectures, ensuring seamless data flow and effective...

  • Data Engineering Expert

    2 weeks ago

    Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time 1,800,000 - 2,000,000

    Software EngineerWe are seeking an experienced software engineer to join our organization.Key Responsibilities:Data Pipeline Development: Design, develop and maintain scalable data pipelines on cloud platforms.Workflow Optimization: Optimize and automate data workflows using cloud-based services such as Dataproc, BigQuery, Dataflow, Cloud Storage and...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad City Taluka, Pakistan techcarrot Full time

    OverviewAs a Data Engineer in our team, you will be responsible for assessing complex new data sources and quickly turning these into business insights. You also will support the implementation and integration of these new data sources into our Azure Data platform.ResponsibilitiesYou are detailed reviewing and analyzing structured, semi-structured and...

  • Cloud Data Engineer

    1 week ago

    Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time 28,000 - 35,000

    Cloud Data Engineer Role OverviewWe are seeking a skilled Cloud Data Engineer to join our data infrastructure team.This role is responsible for all aspects of data collection and ingestion pipeline management. The ideal candidate will have experience with bash/Python scripting in Linux environments, proficiency in Docker and Infrastructure-as-Code concepts,...

  • Lead Data Engineer

    2 weeks ago

    Hyderabad City Taluka, Pakistan JP Morgan Chase Full time

    Join us as we embark on a journey of collaboration and innovation, where your unique skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference.As a Lead Data Engineer at JPMorgan Chase within the CCB (Connected Commerce), you are an integral part of an agile team that works to enhance, build,...

  • Senior Data Engineer for Data Strategy Development

    2 weeks ago

    Hyderabad City Taluka, Pakistan beBeeDataProfessional Full time 1,500,000 - 2,500,000

    Job Opportunity:We are seeking an experienced data professional to support critical data integration and application development initiatives.The ideal candidate will have a strong foundation in Python, SQL, and PySpark, along with proven experience in working across data pipelines, ontologies, and security configurations within the Palantir ecosystem.This...

  • Data Engineering Consultant

    2 weeks ago

    Hyderabad City Taluka, Pakistan beBeeData Full time 1,200,000 - 1,800,000

    Job OverviewA strategic role for a highly skilled data engineer consultant to design, develop and optimize scalable data architectures utilizing Azure Databricks, PySpark and Prophesy.Key Responsibilities:Define data requirements and strategies to drive business growth.Design, develop and maintain efficient data pipelines.Collaborate with cross-functional...