Data Engineering Expert

2 weeks ago

Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time 1,800,000 - 2,000,000
Software Engineer

We are seeking an experienced software engineer to join our organization.

Key Responsibilities:
  • Data Pipeline Development: Design, develop and maintain scalable data pipelines on cloud platforms.
  • Workflow Optimization: Optimize and automate data workflows using cloud-based services such as Dataproc, BigQuery, Dataflow, Cloud Storage and Pub/Sub.
  • ETL Process Management: Build and maintain Extract, Transform, Load processes for data ingestion, transformation and loading into data warehouses.
  • Pipeline Reliability: Ensure the reliability and performance of data pipelines by implementing orchestration tools like Apache Airflow.
  • Collaboration: Collaborate with stakeholders to gather and translate requirements into technical solutions.
  • Data Warehousing Expertise: Work on multiple data warehousing projects applying a thorough understanding of concepts such as dimensions, facts and slowly changing dimensions (SCDs).
  • Large-Scale Data Processing: Develop scripts and applications in Python and PySpark to handle large-scale data processing tasks.
  • Data Analysis: Write optimized SQL queries for data analysis and transformations.
  • Deployment and Management: Use GitHub, Jenkins, Terraform and Ansible to deploy and manage code in production.
  • Troubleshooting: Troubleshoot and resolve issues related to data pipelines ensuring high availability and scalability.

  • Data Engineering and Consulting Expert

    1 week ago

    Hyderabad City Taluka, Pakistan beBeeData Full time 15,000,000 - 25,000,000

    Job SummaryWe are seeking a highly skilled data professional to join our team as a Data Engineer/Consultant Specialist.This role offers an exciting opportunity to work on cutting-edge projects, driving business growth and enhancing customer experiences through expert data management and infrastructure design.Main Responsibilities:Data Pipelines Integration:...

  • Expert Data Architect

    6 days ago

    Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time $90,000 - $120,000

    Are you an expert in data engineering with a passion for innovation?We're seeking a highly skilled and experienced Data Engineer to join our team.Job Description:As a Data Engineer, you will be responsible for designing and developing robust data pipelines within Azure Data Lake. You will work closely with cross-functional teams to understand data...

  • Big Data Solutions Expert

    1 week ago

    Hyderabad City Taluka, Pakistan beBeeData Full time 6,000,000 - 8,000,000

    Job Title: Data ArchitectWe are seeking a seasoned Data Architect to design, build, and optimize scalable data pipelines and architectures.Key Responsibilities:Design and implement data models and integrate data from multiple sources.Develop robust ETL/ELT pipelines and ensure seamless data flow.Leverage backend engineering skills to support API integrations...

  • Senior Data Engineer for Data Strategy Development

    2 weeks ago

    Hyderabad City Taluka, Pakistan beBeeDataProfessional Full time 1,500,000 - 2,500,000

    Job Opportunity:We are seeking an experienced data professional to support critical data integration and application development initiatives.The ideal candidate will have a strong foundation in Python, SQL, and PySpark, along with proven experience in working across data pipelines, ontologies, and security configurations within the Palantir ecosystem.This...

  • Staff Data Engineer

    2 weeks ago

    Hyderabad City Taluka, Pakistan FANATICS INC Full time

    OverviewJoin our dynamic Digital Marketing Data Engineering team at Fanatics, where you'll play a critical role in shaping the big data ecosystem that powers our eCommerce and Digital Marketing platforms. As a full-time Staff Data Engineer, you'll design, build, and optimize scalable data pipelines and architectures, ensuring seamless data flow and effective...

  • Staff Data Engineer

    1 week ago

    Hyderabad City Taluka, Pakistan FANATICS INC Full time

    OverviewJoin our dynamic Digital Marketing Data Engineering team at Fanatics, where you'll play a critical role in shaping the big data ecosystem that powers our eCommerce and Digital Marketing platforms. As a full-time Staff Data Engineer, you'll design, build, and optimize scalable data pipelines and architectures, ensuring seamless data flow and effective...

  • Highly Skilled Data Engineer

    1 week ago

    Hyderabad City Taluka, Pakistan beBeeDataEngineer Full time 15,000,000 - 25,000,000

    Job Summary:We are seeking a highly skilled data engineer to support critical data integration and application development initiatives.The ideal candidate will have a strong foundation in Python, SQL, PySpark, and Azure services, along with proven experience in working across data pipelines, ontologies, and security configurations within the Palantir...

  • Data Engineer

    1 week ago

    Hyderabad City Taluka, Pakistan techcarrot Full time

    OverviewAs a Data Engineer in our team, you will be responsible for assessing complex new data sources and quickly turning these into business insights. You will support the implementation and integration of these new data sources into our Azure Data platform.ResponsibilitiesYou are detailed reviewing and analyzing structured, semi-structured and...

  • Data Governance Expert

    6 days ago

    Hyderabad City Taluka, Pakistan beBeeDataGovernance Full time $40,000 - $60,000

    Job OverviewWe are seeking a Data Governance Expert to manage and oversee the quality of data across our organization. The ideal candidate will have a strong background in data administration and management functions, as well as excellent communication and collaboration skills.Key ResponsibilitiesManage assigned tasks to ensure data meets the standard...

  • Principal Data Engineer

    1 week ago

    Hyderabad City Taluka, Pakistan beBeeData Full time 10,000,000 - 15,000,000

    Data Engineering OpportunityWe are seeking an experienced Data Engineer to drive business growth through data-driven insights. The ideal candidate will possess a strong background in designing, implementing, and maintaining large-scale data pipelines.