Big Data Engineer

1 week ago

Karachi, Sindh, Pakistan beBeeData Full time 15,000,000 - 25,000,000
Job Description

This is an excellent opportunity for data engineers to work with us.

We're seeking skilled professionals who can design, develop and maintain scalable ETL solutions for data pipelines, enhancing and optimizing existing processes to meet evolving business needs.

  • Create efficient data workflows that seamlessly integrate with our systems.
  • Develop robust ETL solutions using Apache Airflow and AWS Glue to extract, transform and load large datasets.
  • Design scalable data architectures on AWS cloud data lake platforms including services like S3, Athena and Redshift.

We require strong SQL skills with a focus on complex query development and optimization. Experience integrating Python applications with RESTful APIs and external services is also necessary.

Requirements:
  • Minimum 3 years of experience working with big data tools and frameworks such as PySpark, Databricks and related technologies.
  • Deep understanding of data warehouse concepts, architectures and structures.
  • Expertise in cloud technologies particularly AWS services including AWS Data Lake and Amazon EMR for big data processing.
  • Familiarity with machine learning concepts and their application to data cleaning and integration tasks.

  • Big Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan Syhtek Full time

    The Big Data Engineer is responsible for designing, developing and managing big data platforms to process and analyze large datasets. You will work with cutting-edge technologies to ensure seamless data flow, scalability and high-performance systems. Your work will be crucial in providing actionable insights for decision-making across the business. Join us...

  • Big Data Expert

    1 week ago

    Karachi, Sindh, Pakistan beBeeData Full time $80,000 - $150,000

    Our organization is seeking a talented Data Architect to design and develop scalable data platforms. This key role will play a crucial part in shaping our data-driven strategies.Main Responsibilities:Platform Development: Create efficient data systems that meet business requirements, utilizing expertise in big data platforms such as Hadoop, Spark, and...

  • Big Data Architect

    6 days ago

    Karachi, Sindh, Pakistan beBeeDataEngineer Full time $120,000 - $140,000

    About UsWe are a pioneering AI company with over 10 years of experience in delivering cutting-edge AI products and solutions to various industries. Our mission is to democratize AI and tap into the global talent pool from underserved communities.About The OpportunityThis is a remote, contract position that involves designing, building, and maintaining...

  • Senior Data Engineer Leader

    6 days ago

    Karachi, Sindh, Pakistan beBeeDataEngineer Full time 5,000,000 - 6,000,000

    Job Title: Senior Data Engineer LeaderJob Description:This is a leadership role for a Senior Data Engineer responsible for defining and executing the Big Data platform vision and roadmap. This includes aligning with business goals, leveraging Azure Big Data services, leading capacity planning, contributing to PI planning for effective resource allocation,...

  • Data Engineer

    2 weeks ago

    Karachi, Sindh, Pakistan SentientAI Full time $90,000 - $120,000 per year

    Job Summary We're hiring a Data Engineer to join our growing data engineering team focused on designing, building, and optimizing scalable data pipelines. The ideal candidate will have experience with big data processing engines, distributed storage, and strong skills in data analysis. Key Responsibilities • Design, build, and manage data pipelines using...

  • Senior Data Engineer

    1 week ago

    Karachi, Sindh, Pakistan Enterprise64 Full time

    OverviewEnterprise64 is a U.S.-based technology company that creates digital solutions for startups to Fortune 500 companies in the United States, Europe, and the United Arab Emirates. We are growing rapidly across all our global offices and have career opportunities for tech professionals who are looking to work in a fast-growing company, work in a fun...

  • Data Engineer

    3 weeks ago

    Karachi, Sindh, Pakistan Contour Software Full time

    Join to apply for the Data Engineer role at Contour SoftwareJoin to apply for the Data Engineer role at Contour SoftwareGet AI-powered advice on this job and more exclusive features.About ContourContour Software has grown from a dozen people to over 2,000 staff across 3 cities, in less than 14 years.About ContourContour Software has grown from a dozen people...

  • Data Engineering Lead

    2 weeks ago

    Karachi, Sindh, Pakistan Techlogix Full time

    Core SkillsData engineer with a solid technical background and banking experience in data-intensive systems (>7 years)Strong experience in Big Data, Hadoop Ecosystem, Spark Streaming, Kafka, Python, SQL, Hive, NIFI, AirflowProficient with Azure Cloud services such as Azure Data Factory (ADF), Databricks, ADLS, Azure Synapse, Logic Apps, Azure Functions. Or...

  • Data Engineering Lead

    2 weeks ago

    Karachi, Sindh, Pakistan Techlogix Full time $90,000 - $120,000 per year

    Core Skills:Data engineer with a solid technical background and banking experience in data-intensive systems (>7 years)Strong experience in Big Data, Hadoop Ecosystem, Spark Streaming, Kafka, Python, SQL, Hive, NIFI, AirflowProficient with Azure Cloud services such as Azure Data Factory (ADF), Databricks, ADLS, Azure Synapse, Logic Apps, Azure Functions. Or...

  • Key Data Engineering Leadership Role

    1 week ago

    Karachi, Sindh, Pakistan beBeeDataEngineering Full time 12,000,000 - 15,000,000

    Job Title: Data Engineering Lead Job Description:We are seeking an experienced professional to lead our data engineering team. The ideal candidate will have a solid technical background and banking experience in data-intensive systems, with a minimum of 7 years of experience.The successful candidate will be responsible for developing and maintaining ETL/ELT...