Big Data Solutions Engineer

1 day ago

Lahore, Punjab, Pakistan beBee Careers Full time

We are seeking a talented Senior Big Data Engineer to lead our team's efforts in designing and developing cutting-edge Big Data and Cloud technologies.

Job Description

The ideal candidate will have 4-6+ years of experience in Data Engineering, with a strong background in ETL, Big Data, and Cloud technologies. They will be responsible for designing, developing, and managing complex ETL jobs and pipelines, as well as driving large-scale data processing pipelines.

Responsibilities
  • Design and develop innovative solutions using Big Data technologies, including ETL pipelines, Python, Hadoop, Spark, and Hive.
  • Create and drive large-scale ETL jobs and pipelines in AWS-based environments, utilizing services such as EMR, Glue, Lambda, and Athena.
  • Develop expertise in integrating data from multiple sources and driving complex data processing pipelines.
  • Analyze and optimize large-scale datasets, leveraging distributed computing frameworks like Spark.

The successful candidate will have strong software development and programming skills in Python, PySpark, and/or Scala, as well as proficiency in ETL schedulers, such as StepFunction or Apache Airflow.

Qualifications
  • 4-6+ years of experience in Data Engineering, with a strong understanding of the ETL cycle.
  • Excellent knowledge of Big Data engineering, ETL, Data Modeling, SQL Scripting, and Data Architecture.
  • Strong understanding of data warehousing concepts, relational databases (e.g., PostgreSQL, MySQL), and columnar databases (e.g., Redshift, BigQuery, HBase, ClickHouse).
  • Experience with containerization technologies, CI/CD pipelines, and IAC tools like Docker, Jenkins, Terraform.

  • Big Data Solutions Architect

    22 hours ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Big Data Solutions ArchitectWe are seeking an experienced Big Data Solutions Architect to design, develop, and maintain our enterprise data platform.You will collaborate with Data Engineers, BI Engineers, and Data Business Analysts across various platform layers, ensuring a scalable, secure, and high-performance data infrastructure.Responsibilities:Develop...

  • Senior Big Data Engineer

    6 days ago

    Lahore, Punjab, Pakistan NorthBay Solutions LLC Full time

    We are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, participate in a large variety of exciting and challenging projects,...

  • Big Data Engineer

    6 days ago

    Lahore, Punjab, Pakistan Arbisoft Full time

    Software Engineering - Arbisoft, Lahore, Islamabad, KarachiWe are looking for a skilled Big Data Engineer with 5+ years of experience in building scalable data solutions. The ideal candidate will have strong coding skills (preferably in Python or Java) and experience in managing the end-to-end development lifecycle—from development to deployment in...

  • Data Engineer

    1 day ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a highly skilled data engineer to expand and optimize our big data pipelines.Collaborate with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines so that data is shared effectively across various business systems.Build ETL/ELT Ingestion pipelines and analytics solutions using cloud and...

  • Big Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan Aug AI Full time

    Direct message the job poster from Aug AIMarketing Strategy | Campaign Management | Marketing Automation | Google Ads, Facebook Ads, LinkedIn Ads | Analytics and Reporting | LinkedIn Lead GenerationLocation: Lahore / On-siteExperience Required: 4–5 yearsType: Full-TimeJob Summary:Note: The following description appears to be about a Big Data Engineer role,...

  • Big Data Engineering Specialist

    1 day ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    BIG DATA ENGINEER ROLEWe are seeking a highly skilled Big Data Engineer to join our team. As a key member of the team, you will be responsible for developing and implementing data lake solutions, managing large sets of structured, semi-structured, and unstructured data in a modern cloud-based environment, and working closely with a diverse team of...

  • Senior Big Data Engineer

    6 days ago

    Lahore, Punjab, Pakistan Avanceon Limited Full time

    Join to apply for the Senior Big Data Engineer (Azure) role at Avanceon Middle East & South Asia.As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention...

  • Senior Big Data Engineer Position

    24 hours ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    A Senior Big Data Engineer PositionJob Description:We are seeking an experienced Senior Big Data Engineer to lead our data engineering team. The ideal candidate will have 4-5 years of experience in Big Data technologies, hands-on experience with Spark, Hadoop, Hive, Kafka, or similar technologies, and proficiency in Python, Scala, or Java.About the Job:This...

  • Big Data Specialist Professional

    1 day ago

    Lahore, Punjab, Pakistan Arbisoft Full time

    We are looking for a talented Big Data Specialist Professional to join our team at Arbisoft in Lahore, Islamabad, Karachi.Main Responsibilities:Develop and maintain robust data pipelines and platforms using scalable data solutions.Work on end-to-end data engineering projects, ensuring smooth deployment in production environments.Requirements:Minimum 5+ years...

  • Big Data Architect

    24 hours ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    We are seeking a highly skilled Senior Big Data Engineer to join our team. The ideal candidate will have solid experience in data engineering and a passion for Big Data. They should have over 4 to 6+ years of experience specifically in Data Engineering.Key Responsibilities:Design and develop cutting-edge Big Data and Cloud technologies to build critical,...