Big Data Engineer

4 weeks ago


Islamabad, Islamabad, Pakistan Adept Tech Solutions Full time

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Adept Tech Solutions

GPU whisperer | Teaching silicon to see and think

Type: Full-time (Onsite)

Working Hours: 9:00 AM - 5:30 PM

Experience Level: 1-2 years

About the Role

We're seeking a Big Data Engineer to build sophisticated data processing pipelines that combine traditional data engineering with statistical analysis and ML preprocessing capabilities using PySpark at scale.

Key Responsibilities

  • Build scalable ETL/ELT pipelines using PySpark and Apache Spark ecosystem with integrated statistical analysis and data quality frameworks
  • Develop ML preprocessing pipelines with advanced data transformation, feature engineering, and automated validation systems
  • Optimize performance for large-scale distributed data processing while monitoring pipeline reliability and troubleshooting issues
  • Collaborate with data scientists and analysts to translate business requirements into robust technical solutions
  • Implement data governance practices and ensure compliance with security standards

Required Technical Skills

  • 1-2 years PySpark/Apache Spark with Big Data ecosystem: HDFS, Hive, SparkSQL, Parquet, Delta Lake
  • Data warehousing and orchestration: BigQuery/Snowflake/Redshift, Airflow/Prefect/Dagster, Databricks
  • Advanced SQL performance tuning for distributed systems, strong Python with scientific computing libraries

Statistical Analysis & ML Engineering

  • Statistical computing and hypothesis testing methodologies
  • Data preprocessing and mathematical transformation techniques
  • Data quality engineering and anomaly detection frameworks
  • ML pipeline development and feature engineering automation
  • Time-series analysis and categorical data processing
  • String processing and similarity analysis algorithms

Required Experience & Knowledge

  • 1-2 years building enterprise-level data pipelines in production with Big Data technologies and distributed systems
  • Domain understanding: statistical methodology application, data quality principles, performance optimization for big data, data modeling and schema design
  • Educational background: Bachelor's in Computer Science/Statistics/Mathematics/Data Science/Engineering with strong mathematical foundation
  • Strong problem-solving skills and attention to detail in high-volume data environments

Preferred Qualifications

  • Experience with streaming technologies (Kafka, Kinesis), NoSQL databases, modern data transformation tools (dbt)
  • Knowledge of data governance frameworks, data visualization tools (Power BI, Tableau), MLOps practices
  • Familiarity with advanced analytics platforms and data monitoring tools
  • Experience working in agile development environments

What We're Looking For

Analytical problem-solver with big data mindset, understanding of distributed systems and scalability challenges, quality-focused approach to building robust systems, and ability to collaborate effectively with cross-functional teams including data scientists, analysts, and engineering teams.

This role combines traditional big data engineering with advanced analytics capabilities, perfect for someone with 1-2 years of experience ready to work at the intersection of big data, statistics, and machine learning in our Islamabad office.

Seniority level
  • Seniority levelEntry level
Employment type
  • Employment typeFull-time
Job function
  • Job functionEngineering and Information Technology
  • IndustriesSoftware Development

Referrals increase your chances of interviewing at Adept Tech Solutions by 2x

Sign in to set job alerts for "Big Data Developer" roles.Associate Software Engineer- Data EngineerAssociate Software Engineer - Data ScienceL1 Application Support Engineer – Data Science SolutionsFull Stack Developer - Python & Angular (Onsite, Islamabad, Remittance Salary)Full STack Developer - [Python + Angular]Senior AI Engineer – AI-Powered Data PlatformSenior Software Developer (C++ & Python) - Team Lead

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

  • Islamabad, Islamabad, Pakistan beBeeDataEngineer Full time $150,000 - $180,000

    Job OverviewWe are seeking a skilled Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining large-scale data systems.Your primary focus will be on building scalable, efficient, and reliable data pipelines that meet the needs of our business.You will work closely with...


  • Islamabad, Islamabad, Pakistan Devsinc Full time

    We are looking for a highly motivated Associate Software Engineer – Data Engineering to join our team. This is an excellent opportunity for recent graduates or early-career professionals who are passionate about data engineering, big data technologies, and building scalable data pipelines. In this role, you will work with experienced engineers to develop,...


  • Islamabad, Islamabad, Pakistan beBeeDataEngineer Full time 4,000,000 - 8,000,000

    Data Engineering Role:">We are seeking a motivated individual to fill our Data Engineer position.This is an excellent opportunity for recent graduates or early-career professionals who are passionate about data engineering, big data technologies, and building scalable data pipelines.


  • Islamabad, Islamabad, Pakistan beBeeData Full time 4,000,000 - 8,000,000

    Job TitleWe are seeking a highly motivated professional to join our team as an Associate Software Engineer – Data Engineering. This is an excellent opportunity for recent graduates or early-career professionals who are passionate about data engineering, big data technologies, and building scalable data pipelines.Key ResponsibilitiesAssist in designing,...


  • Islamabad, Islamabad, Pakistan beBeeData Full time $900,000 - $1,500,000

    Data Engineering OpportunityWe are seeking a skilled Data Engineer to design, build, and maintain large-scale data pipelines using PySpark and Databricks.The successful candidate will collaborate closely with stakeholders to clarify requirements and suggest improvements, ensuring our data infrastructure is robust, scalable, and efficient.


  • Islamabad, Islamabad, Pakistan NorthBay - Pakistan Full time

    Job Title: Senior ETL Data Engineer (Ab Initio / Informatica)Experience: 4+ YearsLocation: Lahore / Karachi / Islamabad (Hybrid)Job Type: Full-TimeAbout The RoleWe are looking for a highly skilled Senior ETL Data Engineer (Ab Initio / Informatica) with strong experience in building robust data pipelines, working with large-scale datasets, and leveraging...


  • Islamabad, Islamabad, Pakistan Cloud Enterprise Business Solutions (CEBS) Full time

    Data Engineer with PySpark and Databricks ExpertiseData Engineer with PySpark and Databricks ExpertiseGet AI-powered advice on this job and more exclusive features.Direct message the job poster from Cloud Enterprise Business Solutions (CEBS)As a Data Engineer, you will play a pivotal role in designing, building, and maintaining large-scale data pipelines...


  • Islamabad, Islamabad, Pakistan beBeeData Full time 2,500,000 - 3,500,000

    Big Data Engineering OpportunityOur organization seeks a highly skilled Senior ETL Data Engineer with strong experience in building robust data pipelines, working with large-scale datasets, and leveraging modern Big Data and cloud technologies.Key Responsibilities:Design and develop complex ETL pipelines and data solutions using Big Data and cloud-native...


  • Islamabad, Islamabad, Pakistan beBeeData Full time 1,500,000 - 2,000,000

    Job Title: Data EngineerWe are seeking a skilled professional to design and develop large-scale data pipelines using modern big data technologies and cloud-native tools.Key Responsibilities:Design, build, and maintain scalable data infrastructure and pipelines in a cloud-based architecture.Develop efficient distributed data processing systems using Hadoop,...

  • Data Engineer

    3 weeks ago


    Islamabad, Islamabad, Pakistan Codeaza Technologies Full time

    Codeaza Technologies is dedicated to helping individuals and businesses showcase their ideas. Whether it's building a website, launching an online store, or selling services, our team of experienced developers can turn your dreams into reality. We are passionate about providing innovative solutions and exceptional customer experiences.Company...