Big Data Engineer

5 days ago

Islamabad, Islamabad, Pakistan Adept Tech Solutions Full time

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Adept Tech Solutions

GPU whisperer | Teaching silicon to see and think

Type: Full-time (Onsite)

Working Hours: 9:00 AM - 5:30 PM

Experience Level: 1-2 years

About the Role

We're seeking a Big Data Engineer to build sophisticated data processing pipelines that combine traditional data engineering with statistical analysis and ML preprocessing capabilities using PySpark at scale.

Key Responsibilities

  • Build scalable ETL/ELT pipelines using PySpark and Apache Spark ecosystem with integrated statistical analysis and data quality frameworks
  • Develop ML preprocessing pipelines with advanced data transformation, feature engineering, and automated validation systems
  • Optimize performance for large-scale distributed data processing while monitoring pipeline reliability and troubleshooting issues
  • Collaborate with data scientists and analysts to translate business requirements into robust technical solutions
  • Implement data governance practices and ensure compliance with security standards

Required Technical Skills

  • 1-2 years PySpark/Apache Spark with Big Data ecosystem: HDFS, Hive, SparkSQL, Parquet, Delta Lake
  • Data warehousing and orchestration: BigQuery/Snowflake/Redshift, Airflow/Prefect/Dagster, Databricks
  • Advanced SQL performance tuning for distributed systems, strong Python with scientific computing libraries

Statistical Analysis & ML Engineering

  • Statistical computing and hypothesis testing methodologies
  • Data preprocessing and mathematical transformation techniques
  • Data quality engineering and anomaly detection frameworks
  • ML pipeline development and feature engineering automation
  • Time-series analysis and categorical data processing
  • String processing and similarity analysis algorithms

Required Experience & Knowledge

  • 1-2 years building enterprise-level data pipelines in production with Big Data technologies and distributed systems
  • Domain understanding: statistical methodology application, data quality principles, performance optimization for big data, data modeling and schema design
  • Educational background: Bachelor's in Computer Science/Statistics/Mathematics/Data Science/Engineering with strong mathematical foundation
  • Strong problem-solving skills and attention to detail in high-volume data environments

Preferred Qualifications

  • Experience with streaming technologies (Kafka, Kinesis), NoSQL databases, modern data transformation tools (dbt)
  • Knowledge of data governance frameworks, data visualization tools (Power BI, Tableau), MLOps practices
  • Familiarity with advanced analytics platforms and data monitoring tools
  • Experience working in agile development environments

What We're Looking For

Analytical problem-solver with big data mindset, understanding of distributed systems and scalability challenges, quality-focused approach to building robust systems, and ability to collaborate effectively with cross-functional teams including data scientists, analysts, and engineering teams.

This role combines traditional big data engineering with advanced analytics capabilities, perfect for someone with 1-2 years of experience ready to work at the intersection of big data, statistics, and machine learning in our Islamabad office.

Seniority level
  • Seniority levelEntry level
Employment type
  • Employment typeFull-time
Job function
  • Job functionEngineering and Information Technology
  • IndustriesSoftware Development

Referrals increase your chances of interviewing at Adept Tech Solutions by 2x

Sign in to set job alerts for "Big Data Developer" roles.Associate Software Engineer- Data EngineerAssociate Software Engineer - Data ScienceL1 Application Support Engineer – Data Science SolutionsFull Stack Developer - Python & Angular (Onsite, Islamabad, Remittance Salary)Full STack Developer - [Python + Angular]Senior AI Engineer – AI-Powered Data PlatformSenior Software Developer (C++ & Python) - Team Lead

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

  • Big Data Platform Owner

    1 week ago

    Islamabad, Islamabad, Pakistan Confiz Full time

    We are looking for an experienced and driven Big Data Platform Owner (Engineering Manager) to lead our Big Data engineering team. This role is perfect for a technical leader with a strong background in Azure Big Data technologies who can drive strategy, foster team growth, and ensure the successful delivery of high-quality data solutions. You will be...

  • Chief Architect

    1 week ago

    Islamabad, Islamabad, Pakistan beBeeData Full time 1,800,000 - 2,500,000

    Big Data Engineering Leadership OpportunityWe are seeking an experienced Big Data Platform Owner to lead our engineering team. This role is ideal for a technical leader with a strong background in Azure Big Data technologies who can drive strategy, foster team growth, and ensure the successful delivery of high-quality data solutions.Key...

  • Associate Software Engineer- Data Engineer

    3 days ago

    Islamabad, Islamabad, Pakistan Devsinc Full time

    We are looking for a highly motivated Associate Software Engineer – Data Engineering to join our team. This is an excellent opportunity for recent graduates or early-career professionals who are passionate about data engineering, big data technologies, and building scalable data pipelines. In this role, you will work with experienced engineers to develop,...

  • Data Engineer

    1 week ago

    Islamabad, Islamabad, Pakistan NorthBay Solutions LLC Full time

    Job Title: Data EngineerLocation:Karachi, Lahore , Islamabad (Hybrid)Experience:5+ YearsJob Type: Full-TimeJob Overview:We are looking for a highly skilled and experienced Data Engineer with a strong foundation in Big Data, distributed computing, and cloud-based data solutions. This role demands a strong understanding of end-to-end Data pipelines, data...

  • Senior Data Engineer

    4 weeks ago

    Islamabad, Islamabad, Pakistan TenX Full time

    JOB SUMMARY:Data Engineers are responsible for designing and creating the data warehouse and all related extraction, transformation, and load of data functions. He should be able to analyze and digest what a business wants to accomplish with its data and design the best possible ETL/BI process around those goals.DESCRIPTION:Data Warehouse /ETLParticipates in...

  • Senior Software Data Engineer

    3 days ago

    Islamabad, Islamabad, Pakistan beBeeDataEngineer Full time 3,500,000 - 5,000,000

    Software Data Engineer PositionWe are looking for a highly motivated and skilled software engineer to join our team as a data engineer. This is an excellent opportunity for recent graduates or early-career professionals who are passionate about data engineering, big data technologies, and building scalable data pipelines.Job Description:The successful...

  • SM EDW and Big Data Development

    3 weeks ago

    Islamabad, Islamabad, Pakistan PTCLal Full time

    Get AI-powered advice on this job and more exclusive features.Sign in to access AI-powered advicesContinue with Google Continue with GoogleDirect message the job poster from PTCL.OfficialTalent Acquisition | Talent & Organizational Development | Total Rewards | HR Transformation | Reporting & AnalyticsARE YOU READY TO RISE WITH PTCL GROUPWith our unwavering...

  • Strategic Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBeeData Full time 1,200,000 - 1,500,000

    Senior Data EngineerWe are seeking an experienced Senior Data Engineer to join our team.Design and develop complex data pipelines using Big Data and cloud-native technologies.Leverage tools such as Ab Initio, Informatica, DBT, and Apache Spark to build scalable data workflows.Implement distributed data processing using Hadoop, Hive, Kafka, and Spark.Build...

  • Data Scientist/Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan SwipBox Full time

    Job Summary: We are looking for a skilled Data Engineer/Data Scientist with strong Python programming and analytical skills, who can work across the data pipeline from ingestion and processing to modelling and reporting. The ideal candidate has experience handling large-scale (big) datasets, building predictive models, working with live and runtime data...

  • Data Science Professional

    5 days ago

    Islamabad, Islamabad, Pakistan beBeeDataEngineer Full time 900,000 - 1,200,000

    Big Data EngineerWe are seeking an experienced professional to join our team as a Big Data Engineer. The successful candidate will be responsible for designing and implementing sophisticated data processing pipelines that combine traditional data engineering with statistical analysis and machine learning preprocessing capabilities using PySpark at scale.The...