
Big Data Engineer
4 weeks ago
Get AI-powered advice on this job and more exclusive features.
Direct message the job poster from Adept Tech Solutions
GPU whisperer | Teaching silicon to see and thinkType: Full-time (Onsite)
Working Hours: 9:00 AM - 5:30 PM
Experience Level: 1-2 years
About the Role
We're seeking a Big Data Engineer to build sophisticated data processing pipelines that combine traditional data engineering with statistical analysis and ML preprocessing capabilities using PySpark at scale.
Key Responsibilities
- Build scalable ETL/ELT pipelines using PySpark and Apache Spark ecosystem with integrated statistical analysis and data quality frameworks
- Develop ML preprocessing pipelines with advanced data transformation, feature engineering, and automated validation systems
- Optimize performance for large-scale distributed data processing while monitoring pipeline reliability and troubleshooting issues
- Collaborate with data scientists and analysts to translate business requirements into robust technical solutions
- Implement data governance practices and ensure compliance with security standards
Required Technical Skills
- 1-2 years PySpark/Apache Spark with Big Data ecosystem: HDFS, Hive, SparkSQL, Parquet, Delta Lake
- Data warehousing and orchestration: BigQuery/Snowflake/Redshift, Airflow/Prefect/Dagster, Databricks
- Advanced SQL performance tuning for distributed systems, strong Python with scientific computing libraries
Statistical Analysis & ML Engineering
- Statistical computing and hypothesis testing methodologies
- Data preprocessing and mathematical transformation techniques
- Data quality engineering and anomaly detection frameworks
- ML pipeline development and feature engineering automation
- Time-series analysis and categorical data processing
- String processing and similarity analysis algorithms
Required Experience & Knowledge
- 1-2 years building enterprise-level data pipelines in production with Big Data technologies and distributed systems
- Domain understanding: statistical methodology application, data quality principles, performance optimization for big data, data modeling and schema design
- Educational background: Bachelor's in Computer Science/Statistics/Mathematics/Data Science/Engineering with strong mathematical foundation
- Strong problem-solving skills and attention to detail in high-volume data environments
Preferred Qualifications
- Experience with streaming technologies (Kafka, Kinesis), NoSQL databases, modern data transformation tools (dbt)
- Knowledge of data governance frameworks, data visualization tools (Power BI, Tableau), MLOps practices
- Familiarity with advanced analytics platforms and data monitoring tools
- Experience working in agile development environments
What We're Looking For
Analytical problem-solver with big data mindset, understanding of distributed systems and scalability challenges, quality-focused approach to building robust systems, and ability to collaborate effectively with cross-functional teams including data scientists, analysts, and engineering teams.
This role combines traditional big data engineering with advanced analytics capabilities, perfect for someone with 1-2 years of experience ready to work at the intersection of big data, statistics, and machine learning in our Islamabad office.
Seniority level- Seniority levelEntry level
- Employment typeFull-time
- Job functionEngineering and Information Technology
- IndustriesSoftware Development
Referrals increase your chances of interviewing at Adept Tech Solutions by 2x
Sign in to set job alerts for "Big Data Developer" roles.Associate Software Engineer- Data EngineerAssociate Software Engineer - Data ScienceL1 Application Support Engineer – Data Science SolutionsFull Stack Developer - Python & Angular (Onsite, Islamabad, Remittance Salary)Full STack Developer - [Python + Angular]Senior AI Engineer – AI-Powered Data PlatformSenior Software Developer (C++ & Python) - Team LeadWe're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr-
Senior Big Data Specialist
6 days ago
Islamabad, Islamabad, Pakistan beBeeDataEngineer Full time $150,000 - $180,000Job OverviewWe are seeking a skilled Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining large-scale data systems.Your primary focus will be on building scalable, efficient, and reliable data pipelines that meet the needs of our business.You will work closely with...
-
Associate Software Engineer- Data Engineer
3 weeks ago
Islamabad, Islamabad, Pakistan Devsinc Full timeWe are looking for a highly motivated Associate Software Engineer – Data Engineering to join our team. This is an excellent opportunity for recent graduates or early-career professionals who are passionate about data engineering, big data technologies, and building scalable data pipelines. In this role, you will work with experienced engineers to develop,...
-
Data Engineer Position Available
1 week ago
Islamabad, Islamabad, Pakistan beBeeDataEngineer Full time 4,000,000 - 8,000,000Data Engineering Role:">We are seeking a motivated individual to fill our Data Engineer position.This is an excellent opportunity for recent graduates or early-career professionals who are passionate about data engineering, big data technologies, and building scalable data pipelines.
-
Senior Data Engineer Role
6 days ago
Islamabad, Islamabad, Pakistan beBeeData Full time 4,000,000 - 8,000,000Job TitleWe are seeking a highly motivated professional to join our team as an Associate Software Engineer – Data Engineering. This is an excellent opportunity for recent graduates or early-career professionals who are passionate about data engineering, big data technologies, and building scalable data pipelines.Key ResponsibilitiesAssist in designing,...
-
Enterprise Data Engineer
6 days ago
Islamabad, Islamabad, Pakistan beBeeData Full time $900,000 - $1,500,000Data Engineering OpportunityWe are seeking a skilled Data Engineer to design, build, and maintain large-scale data pipelines using PySpark and Databricks.The successful candidate will collaborate closely with stakeholders to clarify requirements and suggest improvements, ensuring our data infrastructure is robust, scalable, and efficient.
-
Senior ETL Data Engineer
3 weeks ago
Islamabad, Islamabad, Pakistan NorthBay - Pakistan Full timeJob Title: Senior ETL Data Engineer (Ab Initio / Informatica)Experience: 4+ YearsLocation: Lahore / Karachi / Islamabad (Hybrid)Job Type: Full-TimeAbout The RoleWe are looking for a highly skilled Senior ETL Data Engineer (Ab Initio / Informatica) with strong experience in building robust data pipelines, working with large-scale datasets, and leveraging...
-
Islamabad, Islamabad, Pakistan Cloud Enterprise Business Solutions (CEBS) Full timeData Engineer with PySpark and Databricks ExpertiseData Engineer with PySpark and Databricks ExpertiseGet AI-powered advice on this job and more exclusive features.Direct message the job poster from Cloud Enterprise Business Solutions (CEBS)As a Data Engineer, you will play a pivotal role in designing, building, and maintaining large-scale data pipelines...
-
Transformative Senior Data Architect
6 days ago
Islamabad, Islamabad, Pakistan beBeeData Full time 2,500,000 - 3,500,000Big Data Engineering OpportunityOur organization seeks a highly skilled Senior ETL Data Engineer with strong experience in building robust data pipelines, working with large-scale datasets, and leveraging modern Big Data and cloud technologies.Key Responsibilities:Design and develop complex ETL pipelines and data solutions using Big Data and cloud-native...
-
Chief Data Infrastructure Specialist
6 days ago
Islamabad, Islamabad, Pakistan beBeeData Full time 1,500,000 - 2,000,000Job Title: Data EngineerWe are seeking a skilled professional to design and develop large-scale data pipelines using modern big data technologies and cloud-native tools.Key Responsibilities:Design, build, and maintain scalable data infrastructure and pipelines in a cloud-based architecture.Develop efficient distributed data processing systems using Hadoop,...
-
Data Engineer
3 weeks ago
Islamabad, Islamabad, Pakistan Codeaza Technologies Full timeCodeaza Technologies is dedicated to helping individuals and businesses showcase their ideas. Whether it's building a website, launching an online store, or selling services, our team of experienced developers can turn your dreams into reality. We are passionate about providing innovative solutions and exceptional customer experiences.Company...