
Data Engineer for Big Data Architecture
1 day ago
We are seeking an experienced Data Engineer to join our team and play a key role in designing and maintaining our big data architecture. As a hands-on data engineer, you will be responsible for building and managing our Medallion Architecture (Raw → Curated → Semantic) on MINIO-based Delta Lake.
Key Responsibilities:
- Develop and manage data pipelines across ingestion, transformation, and enrichment using Apache Spark and Delta Lake.
- Design and maintain Raw, Curated, and Semantic Zones within the Data Lake following the Medallion Architecture.
- Enable scalable processing and curation using Apache Spark (batch + structured streaming).
- Implement data modeling in OLAP columnar formats for BI performance.
- Collaborate with governance teams to ensure data is discoverable, high-quality, and catalogued via Open Metadata.
- Support structured and federated queries across data zones using Trino.
- Contribute to data quality frameworks, lineage tracking, and performance tuning.
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- 3 to 5 years of experience in data engineering, ETL development, or related fields.
- Hands-on experience with Python and R for data manipulation and ETL automation.
- Experience with Tableau for data visualization and reporting.
- Strong experience in SQL development and database optimization.
- Experience with Apache Spark (PySpark) or Trino.
- Working knowledge of object stores (MINIO, S3) and Delta-Lake architecture.
-
Big Data Engineer
2 weeks ago
Islamabad, Islamabad, Pakistan Evamp & Saanga Full timeAs a Big Data Engineer specializing in Java development, you will play a crucial role in designing, developing, and implementing large-scale data processing systems. Your primary focus will be on leveraging big data technologies to build robust and efficient solutions for managing and analyzing vast amounts of data. You will collaborate with cross-functional...
-
Big Data Platform Lead
5 days ago
Islamabad, Islamabad, Pakistan beBee Careers Full timeTechnical Requirements:We are seeking a Senior Data Engineer with strong expertise in Azure, who has at least 7 years of experience working on generation of big datasets using different data sources, in the Media industry. The ideal candidate will have hands-on experience with Python, Pyspark, Jupyter Notebooks, familiarity with Databricks, Azure Databricks,...
-
Big Data Expert
1 hour ago
Islamabad, Islamabad, Pakistan beBee Careers Full timeAbout the RoleWe are seeking a highly skilled and experienced Big Data Engineer to join our team. As a Big Data Engineer, you will play a crucial role in designing, developing, and implementing large-scale data processing systems.Your primary focus will be on leveraging big data technologies to build robust and efficient solutions for managing and analyzing...
-
Big Data Integration Specialist
1 day ago
Islamabad, Islamabad, Pakistan beBee Careers Full timeAbout the OpportunityWe are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining high-performance, large-scale complex data architectures using Python, SQL, PySpark, Azure, Databricks, Synapse, Azure Data Lake, DevOps, and cloud-based...
-
Lead Big Data Engineer
17 hours ago
Islamabad, Islamabad, Pakistan beBee Careers Full timeAbout the PositionWe are seeking a Lead Big Data Engineer to join our team. The successful candidate will be responsible for architecting, designing, and developing large-scale data systems using big data technologies such as Apache Spark and Azure Databricks.The ideal candidate will have strong experience with cloud-based large-scale data applications and...
-
Cloud Data Engineer
3 days ago
Islamabad, Islamabad, Pakistan beBee Careers Full timeAbout the RoleThis is a unique opportunity to create a meaningful impact by designing and implementing our big data architecture. As a cloud data engineer, you will be responsible for developing and managing scalable data pipelines, integrating multiple systems, and supporting various applications.We are looking for a skilled professional with expertise in...
-
Big Data Professional
1 week ago
Islamabad, Islamabad, Pakistan ieng Group Full timeieng Group is a cutting-edge technology company that focuses on delivering innovative data engineering solutions. We are currently seeking a talented Big Data Expert to join our team and contribute to the development of our data-driven products.
-
Senior Azure Data Engineer
5 days ago
Islamabad, Islamabad, Pakistan beBee Careers Full timeJob Summary:This full-time position is responsible for leading the development and implementation of big data solutions using Azure Cloud Platform. We are looking for a well-rounded architect with expertise in cloud-based big data applications, who can collaborate with developers on the team to achieve architecture and design objectives as agreed with...
-
Big Data Test Automation Engineer
1 week ago
Islamabad, Islamabad, Pakistan Confiz Full timeAt Confiz, we are committed to providing our employees with a vibrant culture of learning and collaboration.About the RoleWe are seeking a highly skilled Big Data Test Automation Engineer to join our team. The successful candidate will be responsible for designing, developing, and maintaining automated testing frameworks for our big data projects.The ideal...
-
Big Data Specialist
2 weeks ago
Islamabad, Islamabad, Pakistan Clustox Inc. Full timeData Engineering RoleWe are a mission-driven organization building an innovative cloud-based platform to combat coral reef degradation. As a Senior Data Engineer, you will play a critical role in designing and optimizing data systems that power our conservation efforts.Your responsibilities will include creating scalable ETL/ELT pipelines using Azure...