
Senior Big Data Engineer
5 days ago
As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention policies, identifying performance bottlenecks, and accessing external data. You will develop and implement data Lake solutions for company-wide applications and manage large sets of structured, semi-structured, and unstructured data. You will work in a modern cloud-based data lakehousing environment alongside a team of diverse, intense, and interesting co-workers.
Job Responsibilities- Performing analysis of large data stores and derive insights using Big Data querying
- Design and develop code, scripts, and data pipelines that leverage structured, semi-structured, and unstructured data
- Manage data ingestion pipelines and stream processing
- Perform computations using Azure functions
- Responsible for the documentation, design, and development of Hadoop applications
- Perform day-to-day tasks accurately with minimal direction while meeting deadlines
- Bachelor/master's degree in computer science
- At least 4-6 years of relevant working experience with Cloud Computation
- Hands-on experience on Azure/AWS
- Experience working with Apache Spark, Apache Hive, Apache HBase
- Hands-on experience on SQL, Scala, Node.js, JS, Java
- Experience with Python including Pandas, NumPy, TensorFlow
- Experience with ETL
- Implementing Lambda Architecture with stream processing and batch processing
- Implement security standards and practices in the Architecture of Cloud Solution
- Training/Certification on Data Lake HDFS
- Training/Certification on Azure Data Lake Gen 2
- Training/Certification on Data Bricks
- Experience with Azure Data Explorer and Kusto query language would be a plus
- Experience with Azure Data Factory would be a plus
-
Senior Big Data Engineer
7 days ago
Lahore, Punjab, Pakistan Avanceon Limited Full timeJoin to apply for the Senior Big Data Engineer (Azure) role at Avanceon Middle East & South Asia.As a Big Data engineer, you will be responsible for data-related implementation tasks that include provisioning of data storage services, ingesting, streaming and batch data, transforming data, implementing security requirements, implementing data retention...
-
Senior Big Data Engineer
5 days ago
Lahore, Punjab, Pakistan NorthBay Solutions LLC Full timeWe are hiring for Senior Big Data Engineer with solid experience in data engineering and a passion for Big Data. The ideal candidate will have experience of over 4 to 6+ years specifically in Data Engineering.You will have the chance to join a global, multi-cultural team of Data Engineers, participate in a large variety of exciting and challenging projects,...
-
Big Data Engineer Lead
4 days ago
Lahore, Punjab, Pakistan NorthBay Solutions LLC Full timeJob DescriptionWe are seeking a highly skilled Senior Big Data Engineer to join our team at NorthBay Solutions LLC.The ideal candidate will have experience in data engineering and a passion for Big Data, with a strong understanding of the ETL cycle and distributed processing technologies.Key Responsibilities:Design and develop Big Data solutions using...
-
Big Data Engineer
1 week ago
Lahore, Punjab, Pakistan Arbisoft Full timeSoftware Engineering - Arbisoft, Lahore, Islamabad, KarachiWe are looking for a skilled Big Data Engineer with 5+ years of experience in building scalable data solutions. The ideal candidate will have strong coding skills (preferably in Python or Java) and experience in managing the end-to-end development lifecycle—from development to deployment in...
-
Senior Big Data Solutions Architect
7 days ago
Lahore, Punjab, Pakistan Avanceon Limited Full timeWe are looking for a seasoned Senior Big Data Solutions Architect to lead our team's data engineering efforts.The successful candidate will have extensive experience with big data technologies and a strong understanding of data lake architecture. Key responsibilities include implementing lambda architecture with stream processing and batch processing, as...
-
Cloud Big Data Solutions Architect
4 days ago
Lahore, Punjab, Pakistan NorthBay Solutions LLC Full timeJob SummaryWe are looking for a highly skilled Senior Big Data Engineer to join our team at NorthBay Solutions LLC.The ideal candidate will have experience in data engineering and a passion for Big Data, with a strong understanding of the ETL cycle and distributed processing technologies.Key Responsibilities:Design and develop Big Data solutions using...
-
Big Data Solutions Engineer
7 days ago
Lahore, Punjab, Pakistan Tkxel LLC Full timeAbout Tkxel LLCTkxel is a leading software development company located in Reston, Virginia. We are dedicated to developing innovative software solutions for top enterprises in the world, helping them grow their businesses using cutting-edge technology solutions.Job DescriptionThe role requires a deep understanding of cloud-based big data ecosystems (AWS &...
-
Big Data Technology Lead
7 days ago
Lahore, Punjab, Pakistan Avanceon Limited Full timeWe are looking for a senior Big Data Technology Lead to drive our data engineering efforts forward.The successful candidate will have extensive experience with big data technologies and a strong understanding of data lake architecture. Key responsibilities include implementing lambda architecture with stream processing and batch processing, as well as...
-
Big Data Engineer
7 days ago
Lahore, Punjab, Pakistan Vodworks Full timeWe are seeking a highly skilled Big Data Engineer to join our analytics team at Vodworks. In this role, you will be responsible for designing and implementing data solutions that meet business needs.Key Responsibilities:Data Analysis and InsightsAnalyze complex data to provide actionable insights and identify trends for informed decision-making.Database and...
-
Senior Data Engineering Specialist
4 days ago
Lahore, Punjab, Pakistan NorthBay Solutions LLC Full timeAbout the RoleNorthBay Solutions LLC is seeking a seasoned Senior Big Data Engineer to lead our data engineering efforts.This role involves designing and developing large-scale ETL pipelines in AWS-based environments, as well as collaborating with the team to develop cutting-edge Big Data and Cloud technologies.Key Responsibilities:Design and develop complex...
-
Senior Big Data Solutions Specialist
5 days ago
Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full timeJob ResponsibilitiesOur ideal candidate will have a strong background in big data engineering, with hands-on experience in designing and developing scalable big data solutions. They will be responsible for:Designing and developing data pipelines using Hadoop, Spark, and NoSQL databasesManaging large datasets and performing data analyticsProviding insights...
-
Big Data Engineering Leader
7 days ago
Lahore, Punjab, Pakistan Devsinc Full timeAbout the OpportunityWe are looking for a talented Data Engineer to join our team at Devsinc.Key Skills and QualificationsProven experience (3+ years) as a Data Engineer or similar role in data management, processing, and analytics.Experience with data modeling, ETL frameworks, and big data tools like Apache Hadoop, Spark, Kafka, etc.Proficiency in...
-
Data Engineer
5 days ago
Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full timeCompany OverviewAvanceon Middle East & South Asia is a leading provider of technology solutions, committed to delivering exceptional services to our clients. Our team of experts works tirelessly to stay ahead of the curve in the ever-evolving world of data storage and processing.Job DescriptionAs a Senior Big Data Engineer at Avanceon Middle East & South...
-
Big Data MongoDB Specialist
1 week ago
Lahore, Punjab, Pakistan FRESME Full timeBig Data MongoDB SpecialistAbout the Role:We are seeking a Big Data MongoDB Specialist to join our team. As a key member, you will be responsible for designing, developing, and maintaining MongoDB databases for high performance, scalability, and security in big data environments.Responsibilities:- Design and implement MongoDB databases for big data...
-
Data Engineering Team Lead
4 days ago
Lahore, Punjab, Pakistan NorthBay Solutions LLC Full timeJob DetailsNorthBay Solutions LLC is seeking a highly skilled Senior Big Data Engineer to join our team.The ideal candidate will have experience in data engineering and a passion for Big Data, with a strong understanding of the ETL cycle and distributed processing technologies.Key Responsibilities:Design and develop complex ETL jobs and pipelines in...
-
Big Data Expert
4 days ago
Lahore, Punjab, Pakistan Gtradecenter Full timeAt Gtradecenter, we're looking for a highly skilled Big Data Expert to join our development team.About UsWe're a growing company in the IT industry, with over 10 years of experience in software development. Our mission is to automate daily work processes for our clients using innovative business solutions.We take pride in our diverse team, consisting of...
-
Senior Big Data Manager
4 days ago
Lahore, Punjab, Pakistan Confiz Full timeOur Technology StackWe utilize a range of big data tools and technologies, including Azure, Apache NiFi, and Power BI. Our team is well-versed in data lake architecture, data model design, and implementation, as well as enterprise application and data integration design and implementation.What We OfferA dynamic and innovative work environment.Opportunities...
-
Cloud Solutions Architect
7 days ago
Lahore, Punjab, Pakistan Big Data Inc Full timeEnterprise Java ExpertBig Data Inc seeks a highly skilled Enterprise Java Expert to lead our team's efforts in designing, developing, and delivering effective enterprise solutions.Description:This role requires expertise in designing, testing, and implementing cutting-edge open source software, technologies, and methodologies.Responsibilities include leading...
-
Senior Data Engineering Professional
6 days ago
Lahore, Punjab, Pakistan Confiz Full timeWe are seeking a highly skilled data engineer to expand and optimize our big data pipelines using Azure services.About You:You have a strong understanding of data engineering concepts, including data warehousing, publishing, and visualization.You have experience in designing, prototyping, implementing, and optimizing data ingestion pipelines.You have...
-
Senior Business Development Manager
1 week ago
Lahore, Punjab, Pakistan Big Entities Full timeWe are seeking a results-driven Senior Business Development Manager to drive growth and establish strong client relationships.Key ResponsibilitiesDevelop and execute business development strategies for acquiring new clients.Build and manage email pipelines and LinkedIn outreach to engage prospects.Conduct market research to identify potential clients and...