Big Data Infrastructure Engineer

4 days ago


Islamabad, Islamabad, Pakistan NorthBay Solutions Full time

NorthBay Solutions Job Description

We are looking for a skilled Data Engineer to join our team at NorthBay Solutions. In this role, you will be responsible for designing, developing, and implementing robust data pipelines using Microsoft, Databricks Stack.

About the Role

  • You will assess complex new data sources, turning them into business insights, and support the implementation and integration of these new data sources into our Azure Data platform.
  • You will review and analyze structured, semi-structured, and unstructured data sources for quality, completeness, and business value.
  • You will design and implement rapid prototypes that demonstrate the value of the data and present them to diverse audiences.
  • You will participate in early-state design and feature definition activities.

Skill Requirements

  • You have advanced working knowledge and experience with relational and non-relational databases.
  • You have strong analytic skills related to working with structured and unstructured datasets.
  • You have hands-on experience in Azure Databricks utilizing Spark to develop ETL pipelines.
  • You have strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages.
  • You have strong experience in Azure Data Lake Storage Gen2, Azure Data Factory, Databricks, Event Hub, Azure Synapse.
  • You are familiar with several of the following technologies: Event Hub, Docker, Azure Kubernetes Service, Azure DWH, API Azure, Azure Function, Power BI, Azure Cognitive Services.

Qualifications and Experience

  • You have minimum 5-7 years of practical experience as a Data Engineer.
  • You hold a Bachelor's degree in computer science, software engineering, information technology, or a related field.
  • You have Azure cloud stack in-production experience.


  • Islamabad, Islamabad, Pakistan Aricrypta Full time

    Role DescriptionWe are looking for a Data Engineer to lead the development of our big data infrastructure, focusing on scalability, reliability, and efficiency.Key DutiesArchitect and implement data pipelines utilizing Azure Data Factory and Azure Logic Apps.Develop and maintain cloud-based data solutions using AWS, Google Cloud Platform, or Azure.Implement...


  • Islamabad, Islamabad, Pakistan Evamp & Saanga Full time

    About This RoleWe are seeking a highly skilled Big Data Engineer to join our team at Evamp & Saanga. As a key member of our data engineering team, you will design, develop, and implement large-scale data processing systems that meet the needs of our business.Responsibilities include:Designing and building applications and frameworks for big data processing,...


  • Islamabad, Islamabad, Pakistan FuseMachines Full time

    About FusemachinesFusemachines, a leader in AI strategy, talent, and education services, drives innovation through democratized AI. With a presence in 4 countries and over 400 employees, Fusemachines seeks to empower businesses worldwide.About the RoleThis role involves designing, developing, and maintaining large-scale data infrastructure for integration,...


  • Islamabad, Islamabad, Pakistan Evamp & Saanga Full time

    Job DescriptionAs a Big Data Engineer at Evamp & Saanga, you will play a crucial role in designing, developing, and implementing large-scale data processing systems. Your primary focus will be on leveraging big data technologies to build robust and efficient solutions for managing and analyzing vast amounts of data.Key Responsibilities:Designing and...

  • Big Data Specialist

    5 days ago


    Islamabad, Islamabad, Pakistan VisionX Technologies, Inc. Full time

    About VisionXVisionX is a leading innovation partner to Fortune 1000 brands, providing product strategy and custom application development leveraging agile methodologies, technology accelerators, and creating Intellectual Property.We have been recognized as one of the Top 10 Most Innovative Companies of 2020 by Fast Company, alongside Microsoft and Snap...


  • Islamabad, Islamabad, Pakistan Confiz Full time

    Are you a motivated and experienced professional looking for a new challenge? Do you have a passion for Big Data QA Automation?Key ResponsibilitiesDevelop and execute comprehensive test plans to ensure high-quality data and accurate results.Collaborate with the development team to integrate automated tests into the CI/CD pipeline.Use industry-standard tools...


  • Islamabad, Islamabad, Pakistan Confiz Full time

    Confiz is seeking a skilled Big Data QA Automation professional to join our team.Key ResponsibilitiesDevelop and automate processes for gathering expected results from data sources and comparing data results from testing.Assist with the development and maintenance of smoke, performance, functional, and regression tests to ensure code is functioning as...


  • Islamabad, Islamabad, Pakistan Arpatech (Pvt) Ltd Full time

    Job DescriptionAs a Data Engineer at Arpatech (Pvt) Ltd, you will be responsible for designing, building, and maintaining the infrastructure required to manage and process large volumes of data.You will work closely with cross-functional teams to ensure efficient flow, security, and availability of data, enabling analytics reporting and AI-driven...


  • Islamabad, Islamabad, Pakistan Aricrypta Full time

    Job OverviewAricrypta is seeking a skilled Data Engineer to design, build, and maintain infrastructure enabling our organization to store, process, and analyze large volumes of data.Main ResponsibilitiesDesign and implement data pipelines moving data from various sources into a central repository or data lake.Develop and maintain data warehouses and data...


  • Islamabad, Islamabad, Pakistan Confiz Full time

    Confiz is committed to delivering exceptional results through our talented team of professionals.Key ResponsibilitiesDevelop and implement effective test automation strategies to ensure high-quality data and accurate results.Collaborate with the development team to integrate automated tests into the CI/CD pipeline.Use industry-standard tools to write,...

  • Big Data Specialist

    5 days ago


    Islamabad, Islamabad, Pakistan 10Pearls Full time

    We are looking for an experienced Data Engineer to join our team at 10Pearls. Your primary responsibility will be to develop, construct, test, and maintain optimal data pipeline architecture.Key Responsibilities:Develop, construct, test, and maintain optimal data pipeline architecture.Assemble large, complex data sets that meet functional / non-functional...


  • Islamabad, Islamabad, Pakistan VisionX Technologies, Inc. Full time

    About UsVisionX Technologies, Inc. is a leading innovation partner to Fortune 1000 brands, providing product strategy and custom application development leveraging agile methodologies, technology accelerators, and creating Intellectual Property.We have been recognized as one of the Top 10 Most Innovative Companies of 2020 by Fast Company, alongside Microsoft...

  • Cloud Data Engineer

    5 days ago


    Islamabad, Islamabad, Pakistan VisionX Technologies, Inc. Full time

    About VisionXAt VisionX, we empower our employees to grow and thrive in their careers. We offer a comprehensive range of benefits and perks that cater to diverse needs and preferences.Join our dynamic team of innovators and contribute to the development of cutting-edge solutions that drive business results. As a Data Engineer, you will work closely with...


  • Islamabad, Islamabad, Pakistan FuseMachines Full time

    About FusemachinesFusemachines is a pioneer in AI strategy, talent, and education services, providing innovative solutions to businesses worldwide. With operations in 4 countries and over 400 employees, Fusemachines aims to democratize AI and drive growth.About the RoleThis is a contract position responsible for designing, developing, and maintaining...


  • Islamabad, Islamabad, Pakistan ieng Group Full time

    The ieng Group is committed to providing equal opportunities in all aspects of our business, including recruitment. We strive to create an inclusive environment where everyone feels valued and respected.Job DescriptionWe are seeking a highly skilled Data Center Engineer to join our team. The successful candidate will be responsible for designing,...


  • Islamabad, Islamabad, Pakistan Allama Iqbal University Full time

    Sr. System And Archives EngineerThe role requires a strong background in computer science, software engineering, IT, telecom engineering or equivalent fields to maintain efficient and secure connectivity with the data center.Key Responsibilities:Maintain network access storage systems.Operate network devices and video switches for seamless...


  • Islamabad, Islamabad, Pakistan FuseMachines Full time

    About FusemachinesFusemachines, a leader in AI strategy, talent, and education services, empowers businesses to unlock their potential through democratized AI. With a presence in 4 countries and over 400 employees, Fusemachines seeks to drive innovation globally.About the RoleThis role involves designing, developing, and maintaining large-scale data...


  • Islamabad, Islamabad, Pakistan ATSG Full time

    About the Job:Key ResponsibilitiesEvaluate and troubleshoot complex network issues to ensure minimal downtime and optimal network performance.Analyze customer networks to design and implement network infrastructure changes and migrations to improve performance.Complete service requests, network implementations, migrations, and change management engineering...

  • Technical Lead

    5 days ago


    Islamabad, Islamabad, Pakistan 10Pearls Full time

    Our company is seeking a highly skilled Data Engineer to help us build a robust data engineering infrastructure. You will work closely with our data scientists and analysts to develop, deploy, and maintain data pipelines and data warehouses.Key Responsibilities:Design and implement efficient and scalable data pipelines, including data ingestion,...


  • Islamabad, Islamabad, Pakistan VisionX Technologies, Inc. Full time

    ResponsibilitiesUnderstand business requirements, identify and apply suitable Data and Analytics tools and technologies to solve problems, and participate in the architecture and execution of technology solutions.You will help evolve, build, and maintain data pipelines for multiple data sources and collaborate with system owners.Design and develop data...