High-Performance Data Engineer for Large-Scale Analytics

24 hours ago

Islamabad, Islamabad, Pakistan beBeeDataEngineer Full time 15,000,000 - 20,000,000
About the Job

We are seeking an experienced Senior Data Engineer to design, develop, and maintain high-performance, large-scale data architectures for data integration (batch and real-time), storage, processing, orchestration, and infrastructure. The ideal candidate will ensure scalability, reliability, and performance using Azure Databricks and other relevant technologies.

Key Responsibilities
  • Architect and design data pipelines for efficient data processing, storage, and analytics.
  • Develop, test, and maintain scalable data architectures using Apache Spark and Databricks.
  • Collaborate with cross-functional teams to understand data requirements and deliver reusable components.
  • Migrate from Azure Synapse to Azure Data Lake or other technologies as needed.
  • Design and implement efficient ELT/ETL processes in Azure and Databricks; develop custom integration solutions as needed.
Requirements
  • Bachelor's degree in Computer Science or a related field.
  • At least 5 years of experience as a senior data engineer with expertise in Databricks, Azure, DevOps, or other hyperscalers.
  • Strong programming skills in Python, Scala, and SQL.
  • Experience with cloud computing in Microsoft Azure for data and analytics: ADF, Databricks, Synapse, Data Lake, etc.
  • Databricks Certified Associate Developer for Apache Spark and other relevant certifications.
Preferred Qualifications
  • Experience with data warehousing, data lake, and data lake house solutions in Azure and Databricks.
  • Familiarity with SDLC tools: Azure DevOps, GitHub; project management (Jira/Azure Boards), source control, CI/CD (GitHub Actions, Azure Pipelines).
  • DevOps principles: CI/CD, IaC (Terraform, ARM), configuration management, automated testing, performance tuning, cost optimization.
Benefits

As a member of our team, you will have opportunities for professional growth, mentorship, and collaboration with experienced engineers. You will also be working on challenging projects that can make a significant impact on the business.

Others

This is a remote contract position responsible for designing, building, and maintaining the infrastructure required for data integration, storage, processing, and analytics (BI, visualization, and Advanced Analytics). We are looking for a skilled Senior Data Engineer with a strong background in Python, SQL, PySpark, Azure, Databricks, Synapse, Azure Data Lake, DevOps, and cloud-based large-scale data applications with a passion for data quality, performance, and cost optimization.

  • Large Scale Project Executive

    3 days ago

    Islamabad, Islamabad, Pakistan beBeeProgramManager Full time 10,000,000 - 15,000,000

    Senior Program ManagerWe are seeking a seasoned Senior Program Manager to lead our teams in managing large-scale engagements and mitigating risks.Manage the strategic aspects of large projects, identifying and mitigating potential risks.Oversee senior managers and project managers working on client engagements within projects and organization.Ensure that...

  • Senior Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBeeDataEngineering Full time 900,000 - 1,200,000

    Data Engineering Expertise WantedWe are seeking a seasoned data engineering professional to join our team in transforming and ensuring the accuracy and consistency of our data. Our company is undergoing a significant overhaul of its data transformation processes, and we require an expert who can write PySpark and SQL scripts to validate data pipelines,...

  • High-Performance Enterprise Solutions Leader

    5 days ago

    Islamabad, Islamabad, Pakistan beBeeEnterprise Full time 2,200,000 - 2,500,000

    Frontend ArchitectWe are seeking an experienced Frontend Architect to lead the frontend architecture of complex enterprise-grade web applications.Maintain and enhance existing React applications using AG Grid.Define and enforce frontend architecture and design patterns.Optimize applications for speed, scalability, and responsiveness.Key...

  • Data Scientist/Engineer

    6 days ago

    Islamabad, Islamabad, Pakistan SwipBox Full time $125,000 - $175,000 per year

    Job Summary:We are looking for a skilledData Engineer/Data Scientistwith strong Python programming and analytical skills, who can work across the data pipeline from ingestion and processing to modelling and reporting. The ideal candidate has experience handling large-scale (big) datasets, building predictive models, working with live and runtime data (e.g.,...

  • Chief Analytics Strategist

    3 days ago

    Islamabad, Islamabad, Pakistan beBeeDataScience Full time $90,000 - $120,000

    We are seeking an accomplished Data Science Leader to spearhead data science initiatives across the organization. This pivotal role will oversee strategic direction and execution of data science projects, driving innovation in predictive modeling, machine learning, and advanced analytics.Key Responsibilities:Create and implement a comprehensive data science...

  • Data Engineer in Test

    2 weeks ago

    Islamabad, Islamabad, Pakistan Confiz Full time

    We are undergoing a significant data transformation to ensure that accurate and consistent data is available precisely when and where it's needed.ResponsibilitiesWrite PySpark and SQL scripts to validate data pipelines, transformations, and integrations.Design and run tests for data validation, storage, and retrieval using Azure services like Data Lake,...

  • Sr. Data Engineer Azure Databricks

    1 day ago

    Islamabad, Islamabad, Pakistan Fusemachines Full time

    About FusemachinesFusemachines is a 10+ year old AI company, dedicated to delivering state-of-the-art AI products and solutions to a diverse range of industries. Founded by Sameer Maskey, Ph.D., an Adjunct Associate Professor at Columbia University, our company is on a steadfast mission to democratize AI and harness the power of global AI talent from...

  • Data Analytics

    6 days ago

    Islamabad, Islamabad, Pakistan Dost Solutions Full time 3,290,000 per year

    Key ResponsibilitiesOversee the development and implementation of Business Intelligence (BI) and Advanced Analytics initiatives.Design and maintain data models, dashboards, and reporting systems to provide actionable insights for decision-making.Explore data sources to identify patterns, trends, and anomalies, enabling data-driven policy...

  • Sr. Data Engineer Azure Databricks

    10 hours ago

    Islamabad, Islamabad, Pakistan North Eastern Services Full time

    About FusemachinesFusemachines is a 10+ year old AI company, dedicated to delivering state-of-the-art AI products and solutions to a diverse range of industries. Founded by Sameer Maskey, Ph.D., an Adjunct Associate Professor at Columbia University, our company is on a steadfast mission to democratize AI and harness the power of global AI talent from...

  • Data Scientist and Engineer Position

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBeeData Full time $60,000 - $120,000

    Senior Data Engineer and Scientist\About the Role:Job Overview:We are seeking a highly skilled Senior Data Engineer and Scientist to join our team. This role involves designing and implementing scalable data architectures, developing and optimizing data pipelines, and collaborating with cross-functional teams to drive business outcomes.The ideal candidate...