Cloud Data Architect

4 days ago


Islamabad, Islamabad, Pakistan FuseMachines Full time

About Fusemachines

Fusemachines is a leading AI strategy, talent, and education services provider with a mission to democratize AI. With operations in 4 countries and over 400 employees, Fusemachines aims to bring its global expertise in AI to transform companies worldwide.

About the Role

This is a remote contract position responsible for designing, building, and maintaining large-scale data infrastructure for integration, storage, processing, and analytics (BI, visualization, and Advanced Analytics).

We seek an experienced Senior Data Engineer with a strong background in Python, SQL, PySpark, Azure, Databricks, Synapse, Azure Data Lake, DevOps, and cloud-based large-scale data applications. The ideal candidate will have a passion for data quality, performance, and cost optimization, with experience in Agile development environments.

Qualifications & Experience

  • A full-time Bachelor's degree in Computer Science or similar.
  • At least 5 years of experience as a data engineer with expertise in Databricks, Azure, DevOps, or other hyperscalers.
  • Experience with Azure DevOps, GitHub, and proven experience delivering large-scale projects and products for Data and Analytics, including migrations.
  • The following certifications:
    • Databricks Certified Associate Developer for Apache Spark
    • Databricks Certified Data Engineer Associate
    • Microsoft Certified: Azure Fundamentals
    • Microsoft Certified: Azure Data Engineer Associate
    • Microsoft Exam: Designing and Implementing Microsoft DevOps Solutions (nice to have)

Required Skills/Competencies

  • Strong programming skills in one or more languages such as Python, Scala, and proficiency in writing efficient and optimized code for data integration, migration, storage, processing, and manipulation.
  • Experience with SQL and writing advanced SQL queries.
  • Thorough understanding of big data principles, techniques, and best practices.
  • Experience with scalable and distributed Data Processing Technologies such as Spark/PySpark, DBT, and Kafka to handle large volumes of data.
  • Solid Databricks development experience with significant Python, PySpark, Spark SQL, Pandas, NumPy in Azure environment.
  • Experience in designing and implementing efficient ELT/ETL processes in Azure and Databricks and using open-source solutions to develop custom integration solutions as needed.
  • Skilled in Data Integration from different sources such as APIs, databases, flat files, event streaming.
  • Expertise in data cleansing, transformation, and validation.
  • Proficiency with Relational Databases (Oracle, SQL Server, MySQL, Postgres, or similar) and NonSQL Databases (MongoDB or Table).
  • Good understanding of Data Modeling and Database Design Principles.
  • Experience in designing and implementing Data Warehousing, data lake, and data lake house solutions in Azure and Databricks.
  • Experience with Delta Lake, Unity Catalog, Delta Sharing, Delta Live Tables (DLT).
  • Strong understanding of the software development lifecycle (SDLC), especially Agile methodologies.
  • Knowledge of SDLC tools and technologies Azure DevOps and GitHub.
  • Understanding of DevOps principles, including continuous integration, continuous delivery (CI/CD), infrastructure as code (IaC), configuration management, automated testing, performance tuning, and cost management and optimization.
  • Knowledge in cloud computing specifically in Microsoft Azure services related to data and analytics.
  • Experience in Orchestration using technologies like Databricks workflows and Apache Airflow.
  • Knowledge of data structures and algorithms and good software engineering practices.
  • Proven experience migrating from Azure Synapse to Azure Data Lake, or other technologies.
  • Strong analytical skills to identify and address technical issues, performance bottlenecks, and system failures.
  • Proficiency in debugging and troubleshooting issues in complex data and analytics environments and pipelines.
  • Understanding of Data Quality and Governance.
  • Experience with BI solutions including PowerBI is a plus.
  • Strong written and verbal communication skills.
  • Ability to document processes, procedures, and deployment configurations.
  • Understanding of security practices, including network security groups, Azure Active Directory, encryption, and compliance standards.
  • Ability to implement security controls and best practices within data and analytics solutions.
  • Self-motivated with the ability to work well in a team, and experienced in mentoring and coaching different members of the team.
  • A willingness to stay updated with the latest services, Data Engineering trends, and best practices in the field.
  • Comfortable with picking up new technologies independently and working in a rapidly changing environment with ambiguous requirements.
  • Care about architecture, observability, testing, and building reliable infrastructure and data pipelines.

Responsibilities

  • Architect, design, develop, test, and maintain high-performance, large-scale, complex data architectures.
  • Contribute to detailed design, architectural discussions, and customer requirements sessions.
  • Actively participate in the design, development, and testing of big data products.
  • Construct and fine-tune Apache Spark jobs and clusters within the Databricks platform.
  • Migrate out of Azure Synapse to Azure Data Lake or other technologies.
  • Assess best practices and design schemas that match business needs for delivering a modern analytics solution.
  • Design and implement data models and schemas that support efficient data processing and analytics.
  • Design and develop clear, maintainable code with automated testing.
  • Collaborate with cross-functional teams to understand data requirements and develop data solutions.
  • Evaluate and implement new technologies and tools to improve data integration, data processing, storage, and analysis.
  • Evaluate, design, implement, and maintain data governance solutions.
  • Continuously monitor and fine-tune workloads and clusters to achieve optimal performance.
  • Provide guidance and mentorship to junior team members.
  • Maintain clear and comprehensive documentation of the solutions.
  • Promote and enforce best practices in data engineering, data governance, and data quality.
  • Ensure data quality and accuracy.
  • Design, implement, and maintain data security and privacy measures.
  • Be an active member of an Agile team.


  • Islamabad, Islamabad, Pakistan Geospatial And Cloud Analytics Inc Full time

    Job DescriptionWe are seeking an experienced Cloud Systems Architect to design and deploy scalable, secure, and cost-effective cloud environments using best practices and industry standards.Create robust and resilient cloud solutions ensuring high availability of services.Implement and maintain cloud security measures including access controls, firewalls,...


  • Islamabad, Islamabad, Pakistan Cloudelligent Full time

    As a cloud solutions architect leader at Cloudelligent, you will be responsible for designing and implementing scalable, innovative cloud solutions for our clients.You will focus on cloud modernization, data engineering, and AI/ML integration to drive business transformation. You will collaborate with clients, service delivery managers, and cross-functional...


  • Islamabad, Islamabad, Pakistan Creative Chaos Full time

    **Job Title:** Cloud Infrastructure ArchitectCompany Overview:Creative Chaos is a dynamic company that thrives in a fast-paced environment.We are seeking an experienced Cloud Infrastructure Architect to join our team. As a key member of our team, you will be responsible for designing and implementing cloud-based infrastructure solutions.


  • Islamabad, Islamabad, Pakistan Cloudelligent Full time

    At Cloudelligent, we are seeking an experienced AWS cloud architect expert to join our team.As a senior member of our cloud engineering team, you will be responsible for designing and implementing scalable, secure, and efficient cloud solutions for our clients.Responsibilities:Design and implement cloud-native architectures using AWS technologies, focusing...


  • Islamabad, Islamabad, Pakistan NorthBay Solutions Full time

    Job Title: Cloud Security ArchitectOverview:NorthBay Solutions is an AWS Premier Partner specializing in Generative AI, AI/ML, Managed Cloud Services, and Cloud Migration. We are seeking a highly skilled Cloud Security Architect to design, implement, and manage secure cloud infrastructure for our clients.Responsibilities:Design and deploy secure cloud...


  • Islamabad, Islamabad, Pakistan Motive Full time

    About the Job:We are seeking a skilled Cloud Infrastructure Architect to join our team at Motive.Responsibilities:Evaluate and improve existing cloud infrastructure, collaborating with cross-functional teams to design scalable architecture.Implement robust, maintainable code that powers the platform, providing real-time visibility into company...


  • Islamabad, Islamabad, Pakistan Nets-international Communication Full time

    We are seeking a highly skilled Cloud Architect to lead the design and implementation of our cloud-based solutions. With a strong background in cloud technologies, this individual should have expertise in building scalable, reliable, and secure architectures on leading platforms such as AWS, Azure, or Google Cloud.Key Responsibilities:Design and Implement...


  • Islamabad, Islamabad, Pakistan eMumba Full time

    Skill Overview:eMumba is seeking a skilled Senior DevOps Engineer to join our team. As a key member of our DevOps team, you will play a critical role in designing and implementing cloud-based solutions that meet the needs of our clients.You will have expertise in designing and setting up highly available, fault-tolerant, and scalable applications in public...


  • Islamabad, Islamabad, Pakistan S&P Global, Inc. Full time

    Job Description:We are seeking a skilled Cloud Technical Operations Manager to join our team. In this role, you will oversee initiatives aimed at empowering our internal community by providing advanced support, technical consultancy, conducting architectural reviews, and architecting resilient cloud solutions.You will collaborate closely with the Development...


  • Islamabad, Islamabad, Pakistan eMumba Full time

    We are eMumba, a company committed to innovation and excellence. We are seeking an experienced Cloud Solutions Architect to design, build, and deploy cloud-native solutions using AWS S3, Lambda, ECS, or cloud-agnostic Kubernetes platforms.Key ResponsibilitiesDesign and Build Cloud-Native Solutions: Utilize cloud-native services (AWS S3, Lambda, ECS) or...


  • Islamabad, Islamabad, Pakistan NorthBay Solutions Full time

    At NorthBay Solutions, we are seeking an experienced Cloud Network Security Architect to design and implement secure network infrastructures.About the Role:We require a strong understanding of network security principles, protocols, and best practices.The ideal candidate will have hands-on experience with deploying firewalls, routers, and VPN solutions, as...


  • Islamabad, Islamabad, Pakistan VentureDive Full time

    Job OverviewVentureDive is seeking a seasoned Azure data engineer to design and implement scalable, cloud-based data architectures for our government sector clients. As an ideal candidate, you will possess extensive expertise in the Azure data ecosystem.ResponsibilitiesDesign and implement tailored Azure-based data solutions that meet customer requirements...


  • Islamabad, Islamabad, Pakistan 10Pearls Full time

    About Our CompanyAt 10Pearls, we are committed to helping businesses transform and grow through digital innovation.Job SummaryWe are seeking a Cloud Architect and Engineering Manager to join our team. This role will be responsible for designing and implementing cloud-based solutions using AWS, as well as managing a team of engineers and developers.Main...


  • Islamabad, Islamabad, Pakistan JAZZ Full time

    Job OverviewAt Jazz, we empower millions of customers every day by providing them with innovative mobile and digital services. We value diversity, inclusivity and believe in opportunities for all our employees to grow and develop their skills.Key Responsibilities:Work within a team of Architects and Platform Engineers to deliver and maintain cloud solutions...


  • Islamabad, Islamabad, Pakistan S&P Global Full time

    Key ResponsibilitiesManage all aspects of account administration, from onboarding to decommissioning, ensuring seamless transitions and secure access.Automate deployment, monitoring, and management of cloud resources.Design and implement advanced network connectivity solutions, including VPCs, Transit Gateways (TGWs), CIDR governance, routing, and gateways,...


  • Islamabad, Islamabad, Pakistan Hillcrest Solutions Pvt. Ltd. Full time

    Hillcrest Solutions Pvt. Ltd is hiring a Cloud Core Network Architect to support their Global System Controller project in Pakistan.The ideal candidate will be responsible for designing and implementing cloud core network systems, ensuring scalability and reliability.Main Responsibilities:Design and develop comprehensive HLD/LLD documents for cloud core...


  • Islamabad, Islamabad, Pakistan Cedrus Group (Pvt) Ltd. Full time

    We are seeking an accomplished Cloud Integration Architect to join our dynamic team at Cedrus Group (Pvt) Ltd.Key ResponsibilitiesDesign, develop, and deploy scalable integration solutions using Azure Logic Apps and Azure Functions.Collaborate with stakeholders to gather and understand integration requirements.Monitor, troubleshoot, and optimize integration...


  • Islamabad, Islamabad, Pakistan Aricrypta Full time

    Role DescriptionWe are looking for a Data Engineer to lead the development of our big data infrastructure, focusing on scalability, reliability, and efficiency.Key DutiesArchitect and implement data pipelines utilizing Azure Data Factory and Azure Logic Apps.Develop and maintain cloud-based data solutions using AWS, Google Cloud Platform, or Azure.Implement...


  • Islamabad, Islamabad, Pakistan NADRA Technologies Ltd Full time

    About NADRA Technologies LtdNADRA Technologies Ltd is a leading technology company that provides innovative solutions to businesses and organizations. We are seeking an experienced Enterprise Data Architect to join our team and lead our data architecture initiatives.ResponsibilitiesData Architecture: Design and implement data architecture solutions to...

  • Cloud Data Engineer

    3 days ago


    Islamabad, Islamabad, Pakistan Arpatech (Pvt) Ltd Full time

    Key Responsibilities:Data Pipeline DevelopmentDesign and implement robust ETL/ELT pipelines for data ingestion, transformation, and storage.Optimize data workflows to ensure scalability and performance.Data Integration and StorageIntegrate data from multiple sources into centralized data platforms.Design and maintain databases, data lakes, and warehouses for...