Azure ETL Pipeline Architect

1 week ago


Islamabad, Islamabad, Pakistan Shrewd Codes Full time

Job Requirements

We are seeking an experienced Cloud Data Engineering Specialist to join our team at Shrewd Codes. This role will be responsible for designing, implementing, and maintaining large-scale data pipelines using Azure Data Factory.

Key Responsibilities:

  • Design and implement data orchestration workflows using Azure Data Factory Pipelines & Dataflows.
  • Develop a deep understanding of the business requirements and provide insights from a data perspective.
  • Create simple to complex pipelines & dataflows in ADF.
  • Implement security and authorization frameworks within data modules.
  • Stay up-to-date with changing processes as the project evolves in size and function.
  • Implement visualization and traditional reporting in Power BI.

Requirements:

  • Expert level knowledge of Azure Data Factory and Power BI.
  • Experience with analytics, particularly in real estate and finance domains.
  • Advanced knowledge of Azure SQL DB & Synapse Analytics, Power BI, SSIS, SSAS, and Logic Apps.
  • Able to analyze and understand complex data.
  • Experience with security implementation like RLS in Power BI and data governance in Azure.
  • Knowledge of Azure Data Lake, SQL Databases, Stream Analytics, Azure DevOps, and CI/CD.
  • Strong data modeling and database design skills with excellent knowledge of SQL Server best practices.
  • Excellent interpersonal and communication skills (both oral and written) with the ability to communicate at various levels with clarity & precision.
  • Candidate must have a clear understanding of DW lifecycle and contribute to preparing design documents, unit test plans, and code review reports.
  • Experience working in an Agile environment (Scrum, Lean, Kanban) is a plus.
  • Familiarity with big data technologies – Spark Framework, NoSQL, Azure Data Bricks, and Hadoop Ecosystem (Hive, Impala, HDFS, YARN, Pig, Oozie) is a plus.


  • Islamabad, Islamabad, Pakistan Itcs Full time

    We are seeking a highly skilled Azure Services Architect to join our team at Itcs in Islamabad. The ideal candidate will be responsible for designing, implementing, and managing cloud-based infrastructure to ensure seamless delivery of applications and services.Key ResponsibilitiesCloud ArchitectureAzure Service ManagementDevOps IntegrationSecurity and...


  • Islamabad, Islamabad, Pakistan Confiz Full time

    Confiz seeks a skilled Senior Data Engineer to design, build, and maintain efficient data pipelines for business analytics and reporting.Key Responsibilities:Develop and implement ETL/ELT data pipelines using Oracle Data Integrator (ODI).Create optimized data models for performance, scalability, and business needs.Work closely with data analysts, BI...

  • ETL Workflow Developer

    11 hours ago


    Islamabad, Islamabad, Pakistan ID-ware Group Full time

    Job DescriptionDevelop, implement, and optimize ETL workflows to extract, transform, and load data from various sources.Write efficient Python scripts and applications for data processing, ETL, and data analysis.Design and maintain data pipelines for ETL and reporting.Work with relational and non-relational databases (SQL, NoSQL) to store and retrieve data...


  • Islamabad, Islamabad, Pakistan ID-ware Full time

    ID-ware OverviewID-ware is a rapidly growing company that offers a career-oriented position for a skilled Python developer. We provide opportunities for career growth and professional development.Job RequirementsWe are seeking a highly experienced Python developer to develop, implement, and optimize ETL workflows to extract, transform, and load data from...


  • Islamabad, Islamabad, Pakistan ID-ware Full time

    Company OverviewID-ware provides a unique opportunity for a skilled Python developer to join our rapidly growing team. As an international team player, you will work with multinational clients in an exciting environment.Job RequirementsWe are looking for a highly experienced Python developer to develop, implement, and optimize ETL workflows to extract,...

  • ETL Developer

    3 weeks ago


    Islamabad, Islamabad, Pakistan Bush and Bush Law Group Full time

    Company Overview:Bush & Bush Law Group is a fast-paced law firm dedicated to providing exceptional legal services. We are looking for a skilled and motivated ETL Developer (Python) to join our data engineering team. In this role, you will be responsible for designing and implementing data extraction, transformation, and loading processes to enhance our data...

  • Data Architect

    1 week ago


    Islamabad, Islamabad, Pakistan VisionX Technologies, Inc. Full time

    About VisionX Technologies, Inc.VisionX is a leading provider of innovation solutions to top brands. Our team collaborates with Fortune 1000 companies, leveraging agile methodologies, technology accelerators, and Intellectual Property creation. We have been recognized as one of the Top 10 Most Innovative Companies of 2020 by Fast Company, alongside industry...


  • Islamabad, Islamabad, Pakistan Nisum Full time

    Job DescriptionThis role involves designing, implementing, and maintaining large-scale data systems on Azure. Responsibilities include developing and deploying ETL processes, creating complex SQL queries, and integrating data from various sources.


  • Islamabad, Islamabad, Pakistan Shrewd Codes Full time

    Bachelor or master's degree in computer science or related field.This role will be responsible for creating data orchestration with Azure Data Factory Pipelines & Dataflows. Key responsibilities include understanding business requirements and implementing reporting using Power BI.ResponsibilitiesUnderstand business requirements and actively provide inputs...


  • Islamabad, Islamabad, Pakistan Itcs Full time

    We are Itcs, a cutting-edge organization dedicated to delivering exceptional software solutions. We are looking for a skilled DevOps Pipeline Specialist to join our team in Islamabad and contribute to the success of our software delivery process.Job ResponsibilitiesPipeline Design and Implementation: Design and implement Azure DevOps pipelines for CI/CD...


  • Islamabad, Islamabad, Pakistan Shrewd Codes Full time

    Bachelor or master's degree in computer science or related field.This role will be responsible for creating data orchestration with Azure Data Factory Pipelines & Dataflows. Key responsibilities include understanding the business requirements and implementing reporting using Power BI.ResponsibilitiesUnderstand business requirements and actively provide...


  • Islamabad, Islamabad, Pakistan Shrewd Codes Full time

    Job SummaryShrewd Codes is seeking a highly skilled Azure ETL Pipeline Architect to design and implement large-scale data pipelines using Azure Data Factory. As an expert in cloud data engineering, you will play a key role in shaping our data strategy and driving business growth.Key Responsibilities:Design and implement data orchestration workflows using...


  • Islamabad, Islamabad, Pakistan Confiz Limited Full time

    Technical leader responsible for designing, implementing, and managing .Net solutions. The ideal candidate will have a strong background in software engineering, .Net ecosystem and expertise in MS technologies. The Architect will collaborate with various stakeholders to translate business requirements into scalable, secure, and cost-effective cloud...


  • Islamabad, Islamabad, Pakistan Confiz Full time

    Confiz is seeking a CI/CD Pipeline Manager to join our team and play a key role in enhancing our DevSecOps practices. As a CI/CD Pipeline Manager, you will be responsible for designing, implementing, and managing secure CI/CD pipelines using Azure DevOps. Your goal will be to ensure compliance with industry standards and leverage the right tools to build a...

  • Azure DevOps Engineer

    3 weeks ago


    Islamabad, Islamabad, Pakistan Itcs Full time

    We are seeking a skilled Azure DevOps Engineer to join our team in Islamabad. The ideal candidate will be responsible for implementing and maintaining DevOps practices, automating workflows, and managing cloud-based infrastructure to ensure seamless delivery of applications and services.Key ResponsibilitiesDesign, implement, and manage Azure DevOps pipelines...


  • Islamabad, Islamabad, Pakistan Itcs Full time

    We are looking for a highly skilled DevOps Pipeline Specialist to join our team at Itcs in Islamabad. The ideal candidate will be responsible for designing, implementing, and maintaining DevOps practices, automating workflows, and managing cloud-based infrastructure.Key ResponsibilitiesPipeline DevelopmentAutomation and OrchestrationInfrastructure as...


  • Islamabad, Islamabad, Pakistan Nisum Full time

    Job SummaryNisum seeks an experienced Data Engineer to lead the design and development of data-intensive solutions using Azure cloud services.Key ResponsibilitiesDesign, implement, and maintain large-scale data processing pipelines using Azure functions, Databricks, and PySpark.Develop and manage data governance models to ensure data quality, security, and...

  • Cloud Architect

    3 days ago


    Islamabad, Islamabad, Pakistan Devsinc, LLC Full time

    Devsinc, LLC is seeking a Cloud Architect to design and develop scalable and efficient cloud-based systems. As a Cloud Architect, you will be responsible for designing, developing, and deploying cloud-based systems using Python and frameworks like Django, Flask, or FastAPI.**Responsibilities• Design and develop scalable and efficient cloud-based systems...


  • Islamabad, Islamabad, Pakistan NorthBay Solutions Full time

    Get AI-powered advice on this job and more exclusive features.Job OverviewWe are seeking a Level 2 AWS Data Engineer to join our team. This role involves monitoring, troubleshooting, and optimizing AWS-based data pipelines while ensuring data integrity and pipeline continuity. You will work with AWS Glue, Lambda, Step Functions, and other AWS data services...


  • Islamabad, Islamabad, Pakistan Cedrus Group (Pvt) Ltd. Full time

    Cedrus Group (Pvt) Ltd. seeks an experienced Azure Integration Developer to contribute to its dynamic team. As a key member of the team, you will be responsible for designing, implementing, and optimizing integration workflows using Azure Logic Apps, Azure Functions, and Bicep templates.The ideal candidate should have hands-on experience with Azure services,...