Azure Data Integration Engineer

7 days ago

Lahore, Punjab, Pakistan ITC Worldwide, LTD. Full time

The role involves building and managing data pipelines, troubleshooting issues, and ensuring data accuracy across various platforms such as Azure Synapse Analytics, Azure Data Lake Gen2, and SQL environments.

This position requires extensive SQL experience and a strong background in PySpark development.

Certifications in Azure Data Fabric: DP-600 / DP-700

Responsibilities

Data Engineering:

  • Work with Azure Synapse Pipelines and PySpark for data transformation and pipeline management.
  • Perform data integration and schema updates in Delta Lake environments, ensuring smooth data flow and accurate reporting.
  • Work with our Azure DevOps team on CI/CD processes for deployment of Infrastructure as Code (IaC) and Workspace artifacts.
  • Develop custom solutions for our customers defined by our Data Architect and assist in improving our data solution patterns over time.

Documentation:

  • Document ticket resolutions, testing protocols, and data validation processes.
  • Collaborate with other stakeholders to provide specifications and quotations for enhancements requested by customers.

Ticket Management:

  • Monitor the Jira ticket queue and respond to tickets as they are raised.
  • Understand ticket issues, utilizing extensive SQL, Synapse Analytics, and other tools to troubleshoot them.
  • Communicate effectively with customer users who raised the tickets and collaborate with other teams (e.g., FinOps, Databricks) as needed to resolve issues.

Troubleshooting and Support:

  • Handle issues related to ETL pipeline failures, Delta Lake processing, or data inconsistencies in Synapse Analytics.
  • Provide prompt resolution to data pipeline and validation issues, ensuring data integrity and performance.
Desired Skills & Requirements

Seeking a candidate with 5+ years of Dynamics 365 ecosystem experience with a strong PySpark development background. While various profiles may apply, we highly value a strong person-organization fit.

Our ideal candidate possesses the following attributes and qualifications:

  • Extensive experience with SQL, including query writing and troubleshooting in Azure SQL, Synapse Analytics, and Delta Lake environments.
  • Strong understanding and experience in implementing and supporting ETL processes, Data Lakes, and data engineering solutions.
  • Proficiency in using Azure Synapse Analytics, including workspace management, pipeline creation, and data flow management.
  • Hands-on experience with PySpark for data processing and automation.
  • Ability to use VPNs, MFA, RDP, jump boxes/jump hosts, etc., to operate within the customers secure environments.
  • Some experience with Azure DevOps CI/CD IaC and release pipelines.
  • Ability to communicate effectively both verbally and in writing, with strong problem-solving and analytical skills.
  • Understanding of the operation and underlying data structure of D365 Finance and Operations, Business Central, and Customer Engagement.
  • Experience with Data Engineering in Microsoft Fabric.
  • Experience with Delta Lake and Azure data engineering concepts (e.g., ADLS, ADF, Synapse, AAD, Databricks).
  • Certifications in Azure Data Fabric: DP-600 / DP-700
Why Join Us?
  • Opportunity to work with innovative technologies in a dynamic environment where progressive work culture with a global perspective where your ideas truly matter, and growth opportunities are endless.
  • Work with the latest Microsoft Technologies alongside Dynamics professionals committed to driving customer success.
  • Enjoy the flexibility to work from anywhere.
  • Work-life balance that suits your lifestyle.
  • Competitive salary and comprehensive benefits package.
  • Career growth and professional development opportunities.
  • A collaborative and inclusive work culture.
#J-18808-Ljbffr

  • Azure Data Engineer

    6 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Azure Data Engineer JobAzure Data Engineer plays a crucial role in developing user-friendly software from start to finish in a fast-paced and collaborative environment.Key Responsibilities:Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Functions, Data Lake Gen2, and Databricks.Leverage Python, SQL, Scala, or JavaScript...

  • Data Integration Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan Remotiv Full time

    1 day ago Be among the first 25 applicantsAt Remotiv, we're connecting people worldwide. We connect talented people with businesses.*Hiring for one of our client -Workplace type: Onsite - LahoreSalary: Upto $2,500Data Integration Engineer (Pakistan) – Join Our Client TeamWe are seeking a Data Integration Engineer with hands-on experience in S/4HANA...

  • Azure Data Engineer

    7 days ago

    Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

    Azure Data EngineerAVANCEON is hiring an Azure Data Engineer for their Lahore office. You will work with a team to develop user-friendly software from start to finish in a fast-moving and collaborative environment.Must-Have Checklist:Practical Experience With:Azure Data FactoryAzure FunctionsData Lake Gen2 and DatabricksSkills in:Python, SQL, Scala, or...

  • Azure Integration Developer

    3 weeks ago

    Lahore, Punjab, Pakistan Tkxel Full time

    Tkxel is a leading softwaredevelopment company located in Reston, Virginia. We are committedto develop innovative software solutions for leading enterprisesin the world, helping them grow their businesses using latesttechnology solutions.Job DescriptionWe are looking for a highly skilled .NET Engineer with 5-7 years of experience, specializing in Microsoft...

  • Azure Integration Developer

    5 days ago

    Lahore, Punjab, Pakistan Devsinc Full time

    We are seeking a highly skilled .NET Developer with experience in Azure Data Factory, SQL Server, and Microsoft Dynamics 365 CRM to design and deliver data-driven backend applications and integration solutions. This position is ideal for someone who thrives on creating scalable and efficient backend systems, automating data pipelines, and building...

  • Azure Integration Developer

    6 days ago

    Lahore, Punjab, Pakistan Devsinc, LLC Full time

    We are seeking a highly skilled .NET Developer with experience in Azure Data Factory, SQL Server, and Microsoft Dynamics 365 CRM to design and deliver data-driven backend applications and integration solutions. This position is ideal for someone who thrives on creating scalable and efficient backend systems, automating data pipelines, and building...

  • Data Engineer

    6 days ago

    Lahore, Punjab, Pakistan Tkxel Full time

    Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe are seeking a skilled and experienced Data Engineer with expertise in PySpark and Azure Data...

  • Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Avanceon Limited Full time

    Join to apply for the Data Engineer role at Avanceon Middle East & South Asia.About Us?Avanceon is a multinational corporation which specializes in automation, control systems integration, energy management solutions, and support services. With offices in Dubai, Qatar, Saudi Arabia, and Pakistan, it has established a significant market presence. Over its...

  • Senior Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Digifloat Full time

    Direct message the job poster from DigifloatHiring Data Engineers | Head hunter | Talent Acquisition | Recruitment Consultant | HR ProfessionalWe are seeking a skilled Azure Data Engineer to design, develop, and maintain scalable data solutions on Microsoft Azure. The ideal candidate will have extensive experience in building data pipelines, managing data...

  • Azure DevOps Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Consultancy Outfit Full time

    Experience Required: Minimum 3 years in Azure DevOps or a similar roleJob Overview:We are seeking a skilled and motivated Azure DevOps Engineer with over 3 years of hands-on experience in managing and automating cloud infrastructure and deployment pipelines using Microsoft Azure. The ideal candidate will have expertise in CI/CD pipelines, Infrastructure as...