Azure Data Integration Specialist

19 hours ago

Lahore, Punjab, Pakistan ITC WORLDWIDE Full time

The role of a Data Integration Specialist at ITC Worldwide involves designing, building, and managing scalable data pipelines across various platforms, including Azure Synapse Analytics, Azure Data Lake Gen2, and SQL environments. This position requires in-depth knowledge of SQL and a strong background in PySpark development.

Key Responsibilities
  • Develop and maintain complex data integration processes using Azure Synapse Pipelines and PySpark for data transformation and pipeline management.
  • Ensure data accuracy and integrity by performing schema updates in Delta Lake environments and troubleshooting issues related to ETL pipeline failures, data inconsistencies, and Delta Lake processing.
  • Collaborate with the Azure DevOps team on CI/CD processes for deployment of Infrastructure as Code (IaC) and Workspace artifacts.
  • Design custom solutions for customers based on requirements defined by our Data Architect and assist in improving our data solution patterns over time.

Ticket Management

  • Monitor the Jira ticket queue and respond to tickets as they are raised, understanding ticket issues utilizing extensive SQL, Synapse Analytics, and other tools to troubleshoot them.
  • Communicate effectively with customer users who raised the tickets and collaborate with other teams (e.g., FinOps, Databricks) as needed to resolve issues.

Desired Skills & Requirements

  • 5+ years of experience with Dynamics 365 ecosystem, focusing on a strong PySpark development background.
  • Extensive experience with SQL, including query writing and troubleshooting in Azure SQL, Synapse Analytics, and Delta Lake environments.
  • Strong understanding and experience in implementing and supporting ETL processes, Data Lakes, and data engineering solutions.
  • Proficiency in using Azure Synapse Analytics, including workspace management, pipeline creation, and data flow management.
  • Hands-on experience with PySpark for data processing and automation.
  • Ability to use VPNs, MFA, RDP, jump boxes/jump hosts, etc., to operate within secure customer environments.
  • Some experience with Azure DevOps CI/CD IaC and release pipelines.
  • Ability to communicate effectively both verbally and in writing, with strong problem-solving and analytical skills.

Why Join Us?

  • Opportunity to work with innovative technologies in a dynamic environment where progressive work culture offers global perspectives, making your ideas matter, and growth opportunities are endless.
  • Work with the latest Microsoft Technologies alongside Dynamics professionals dedicated to driving customer success.
  • Enjoy flexibility to work from anywhere, with a focus on work-life balance that suits your lifestyle.
  • Competitive salary and comprehensive benefits package.
  • Career growth and professional development opportunities.
  • A collaborative and inclusive work culture.

  • Azure Data Integration Engineer

    19 hours ago

    Lahore, Punjab, Pakistan ITC Worldwide, LTD. Full time

    The role involves building and managing data pipelines, troubleshooting issues, and ensuring data accuracy across various platforms such as Azure Synapse Analytics, Azure Data Lake Gen2, and SQL environments.This position requires extensive SQL experience and a strong background in PySpark development.Certifications in Azure Data Fabric: DP-600 /...

  • Azure Integration Developer

    3 weeks ago

    Lahore, Punjab, Pakistan Tkxel LLC Full time

    Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe are looking for a highly skilled .NET Engineer with 5-7 years of experience, specializing in...

  • Azure Data Engineer

    3 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Azure Data Engineer JobAzure Data Engineer plays a crucial role in developing user-friendly software from start to finish in a fast-paced and collaborative environment.Key Responsibilities:Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Functions, Data Lake Gen2, and Databricks.Leverage Python, SQL, Scala, or JavaScript...

  • Azure Integration Developer

    2 weeks ago

    Lahore, Punjab, Pakistan Tkxel Full time

    Tkxel is a leading softwaredevelopment company located in Reston, Virginia. We are committedto develop innovative software solutions for leading enterprisesin the world, helping them grow their businesses using latesttechnology solutions.Job DescriptionWe are looking for a highly skilled .NET Engineer with 5-7 years of experience, specializing in Microsoft...

  • Azure Data Engineer

    1 week ago

    Lahore, Punjab, Pakistan Avanceon Middle East & South Asia Full time

    Azure Data EngineerAVANCEON is hiring an Azure Data Engineer for their Lahore office. You will work with a team to develop user-friendly software from start to finish in a fast-moving and collaborative environment.Must-Have Checklist:Practical Experience With:Azure Data FactoryAzure FunctionsData Lake Gen2 and DatabricksSkills in:Python, SQL, Scala, or...

  • Azure Administrator

    3 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    IT Operations SpecialistThis role involves managing, maintaining, and optimizing our infrastructure and related systems, with a strong focus on Azure Cloud services.Implement and manage backup, disaster recovery, and failover strategies to ensure high availability and data integrity.Monitor system performance, availability, and security using Azure Monitor...

  • Azure Data Engineering Specialist

    3 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Azure Data Engineer is responsible for designing, building, and maintaining data ingestion pipelines and analytics solutions.Implement data profiling, cataloguing, and mapping to enable the design and build of technical data flows.Ensure the design, code, and procedural aspects of solution are production ready, in terms of operational, security, and...

  • Integration Specialist

    3 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Integration Specialist Position AvailableWe are looking for a highly skilled Integration Specialist to join our team. The successful candidate will be responsible for integrating laboratory systems with our platform using HL7 interfaces.The ideal candidate will have experience with laboratory interfaces and data integration, as well as strong QA testing...

  • Data Integration Specialist

    3 days ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Key Responsibilities:">Migrate data from external platforms into our databases.Develop, debug, and optimize complex SQL scripts and stored procedures to extract, transform, and load data into our systems.Create and maintain stored procedures, triggers, views, and scripts for data transformation and integration.Manage, update, and maintain our databases to...

  • Azure Infrastructure Specialist

    1 week ago

    Lahore, Punjab, Pakistan beBee Careers Full time

    Key Responsibilities:Design and Implement CI/CD Pipelines:Create and maintain Continuous Integration and Continuous Deployment (CI/CD) pipelines using tools like Jenkins, GitLab CI/CD, or Azure DevOps to automate software delivery and deployment processes.Develop and Maintain Infrastructure as Code:Use Terraform or Azure Resource Manager templates to develop...