Azure Data Integration Specialist

3 days ago

Lahore, Punjab, Pakistan beBeeData Full time 800,000 - 1,000,000
Azure Data Engineer Role Summary

This key position involves overseeing the development and management of data pipelines, resolving technical issues, and ensuring the accuracy of data across various platforms such as Azure Synapse Analytics, Azure Data Lake Gen2, and SQL environments.

Key Responsibilities:
  • Data Engineering:
    • Work with Azure Synapse Pipelines and PySpark for data transformation and pipeline management.
    • Perform data integration and schema updates in Delta Lake environments, ensuring smooth data flow and accurate reporting.
    • Collaborate with our DevOps team on CI/CD processes for deployment of Infrastructure as Code (IaC) and Workspace artifacts.
    • Develop custom solutions for customers defined by our Data Architect and assist in improving data solution patterns over time.
  • Documentation:
    • Document ticket resolutions, testing protocols, and data validation processes.
    • Collaborate with other stakeholders to provide specifications and quotations for enhancements requested by customers.
  • Ticket Management:
    • Monitor the Jira ticket queue and respond to tickets as they are raised.
    • Understand ticket issues, utilizing extensive SQL, Synapse Analytics, and other tools to troubleshoot them.
    • Communicate effectively with customer users who raised the tickets and collaborate with other teams as needed to resolve issues.
  • Troubleshooting and Support:
    • Handle issues related to ETL pipeline failures, Delta Lake processing, or data inconsistencies in Synapse Analytics.
    • Provide prompt resolution to data pipeline and validation issues, ensuring data integrity and performance.
Desired Skills & Qualifications:
  • 5+ years of experience with Dynamics 365 ecosystem and strong PySpark development background.
  • Extensive experience with SQL, including query writing and troubleshooting in Azure SQL, Synapse Analytics, and Delta Lake environments.
  • Strong understanding and experience in implementing and supporting ETL processes, Data Lakes, and data engineering solutions.
  • Proficiency in using Azure Synapse Analytics, including workspace management, pipeline creation, and data flow management.
  • Hands-on experience with PySpark for data processing and automation.
  • Ability to use VPNs, MFA, RDP, jump boxes/jump hosts, etc., to operate within secure environments.
  • Some experience with Azure DevOps CI/CD IaC and release pipelines.
  • Ability to communicate effectively both verbally and in writing, with strong problem-solving and analytical skills.
  • Understanding of D365 Finance and Operations, Business Central, and Customer Engagement operation and underlying data structure.
  • Experience with Data Engineering in Microsoft Fabric.
  • Experience with Delta Lake and Azure data engineering concepts (e.g., ADLS, ADF, Synapse, AAD, Databricks).
  • Certifications in Azure Data Fabric: DP-600 / DP-700

  • Azure Data Integration Specialist

    1 week ago

    Lahore, Punjab, Pakistan beBeeDataIntegration Full time

    Job Opportunity: Azure Data Integration Engineer (DP600/700)We are seeking a skilled Data Integration Specialist to join our team. As an integral part of our organization, you will be responsible for designing, building, and managing data pipelines, ensuring seamless data flow across various platforms. This position requires extensive experience with SQL,...

  • Data Integration Specialist

    6 days ago

    Lahore, Punjab, Pakistan beBeeData Full time $100,000 - $150,000

    Unlock the Power of Data IntegrationWe are seeking a seasoned data expert to spearhead our data integration initiatives. As a key member, you will be responsible for designing and implementing scalable data pipelines, integrating data from various sources, and enabling business insights with clean, structured data.Key Responsibilities:Develop processes to...

  • Data Integration Specialist

    2 days ago

    Lahore, Punjab, Pakistan beBeeDataIntegration Full time $80,000 - $120,000

    Unlock the Power of Data IntegrationWe are seeking a highly skilled Data & Analytics professional to join our team. In this role, you will be responsible for building and maintaining scalable data pipelines, integrating data from various sources, and enabling analytics teams with clean, structured data.Key Responsibilities:Designing and implementing...

  • Data & Integration Engineer

    6 days ago

    Lahore, Punjab, Pakistan Wizient LLC Full time

    14 hours ago Be among the first 25 applicantsDirect message the job poster from Wizient LLCDriving Innovation in IT Solutions | Expert in SaaS Development, Cloud, and Digital TransformationWe're looking for Senior Software Engineers (Mid to Senior Level) with a strong background in Data & Analytics to join our growing team. In this role, you'll be...

  • Azure Integration Developer

    3 weeks ago

    Lahore, Punjab, Pakistan Tkxel LLC Full time

    Tkxel is a leading software development company located in Reston, Virginia. We are committed to developing innovative software solutions for leading enterprises in the world, helping them grow their businesses using the latest technology solutions.Job DescriptionWe are looking for a highly skilled .NET Engineer with 5-7 years of experience, specializing in...

  • Azure AI Specialist

    3 weeks ago

    Lahore, Punjab, Pakistan LITS SERVICES - Microsoft Solutions Partner Full time

    2 weeks ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.This individual will focus on the specialized AI components of both projects, particularly the configuration, training, and deployment of the machine learning models.Job Summary:The Azure AI Specialist will be responsible for the artificial intelligence...

  • Senior Azure Specialist

    2 weeks ago

    Lahore, Punjab, Pakistan 365 Care Group Full time

    1 day ago Be among the first 25 applicantsLocation: Gulberg 3, LahoreJob Type: Full-TimeExperience Level: Senior (5+ Years)About the RoleWe are seeking a highly experienced Senior Azure Specialist to lead the design, implementation, and administration of our cloud infrastructure and Microsoft 365 ecosystem. This role is essential for advancing our cloud...

  • Data Integration Specialist

    1 week ago

    Lahore, Punjab, Pakistan beBeeDataIntegration Full time

    Job OpportunityWe are seeking an experienced professional to join our dynamic development team as a Data Integration Specialist. In this role, you will be responsible for innovating data integration solutions on Apache Spark-based platforms.You will work closely with the business team to understand requirements, identify problems, and provide effective...

  • Jr. Azure Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan ACME ONE Full time

    Direct message the job poster from ACME ONEHR Generalist at ACME ONE | Talent Acquisition | Recruitment Specialist | Technical Recruiter | Sourcing Top 1% | Driving Operational Excellence &…Experience: 1+ YearsEmployment Type: Full-timeJob Summary:We are looking for an enthusiastic Junior Data Engineer / Analyst to support our data platform initiatives...

  • Senior Data Integration Specialist

    1 week ago

    Lahore, Punjab, Pakistan beBeeData Full time 600,000 - 800,000

    Senior Data Integration SpecialistThis is a highly demanding and rewarding role for an experienced professional with a strong background in data integration, ETL processes, and data warehousing.The ideal candidate will have hands-on experience with SSIS and SSRS, as well as advanced proficiency in SQL Server Integration Services (SSIS) and SQL Server...