Azure Data Integration Engineer

4 weeks ago

Lahore, Punjab, Pakistan ITC Worldwide, LTD. Full time

The role involves building and managing data pipelines, troubleshooting issues, and ensuring data accuracy across various platforms such as Azure Synapse Analytics, Azure Data Lake Gen2, and SQL environments.

This position requires extensive SQL experience and a strong background in PySpark development.

Certifications in Azure Data Fabric: DP-600 / DP-700

Responsibilities

Data Engineering:

  • Work with Azure Synapse Pipelines and PySpark for data transformation and pipeline management.
  • Perform data integration and schema updates in Delta Lake environments, ensuring smooth data flow and accurate reporting.
  • Work with our Azure DevOps team on CI/CD processes for deployment of Infrastructure as Code (IaC) and Workspace artifacts.
  • Develop custom solutions for our customers defined by our Data Architect and assist in improving our data solution patterns over time.

Documentation:

  • Document ticket resolutions, testing protocols, and data validation processes.
  • Collaborate with other stakeholders to provide specifications and quotations for enhancements requested by customers.

Ticket Management:

  • Monitor the Jira ticket queue and respond to tickets as they are raised.
  • Understand ticket issues, utilizing extensive SQL, Synapse Analytics, and other tools to troubleshoot them.
  • Communicate effectively with customer users who raised the tickets and collaborate with other teams (e.g., FinOps, Databricks) as needed to resolve issues.

Troubleshooting and Support:

  • Handle issues related to ETL pipeline failures, Delta Lake processing, or data inconsistencies in Synapse Analytics.
  • Provide prompt resolution to data pipeline and validation issues, ensuring data integrity and performance.
Desired Skills & Requirements

Seeking a candidate with 5+ years of Dynamics 365 ecosystem experience with a strong PySpark development background. While various profiles may apply, we highly value a strong person-organization fit.

Our ideal candidate possesses the following attributes and qualifications:

  • Extensive experience with SQL, including query writing and troubleshooting in Azure SQL, Synapse Analytics, and Delta Lake environments.
  • Strong understanding and experience in implementing and supporting ETL processes, Data Lakes, and data engineering solutions.
  • Proficiency in using Azure Synapse Analytics, including workspace management, pipeline creation, and data flow management.
  • Hands-on experience with PySpark for data processing and automation.
  • Ability to use VPNs, MFA, RDP, jump boxes/jump hosts, etc., to operate within the customers secure environments.
  • Some experience with Azure DevOps CI/CD IaC and release pipelines.
  • Ability to communicate effectively both verbally and in writing, with strong problem-solving and analytical skills.
  • Understanding of the operation and underlying data structure of D365 Finance and Operations, Business Central, and Customer Engagement.
  • Experience with Data Engineering in Microsoft Fabric.
  • Experience with Delta Lake and Azure data engineering concepts (e.g., ADLS, ADF, Synapse, AAD, Databricks).
  • Certifications in Azure Data Fabric: DP-600 / DP-700
Why Join Us?
  • Opportunity to work with innovative technologies in a dynamic environment where progressive work culture with a global perspective where your ideas truly matter, and growth opportunities are endless.
  • Work with the latest Microsoft Technologies alongside Dynamics professionals committed to driving customer success.
  • Enjoy the flexibility to work from anywhere.
  • Work-life balance that suits your lifestyle.
  • Competitive salary and comprehensive benefits package.
  • Career growth and professional development opportunities.
  • A collaborative and inclusive work culture.
#J-18808-Ljbffr

  • Azure Integration Developer

    4 weeks ago

    Lahore, Punjab, Pakistan Devsinc Full time

    We are seeking a highly skilled .NET Developer with experience in Azure Data Factory, SQL Server, and Microsoft Dynamics 365 CRM to design and deliver data-driven backend applications and integration solutions. This position is ideal for someone who thrives on creating scalable and efficient backend systems, automating data pipelines, and building...

  • Senior Integration Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan GoSaaS Full time

    Who We Are:GoSaaS is a global leading Oracle partner specializing in the implementation of SaaS solutions. We are headquartered in the USA with additional offices in Canada, Malaysia, Pakistan and India. Our consistent ranking among USA's fastest-growing companies and Fortune 5000 recognition for three consecutive years attest to our commitment to innovation...

  • Senior Integration Engineer

    2 hours ago

    Lahore, Punjab, Pakistan GoSaaS Full time

    Who We Are:GoSaaS is a global leading Oracle partner specializing in the implementation of SaaS solutions. We are headquartered in the USA with additional offices in Canada, Malaysia, Pakistan and India. Our consistent ranking among USA's fastest-growing companies and Fortune 5000 recognition for three consecutive years attest to our commitment to innovation...

  • NET Azure Developer

    4 weeks ago

    Lahore, Punjab, Pakistan Cinnova Technologies, LLC Full time

    Cinnova is seeking a highly skilled and experienced .NET Azure Developer with a creative mindset and entrepreneurial spirit to join our growing team in Lahore. As a key member of our team, you will bridge the gap between the physical and digital worlds, crafting integrated technological solutions for our US customers. If you are passionate about leveraging...

  • Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Ekho Full time

    Ekho is a profitable US-based ML/AI startup building agentic systems to automatically clean, enrich, and orchestrate CRM data. Our leadership team has scaled startups to millions of dollars in revenue, has worked at leading tech companies such as Adobe and Square, and cares deeply about team culture. We're looking for data nerds, who are genuinely curious,...

  • Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Algo Full time

    Get AI-powered advice on this job and more exclusive features.Responsibilities:Design, build, and maintain efficient and scalable ETL/ELT data pipelines using tools like Azure Data Factory or Apache Airflow.Develop, test, and deploy Python-based data processing solutions.Work with Snowflake, Databricks, and other data warehousing technologies to support data...

  • Senior Data Engineer

    4 weeks ago

    Lahore, Punjab, Pakistan nexaquanta Full time

    1 day ago Be among the first 25 applicantsDirect message the job poster from NexaQuantaTechnical and Non-Technical Recruiter | Payroll Executive | HR Operations | Talent Acquisition | HR Generalist | Sr. HR Officer | Employees Relation…Role DescriptionWe are looking for a highly motivated and skilled Data Engineer with around 4 years of experience to join...

  • Data Architect

    3 weeks ago

    Lahore, Punjab, Pakistan Confiz Full time

    We are looking for an experienced Data Architect with 12+ years of progressive experience in data engineering, architecture design, and technical leadership. You will lead the architectural strategy and execution for our real-time and batch data platforms, ensuring scalability, reliability, and performance across a modern cloud-native ecosystem. This role is...

  • Senior Data Engineer

    2 days ago

    Lahore, Punjab, Pakistan NexaQuanta Full time

    NexaQuanta offers expert consulting and implementation services for Generative AI-powered transformation of businesses and software applications in a responsible, safe, and cost-effective manner to drive higher revenues, profitability, and productivity.Headquartered in London, UK, NexaQuanta is a team of highly experienced Generative AI Consultants,...

  • Data Engineer

    2 days ago

    Lahore, Punjab, Pakistan Algo Full time

    1. Design, build, and maintain efficient and scalable ETL/ELT data pipelines using tools like Azure Data Factory or Apache Airflow.2. Develop, test, and deploy Python-based data processing solutions.3. Work with Snowflake, Databricks, and other data warehousing technologies to support data analytics and reporting needs.4. Write complex and optimized SQL...