Azure Data Integration Engineer
3 days ago
Join to apply for the Azure Data Integration Engineer (DP600/700) role at ITC Worldwide.
OverviewThe role involves building and managing data pipelines, troubleshooting issues, and ensuring data accuracy across platforms such as Azure Synapse Analytics, Azure Data Lake Gen2, and SQL environments. This position requires extensive SQL experience and a strong background in PySpark development.
Responsibilities- Data Engineering: Work with Azure Synapse Pipelines and PySpark for data transformation and pipeline management.
- Perform data integration and schema updates in Delta Lake environments, ensuring smooth data flow and accurate reporting.
- Collaborate with our Azure DevOps team on CI/CD processes for deployment of Infrastructure as Code (IaC) and Workspace artifacts.
- Develop custom solutions for our customers defined by our Data Architect and assist in improving our data solution patterns over time.
- Document ticket resolutions, testing protocols, and data validation processes.
- Collaborate with other stakeholders to provide specifications and quotations for enhancements requested by customers.
- Monitor the Jira ticket queue and respond to tickets as they are raised.
- Understand ticket issues, utilizing extensive SQL, Synapse Analytics, and other tools to troubleshoot them.
- Communicate effectively with customer users who raised the tickets and collaborate with other teams (e.g., FinOps, Databricks) as needed to resolve issues.
- Handle issues related to ETL pipeline failures, Delta Lake processing, or data inconsistencies in Synapse Analytics.
- Provide prompt resolution to data pipeline and validation issues, ensuring data integrity and performance.
Seeking a candidate with 5+ years of Dynamics 365 ecosystem experience with a strong PySpark development background. While various profiles may apply, we highly value a strong person-organization fit.
- Extensive experience with SQL, including query writing and troubleshooting in Azure SQL, Synapse Analytics, and Delta Lake environments.
- Strong understanding and experience in implementing and supporting ETL processes, Data Lakes, and data engineering solutions.
- Proficiency in using Azure Synapse Analytics, including workspace management, pipeline creation, and data flow management.
- Hands-on experience with PySpark for data processing and automation.
- Ability to use VPNs, MFA, RDP, jump boxes/jump hosts, etc., to operate within customers' secure environments.
- Some experience with Azure DevOps CI/CD IaC and release pipelines.
- Ability to communicate effectively both verbally and in writing, with strong problem-solving and analytical skills.
- Understanding of the operation and underlying data structure of D365 Finance and Operations, Business Central, and Customer Engagement.
- Experience with Data Engineering in Microsoft Fabric
- Experience with Delta Lake and Azure data engineering concepts (ADLS, ADF, Synapse, AAD, Databricks).
- Certifications in Azure Data Fabric: DP-600 / DP-700
- Opportunity to work with innovative technologies in a dynamic environment where progressive work culture with a global perspective where your ideas truly matter, and growth opportunities are endless.
- Work with the latest Microsoft Technologies alongside Dynamics professionals committed to driving customer success.
- Enjoy the flexibility to work from anywhere
- Work-life balance that suits your lifestyle.
- Competitive salary and comprehensive benefits package.
- Career growth and professional development opportunities.
- A collaborative and inclusive work culture.
- Mid-Senior level
- Full-time
- Information Technology
- IT Services and IT Consulting
-
Senior Data Integration Specialist
3 days ago
Lahore, Punjab, Pakistan beBeeDataEngineer Full time $90,000 - $120,000Job DescriptionAs a seasoned data integration professional, you will be responsible for building and managing complex data pipelines using Azure Synapse Analytics and PySpark. Your expertise in troubleshooting issues and ensuring data accuracy across various platforms will be invaluable to our team.This role requires extensive SQL experience and a strong...
-
Microsoft Certified Trainer Azure Data
2 days ago
Lahore, Punjab, Pakistan ITC Worldwide Full timeOverviewJoin to apply for the Microsoft Certified Trainer Azure Data role at ITC Worldwide.About ITC WorldwideITC Worldwide is a global leader in delivering high-impact technology training and consultancy services. We specialize in empowering professionals and organizations through expert-led instruction in platforms such as Microsoft, AWS, Atlassian, IBM,...
-
Senior Integration Engineer
3 weeks ago
Lahore, Punjab, Pakistan GoSaaS Full timeWho We Are:GoSaaS is a global leading Oracle partner specializing in the implementation of SaaS solutions. We are headquartered in the USA with additional offices in Canada, Malaysia, Pakistan and India. Our consistent ranking among USA's fastest-growing companies and Fortune 5000 recognition for three consecutive years attest to our commitment to innovation...
-
Senior Integration Engineer
4 days ago
Lahore, Punjab, Pakistan GoSaaS Full timeWho We Are:GoSaaS is a global leading Oracle partner specializing in the implementation of SaaS solutions. We are headquartered in the USA with additional offices in Canada, Malaysia, Pakistan and India. Our consistent ranking among USA's fastest-growing companies and Fortune 5000 recognition for three consecutive years attest to our commitment to innovation...
-
Senior Data Engineer
2 days ago
Lahore, Punjab, Pakistan Tkxel LLC Full timeTkxel is a leading softwaredevelopment company located in Reston, Virginia. We are committedto develop innovative software solutions for leading enterprisesin the world, helping them grow their businesses using latesttechnology solutions.Job DescriptionProfessional Summary: We seek a seasoned Data Engineer with a proven track record of over 5 years in...
-
Data Architect
3 days ago
Lahore, Punjab, Pakistan Tkxel Full timeOverviewThis is a remote position. We seek an experienced Data Architect to lead the design, development, and maintenance of our enterprise Data Platform. You will collaborate with Data Engineers, BI Engineers, and Data Business Analysts across various platform layers, ensuring a scalable, secure, and high-performance data infrastructure. This role requires...
-
Data Engineer
4 weeks ago
Lahore, Punjab, Pakistan Ekho Full timeEkho is a profitable US-based ML/AI startup building agentic systems to automatically clean, enrich, and orchestrate CRM data. Our leadership team has scaled startups to millions of dollars in revenue, has worked at leading tech companies such as Adobe and Square, and cares deeply about team culture. We're looking for data nerds, who are genuinely curious,...
-
Senior Data Engineer/Delivery Lead
1 day ago
Lahore, Punjab, Pakistan Tkxel LLC Full timeTkxel is a leading software development company located in Reston, Virginia. We are committed to develop innovative software solutions for leading enterprises in the world, helping them grow their businesses using latest technology solutions.Job DescriptionOverviewWe are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team....
-
Senior Data Engineer
2 days ago
Lahore, Punjab, Pakistan Devsinc Full timeOverviewDevsinc is seeking a talented Senior Data Engineer to join our dynamic team. The ideal candidate will possess a deep understanding of data architecture and engineering principles, along with hands-on experience in developing, optimizing, and maintaining data pipelines and databases. This role is crucial to support our data-driven initiatives and to...
-
Data Engineer
4 weeks ago
Lahore, Punjab, Pakistan Algo Full timeGet AI-powered advice on this job and more exclusive features.Responsibilities:Design, build, and maintain efficient and scalable ETL/ELT data pipelines using tools like Azure Data Factory or Apache Airflow.Develop, test, and deploy Python-based data processing solutions.Work with Snowflake, Databricks, and other data warehousing technologies to support data...
