Senior Data Engineer

3 days ago

Gujrat, Punjab, Pakistan beBeeDataEngineer Full time $100,000 - $150,000
Job Opportunity

The role requires a candidate with 5+ years of experience in the Dynamics 365 ecosystem, possessing strong PySpark development skills. The ideal candidate will have extensive SQL knowledge, including query writing and troubleshooting in Azure SQL, Synapse Analytics, and Delta Lake environments.

Key Responsibilities
  • Data Engineering: Work with Azure Synapse Pipelines and PySpark for data transformation and pipeline management.
  • Perform data integration and schema updates in Delta Lake environments, ensuring smooth data flow and accurate reporting.
  • Collaborate with our Azure DevOps team on CI/CD processes for deployment of Infrastructure as Code (IaC) and Workspace artifacts.
  • Develop custom solutions for our customers defined by our Data Architect and assist in improving our data solution patterns over time.
Documentation and Ticket Management
  • Document ticket resolutions, testing protocols, and data validation processes.
  • Monitor the Jira ticket queue and respond to tickets as they are raised.
Troubleshooting And Support
  • Handle issues related to ETL pipeline failures, Delta Lake processing, or data inconsistencies in Synapse Analytics.
  • Provide prompt resolution to data pipeline and validation issues, ensuring data integrity and performance.
Qualifications

Seeking a candidate with strong problem-solving and analytical skills, ability to communicate effectively verbally and in writing, and understanding of D365 Finance and Operations, Business Central, and Customer Engagement.

  • Extensive experience with SQL, including query writing and troubleshooting in Azure SQL, Synapse Analytics, and Delta Lake environments.
  • Strong understanding and experience in implementing and supporting ETL processes, Data Lakes, and data engineering solutions.
  • Proficiency in using Azure Synapse Analytics, including workspace management, pipeline creation, and data flow management.
  • Hands-on experience with PySpark for data processing and automation.
  • Ability to use VPNs, MFA, RDP, jump boxes/jump hosts, etc., to operate within customers' secure environments.
  • Some experience with Azure DevOps CI/CD IaC and release pipelines.
  • Ability to communicate effectively both verbally and in writing, with strong problem-solving and analytical skills.
  • Understanding of the operation and underlying data structure of D365 Finance and Operations, Business Central, and Customer Engagement.
  • Experience with Data Engineering in Microsoft Fabric
  • Experience with Delta Lake and Azure data engineering concepts (ADLS, ADF, Synapse, AAD, Databricks).
  • Certifications in Azure Data Fabric: DP-600 / DP-700
About the Role
  • This is a mid-senior level full-time Information Technology job in IT Services and IT Consulting industry.
  • Work with the latest Microsoft Technologies alongside Dynamics professionals committed to driving customer success.
  • Enjoy the flexibility to work from anywhere
  • Work-life balance that suits your lifestyle.
  • Competitive salary and comprehensive benefits package.
  • Career growth and professional development opportunities.
  • A collaborative and inclusive work culture.

  • Senior Data Engineer – Scalable Solutions Specialist

    3 days ago

    Gujrat, Punjab, Pakistan beBeeDataEngineering Full time $120,000 - $160,000

    We are seeking an experienced Senior Data Engineer to design and develop scalable data pipelines and solutions.Key Responsibilities:Data EngineeringDesign, develop, and optimize scalable data pipelines, ETL processes, and data integration solutions using SQL Server, Azure Data Factory, Microsoft Fabric, and Databricks.Architect and implement robust data...

  • Senior Data Engineer Leader

    3 days ago

    Gujrat, Punjab, Pakistan beBeeBigData Full time 800,000 - 1,200,000

    Job Opportunity: Leading Big Data ExpertWe seek a seasoned leader with extensive experience in guiding and managing teams, leveraging Agile methodologies and DevOps best practices to drive business outcomes.Key Qualifications:Bachelor's or Master's degree in Computer Science, Engineering, or a related field.Minimum 7+ years of hands-on expertise in leading...

  • Senior Data Architecture Specialist

    3 days ago

    Gujrat, Punjab, Pakistan beBeeDataEngineering Full time $180,000 - $200,000

    Data Engineer Lead Role OverviewThis is a senior data engineering position where you will lead the development of data architectures and systems, ensuring scalability, reliability, quality, and performance.The ideal candidate has 5+ years of experience in cloud platforms like AWS and GCP, with expertise in programming languages such as Python and SQL, as...

  • Data Engineering Lead

    3 days ago

    Gujrat, Punjab, Pakistan beBeeDataEngineering Full time 6,000,000 - 7,500,000

    Job Title: Data Engineering LeadWe are seeking a highly experienced data engineering leader to define and execute the data platform vision and roadmap, aligning with business goals and leveraging cloud-based services.Bachelors or Masters degree in Computer Science, Engineering, or a related field.Minimum of 7+ years of hands-on experience in data engineering...

  • Chief Data Architect

    3 days ago

    Gujrat, Punjab, Pakistan beBeeDataEngineering Full time $120,000 - $140,000

    Senior Data Engineer Role\We are seeking an experienced and highly skilled professional to join our innovative team as a Senior Data Engineer. This vital role involves designing, developing, and optimizing complex data architectures that drive business success.\Job Responsibilities\\Design and develop scalable data pipelines, ETL processes, and data...

  • Senior Cloud-Based Data Architect

    3 days ago

    Gujrat, Punjab, Pakistan beBeeDataEngineer Full time 18,000,000 - 25,000,000

    About the RoleThis is a remote position that oversees the design, development, and maintenance of infrastructure for data integration, storage, processing, and analytics.We are seeking an experienced Senior Data Engineer with a strong background in Python, SQL, PySpark, Azure, Databricks, Synapse, Azure Data Lake, DevOps, and cloud-based large-scale data...

  • Javascript Senior Software Engineer

    3 days ago

    Gujrat, Punjab, Pakistan Tether Full time

    Join Tether and Shape the Future of Digital FinanceAt Tether, we're not just building products, we're pioneering a global financial revolution. Our cutting-edge solutions empower businesses—from exchanges and wallets to payment processors and ATMs—to seamlessly integrate reserve-backed tokens across blockchains. By harnessing the power of blockchain...

  • Highly Skilled Data Architect

    3 days ago

    Gujrat, Punjab, Pakistan beBeeData Full time $90,000 - $120,000

    Senior Data Engineer PositionWe are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in designing and implementing data pipelines, as well as experience in optimizing data workflows and handling large volumes of data.Job Description:Design and develop scalable and reliable data...

  • Enterprise Data Strategist

    3 days ago

    Gujrat, Punjab, Pakistan beBeeDataArchitect Full time $120,000 - $150,000

    About the RoleThis is a remote opportunity to lead the design, development, and maintenance of an enterprise data platform.The ideal candidate will collaborate with data engineers, BI engineers, and data business analysts across various platform layers, ensuring a scalable, secure, and high-performance data infrastructure. This role requires a deep...

  • Data Engineer

    3 days ago

    Gujrat, Punjab, Pakistan beBeeDataTransformation Full time 15,000,000 - 25,000,000

    Big Data Transformation ExpertWe are undergoing a comprehensive big data transformation to ensure accurate and consistent data is available precisely when and where it's needed.The goal is to deliver precise, reliable, and high-quality data across multiple systems.This involves ensuring seamless data flow and accuracy across multiple systems.We're looking...