Senior Data Engineer

7 days ago

Lahore, Punjab, Pakistan beBeeData Full time

The role involves building and managing data pipelines, troubleshooting issues, and ensuring data accuracy across various platforms.

Key Responsibilities
  • Data Engineering:
    • Work with Azure Synapse Pipelines and PySpark for data transformation and pipeline management.
    • Perform data integration and schema updates in Delta Lake environments, ensuring smooth data flow and accurate reporting.
    • Work with the DevOps team on CI/CD processes for deployment of Infrastructure as Code (IaC) and Workspace artifacts.
    • Develop custom solutions for customers defined by the Data Architect and assist in improving data solution patterns over time.
  • Documentation:
    • Document ticket resolutions, testing protocols, and data validation processes.
    • Collaborate with stakeholders to provide specifications and quotations for enhancements requested by customers.
  • Ticket Management:
    • Monitor the Jira ticket queue and respond to tickets as they are raised.
    • Understand ticket issues, utilizing extensive SQL, Synapse Analytics, and other tools to troubleshoot them.
    • Communicate effectively with customer users who raised the tickets and collaborate with other teams as needed to resolve issues.
  • Troubleshooting and Support:
    • Handle issues related to ETL pipeline failures, Delta Lake processing, or data inconsistencies in Synapse Analytics.
    • Provide prompt resolution to data pipeline and validation issues, ensuring data integrity and performance.
    Requirements
    • A strong background in PySpark development.
    • Extensive experience with SQL, including query writing and troubleshooting in Azure SQL, Synapse Analytics, and Delta Lake environments.
    • A strong understanding and experience in implementing and supporting ETL processes, Data Lakes, and data engineering solutions.
    • Proficiency in using Azure Synapse Analytics, including workspace management, pipeline creation, and data flow management.
    • Hands-on experience with PySpark for data processing and automation.
    • Ability to work within secure environments using VPNs, MFA, RDP, jump boxes/jump hosts, etc.
    • Some experience with Azure DevOps CI/CD IaC and release pipelines.
    • Ability to communicate effectively both verbally and in writing, with strong problem-solving and analytical skills.
    • Understanding of the operation and underlying data structure of Microsoft Fabric.
    • Experience with Delta Lake and Azure data engineering concepts.
    Why This Opportunity?
    • The opportunity to work with innovative technologies in a dynamic environment.
    • A progressive work culture with a global perspective where your ideas truly matter.
    • Growth opportunities are endless.
    • Work with the latest Microsoft Technologies alongside Dynamics professionals committed to driving customer success.
    • Enjoy the flexibility to work from anywhere.
    • Competitive salary and comprehensive benefits package.
    • Career growth and professional development opportunities.
    • A collaborative and inclusive work culture.

  • Senior Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Digifloat Full time

    Direct message the job poster from DigifloatHiring Data Engineers | Head hunter | Talent Acquisition | Recruitment Consultant | HR ProfessionalWe are seeking a skilled Azure Data Engineer to design, develop, and maintain scalable data solutions on Microsoft Azure. The ideal candidate will have extensive experience in building data pipelines, managing data...

  • Senior Data Engineer

    3 days ago

    Lahore, Punjab, Pakistan Mavericks United Full time

    Direct message the job poster from Mavericks UnitedHR Executive l Technical Recruiter I Talent Acquisition SpecialistThe ideal candidate's favorite words are learning, data, scale, and agility. You will leverage your strong collaboration skills and ability to extract valuable insights from highly complex data sets to ask the right questions and find the...

  • Senior Data Engineer

    7 days ago

    Lahore, Punjab, Pakistan Mavericks United Full time

    4 days ago Be among the first 25 applicantsDirect message the job poster from Mavericks United35k+ | HR Lead @ Mavericks | Talent Acquisition Specialist | Tech & Non-Tech Recruitment | People Managment | Employer & Employee Branding | HR Ops |…The Role:Mavericks United is looking for a highly skilled Data Engineer to join our on-site team. This role is...

  • Senior Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan Devsinc Full time

    Devsinc is seeking a talented Senior Data Engineer to join our dynamic team. The ideal candidate will possess a deep understanding of data architecture and engineering principles, along with hands-on experience in developing, optimizing, and maintaining data pipelines and databases. This role is crucial to support our data-driven initiatives and to enhance...

  • Data Engineer

    3 days ago

    Lahore, Punjab, Pakistan NETSOL Technologies Inc. Full time

    4 days ago Be among the first 25 applicantsDirect message the job poster from NETSOL Technologies Inc.Manager Talent Acquisition@ NETSOL Technologies Inc. | International RecruitmentKey Responsibilities:Design and implement ETL/ELT pipelines, data lakes, and data warehouses to support client-specific use cases.Lead the development of Proof of Concepts (POCs)...

  • Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan DOT LABS Full time

    At Dot Labs, we are seeking a talented Associate Data Engineer to join our growing team.Forward your resume tocareers@dotlabs.aiLocation: DHA Phase 2Timing: 11:00 AM -8:00 PM (Onsite)As an Associate Data Engineer, you will be responsible for designing and implementing data pipelines, maintaining our data infrastructure, and optimizing data storage and...

  • Senior Data Engineer

    7 days ago

    Lahore, Punjab, Pakistan Manafa Technologies Full time

    Join to apply for the Senior Data Engineer (8+ Years) role at Manafa Technologies.About Us:At Manafa Technologies, we are dedicated to revolutionizing the fintech landscape by empowering small and medium-sized enterprises (SMEs) across Saudi Arabia. Our vision is to be the most accessible lending partner for SMEs, always just one click away from fulfilling...

  • Artificial Intelligence Engineer

    7 days ago

    Lahore, Punjab, Pakistan Base Camp Data Solutions Full time

    Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Base Camp Data Solutions.Talent Acquisition Specialist at Base Camp Data SolutionsWe're hiring: Senior / Lead AI EngineersLocations: Karachi | Islamabad | Lahore | HyderabadExperience: 5–6+ YearsExpertise: Artificial Intelligence, Computer Vision, or NLPAre you...

  • Data Engineer

    3 weeks ago

    Lahore, Punjab, Pakistan BridgeLinx Technologies Full time

    Direct message the job poster from BridgeLinx TechnologiesWe, at BridgeLinx, are looking to hire a data engineer to accelerate our data infrastructure development process. We are a small team driven by our common love for data and helping people to adopt data-driven decision-making. As a data engineer, you would be responsible for creating and maintaining...

  • Data Engineer

    2 weeks ago

    Lahore, Punjab, Pakistan TenX Full time

    Join to apply for the Data Engineer role at TenX.Get AI-powered advice on this job and more exclusive features.Senior Talent Acquisition Executive @ TenX | 360° HR Resource | Scouting Talent | C-level Recruitment | Your hiring PartnerJOB SUMMARY:Data Engineers are responsible for designing and creating the data warehouse and all related extraction,...