Senior Data Transformation Specialist

3 days ago

Gujrat, Punjab, Pakistan beBeeDataEngineer Full time 9,000,000 - 15,000,000
Big Data Engineer and Tester

We are undergoing a significant transformation to ensure our data is accurate, consistent, and available when needed.

Responsibilities:
  • Write PySpark and SQL scripts to validate data pipelines, transformations, and integrations.
  • Design and run tests for data validation, storage, and retrieval using Azure services like Data Lake, Synapse, and Data Factory, adhering to industry standards.
  • Enhance automated tests as new features are developed, ensuring data quality frameworks maintain accuracy, completeness, and consistency across the platform.
  • Formulate and maintain test strategies—including smoke, performance, functional, and regression testing—to ensure data processing and ETL jobs meet requirements.
  • Collaborate with development teams to assess changes in data workflows and update test cases to preserve data integrity.
  • Share knowledge and best practices by collaborating with business analysts and technology teams to document testing processes and findings.
  • Communicate testing progress effectively with stakeholders, highlighting issues or blockers, and ensuring alignment with business objectives.
  • Maintain a comprehensive understanding of the Azure Data Lake platform's data landscape to ensure thorough testing coverage.
Requirements:
  • Bachelor's degree in computer science or related field
  • 3-6 years of hands-on experience in Big Data Engineering particularly in Data Lake environments on Azure's cloud platform.
  • Proficient in Azure Data Factory, Azure Synapse Analytics, and Databricks for big data processing and scaled data quality checks.
  • Proficiency in SQL, capable of writing and optimizing simple and complex queries for data validation and testing purposes.
  • Proficient in PySpark, with experience in data manipulation and transformation, and a demonstrated ability to write and execute test scripts for data processing and validation.
  • Hands-on experience with Functional & system integration testing in big data environments, ensuring seamless data flow and accuracy across multiple systems.
  • Knowledge and ability to design and execute test cases in Behaviour-Driven Development environment.
  • Fluency in Agile methodologies, with active participation in Scrum ceremonies and strong understanding of Agile principles.
  • Familiarity with tools like Jira, including experience with X-Ray or Jira Zephyr for defect management and test case management.
  • Proven experience working on high-traffic and large-scale software products, ensuring data quality, reliability, and performance under demanding conditions.
  • Identify and resolve issues in complex Big Data environments, ensuring data accuracy and system efficiency.
  • Initiate and manage tasks, delivering high-quality results within deadlines in dynamic setting.
  • Confidently challenge existing assumptions and processes to enhance data engineering and QA practices.
  • Maintain organized testing schedules and documentation, ensuring thorough coverage of all scenarios.
  • Exhibit strong interpersonal skills, working effectively in cross-functional, multicultural teams with minimal supervision.
  • Comfortable in Agile and Scrum environments, proficient with tools like Jira, and adaptable to changing priorities.
  • Manage multiple projects simultaneously, demonstrating strong planning and organizational skills to ensure timely task completion.

  • Data Engineer

    3 days ago

    Gujrat, Punjab, Pakistan beBeeDataTransformation Full time 15,000,000 - 25,000,000

    Big Data Transformation ExpertWe are undergoing a comprehensive big data transformation to ensure accurate and consistent data is available precisely when and where it's needed.The goal is to deliver precise, reliable, and high-quality data across multiple systems.This involves ensuring seamless data flow and accuracy across multiple systems.We're looking...

  • Data Insights Specialist

    3 days ago

    Gujrat, Punjab, Pakistan beBeeDataInsights Full time $80,000 - $120,000

    Job Title: Data Insights SpecialistWe are seeking a highly skilled data insights specialist to turn complex data into actionable business decisions.About the Role:Analyze large datasets from multiple sources to identify trends, patterns, and insights that inform strategic business planning.Collaborate with cross-functional teams to gather requirements and...

  • Data Architect

    3 days ago

    Gujrat, Punjab, Pakistan beBeeData Full time 1,200,000 - 2,000,000

    Job Title: Senior Data ArchitectWe are seeking a highly skilled professional to lead our data architecture initiatives and contribute to the success of our organization.The ideal candidate will possess strong technical skills in Azure Data Services, including Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics. They will also have...

  • Business Transformation Expert

    3 days ago

    Gujrat, Punjab, Pakistan beBeeImplementation Full time $80,000 - $100,000

    Odoo Implementation SpecialistAs a seasoned Odoo expert, you will be responsible for delivering high-quality solutions to clients worldwide. Your expertise in functional consulting and development will drive the success of business transformation projects from analysis to deployment.You will work closely with our team to shape the future of custom software...

  • ERP System Transformation Professional

    3 days ago

    Gujrat, Punjab, Pakistan beBeeMigration Full time 1,000,000 - 1,500,000

    ERP Migration SpecialistWe are seeking an experienced professional to lead Salesforce integration projects, focusing on the migration of Oracle ERP to Workday Finance and Billing.Key Responsibilities:Lead and execute Salesforce integration projects with a focus on Oracle ERP to Workday Finance and Billing migration.Analyze business and technical requirements...

  • Senior Data Engineer

    3 days ago

    Gujrat, Punjab, Pakistan beBeeDataEngineer Full time $100,000 - $150,000

    Job OpportunityThe role requires a candidate with 5+ years of experience in the Dynamics 365 ecosystem, possessing strong PySpark development skills. The ideal candidate will have extensive SQL knowledge, including query writing and troubleshooting in Azure SQL, Synapse Analytics, and Delta Lake environments.Key ResponsibilitiesData Engineering: Work with...

  • ERP Business Transformation Consultant

    3 days ago

    Gujrat, Punjab, Pakistan beBeeExpert Full time $100,000 - $140,000

    Business Transformation ExpertAt EndeavourOn, we specialize in streamlining business processes with cutting-edge technology.Key Responsibilities:Lead and execute Salesforce integration projects with a focus on migrating Oracle ERP systems to Workday Finance and Billing.Analyze business requirements to design scalable integration solutions.Develop, configure,...

  • Cloud Data Solutions Specialist

    3 days ago

    Gujrat, Punjab, Pakistan beBeeDataEngineer Full time 900,000 - 1,200,000

    Job OpportunityWe are seeking a skilled Data Engineer to contribute to our team.Main ResponsibilitiesData Pipeline Architectures: Design and implement robust data pipeline solutions using Azure Data Lake.Data Integration and Transformation: Integrate and transform data from various sources to enable comprehensive analytics and reporting.Quality Assurance:...

  • Transformational Business Leader

    3 days ago

    Gujrat, Punjab, Pakistan beBeeAutomation Full time $144,240 - $175,320

    Unlock the Power of Efficiency and AgilityAbout Our MissionOur organization transforms technology complexity into business opportunity. As leaders in orchestration, we help businesses streamline operations by connecting data, processes, applications, and experiences.Trusted by a community of global customers, we empower organizations to unlock new value and...

  • Data Entry Specialist

    3 days ago

    Gujrat, Punjab, Pakistan beBeeDataEntry Full time 4,000,000 - 6,000,000

    Job Title: Data Entry SpecialistWe are seeking a meticulous and detail-oriented Data Entry Specialist to join our team. As a Data Entry Specialist, you will be responsible for accurately and efficiently entering data into various computer systems and databases.This involves entering data into various computer systems and databases with a high level of...