Data Transformation Specialist

1 day ago

Islamabad, Islamabad, Pakistan beBeeDataEngineer Full time 800,000 - 1,200,000
Job Description:
We are undergoing a significant transformation to ensure accurate and consistent data is available precisely when and where it's needed.

Key Responsibilities
  • Write PySpark and SQL scripts to validate data pipelines, transformations, and integrations.
  • Design and run tests for data validation, storage, and retrieval using Azure services like Data Lake, Synapse, and Data Factory, adhering to industry standards.
  • Continuously enhance automated tests as new features are developed, ensuring participation in data reconciliation and verification of data quality frameworks to maintain data accuracy, completeness, and consistency across the platform.
  • Formulate and maintain test strategies—including smoke, performance, functional, and regression testing—to ensure data processing and ETL jobs meet requirements.
  • Collaborate with development teams to assess changes in data workflows and update test cases to preserve data integrity.
  • Share knowledge and best practices by collaborating with business analysts and technology teams to document testing processes and findings.
  • Communicate testing progress effectively with stakeholders, highlighting issues or blockers, and ensuring alignment with business objectives.
  • Maintain a comprehensive understanding of the Azure Data Lake platform's data landscape to ensure thorough testing coverage.


Requirements:
  • Bachelor's degree in computer science or related discipline.
  • 3-6 years of hands-on experience in Data Engineering particularly in Data Lake environments on Azure's cloud platform.
  • Proficient in Azure Data Factory, Azure Synapse Analytics, and Databricks for big data processing and scaled data quality checks.
  • Proficiency in SQL, capable of writing and optimizing both simple and complex queries for data validation and testing purposes.
  • Proficient in PySpark, with experience in data manipulation and transformation, and a demonstrated ability to write and execute test scripts for data processing and validation.
  • Hands-on experience with Functional & system integration testing in big data environments, ensuring seamless data flow and accuracy across multiple systems.
  • Knowledge and ability to design and execute test cases in a behaviour-driven development environment.
  • Fluency in Agile methodologies, with active participation in Scrum ceremonies and a strong understanding of Agile principles.
  • Familiarity with tools like Jira, including experience with X-Ray or Jira Zephyr for defect management and test case management.
  • Proven experience working on high-traffic and large-scale software products, ensuring data quality, reliability, and performance under demanding conditions.
  • Identify and resolve issues in complex Big Data environments, ensuring data accuracy and system efficiency.
  • Initiate and manage tasks, delivering high-quality results within deadlines in a dynamic setting.
  • Confidently challenge existing assumptions and processes to enhance data engineering and QA practices.
  • Maintain organized testing schedules and documentation, ensuring thorough coverage of all scenarios.
  • Exhibit strong interpersonal skills, working effectively in cross-functional, multicultural teams with minimal supervision.
  • Comfortable in Agile and Scrum environments, proficient with tools like Jira, and adaptable to changing priorities.
  • Manage multiple projects simultaneously, demonstrating strong planning and organizational skills to ensure timely task completion.


What We Offer:
You will work with a team of 700+ individuals on highly innovative enterprise projects & products. Our customer base includes Fortune 5 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups. You will be part of an organization that values culture and processes. We are ISO certified and have a vibrant culture of learning via collaboration and making the workplace fun.

  • Senior Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBeeDataEngineering Full time 900,000 - 1,200,000

    Data Engineering Expertise WantedWe are seeking a seasoned data engineering professional to join our team in transforming and ensuring the accuracy and consistency of our data. Our company is undergoing a significant overhaul of its data transformation processes, and we require an expert who can write PySpark and SQL scripts to validate data pipelines,...

  • Digital Transformation

    1 week ago

    Islamabad, Islamabad, Pakistan Abacus Full time 900,000 - 1,200,000 per year

    Job Opportunity: Digital Transformation & Analytics Consultant (SPPS-II)Location:IslamabadDuration:1 Year (Extendable based on performance)Organization:Ministry of National Food Security & Research, Government of PakistanThe Ministry of National Food Security & Research is seeking a highly qualifiedDigital Transformation & Analytics Consultant (SPPS-II)to...

  • Data Analysis Consultant

    5 days ago

    Islamabad, Islamabad, Pakistan beBeeBusiness Full time 800,000 - 1,200,000

    Job Opportunity:We are seeking a highly skilled Business Intelligence Specialist to develop comprehensive operational, client, KPIs, and bid proposal reports and dashboards using Power BI and Excel. They will perform data extraction, cleaning, and transformation using SQL and Power Query, analyze large datasets to identify trends, patterns, and actionable...

  • Data Architect

    1 week ago

    Islamabad, Islamabad, Pakistan Datamatics Technologies Full time $900,000 - $1,200,000 per year

    We are seeking a highly experienced Data Evangelist to lead a major technology refresh and data transformation initiative for a leading bank in KSA. The ideal candidate will be a strategic thinker and hands-on practitioner with deep expertise in data architecture, financial data models, governance frameworks, and modern data methodologies. This role will...

  • Data Entry Specialist

    7 days ago

    Islamabad, Islamabad, Pakistan Worthgenics Solutions Full time

    Data Entry Specialist Worthgenics Solutions , Pakistan We are looking for a Data Entry Specialist to join our team. The ideal candidate will have experience collecting data from online platforms. The Data Entry Specialist will be responsible for collecting, entering, and maintaining data in our database, as well as creating reports and...

  • Digital Transformation Specialist

    5 days ago

    Islamabad, Islamabad, Pakistan beBeeTransformation Full time 800,000 - 1,000,000

    Exciting Career OpportunityWe are seeking a highly motivated and ambitious individual to join our digital team as a Trainee Executive. This role offers a unique opportunity to gain hands-on experience in the rapidly evolving digital landscape.As a Trainee Executive, you will be part of a dynamic team that is responsible for driving innovation and growth...

  • Data Entry Specialist

    5 days ago

    Islamabad, Islamabad, Pakistan beBeeDataEntry Full time 3,000,000 - 5,500,000

    Data Entry Specialist Job DescriptionWe are seeking a detail-oriented Data Entry Specialist to play a crucial role in maintaining and updating information across various platforms.

  • Data Architect

    1 day ago

    Islamabad, Islamabad, Pakistan beBeeDataEngineer Full time 1,200,000 - 1,500,000

    Job Title: Key Data ArchitectJob Description:We are seeking a seasoned Data Engineer to design and optimize data pipelines using Azure Data Lake. This role requires expertise in designing, implementing, and transforming data from various sources for comprehensive analytics and reporting.Key Responsibilities:Design robust data pipeline solutions within Azure...

  • Senior Financial Data Specialist

    5 days ago

    Islamabad, Islamabad, Pakistan beBeeFinance Full time 1,200,000 - 1,500,000

    Our organization is seeking a highly skilled Financial Data Analyst to join our team.This role involves the development of Power BI reports and the computerization of analytics and data collection processes.Key ResponsibilitiesDeveloping visual reports, KPI scorecards, and dashboards using Power BI desktopConnecting data sources, importing data, and...

  • Data Insights Specialist

    1 week ago

    Islamabad, Islamabad, Pakistan beBeeBusiness Full time 800,000 - 1,500,000

    Job Summary:A key player in our organization will be responsible for crafting data-driven visualizations to inform business decisions. This critical role focuses on transforming complex data into clear, actionable insights that drive success.Main Responsibilities:Develop and implement dashboards and reports using advanced BI tools.Data Visualization...