Data Engineer in Test

4 days ago

Islamabad, Islamabad, Pakistan Confiz Full time

We are undergoing a significant data transformation to ensure that accurate and consistent data is available precisely when and where it's needed.

Responsibilities
  • Write PySpark and SQL scripts to validate data pipelines, transformations, and integrations.
  • Design and run tests for data validation, storage, and retrieval using Azure services like Data Lake, Synapse, and Data Factory, adhering to industry standards.
  • Continuously enhance automated tests as new features are developed, ensuring participation in data reconciliation and verifying data quality frameworks to maintain data accuracy, completeness, and consistency across the platform.
  • Formulate and maintain test strategies—including smoke, performance, functional, and regression testing—to ensure data processing and ETL jobs meet requirements.
  • Collaborate with development teams to assess changes in data workflows and update test cases to preserve data integrity.
  • Share knowledge and best practices by collaborating with business analysts and technology teams to document testing processes and findings.
  • Communicate testing progress effectively with stakeholders, highlighting issues or blockers, and ensuring alignment with business objectives.
  • Maintain a comprehensive understanding of the Azure Data Lake platform's data landscape to ensure thorough testing coverage.
Requirements
  • Bachelor's degree in computer science or related discipline
  • 3-6 years of hands-on experience in Data Engineering particularly in Data Lake environments on Azure's cloud platform.
  • Proficient in Azure Data Factory, Azure Synapse Analytics and Databricks for big data processing and scaled data quality checks.
  • Proficiency in SQL, capable of writing and optimizing both simple and complex queries for data validation and testing purposes.
  • Proficient in PySpark, with experience in data manipulation and transformation, and a demonstrated ability to write and execute test scripts for data processing and validation.
  • Hands-on experience with Functional & system integration testing in big data environments, ensuring seamless data flow and accuracy across multiple systems.
  • Knowledge and ability to design and execute test cases in a behaviour-driven development environment.
  • Fluency in Agile methodologies, with active participation in Scrum ceremonies and a strong understanding of Agile principles.
  • Familiarity with tools like Jira, including experience with X-Ray or Jira Zephyr for defect management and test case management.
  • Proven experience working on high-traffic and large-scale software products, ensuring data quality, reliability, and performance under demanding conditions.
  • Identify and resolve issues in complex Big Data environments, ensuring data accuracy and system efficiency.
  • Initiate and manage tasks, delivering high-quality results within deadlines in a dynamic setting.
  • Confidently challenge existing assumptions and processes to enhance data engineering and QA practices.
  • Maintain organized testing schedules and documentation, ensuring thorough coverage of all scenarios.
  • Exhibit strong interpersonal skills, working effectively in cross-functional, multicultural teams with minimal supervision.
  • Comfortable in Agile and Scrum environments, proficient with tools like Jira, and adaptable to changing priorities.
  • Manage multiple projects simultaneously, demonstrating strong planning and organizational skills to ensure timely task completion.
#J-18808-Ljbffr

  • Test Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan SWATX Full time

    SWATX is seeking a dedicated Test Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, and executing test plans and cases to ensure the quality and functionality of software products. You will collaborate closely with the development team to identify issues early in the software development life cycle and...

  • Test Engineer

    15 hours ago

    Islamabad, Islamabad, Pakistan Swatxsolutions Full time

    OverviewSWATX is seeking a dedicated Test Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, and executing test plans and cases to ensure the quality and functionality of software products. You will collaborate closely with the development team to identify issues early in the software development life cycle...

  • Senior Test Engineer

    5 days ago

    Islamabad, Islamabad, Pakistan SWATX Full time

    SWATX is looking for an experienced Senior Test Engineer to join our innovative team. In this pivotal role, you will lead the testing efforts for our software products, ensuring the highest standards of quality and performance. You will be responsible for designing test strategies, developing robust test cases, and executing comprehensive testing plans...

  • Automated Test Engineer

    5 days ago

    Islamabad, Islamabad, Pakistan beBeeAutomation Full time

    Job Title: Automated Test Engineer**Job Description**Are you a highly skilled professional with a passion for automated testing? Do you have experience in designing and implementing test automation strategies? We are looking for a talented individual to join our team as an Automated Test Engineer. In this role, you will be responsible for developing and...

  • Senior Test Automation Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan Creative Chaos Full time

    1 week ago Be among the first 25 applicantsAs a seasoned QA resource in project teams, provide expert opinion and guidance on business & quality parametersDevelop test automation framework, and continue to enhance and modify based on project needsReview test cases, scripts, plans and procedures (manual and automated)Ensure that manual and automation test...

  • Software Test Engineer

    5 hours ago

    Islamabad, Islamabad, Pakistan beBeeAutomation Full time $80,000 - $120,000

    Job DescriptionWe are seeking a Software Test Engineer to join our distributed agile team. This role will involve designing and implementing automation strategies, analyzing system architecture, and collaborating with engineering teams to embed quality upstream.This position requires strong programming skills and experience with automation frameworks. A...

  • Senior Data Engineer

    3 days ago

    Islamabad, Islamabad, Pakistan beBeeDataEngineering Full time 900,000 - 1,200,000

    Data Engineering Expertise WantedWe are seeking a seasoned data engineering professional to join our team in transforming and ensuring the accuracy and consistency of our data. Our company is undergoing a significant overhaul of its data transformation processes, and we require an expert who can write PySpark and SQL scripts to validate data pipelines,...

  • Senior/Principal Test Automation Engineer

    4 weeks ago

    Islamabad, Islamabad, Pakistan Creative Chaos Full time

    Senior/Principal Test Automation EngineerSenior/Principal Test Automation Engineer4 weeks ago Be among the first 25 applicantsAs a seasoned QA resource in project teams, provide expert opinion and guidance on business & quality parametersDevelop test automation framework, and continue to enhance and modify based on project needsReview test cases, scripts,...

  • Test Delivery Specialist

    10 hours ago

    Islamabad, Islamabad, Pakistan beBeeQualityAssurance Full time 900,000 - 1,200,000

    Job Title: Quality Assurance LeadOur company is seeking a highly skilled Quality Assurance Lead to drive the delivery of high-quality software solutions. The ideal candidate will bring expertise in automation (UI and API), manual, SQL/database, and performance testing, along with proven leadership experience in managing QA teams, mentoring talent, and...

  • Lead Data Engineer

    2 days ago

    Islamabad, Islamabad, Pakistan Fusemachines Full time

    About FusemachinesFusemachines is a leading AI strategy, talent, and education services provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic) and more than 450 employees,...