Data Engineer in Test

3 weeks ago

Islamabad, Islamabad, Pakistan Confiz Full time

We are undergoing a significant data transformation to ensure that accurate and consistent data is available precisely when and where it's needed.

Responsibilities
  • Write PySpark and SQL scripts to validate data pipelines, transformations, and integrations.
  • Design and run tests for data validation, storage, and retrieval using Azure services like Data Lake, Synapse, and Data Factory, adhering to industry standards.
  • Continuously enhance automated tests as new features are developed, ensuring participation in data reconciliation and verifying data quality frameworks to maintain data accuracy, completeness, and consistency across the platform.
  • Formulate and maintain test strategies—including smoke, performance, functional, and regression testing—to ensure data processing and ETL jobs meet requirements.
  • Collaborate with development teams to assess changes in data workflows and update test cases to preserve data integrity.
  • Share knowledge and best practices by collaborating with business analysts and technology teams to document testing processes and findings.
  • Communicate testing progress effectively with stakeholders, highlighting issues or blockers, and ensuring alignment with business objectives.
  • Maintain a comprehensive understanding of the Azure Data Lake platform's data landscape to ensure thorough testing coverage.
Requirements
  • Bachelor's degree in computer science or related discipline
  • 3-6 years of hands-on experience in Data Engineering particularly in Data Lake environments on Azure's cloud platform.
  • Proficient in Azure Data Factory, Azure Synapse Analytics and Databricks for big data processing and scaled data quality checks.
  • Proficiency in SQL, capable of writing and optimizing both simple and complex queries for data validation and testing purposes.
  • Proficient in PySpark, with experience in data manipulation and transformation, and a demonstrated ability to write and execute test scripts for data processing and validation.
  • Hands-on experience with Functional & system integration testing in big data environments, ensuring seamless data flow and accuracy across multiple systems.
  • Knowledge and ability to design and execute test cases in a behaviour-driven development environment.
  • Fluency in Agile methodologies, with active participation in Scrum ceremonies and a strong understanding of Agile principles.
  • Familiarity with tools like Jira, including experience with X-Ray or Jira Zephyr for defect management and test case management.
  • Proven experience working on high-traffic and large-scale software products, ensuring data quality, reliability, and performance under demanding conditions.
  • Identify and resolve issues in complex Big Data environments, ensuring data accuracy and system efficiency.
  • Initiate and manage tasks, delivering high-quality results within deadlines in a dynamic setting.
  • Confidently challenge existing assumptions and processes to enhance data engineering and QA practices.
  • Maintain organized testing schedules and documentation, ensuring thorough coverage of all scenarios.
  • Exhibit strong interpersonal skills, working effectively in cross-functional, multicultural teams with minimal supervision.
  • Comfortable in Agile and Scrum environments, proficient with tools like Jira, and adaptable to changing priorities.
  • Manage multiple projects simultaneously, demonstrating strong planning and organizational skills to ensure timely task completion.
#J-18808-Ljbffr

  • Test Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan Swatxsolutions Full time

    OverviewSWATX is seeking a dedicated Test Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, and executing test plans and cases to ensure the quality and functionality of software products. You will collaborate closely with the development team to identify issues early in the software development life cycle...

  • Elixir Test Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBeeTest Full time 1,200,000 - 1,500,000

    The Software Engineer in Test is a key member of our engineering team responsible for owning the test cycles for all product releases and upholding quality across all products.Key responsibilities include designing, reviewing, and executing tests pertinent to each release, covering both manual and automation test tasks. This involves architecting and...

  • Senior Test Engineer

    4 weeks ago

    Islamabad, Islamabad, Pakistan SWATX Full time

    SWATX is looking for an experienced Senior Test Engineer to join our innovative team. In this pivotal role, you will lead the testing efforts for our software products, ensuring the highest standards of quality and performance. You will be responsible for designing test strategies, developing robust test cases, and executing comprehensive testing plans...

  • Software Engineer in Test

    2 weeks ago

    Islamabad, Islamabad, Pakistan Elixir Technologies Corporation Full time

    Reporting to the Manager, Quality Assurance, the Software Engineer in Test (SET) is a motivated, mid-level individual contributor and a key member of the engineering team responsible for owning the test cycles for all product releases and upholding quality across all Elixir products. This individual will design, review with peers, and execute all tests...

  • AI Testing Specialist

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBeeSoftware Full time $100,000 - $120,000

    Software Quality Assurance EngineerWe are seeking a dedicated Software Quality Assurance (SQA) Engineer to join our team. As an SQA Engineer, you will be responsible for creating and executing automated and manual test cases for our software applications.Responsibilities:Create and execute test cases for software applications.Validate AI/ML model outputs...

  • Test Automation Engineer Position

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBeeTest Full time $900,000 - $1,200,000

    Job Title: Test Engineering StrategistOverviewWe are seeking an experienced and visionary test engineer to drive our test automation strategy. This individual will be responsible for designing robust test architectures, mentoring junior team members and collaborating with cross-functional teams.Key Responsibilities:Architect and lead the development of...

  • Principal Test Automation Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan Creative Chaos Full time

    Job Duties and Responsibilities:As a seasoned QA resource in project teams, provide expert opinion and guidance on business & quality parametersDevelop test automation framework, and continue to enhance and modify based on project needsReview test cases, scripts, plans and procedures (manual and automated)Ensure that manual and automation test execution are...

  • Software Development Engineer in Test II

    1 week ago

    Islamabad, Islamabad, Pakistan S&P Global, Inc. Full time

    About the RoleThe Role: Software Development Engineer in Test IIThe Team: The Quality Engineering team works in partnership with other Technology Functions and the Business to ensure quality delivery of our products. The team works in an Agile environment and is located globally. The team is independent in driving all decisions and is responsible for...

  • Lead Automated Testing Specialist

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBeeSoftware Full time $80,000 - $110,000

    Job Title:Senior Software Quality Assurance Engineer">Job Description:We are seeking a skilled Senior Software Quality Assurance (SQA) Engineer to join our team. As an SQA Engineer, you will be responsible for developing and executing automated and manual test cases for our software applications.">Key Responsibilities:Develop and execute comprehensive...

  • Data Engineer

    2 weeks ago

    Islamabad, Islamabad, Pakistan beBeeDataEngineering Full time 6,000,000 - 10,000,000

    Job SummaryWe are seeking a skilled professional to deliver high-value financial datasets and accelerate the migration of data delivery channels to cloud-native infrastructure.About the RoleThis role plays a critical part in ensuring timely, accurate, and scalable delivery of S&P Global's financial datasets. The team is responsible for delivering structured...