Data Engineer in Test

2 weeks ago

Islamabad, Islamabad, Pakistan Confiz Full time

Join to apply for the Data Engineer in Test role at Confiz.

We are undergoing a significant data transformation to ensure that accurate and consistent data is available precisely when and where it's needed.

Responsibilities
  • Write PySpark and SQL scripts to validate data pipelines, transformations, and integrations.
  • Design and run tests for data validation, storage, and retrieval using Azure services like Data Lake, Synapse, and Data Factory, adhering to industry standards.
  • Continuously enhance automated tests as new features are developed, participating in data reconciliation and verifying Data Quality frameworks to maintain data accuracy, completeness, and consistency across the platform.
  • Formulate and maintain test strategies—including smoke, performance, functional, and regression testing—to ensure data processing and ETL jobs meet requirements.
  • Collaborate with development teams to assess changes in data workflows and update test cases to preserve data integrity.
  • Share knowledge and best practices by collaborating with business analysts and technology teams to document testing processes and findings.
  • Communicate testing progress effectively with stakeholders, highlighting issues or blockers, and ensuring alignment with business objectives.
  • Maintain a comprehensive understanding of the Azure Data Lake platform's data landscape to ensure thorough testing coverage.
Requirements
  • Bachelor's degree in computer science or related discipline
  • 3-6 years of hands-on experience in Data Engineering, particularly in Data Lake environments on Azure's cloud platform.
  • Proficient in Azure Data Factory, Azure Synapse Analytics, and Databricks for big data processing and scaled data quality checks.
  • Proficiency in SQL, capable of writing and optimizing both simple and complex queries for data validation and testing purposes.
  • Proficient in PySpark, with experience in data manipulation and transformation, and a demonstrated ability to write and execute test scripts for data processing and validation.
  • Hands-on experience with functional & system integration testing in big data environments, ensuring seamless data flow and accuracy across multiple systems.
  • Knowledge and ability to design and execute test cases in a behavior-driven development environment.
  • Fluency in Agile methodologies, with active participation in Scrum ceremonies and a strong understanding of Agile principles.
  • Familiarity with tools like Jira, including experience with X-Ray or Jira Zephyr for defect management and test case management.
  • Proven experience working on high-traffic and large-scale software products, ensuring data quality, reliability, and performance under demanding conditions.
  • Identify and resolve issues in complex Big Data environments, ensuring data accuracy and system efficiency.
  • Manage multiple projects simultaneously, demonstrating strong planning and organizational skills to ensure timely task completion.

We have an amazing team of 700+ individuals working on innovative enterprise projects & products, serving Fortune 5 retail and CPG companies, leading store chains, fintech, and Silicon Valley startups.

Confiz stands out due to our focus on processes and culture. We are ISO 9001:2015 (QMS), ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM), and ISO 14001:2015 (EMS) certified. We foster a vibrant culture of learning and collaboration, making the workplace fun.

Join us to work with cutting-edge technologies and contribute to our success and your growth.

Learn more about Confiz Limited at: https://web.facebook.com/lifeatconfiz

Seniority level
  • Mid-Senior level
Employment type
  • Full-time
Job function
  • Information Technology
Industries
  • IT Services and IT Consulting
#J-18808-Ljbffr

  • Test Engineer

    6 days ago

    Islamabad, Islamabad, Pakistan Swatxsolutions Full time

    SWATX is seeking a dedicated Test Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, and executing test plans and cases to ensure the quality and functionality of software products. You will collaborate closely with the development team to identify issues early in the software development life cycle and...

  • Test Engineer

    6 days ago

    Islamabad, Islamabad, Pakistan SWATX Full time

    SWATX is seeking a dedicated Test Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, and executing test plans and cases to ensure the quality and functionality of software products. You will collaborate closely with the development team to identify issues early in the software development life cycle and...

  • Senior Test Engineer

    6 days ago

    Islamabad, Islamabad, Pakistan Swatxsolutions Full time

    SWATX is looking for an experienced Senior Test Engineer to join our innovative team. In this pivotal role, you will lead the testing efforts for our software products, ensuring the highest standards of quality and performance. You will be responsible for designing test strategies, developing robust test cases, and executing comprehensive testing plans...

  • Senior Test Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan SWATX Full time

    SWATX is looking for an experienced Senior Test Engineer to join our innovative team. In this pivotal role, you will lead the testing efforts for our software products, ensuring the highest standards of quality and performance. You will be responsible for designing test strategies, developing robust test cases, and executing comprehensive testing plans...

  • Big Data Engineer

    1 day ago

    Islamabad, Islamabad, Pakistan beBeeDataEngineering Full time

    We are seeking an experienced Data Engineer to join our team.The ideal candidate will have a strong background in data engineering, particularly in big data environments on Azure's cloud platform.Job DescriptionThis is a mid-senior level full-time position that requires a bachelor's degree in computer science or a related field and 3-6 years of...

  • Software Development Engineer in Test

    7 days ago

    Islamabad, Islamabad, Pakistan Upstartcommerce Full time

    UpStart Commerce is a startup focused on building a next-generation platform to support retail and eCommerce merchants. The technology is founded on the principles of reactive design and micro-services. We are leveraging Akka, Zio, OpenSearch, Spark, Cassandra, Docker, Kubernetes, and Kafka as the foundation of our platform. The implementation is primarily...

  • Data Engineering Specialist

    5 days ago

    Islamabad, Islamabad, Pakistan beBeeDataEngineering Full time

    Job Title: Data Engineering SpecialistJob Description:We are seeking a highly skilled Data Engineer with expertise in designing and implementing end-to-end data pipelines, including ingestion, transformation, and delivery.The ideal candidate will have experience working with large-scale datasets, building predictive models, and producing actionable business...

  • Senior Software Engineer in Test

    3 weeks ago

    Islamabad, Islamabad, Pakistan Elixir Technologies Corporation Full time

    All Jobs > Senior Software Engineer in TestReporting to the Global Director QA, the Senior Software Engineer in Test (Sr. SET) is a motivated, high-level individual contributor and a key member of the engineering team responsible for owning the test cycles for all product releases and upholding quality across all Elixir products. This individual will...

  • Data Scientist/Engineer

    3 weeks ago

    Islamabad, Islamabad, Pakistan SwipBox Full time

    Job Summary: We are looking for a skilled Data Engineer/Data Scientist with strong Python programming and analytical skills, who can work across the data pipeline from ingestion and processing to modelling and reporting. The ideal candidate has experience handling large-scale (big) datasets, building predictive models, working with live and runtime data...

  • Chief Data Insights Engineer

    2 days ago

    Islamabad, Islamabad, Pakistan beBeeDataScientist Full time

    We are seeking a highly skilled Data Scientist to drive data-driven insights, develop predictive models, and build scalable data preparation pipelines. The ideal candidate should be proficient in Python or R, statistical analysis, and traditional machine learning techniques to solve complex business problems.Responsibilities:Perform exploratory data analysis...