Senior QA Engineer – AI Platform Testing

19 hours ago

Karachi, Sindh, Pakistan NorthBay - Pakistan Full time

2 days ago Be among the first 25 applicants

Job Title: QA Engineer – AI Platform Testing

Job Title: QA Engineer – AI Platform Testing

Location: Pakistan (Karachi - Lahore - Islamabad) (Willing to Travel Frequently or Relocate to Abu Dhabi)

Experience: 5+ Years

Company: NorthBay Solutions

About The Role

NorthBay Solutions is looking for a QA Engineer with strong automation skills to support testing efforts across our AI-driven platforms. In this role, you will ensure the functional accuracy, performance, and quality of features while also contributing to validation of AI model outputs, training data quality, and overall user experience across web and API-based systems.

Key Responsibilities

  • Design, write, and execute test cases to validate features, APIs, and end-to-end system integrations.
  • Develop and maintain automated test scripts using Java-based frameworks (e.g., Selenium, TestNG, or similar).
  • Conduct manual and exploratory testing for AI model outputs and user workflows.
  • Validate training datasets, detect anomalies, and evaluate model-generated content.
  • Log and track defects with comprehensive documentation using bug tracking tools.
  • Collaborate closely with Machine Learning, Development, and Automation teams to define test strategies and acceptance criteria.
  • Contribute to regression testing cycles and final release validations.

Required Skills & Qualifications
  • 5+ years of professional experience in QA or software testing.
  • Proven experience in QA automation using Java.
  • Solid understanding of Agile methodologies, QA processes, and test lifecycle management.
  • Hands-on experience with test management tools (TestRail, Zephyr) and defect tracking tools (JIRA, Azure DevOps).
  • Strong experience with API testing tools such as Postman.
  • Excellent analytical skills and attention to detail.
  • Preferred (Nice to Have):
    • Exposure to AI/ML concepts, particularly around testing LLM outputs, computer vision, or NLP systems.
    • Experience validating training data quality and evaluating model behavior in production environments.
    About NorthBay Solutions

    NorthBay Solutions is a leading cloud-native and AI-focused digital transformation company. We specialize in helping enterprises modernize their applications and data ecosystems to accelerate innovation and business growth.Seniority level
    • Seniority levelMid-Senior level
    Employment type
    • Employment typeFull-time
    Job function
    • Job functionEngineering and Information Technology
    • IndustriesIT Services and IT Consulting

Referrals increase your chances of interviewing at NorthBay - Pakistan by 2x

Get notified about new Senior Quality Assurance Engineer jobs in Karāchi, Sindh, Pakistan.

Software Quality Assurance Engineer-ManualSenior Software Quality Assurance Engineer

Karachi Division, Sindh, Pakistan 8 months ago

Karachi Division, Sindh, Pakistan 2 days ago

Quality Assurance Specialist- Sales and LeadSoftware Quality Assurance Engineer - Automation

Karachi Division, Sindh, Pakistan 1 day ago

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

  • Senior QA Engineer – AI Platform Testing

    19 hours ago

    Karachi, Sindh, Pakistan NorthBay Solutions LLC Full time

    Job Title: QA Engineer – AI Platform TestingLocation: Pakistan (Karachi - Lahore - Islamabad) (Willing to Travel Frequently or Relocate to Abu Dhabi)Experience: 5+ YearsCompany: NorthBay SolutionsAbout the Role:NorthBay Solutions is looking for a QA Engineer with strong automation skills to support testing efforts across our AI-driven platforms. In this...

  • Senior QA Automation Engineer

    3 weeks ago

    Karachi, Sindh, Pakistan Beam AI Full time

    1 week ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.About BeamBeam is a tech start-up leveraging Generative AI to build AI Agents for business operations. Beam's generative agents help organisations to boost their productivity by automating repetitive tasks in seconds. Powered by LLMs, AI agents are easy...

  • AI Platform Testing Specialist

    9 hours ago

    Karachi, Sindh, Pakistan beBeeTesting Full time 600,000 - 1,000,000

    Job OverviewRole Summary:We are seeking a skilled QA Engineer to support testing efforts across AI-driven platforms.Ensure accurate, efficient, and high-quality features.Contribute to validation of AI model outputs, data quality, and user experience.

  • AI Platform Tester

    3 days ago

    Karachi, Sindh, Pakistan beBeeAutomation Full time 500,000 - 1,000,000

    Job Title: Senior QA Engineer - AI Platform TestingWe are seeking an experienced QA Engineer to join our team and support the testing efforts of our AI-driven platforms.The ideal candidate will have strong automation skills and a solid understanding of Agile methodologies, QA processes, and test lifecycle management.The role involves designing, writing, and...

  • AI Testing Professional

    3 days ago

    Karachi, Sindh, Pakistan beBeeQuality Full time 8,000,000 - 10,000,000

    Senior AI Quality Assurance EngineerIn this role, you will be responsible for ensuring the functional accuracy and performance of features while contributing to validation of AI model outputs and training data quality.Main Responsibilities:You will design, write, and execute test cases to validate features, APIs, and end-to-end system integrations.A strong...

  • SQA Engineer

    3 weeks ago

    Karachi, Sindh, Pakistan QA Brains Full time

    Key Responsibilities – SQA Engineer at SIRPDesign and execute effective manual test cases for the product and APIs based on product requirements and technical documentation.Independently performall aspects of testing, including smoke, functional, integration, system, regression, and automation testing.Collaborate with cross-functional teams, including...

  • QA Engineer Position

    14 hours ago

    Karachi, Sindh, Pakistan beBee Careers Full time 1,200,000 - 1,500,000

    Sr. QA EngineerWe are looking for a highly skilled Senior Quality Assurance (QA) Engineer to join our team. As a Sr. QA Engineer, you will be responsible for developing and maintaining high-quality test scripts, utilities, and tools required to execute test plans.Key Responsibilities & Deliverables:Develops, maintains, and upgrades manual and automated test...

  • qa engineer

    1 week ago

    Karachi, Sindh, Pakistan Abroad Work Full time

    QA EngineerOur fast-growing software development company is seeking a highly skilled QA Engineer to join our team in Karachi. As a QA Engineer, you will be responsible for testing and ensuring the quality of our software products before they are released to our clients. This position does not require accommodation, and we provide visa sponsorship for...

  • AI Agent Forward Deployment Engineer

    4 weeks ago

    Karachi, Sindh, Pakistan Beam AI Full time

    About BeamBeam is a tech start-up revolutionising business operations with AI. Our AI Agents empower organisations by automating repetitive tasks, boosting productivity in seconds. With seamless integration into business applications, our agents provide support where teams need it most. Our mission? To transform business practices, increase efficiency,...

  • Senior QA Engineer

    4 days ago

    Karachi, Sindh, Pakistan Creative Chaos Full time

    Job ResponsibilitiesPlan, organize, and implement day-to-day activities of testing and work with developers, architects, and technical release managers within an agile/scrum environment.Participate in scrum & product planning and be responsible for all phases and types of testing, including but not limited to strategies, requirements, planning, management,...