AI Testing Specialist

3 days ago

Islamabad, Islamabad, Pakistan beBeeSoftware Full time $100,000 - $120,000
Software Quality Assurance Engineer

We are seeking a dedicated Software Quality Assurance (SQA) Engineer to join our team. As an SQA Engineer, you will be responsible for creating and executing automated and manual test cases for our software applications.

Responsibilities:
  • Create and execute test cases for software applications.
  • Validate AI/ML model outputs against ground-truth data, test cases, and business requirements.
  • Evaluate the correctness, relevance, fairness, and consistency of model predictions.
  • Design test cases to handle exceptions, edge cases, and out-of-distribution data.
  • Monitor latency, throughput, and memory usage of AI pipelines.
  • Identify bottlenecks and collaborate with engineering teams to optimize performance.
  • Conduct stress, load, and scalability testing for deployed AI systems.
  • Develop manual and automated test suites for AI workflows, APIs, and endpoints.
  • Test system resilience to invalid inputs, adversarial samples, and API failures.
  • Ensure fallback mechanisms and graceful error handling are in place.
  • Work closely with ML engineers, data scientists, and product managers to refine testing requirements.
  • Document test cases, test results, and known limitations of models.
  • Report quality metrics and purposes.
Requirements:
  • Bachelor's degree in Computer Science, AI, Data Science, or related field.
  • Strong proficiency in Python and experience with testing frameworks.
  • 6 months to 2 years of experience as an AI QA Engineer, ML/AI Tester.
  • Experience with AI frameworks.
  • Strong debugging, analytical, and problem-solving skills.
  • Solid knowledge of SQL and working experience with relational databases.
  • Familiar with evaluation matrices for AI modeling techniques.
About Us

Our mission is to revolutionize the restaurant industry by providing a comprehensive and fully integrated solution that empowers restaurant owners to efficiently manage all aspects of their businesses.

We believe restaurants should focus on delivering exceptional dining experiences without managing complex systems. That's why we offer an All-In-One super app platform for all their needs, from front-of-the-house operations to back-of-the-house management.

As part of our world-class Silicon Valley-funded startup, you will contribute to becoming a significant player in the $55 billion restaurant tech SaaS market.

  • AI Test Engineer

    5 days ago

    Islamabad, Islamabad, Pakistan beBeeQuality Full time 4,000,000 - 6,000,000

    About Us:We are a fast-paced startup seeking a skilled Quality Assurance Specialist to join our team.This is a hybrid role that combines testing, scripting, and AI agent design.

  • AI-Powered Test Expert

    5 days ago

    Islamabad, Islamabad, Pakistan beBeeTest Full time 5,000,000 - 7,000,000

    AI-Powered Test EngineerWe're seeking a skilled professional to lead our test strategy development, ensuring it aligns with our business objectives and incorporates AI-driven insights.As an AI-Powered Test Engineer, you'll be responsible for designing and implementing robust test automation frameworks, validating complex networking features, and ensuring...

  • Network Testing Specialist

    1 week ago

    Islamabad, Islamabad, Pakistan beBeeAutomation Full time $90,000 - $120,000

    Job OpportunityWe are seeking a skilled Test Automation Engineer with expertise in WiFi and Switching technologies, including L2/L3 networking protocols.About the RoleThis is an exciting opportunity for a talented individual to join our team as a QE Test Automation Engineer. In this role, you will design and implement robust test automation frameworks,...

  • Lead Automated Testing Specialist

    5 days ago

    Islamabad, Islamabad, Pakistan beBeeSoftware Full time $80,000 - $110,000

    Job Title:Senior Software Quality Assurance Engineer">Job Description:We are seeking a skilled Senior Software Quality Assurance (SQA) Engineer to join our team. As an SQA Engineer, you will be responsible for developing and executing automated and manual test cases for our software applications.">Key Responsibilities:Develop and execute comprehensive...

  • Advanced Test Automation Specialist

    1 day ago

    Islamabad, Islamabad, Pakistan beBeeQuality Full time $80,000 - $120,000

    Job Title: Senior Quality Assurance EngineerTalent is not evenly distributed, but opportunities are often limited. A leading technology firm has created an innovative platform that connects top-tier professionals with innovative companies across the US.This role involves ensuring the reliability, performance, and scalability of AI-powered automation...

  • AI Specialist

    1 week ago

    Islamabad, Islamabad, Pakistan Ninjas Code Full time 900,000 - 1,200,000 per year

    AI Specialist – Conversational AI & Predictive Analytics (On-site, Full-Time)Location : Islamabad – E11/3We are seeking an experienced AI Specialist to join our team on-site and lead the design and development of AI-driven features that will transform how customers, vendors, and administrators interact with the platform.Key Responsibilities: ● Design...

  • Test Assurance Specialist

    1 day ago

    Islamabad, Islamabad, Pakistan beBeeQuality Full time $45,000 - $75,000

    Job Title: Test Assurance SpecialistThis role is ideal for a detail-oriented professional who wants to deliver high-quality software applications.

  • Manual Testing Specialist

    1 day ago

    Islamabad, Islamabad, Pakistan beBeeQuality Full time 350,000 - 400,000

    Job OpportunityWe are seeking a detail-oriented Quality Assurance Specialist who thrives on identifying and resolving issues, ensuring a seamless user experience.You will collaborate closely with product managers, designers, and engineers to validate new features and updates before they reach our users.This is a hands-on role where attention to detail,...

  • Usability Testing Specialist

    5 days ago

    Islamabad, Islamabad, Pakistan Vialogic Full time

    Bachelor's degree in Human-Computer Interaction, Psychology, Computer Science, or related field.Our team of experienced professionals is committed to delivering high-quality services and exceeding client expectations.Job DescriptionVialogic is seeking a Temporary/Contract Usability Testing Specialist to join our team in Islamabad. The successful candidate...

  • Psychometric Testing Specialist

    7 days ago

    Islamabad, Islamabad, Pakistan ASK Development Full time

    Psychometric Testing Specialist ASK Development, Pakistan Education: MS/Phil of Behavioral Sciences (Psychology)Responsibilities:Develop and manage the database of beneficiaries/clientsConduct, implement, coordinate, and facilitate research surveys, data entry, and record maintenancePrepare reports/publications and input for the website development and image...