AI Tester Accreditation Programme (AI TAP) accredits testing service firms that can technically assess AI systems for safety, reliability, and governance risks. Accredited firms are recognised by AI Verify Foundation as having possessed the technical competencies and operational readiness to evaluate AI systems against a defined scope. AI systems developers and deployers, and their end users will have greater confidence in the AI that have been tested by the accredited firms.
This is the first programme of its kind in Asia, aiming to establish what good AI assurance testing looks like.
As AI adoption accelerates, the importance of having AI systems independently assessed is increasing. However, technical testing services which require specialised expertise remain in nascent supply. Businesses thus face a challenge in selecting qualified third party AI testing firms to technically assess their AI systems. This creates an opportunity for AI Verify Foundation to work with the industry to shape the standards for technical testing.
The programme aims to build a pipeline of competent testing firms that can assess AI systems across industries, from healthcare and finance to recruitment and public services. This will provide businesses greater confidence in the assessments made by accredited testing firms, which they can use to build confidence with their stakeholders.
| Technical Testing Service Providers | Benefits |
|---|---|
| Companies that offer a business service (not just testing product) around the technical testing of Generative AI applications |
|
Technical Testing Service Providers
Companies that offer a business service (not just testing product) around the technical testing of Generative AI applications
Benefits
Interested assurance testing service providers will be assessed according to the following criteria:
| Focus | Evaluation | Objective |
|---|---|---|
| Testing Service Assessment | Technical | Ensure technical competency by validating claimed specific testing services against guidelines e.g., IMDA Starter Kit for Testing LLM-Based Applications for Safety and Reliability |
| Company Assessment | Good Standing | Ensure good standing through relevant track record, with a commitment of business activity in Singapore |
| Financials | Ensure financial sustainability | |
| Operations | Ensure operational readiness and capacity | |
| Business Scope | Ensure declared business scope matches actual capabilities |