British Standards Institution

Source:: ISO/IEC
Committee:: ART/1 - Artificial Intelligence
Categories:: Information management | Vocabularies | Information technology. | Standardization. General rules | ICT | Information technology | Software

Scope

This document provides guidelines for evaluation of AI systems using an AI system quality model.

The document is applicable to all types of organizations engaged in the development and the use of artificial intelligence.

Purpose

AI systems can be very challenging to evaluate. Concurrently, the impact of poor AI systems’ quality is considerable as they are often developed to facilitate the automation of critical actions and decisions.

The purpose of this technical specification is to guide AI developers through proper quality evaluation of their AI systems. This document does not state exact metrics and thresholds as they vary depending on the nature of each system. Instead, it specifies a comprehensive set of guidelines that cover relevant facets of AI system’s quality for successful quality evaluation.

Testing is in scope as far as each characteristics and sub-characteristics are verified by testing strategies, but details of testing methods and metrics is covered elsewhere, for example in ISO/IEC/IEEE 29119 Series

Comment on proposal

Required form fields are indicated by an asterisk (*) character.

How important do you think standardization is in this area? *

Do you agree that a standard on this subject is feasible?: *

Please give reasons for your selections above: *

Would you or your organization use the standard? *

Would you or your organization be prepared to participate in the development of the standard or to comment on the draft when it is available? *

Are you aware of any regulation, existing standards and other good practice information in this area in the UK (e.g. Industry codes of practice; company specifications, international or European Standards)? *

Would the development of a standard(s) in this area have a particular impact/relevance to SME, consumer, environmental or societal interests? *

Are you aware of any other organizations to which this proposal may be relevant? If so please provide details below. *

Additional comments on the scope or proposal:

Although BSI will not usually enter into correspondence regarding individual comments or suggestions we may wish to contact you to seek further clarification. Please indicate whether this will be acceptable: *

Discard

Please email further comments to: debbie.stead@bsigroup.com

Standard timeline

1. Proposal

Proposal start date:

17/02/2021

Proposal end date:

16/04/2021

2. Draft

3. Public Comments

4. Comment Resolution

5. Approval

6. Publication

Learn more about the standards development process

Standards Development

ISO/IEC NP TS 5471 Artificial intelligence -- Quality evaluation guidelines for AI systems

Scope

Purpose

Comment on proposal

Discard changes?

Submit comment

Submit comment

Follow standard

Unfollow standard

Error