We use cookies to give you the best experience and to help improve our website

Find out what cookies we use and how to disable them

ISO/IEC JTC 1/SC 42 N 537 Software engineering -- Systems and software Quality Requirements and Evaluation (SQuaRE) -- Quality Model for AI-based systems

Scope

This document outlines a quality model for AI-based systems, and is an application-specific extension to the SQuaRE series. The characteristics and sub-characteristics detailed in the model provide consistent terminology for specifying, measuring and evaluating AI-based system quality, and a set of quality characteristics against which stated quality requirements can be compared for completeness.

Purpose

ISO/IEC 25010 (System and software quality models) defines a product quality and a quality-in-use model. The characteristics defined by both models are currently generic enough for all computer systems, but the sub-characteristics require adaption for AI-based systems. It is also necessary to define the relationship between trustworthiness and quality characteristics. Comprehensive specification of quality characteristics in accordance with stakeholders' values, goals, objectives and risk appetite are key factors in ensuring the delivery of trustworthy AI systems.

ISO/IEC 25010 is a popular standard in software and systems quality management, however it has been identified by SC7 and SC42 that it is not adequate for AI systems. Should a practitioner wish to define a strategy or approach to holistically evaluate the quality of an AI system at present, it requires review of many scholarly articles in order to identify the relevant properties. Introducing a standardised model, that is an International Standard, consistent with ISO/IEC 25010, will drive efficiency in industry.

This new deliverable, ISO/IEC 250xx, will define differences in terminology with SC7/WG6, to support work related to SC7 deliverables (e.g. ISO/IEC TR 29119-11), and ensures that other SC42 deliverables (e.g. ISO/IEC TR 24029) that specify (quality-related) measurements and methodologies use common terminology. This includes qualities related to the impact the system has on its stakeholders, and incorporates aspects of trustworthiness into the quality model.

It is possible, that following the definition of this quality model, additional SQuaRE deliverables such as those below will also need to be extended with similar, application-specific documents:

Quality Measurement Division (ISO/IEC 2502n),

Quality Requirements Division (ISO/IEC 2503n),

Quality Evaluation Division (ISO/IEC 2504n)

Comment on proposal

Required form fields are indicated by an asterisk (*) character.


Please email further comments to: debbie.stead@bsigroup.com

Follow standard

You are now following this standard. Weekly digest emails will be sent to update you on the following activities:

You can manage your follow preferences from your Account. Please check your mailbox junk folder if you don't receive the weekly email.

Unfollow standard

You have successfully unsubscribed from weekly updates for this standard.

Error