Standards Development
This document specifies measurement and test methods for hardware performance benchmarking in quantum processor units.
The scope of this document includes established benchmarking procedures for quantum computing components and subsystems in hardware platforms which carry out quantum information processing, such as but not limited to gate-based quantum computers and one-way quantum computers. Examples include the family of randomized benchmarking protocols, gate -set tomography, and other tomographic methods for quantum process characterisation.
The scope excludes methods directed towards benchmarking the performance and resource requirements for algorithms and end-user applications (algorithmic, application and use-case benchmarking), that is, that focus on benchmarking the circuit construction a nd compilation (the software) rather than the quantum computing system hardware.
The proposed work item aims to create a measurement and test method standard describing established hardware benchmarking methodologies for gate -based quantum computers, such as randomized benchmarking and gate-set tomography.
Specifically, it would collect together well-established techniques which are determined through well - determined protocols, as is the case for the family of randomized benchmarking protocols.
The project will survey and classify existing benchmarking methodologies, identify procedures which are ready to be specified, and specify them. In particular, this project would focus on operational level benchmarks which characterise performance of higher-level quantum components within a quantum computing system, through the implementation of non -trivial quantum circuits and protocols. If appropriate, the proposed standard might also describe and assess the technical state -of-the-art of other procedures which are not yet ready to be specified.
In relation to generic (cross-pillar) element level benchmarks, such as qubit coherence characterisation (T1, T2, etc), it is anticipated that this project would build on but not itself attempt to specify these, as it is expected that these will be address ed in IEC 63607 ED1 Quantum technologies – Terminology and quantities – General quantities and subsequent projects.
Need: The quantum computing industry has experienced extraordinary growth over the past decade, and this is arguably only accelerating, yet it still encompasses many active development efforts across a wide range of disparate and competing hardware platfor ms, with no clear indication available as to which of these platforms may ultimately prove commercially successful. Further complicating the diversity of platforms, without clearly defined and established standard performance benchmarking methodologies, quantum computing system vendors also employ highly diverse validation methods to demonstrate their own system performance. This large variation in platforms and benchmarking methods creates challenges for quantum businesses seeking to communicate their deve lopment progress; for downstream stakeholders seeking to compare performance and capabilities across platforms or vendors; and for defining the quality assurance processes which will be needed to build strong public licence for quantum computing technologi es and investment.
Benefit: Establishing clearly defined procedures for quantum computing hardware component and system performance benchmarking will deliver significant benefits to a wide range of stakeholders of the quantum computing industry. It will facilitate easier, cl earer and more reliable performance and capability comparisons across vendors and platforms to enable better procurement and investment decisions for prospective investors, funders and end users. This will in turn accelerate overall industry development progress and ultimately deliver better trust. It will also decrease competitive barriers to new market entrants, by enabling them to establish reputation and trusted performance capabilities using established and widely accepted validation methods, and by fa cilitating clear target hardware development milestones to guide their progress.
Timing: Numerous benchmarking methods, such as the family of randomized benchmarking protocols (e.g., qubit randomized benchmarking, interleaved randomized benchmarking, etc), have been well established in both research literature and quantum industry, to the point of being tacitly adopted as de facto standards within the community of quantum experts. There is already wide consensus surrounding these standards, and they are technically ready for standardisation to begin now. Recently, numerous pre-standardisation projects in this area have also been taking place among local communities, which have prepared the way for the development of full standards at the international level. These include:
• In the US: Hardware benchmarking protocols defined for progress assessment purposes in quantum computing funding programs.
• In the UK: Survey and categorisation of hardware benchmarking protocols by NPL.
• European projects such as QuTest (Ion Traps) and MeTSuperQ (Superconducting Qubits), which
• NMI-Q: A global cooperation between National Measurement Institutes to develop neutral and reliable measurement infrastructure for QT components.
A potential, illustrative Table of Contents as an outline for the proposed standard is attached to this NP.
Required form fields are indicated by an asterisk (*) character.
You are now following this standard. Weekly digest emails will be sent to update you on the following activities:
You can manage your follow preferences from your Account. Please check your mailbox junk folder if you don't receive the weekly email.
You have successfully unsubscribed from weekly updates for this standard.
Comment by: