ISO/IEC TR 29119-13:2022

TECHNICAL ISO/IEC TR
REPORT 29119-13
First edition
2022-11
Software and systems engineering —
Software testing —
Part 13:
Using the ISO/IEC/IEEE 29119 series
in the testing of biometric systems
Reference number
© ISO/IEC 2022
© ISO/IEC 2022
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on
the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below
or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii
© ISO/IEC 2022 – All rights reserved

Contents Page
Foreword .v
Introduction . vi
1 Scope . 1
2 Normative references . 1
3 Terms, definitions and abbreviated terms . 1
3.1 Terms and definitions . 1
3.2 Abbreviated terms . 7
4 Introduction to biometrics . 9
4.1 Biometrics overview . 9
4.2 Standardization and biometrics . 9
4.2.1 Introduction to standardization of biometrics . 9
4.2.2 ISO/IEC JTC 1/SC 37 (biometrics) . 9
4.2.3 ISO/IEC JTC 1/SC 37/WG 5 (biometrics and testing) . 10
5 Introduction to software testing .10
5.1 Software testing in context . 10
5.2 Static and dynamic testing . 10
5.3 Systematic software testing . 10
5.4 Purpose of testing . 11
5.5 Standardization and software testing . 11
5.5.1 Testing standards prior to the ISO/IEC/IEEE 29119 series . 11
5.5.2 The ISO/IEC/IEEE 29119 series . 11
5.5.3 ISO/IEC JTC 1/SC 7/WG 26 (software testing) .12
5.6 Risk-based testing .12
5.6.1 Risk-based testing at the core of software testing .12
5.6.2 Risk categories .13
6 Software testing of biometric systems and subsystems .13
6.1 Traditional evaluation of biometric systems . 13
6.1.1 General .13
6.1.2 Evaluation levels for biometric systems .13
6.1.3 Performance measures for biometric systems. 17
6.2 Scope of testing for biometric systems . 18
6.2.1 General . 18
6.2.2 Biometric enrolment and recognition . 18
6.2.3 Biometric components and supporting components . 18
6.2.4 Biometric subsystem as part of a larger system . 18
6.2.5 Static and dynamic testing of the biometric system . 19
6.2.6 Testing all quality characteristics or limited to biometric performance . 19
6.3 Documentation for testing biometric systems . 19
6.4 Standards for testing biometric systems . 19
Annex A (informative) Brief introduction to biometric systems .20
Annex B (informative) Standards related to the testing of biometric systems .26
Annex C (informative) Generic risks in biometric systems.32
Annex D (informative) Test documentation mappings for biometric systems .77
Annex E (informative) Mapping from ISO/IEC 19795-1 to the ISO/IEC/IEEE 29119 series .97
Annex F (informative) Mapping from ISO/IEC 19795-2 to the ISO/IEC/IEEE 29119 series . 150
Annex G (informative) Mapping from ISO/IEC 19795-4 to the ISO/IEC/IEEE 29119 series . 194
Annex H (informative) Mapping from ISO/IEC 19795-6 to the ISO/IEC/IEEE 29119 series . 226
Annex I (informative) Mapping from ISO/IEC 19795-7 to the ISO/IEC/IEEE 29119 series . 236
iii
© ISO/IEC 2022 – All rights reserved

Annex J (informative) Mapping from ISO/IEC TS 19795-9 to the ISO/IEC/IEEE 29119 series . 247
Annex K (informative) Mapping from ISO/IEC 29109-1 to the ISO/IEC/IEEE 29119 series . 261
Bibliography . 272
iv
© ISO/IEC 2022 – All rights reserved

Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are
members of ISO or IEC participate in the development of International Standards through technical
committees established by the respective organization to deal with particular fields of technical
activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international
organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the
work.
The procedures used to develop this document and those intended for its further maintenance
are described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria
needed for the different types of document should be noted. This document was drafted in
accordance with the editorial rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives or
www.iec.ch/members_experts/refdocs).
Attention is drawn to the possibility that some of the elements of this document may be the subject
of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent
rights. Details of any patent rights identified during the development of the document will be in the
Introduction and/or on the ISO list of patent declarations received (see www.iso.org/patents) or the IEC
list of patent declarations received (see https://patents.iec.ch).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to
the World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see
www.iso.org/iso/foreword.html. In the IEC, see www.iec.ch/understanding-standards.
This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 7, Software and systems engineering.
A list of all parts in the ISO/IEC/IEEE 29119 series can be found on the ISO and IEC websites.
Any feedback or questions on this document should be directed to the user’s national standards
body. A complete listing of these bodies can be found at www.iso.org/members.html and
www.iec.ch/national-committees.
v
© ISO/IEC 2022 – All rights reserved

Introduction
This document provides an overview of the topics of biometric systems and software testing and their
standardization. It describes how to apply the ISO/IEC/IEEE 29119 series of software testing standards
to the testing of both pure biometric systems and more extensive systems that include biometric
subsystems.
It includes information on the creation of a risk-based test strategy that addresses the full range of
quality characteristics for a system (i.e. not restricted or focused solely on those quality characteristics
covered by biometric technical performance testing).
This document includes mappings between the documentation requirements of:
— ISO/IEC 19795-1
— ISO/IEC 19795-2
— ISO/IEC 19795-6
and the software test documentation defined by ISO/IEC/IEEE 29119-3.
It provides mappings between the ISO/IEC/IEEE 29119 series and the following standards defining the
testing of biometric systems:
— ISO/IEC 19795-1
— ISO/IEC 19795-2
— ISO/IEC 19795-4
— ISO/IEC 19795-6
— ISO/IEC 19795-7
— ISO/IEC TS 19795-9
— ISO/IEC 29109-1
The standards covering the evaluation and testing of biometric systems (e.g. the ISO/IEC 19795 series)
are written from the perspective of an expert in biometric systems, are focused on technical biometric
performance testing (i.e. error rates and throughput rates) based on dynamic testing and do not
explicitly use a risk-based approach to the testing, as required by the ISO/IEC/IEEE 29119 series of
software testing standards.
This document has been created to provide support to software testers who are inexperienced in testing
biometric systems. It lists the most relevant biometric standards for software testers of biometric
systems. It provides information on performing systematic software testing (static and dynamic) of
biometric systems using a risk-based approach in conformance with the ISO/IEC/IEEE 29119 series
of software testing standards. The mappings also show how conformance with the most popular
biometric testing standards maps to the requirements of the ISO/IEC/IEEE 29119 series. This document
also provides useful information for biometrics experts, who want to test a complete biometric system
using a risk-based approach in conformance with the ISO/IEC/IEEE 29119 series of software testing
standards.
As a Technical Report, this document contains data of a different kind from that normally published as
an International Standard or Technical Specification, such as data on the “state of the art”.
vi
© ISO/IEC 2022 – All rights reserved

TECHNICAL REPORT ISO/IEC TR 29119-13:2022(E)
Software and systems engineering — Software testing —
Part 13:
Using the ISO/IEC/IEEE 29119 series in the testing of
biometric systems
...