ISO/TR 11462-4:2022

TECHNICAL ISO/TR
REPORT 11462-4
First edition
2022-02
Guidelines for implementation of
statistical process control (SPC) —
Part 4:
Reference data sets for measurement
process analysis software validation
Lignes directrices pour la mise en œuvre de la maîtrise statistique des
processus (MSP) —
Partie 4: Jeu de données pour la validation des logiciels d'analyse de
processus de mesure
Reference number
© ISO 2022
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on
the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below
or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii
Contents Page
Foreword .iv
Introduction .v
1 Scope . 1
2 Normative references . 1
3 Terms and definitions, and symbols and abbreviated terms . 1
3.1 Terms and definitions . 1
3.2 Symbols and abbreviated terms . 2
3.3 Abbreviated terms . 4
4 Overview of the test examples . 4
4.1 Overview . 4
4.2 Notes . 5
4.2.1 Notes on the accuracy of the test examples and results . 5
4.2.2 Note on outlier detection . 5
4.2.3 Note on capability indices . 5
4.2.4 Note on the model of the measurement and correlations . 5
4.2.5 Note on other reference data sets . 5
4.2.6 Note on systematic errors . 6
5 Reference data sets description and evaluation . 6
5.1 Test data set 1 – example of linearity study with at least three standards . 6
5.1.1 Test data set 1 – information . 6
5.1.2 Test data set 1 – data, calculations and results. 6
5.2 Test data set 2 – attribute measurement process – operator influence (ISO 22514-7) .12
5.2.1 Test data set 2 – information .12
5.2.2 Test data set 2 – data, calculations and results.12
5.3 Test data set 3 – attributive measurements – capability calculations using
reference values – calculation of the uncertainty range (ISO 22514-7) .13
5.3.1 Test data set 3 – information . 13
5.3.2 Test data set 3 – data, calculations and results.13
5.4 Test data set 4 – measurement process capability with three reference standards
(VDA 5) . 16
5.4.1 Test data set 4 – information . 16
5.4.2 Test data set 4 – data, calculations and results. 16
5.5 Test data set 5 – Measurement Process Capability of a CMM (VDA 5 and ISO 15530-
3) . 19
5.5.1 Test data set 5 – information . 19
5.5.2 Test data set 5 – data, calculations and results. 20
5.6 Test data set 6 – measurement process capability of automated test device .23
5.6.1 Test data set 6 – information . 23
5.6.2 Test data set 6 – data, calculations and results.23
5.7 Test data set 7 – measurement process capability of a multiple-point measuring
Instrument (VDA 5) . 27
5.7.1 Test data set 7 – information . 27
5.7.2 Test data set 7 – data, calculations and results. 27
Bibliography .32
iii
Foreword
ISO (the International Organization for Standardization) is a worldwide federation of national standards
bodies (ISO member bodies). The work of preparing International Standards is normally carried out
through ISO technical committees. Each member body interested in a subject for which a technical
committee has been established has the right to be represented on that committee. International
organizations, governmental and non-governmental, in liaison with ISO, also take part in the work.
ISO collaborates closely with the International Electrotechnical Commission (IEC) on all matters of
electrotechnical standardization.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for the
different types of ISO documents should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives).
Attention is drawn to the possibility that some of the elements of this document may be the subject of
patent rights. ISO shall not be held responsible for identifying any or all such patent rights. Details of
any patent rights identified during the development of the document will be in the Introduction and/or
on the ISO list of patent declarations received (see www.iso.org/patents).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to
the World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT), see
www.iso.org/iso/foreword.html.
This document was prepared by Technical Committee ISO/TC 69, Applications of statistical methods,
Subcommittee SC 4, Applications of statistical methods in product and process management.
A list of all parts in the ISO 11462 series can be found on the ISO website.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at www.iso.org/members.html.
iv
Introduction
The test examples were developed for the assessment of systems performing a measurement system
analysis (MSA). They allow MSA software developers to evaluate their systems. Thus, the end user of
those systems can be sure that the data sets are evaluated correctly with a high level of reliability.
In order to cover as wide a spectrum as possible, suitable data sets were prepared individually for
various constellations. The evaluation results of those data sets are documented and commented on
the following pages.
The results were verified multiple times using different computer programs. This turns the data sets
and the results into references for validation of the software. The data sets are listed in the related
clauses of this document or can be accessed via https://standards.iso.org/iso/tr/11462/-4/ed-1/en.
v
TECHNICAL REPORT ISO/TR 11462-4:2022(E)
Guidelines for implementation of statistical process
control (SPC) —
Part 4:
Reference data sets for measurement process analysis
software validation
1 Scope
This document describes examples for software validation for software implementing the standards of
ISO 22514-7 on the capability of measurement processes. In detail, the following standards are covered:
— ISO 22514-7.
It provides data sets and test results for testing the implementation of the evaluation methods described
in these standards. This includes:
a) the calculation of standard uncertainties from other sources (other than experiments – type B –
ISO/IEC Guide 98-3);
b) the estimation of uncertainty components using repeated measurements on reference parts;
c) the estimation of uncertainty components using repeated measurements on multiple parts with
different operators and their evaluation using the ANOVA method;
d) the combination of uncertainty components using the Gaussian law of uncertainty propagation;
e) the calculation of measurement process capability indices;
f) the influence of operators on attributive measurements;
g) the uncertainty range and capability indices for attributive measurements.
The test examples are intended to cover the calculation of the measuring system capability and
measurement process capability according to ISO 22514-7.
2 Normative references
The following documents are referred to in the text in such a way that some or all of their content
constitutes requirements of this document. For dated references, only the edition cited applies. For
undated references, the latest edition of the referenced document (including any amendments) applies.
ISO 22514-2, Statistical methods in process management — Capability and performance — Part 2: Process
capability and performance of time-dependent process models
3 Terms and definitions, and symbols and abbreviated terms
3.1 Terms and definitions
For the purposes of this document, the terms and definitions given in ISO 22514-2 apply.
ISO and IEC maintain terminological databases for use in standardization at the following addresses:
— ISO Online browsing platform: available at https:// www .iso .org/ obp
— IEC Electropedia: available at https:// www .electropedia .org/
3.2 Symbols and abbreviated terms
Symbols used in this standard are identical to symbols used in ISO 22514-7.
a half width of a distribution of possible values of input quantity
a maximal form deviation
OBJ
α significance level
B bias
i
C capability index for attributive measurement
attr
C measurement process capability index
MP
C measuring system capability index
MS
d average interval
d interval from the last reference value, for which all operators have assessed the result as
LR
unsatisfied to the first reference value, for which all operators have the result as approved
d interval from the last reference valu
...