ISO/IEC Guide 98-3:2008/Suppl 2:2011
(Main)Uncertainty of measurement — Part 3: Guide to the expression of uncertainty in measurement (GUM:1995) — Supplement 2: Extension to any number of output quantities
Uncertainty of measurement — Part 3: Guide to the expression of uncertainty in measurement (GUM:1995) — Supplement 2: Extension to any number of output quantities
ISO/IEC Guide 98-3:2008/Suppl.2:2011 is concerned with measurement models having any number of input quantities and any number of output quantities. The quantities involved might be real or complex. Two approaches are considered for treating such models. The first approach is a generalization of the GUM uncertainty framework. The second is a Monte Carlo method as an implementation of the propagation of distributions. Appropriate use of the Monte Carol method would be expected to provide valid results when the applicability of the GUM uncertainty framework is questionable. For a prescribed coverage probability, ISO/IEC Guide 98-3:2008/Suppl.2:2011 can be used to provide a coverage region for the output quantities of a multivariate model, the counterpart of a coverage interval for a single scalar output quantiy. The provision of coverage regions includes those taking the form of a hyper-ellipsoid or a hyper-rectangle. These coverage regions are produced from the results of the two approaches described here. A procedure for providing an approximation to the smallest coverage region, obtained from results provided by the Monte Carol method, is also given. Detailed examples to illustrate the guidance are provided.
Incertitude de mesure — Partie 3: Guide pour l'expression de l'incertitude de mesure (GUM:1995) — Supplément 2: Extension à un nombre quelconque de grandeurs de sortie
General Information
Relations
Standards Content (Sample)
GUIDE 98-3/Suppl.2
Uncertainty of measurement —
Part 3:
Guide to the expression of
uncertainty in measurement
(GUM:1995)
Supplement 2:
Extension to any number of
output quantities
First edition 2011
©
ISO/IEC 2011
ISO/IEC GUIDE 98-3:2008/Suppl.2:2011(E)
PDF disclaimer
This PDF file may contain embedded typefaces. In accordance with Adobe's licensing policy, this file may be printed or viewed but
shall not be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In
downloading this file, parties accept therein the responsibility of not infringing Adobe's licensing policy. The ISO Central Secretariat
accepts no liability in this area.
Adobe is a trademark of Adobe Systems Incorporated.
Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation
parameters were optimized for printing. Every care has been taken to ensure that the file is suitable for use by ISO member bodies. In
the unlikely event that a problem relating to it is found, please inform the Central Secretariat at the address given below.
© ISO/IEC 2011
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means,
electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or
ISO's member body in the country of the requester.
ISO copyright office
Case postale 56 CH-1211 Geneva 20
Tel. + 41 22 749 01 11
Fax + 41 22 749 09 47
E-mail copyright@iso.org
Web www.iso.org
Published in Switzerland
ii © ISO/IEC 2011 – All rights reserved
ISO/IEC GUIDE 98-3:2008/Suppl.2:2011(E)
ISO/IEC Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are members of
ISO or IEC participate in the development of International Standards through technical committees
established by the respective organization to deal with particular fields of technical activity. ISO and IEC
technical committees collaborate in fields of mutual interest. Other international organizations, governmental
and non-governmental, in liaison with ISO and IEC, also take part in the work.
Draft Guides adopted by the responsible Committee or Group are circulated to the member bodies for voting.
Publication as a Guide requires approval by at least 75 % of the member bodies casting a vote.
Attention is drawn to the possibility that some of the elements of this document may be the subject of patent
rights. ISO shall not be held responsible for identifying any or all such patent rights.
ISO/IEC Guide 98-3/Suppl.2 was prepared by Working Group 1 of the Joint Committee for Guides in
Metrology (as JCGM 102:2011), and was adopted by the national bodies of ISO and IEC.
ISO/IEC Guide 98 consists of the following parts, under the general title Uncertainty of measurement:
Part 1: Introduction to the expression of uncertainty in measurement
Part 3: Guide to the expression of uncertainty in measurement (GUM:1995)
Part 4: Role of measurement uncertainty in conformity assessment
The following parts are planned:
Part 2: Concepts and basic principles
Part 5: Applications of the least-squares method
ISO/IEC Guide 98-3 has three supplements:
Supplement 1: Propagation of distributions using a Monte Carlo method
Supplement 2: Models with any number of output quantities
Supplement 3: Modelling
Given that ISO/IEC Guide 98-3:2008/Suppl.2:2011 is identical in content to JCGM 102:2011, the decimal
symbol is a point on the line in the English version.
Annex ZZ has been appended to provide a list of corresponding ISO/IEC Guides and JCGM guidance
documents for which equivalents are not given in the text.
© ISO/IEC 2011 – All rights reserved iii
JCGM 102:2011 ISO/IEC GUIDE 98-3:2008/Suppl.2:2011(E)
Joint Committee for Guides in Metrology JCGM
Evaluation of measurement data | Supplement 2
to the \Guide to the expression of uncertainty in
measurement" | Extension to any number of
output quantities
Evaluation des donnees de mesure | Supplement 2 du \Guide pour l'expression
de l'incertitude de mesure" | Extension a un nombre quelconque de grandeurs
de sortie
c JCGM 2011| All rights reserved
© ISO/IEC – JCGM 2011 – All rights reserved i
ISO/IEC GUIDE 98-3:2008/Suppl.2:2011(E) JCGM 102:2011
c
JCGM 2011
Copyright of this JCGM guidance document is shared jointly by the JCGM member organizations (BIPM, IEC,
IFCC, ILAC, ISO, IUPAC, IUPAP and OIML).
Copyright
Even if electronic versions are available free of charge on the website of one or more of the JCGM member
organizations, economic and moral copyrights related to all JCGM publications are internationally protected.
The JCGM does not, without its written authorisation, permit third parties to rewrite or re-brand issues, to
sell copies to the public, or to broadcast or use on-line its publications. Equally, the JCGM also objects to
distortion, augmentation or mutilation of its publications, including its titles, slogans and logos, and those of
its member organizations.
Ocial versions and translations
The only ocial versions of documents are those published by the JCGM, in their original languages.
The JCGM's publications may be translated into languages other than those in which the documents were
originally published by the JCGM. Permission must be obtained from the JCGM before a translation can be
made. All translations should respect the original and ocial format of the formul and units (without any
conversion to other formul or units), and contain the following statement (to be translated into the chosen
language):
All JCGM's products are internationally protected by copyright. This translation of the original JCGM
document has been produced with the permission of the JCGM. The JCGM retains full internationally
protected copyright on the design and content of this document and on the JCGM's titles, slogan and
logos. The member organizations of the JCGM also retain full internationally protected right on their
titles, slogans and logos included in the JCGM's publications. The only ocial version is the document
published by the JCGM, in the original languages.
The JCGM does not accept any liability for the relevance, accuracy, completeness or quality of the information
and materials oered in any translation. A copy of the translation shall be provided to the JCGM at the time
of publication.
Reproduction
The JCGM's publications may be reproduced, provided written permission has been granted by the JCGM. A
sample of any reproduced document shall be provided to the JCGM at the time of reproduction and contain
the following statement:
This document is reproduced with the permission of the JCGM, which retains full internationally
protected copyright on the design and content of this document and on the JCGM's titles, slogans
and logos. The member organizations of the JCGM also retain full internationally protected right on
their titles, slogans and logos included in the JCGM's publications. The only ocial versions are the
original versions of the documents published by the JCGM.
Disclaimer
The JCGM and its member organizations have published this document to enhance access to information
about metrology. They endeavor to update it on a regular basis, but cannot guarantee the accuracy at all times
and shall not be responsible for any direct or indirect damage that may result from its use. Any reference to
commercial products of any kind (including but not restricted to any software, data or hardware) or links to
websites, over which the JCGM and its member organizations have no control and for which they assume no
responsibility, does not imply any approval, endorsement or recommendation by the JCGM and its member
organizations.
ii © ISO/IEC – JCGM 2011 – All rights reserved
JCGM 102:2011 ISO/IEC GUIDE 98-3:2008/Suppl.2:2011(E)
Contents Page
Foreword::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: v
Introduction:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: vi
1 Scope ::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: 1
2 Normative references:::::::::::::::::::::::::::::::::::::::::::::::::::::::::: 2
3 Terms and denitions ::::::::::::::::::::::::::::::::::::::::::::::::::::::::: 2
4 Conventions and notation :::::::::::::::::::::::::::::::::::::::::::::::::::::: 8
5 Basic principles::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: 10
5.1 General . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
5.2 Main stages of uncertainty evaluation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
5.3 Probability density functions for the input quantities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
5.3.1 General . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
5.3.2 Multivariate t-distribution . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
5.3.3 Construction of multivariate probability density functions . . . . . . . . . . . . . . . . . . . . . . . . 12
5.4 Propagation of distributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
5.5 Obtaining summary information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
5.6 Implementations of the propagation of distributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
6 GUM uncertainty framework ::::::::::::::::::::::::::::::::::::::::::::::::::: 14
6.1 General . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
6.2 Propagation of uncertainty for explicit multivariate measurement models . . . . . . . . . . . . . . . . . . 15
6.2.1 General . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
6.2.2 Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
6.3 Propagation of uncertainty for implicit multivariate measurement models . . . . . . . . . . . . . . . . . . 17
6.3.1 General . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
6.3.2 Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
6.4 Propagation of uncertainty for models involving complex quantities . . . . . . . . . . . . . . . . . . . . . . 19
6.5 Coverage region for a vector output quantity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
6.5.1 General . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
6.5.2 Bivariate case . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
6.5.3 Multivariate case . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
6.5.4 Coverage region for the expectation of a multivariate Gaussian distribution . . . . . . . . . . . 22
7 Monte Carlo method :::::::::::::::::::::::::::::::::::::::::::::::::::::::::: 23
7.1 General . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
7.2 Number of Monte Carlo trials . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
7.3 Making draws from probability distributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
7.4 Evaluation of the vector output quantity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
7.5 Discrete representation of the distribution function for the output quantity . . . . . . . . . . . . . . . . 27
7.6 Estimate of the output quantity and the associated covariance matrix . . . . . . . . . . . . . . . . . . . . 27
7.7 Coverage region for a vector output quantity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
7.7.1 General . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
7.7.2 Hyper-ellipsoidal coverage region . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
7.7.3 Hyper-rectangular coverage region . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
7.7.4 Smallest coverage region . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
7.8 Adaptive Monte Carlo procedure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
7.8.1 General . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
7.8.2 Numerical tolerance associated with a numerical value . . . . . . . . . . . . . . . . . . . . . . . . . . 32
7.8.3 Adaptive procedure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
8 Validation of the GUM uncertainty framework using a Monte Carlo method::::::::::: 34
© ISO/IEC – JCGM 2011 – All rights reserved iii
ISO/IEC GUIDE 98-3:2008/Suppl.2:2011(E) JCGM 102:2011
9 Examples:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::: 35
9.1 Illustrations of aspects of this Supplement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
9.2 Additive measurement model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
9.2.1 Formulation . .
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.