{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,6]],"date-time":"2025-11-06T12:13:25Z","timestamp":1762431205389,"version":"3.41.2"},"reference-count":34,"publisher":"Emerald","issue":"9","license":[{"start":{"date-parts":[[2016,10,3]],"date-time":"2016-10-03T00:00:00Z","timestamp":1475452800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJQRM"],"published-print":{"date-parts":[[2016,10,3]]},"abstract":"<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title>\n<jats:p>The purpose of this paper is to present a methodology to represent the uncertainty generated in performance measures (PMs) during the operational step or \u201cuse step\u201d of the performance measurement process (PMP). The different steps of the methodology are described and exemplified through an application example.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title>\n<jats:p>An index that reflects the level of uncertainty originated by the factors and the strength of their inter-relationships is developed through the use of graph theory. A graph is developed considering all sources or factors of uncertainty that may be present in this process. Based on the graph, the methodology includes the use of a matrix and the determination of the associated permanent function which is used for determining the uncertainty index.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Findings<\/jats:title>\n<jats:p>During the development of the methodology, it was found that the use of a scale that includes zero for assigning values of the elements of the matrix is not appropriate when using graph theory and permanent function calculation, since in this case the permanent function is insensible to changes in some matrix elements.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title>\n<jats:p>This paper identifies all the sources that can affect the quality of performance measurement values during the operational step of the PMP and proposes a method to characterize the strength of this uncertainty. Beyond alerting decision makers to the level of uncertainty associated with a PM, it also allows defining appropriate actions to improve PMs\u2019 quality.<\/jats:p>\n<\/jats:sec>","DOI":"10.1108\/ijqrm-10-2014-0146","type":"journal-article","created":{"date-parts":[[2016,9,20]],"date-time":"2016-09-20T03:41:26Z","timestamp":1474342886000},"page":"1346-1363","source":"Crossref","is-referenced-by-count":6,"title":["Methodology for uncertainty characterization of performance measures"],"prefix":"10.1108","volume":"33","author":[{"given":"Isabel Silva","family":"Lopes","sequence":"first","affiliation":[]},{"given":"S\u00e9rgio Dinis","family":"Sousa","sequence":"additional","affiliation":[]},{"given":"Eus\u00e9bio","family":"Nunes","sequence":"additional","affiliation":[]}],"member":"140","reference":[{"issue":"1","key":"key2020121123560944700_ref001","first-page":"50","article-title":"Graph theoretic approach (GTA) \u2013 \u2018a multi- attribute decision making (MADM) technique\u2019","volume":"2","year":"2013","journal-title":"Research Journal of Engineering Sciences"},{"issue":"10","key":"key2020121123560944700_ref002","doi-asserted-by":"publisher","first-page":"3032","DOI":"10.1080\/00207543.2013.860250","article-title":"A graph theoretic approach to evaluate the intensity of barriers in the implementation of total productive maintenance (TPM)","volume":"52","year":"2013","journal-title":"International Journal of Production Research"},{"issue":"4","key":"key2020121123560944700_ref003","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1108\/EUM0000000006514","article-title":"New criteria of performance management","volume":"5","year":"2001","journal-title":"Measuring Business Excellence"},{"issue":"3","key":"key2020121123560944700_ref004","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1541880.1541883","article-title":"Methodologies for data quality assessment and improvement","volume":"41","year":"2009","journal-title":"Journal of ACM Computing Surveys"},{"issue":"7","key":"key2020121123560944700_ref005","doi-asserted-by":"crossref","first-page":"754","DOI":"10.1108\/01443570010330739","article-title":"Designing, implementing and updating performance measurement systems","volume":"20","year":"2000","journal-title":"International Journal of Operations and Production Management"},{"issue":"10","key":"key2020121123560944700_ref006","first-page":"751","article-title":"Reviewing and improving performance measurement systems: an action research","volume":"133","year":"2011","journal-title":"International Journal of Production Economics"},{"issue":"6","key":"key2020121123560944700_ref007","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1016\/j.ijproman.2008.10.004","article-title":"Application of graph theory and matrix methods to contractor ranking","volume":"27","year":"2009","journal-title":"International Journal of Project Management"},{"issue":"8","key":"key2020121123560944700_ref008","doi-asserted-by":"crossref","first-page":"698","DOI":"10.1108\/00251740310496215","article-title":"Factors that play a role in \u2018managing through measures\u2019","volume":"41","year":"2003","journal-title":"Management Decision"},{"issue":"4","key":"key2020121123560944700_ref009","first-page":"1","article-title":"Classifying data quality problems","volume":"7","year":"2011","journal-title":"IAIDQ\u2019s Information and Data Quality Newsletter"},{"issue":"3","key":"key2020121123560944700_ref010","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/S0925-5273(96)00093-X","article-title":"An integrated dynamic performance measurement system for improving manufacturing competitiveness","volume":"48","year":"1997","journal-title":"International Journal of Production Economics"},{"issue":"4","key":"key2020121123560944700_ref011","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1080\/00207548508904734","article-title":"Issues in developing a performance criteria system for an organisation","volume":"23","year":"1985","journal-title":"International Journal of Production Research"},{"issue":"3","key":"key2020121123560944700_ref012","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/j.ijpe.2003.08.003","article-title":"A framework for supply chain performance measurement","volume":"87","year":"2004","journal-title":"International Journal of Production Economics"},{"volume-title":"ISO 10012:2003 Measurement Management Systems \u2013 Requirements For Measurement Processes and Measuring Equipment","year":"2003","author":"ISO","key":"key2020121123560944700_ref013"},{"key":"key2020121123560944700_ref014","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1016\/j.measurement.2015.03.014","article-title":"Performance measurement of decision-making units under uncertainty conditions: an approach based on double frontier analysis","volume":"69","year":"2015","journal-title":"Measurement"},{"volume-title":"JCGM 100:2008 \u2013 GUM 1995 with Minor Corrections \u2013 Evaluation of Measurement Data \u2013 Guide to the Expression of Uncertainty in Measurement","year":"2008","author":"JCGM\/WG 1","key":"key2020121123560944700_ref015"},{"edition":"5th ed","volume-title":"Juran\u2019s Quality Handbook","year":"1999","key":"key2020121123560944700_ref016"},{"first-page":"322","volume-title":"The Balanced Scorecard \u2013 Translating Strategy into Action","year":"1996","key":"key2020121123560944700_ref017"},{"issue":"3\/4","key":"key2020121123560944700_ref034","first-page":"149","article-title":"Building a process performance measurement system: some early experiences","volume":"58","year":"1999","journal-title":"Journal of Scientific and Industrial Research"},{"issue":"8","key":"key2020121123560944700_ref018","doi-asserted-by":"crossref","first-page":"1145","DOI":"10.1002\/qre.1202","article-title":"Quantification of human error in maintenance using graph theory and matrix approach","volume":"27","year":"2011","journal-title":"Quality and Reliability Engineering International"},{"issue":"2","key":"key2020121123560944700_ref019","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/S0378-7206(02)00043-5","article-title":"AIMQ: a methodology for information quality assessment","volume":"40","year":"2002","journal-title":"Information and Management"},{"issue":"2","key":"key2020121123560944700_ref020","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1108\/13683040110397220","article-title":"Performance measurement in not-for-profit and public-sector organisations","volume":"5","year":"2001","journal-title":"Measuring Business Excellence"},{"first-page":"4053","article-title":"Aligning process automation and business intelligence to support corporate performance management","year":"2004","key":"key2020121123560944700_ref021"},{"issue":"12","key":"key2020121123560944700_ref022","first-page":"1228","article-title":"Performance measurement system design: a literature review and research agenda","volume":"25","year":"2005","journal-title":"International Journal of Operations and Production Management"},{"issue":"2","key":"key2020121123560944700_ref023","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1108\/17410381011014350","article-title":"GTA-based framework for evaluating the feasibility of transition FMS","volume":"21","year":"2010","journal-title":"Journal of Manufacturing Technology Management"},{"issue":"11","key":"key2020121123560944700_ref024","first-page":"1101","article-title":"A decision-making framework model for evaluating flexible manufacturing systems using digraph and matrix methods","volume":"30","year":"2006","journal-title":"International Journal of Advanced Manufacturing Technology"},{"issue":"1-2","key":"key2020121123560944700_ref025","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1016\/j.msea.2006.06.006","article-title":"A material selection model using graph theory and matrix approach","volume":"431","year":"2006","journal-title":"Materials Science and Engineering"},{"volume-title":"Decision Making in the Manufacturing Environment: Using Graph Theory and Fuzzy Multiple Attribute Decision Making Methods","year":"2007","key":"key2020121123560944700_ref026"},{"issue":"4","key":"key2020121123560944700_ref027","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1016\/j.rcim.2005.08.003","article-title":"Selection, identification and comparison of industrial robots using digraph and matrix methods","volume":"22","year":"2006","journal-title":"Robotics and Computer-Integrated Manufacturing"},{"issue":"2","key":"key2020121123560944700_ref028","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1108\/09544789810211434","article-title":"Total quality management and the performance measurement barrier","volume":"10","year":"1998","journal-title":"The TQM Magazine"},{"issue":"3","key":"key2020121123560944700_ref029","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/S0305-0483(02)00028-2","article-title":"Challenging the paradigm of the process enterprise: a case-study analysis of BPR implementation","volume":"30","year":"2002","journal-title":"Omega"},{"issue":"5","key":"key2020121123560944700_ref030","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1080\/14783363.2010.481510","article-title":"Development of a performance measurement framework for SMEs","volume":"21","year":"2010","journal-title":"Total Quality Management & Business Excellence"},{"key":"key2020121123560944700_ref031","doi-asserted-by":"crossref","unstructured":"Sousa, S.D., Nunes, E.P. and Lopes, I.S. (2013), \u201cUncertainty components in performance measures\u201d, in Yang, G.-C. et al. (Eds), IAENG Transactions on Engineering Technologies \u2013 Special Issue of the World Congress on Engineering 2012, Springer, Dordrecht, pp. 753-765.","DOI":"10.1007\/978-94-007-6190-2_57"},{"volume-title":"Process Redesign","year":"1997","key":"key2020121123560944700_ref032"},{"issue":"1","key":"key2020121123560944700_ref033","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.ijpe.2009.10.007","article-title":"Assessing the vulnerability of supply chains using graph theory","volume":"126","year":"2010","journal-title":"International Journal of Production Economics"}],"container-title":["International Journal of Quality &amp; Reliability Management"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.emeraldinsight.com\/doi\/full-xml\/10.1108\/IJQRM-10-2014-0146","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IJQRM-10-2014-0146\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IJQRM-10-2014-0146\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T22:09:19Z","timestamp":1753394959000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/ijqrm\/article\/33\/9\/1346-1363\/141725"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,10,3]]},"references-count":34,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2016,10,3]]}},"alternative-id":["10.1108\/IJQRM-10-2014-0146"],"URL":"https:\/\/doi.org\/10.1108\/ijqrm-10-2014-0146","relation":{},"ISSN":["0265-671X"],"issn-type":[{"type":"print","value":"0265-671X"}],"subject":[],"published":{"date-parts":[[2016,10,3]]}}}