{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T01:22:22Z","timestamp":1760059342414,"version":"build-2065373602"},"reference-count":55,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2025,6,7]],"date-time":"2025-06-07T00:00:00Z","timestamp":1749254400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Fundac\u0327a\u0303o para a Cie\u0302ncia e a Tecnologia (FCT) for its financial support via the project LAETA Base Funding","award":["10.54499\/UIDB\/50022\/2020","CZ05-000291-2017"],"award-info":[{"award-number":["10.54499\/UIDB\/50022\/2020","CZ05-000291-2017"]}]},{"name":"Secretar\u00eda Nacional de Educaci\u00f3n Superior, Ciencia, Tecnolog\u00eda e Innovaci\u00f3n (SENESCYT) of the Ecuadorian Government through fellowship","award":["10.54499\/UIDB\/50022\/2020","CZ05-000291-2017"],"award-info":[{"award-number":["10.54499\/UIDB\/50022\/2020","CZ05-000291-2017"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>The efficacy of new FMECA methods can be assessed through qualitative comparisons of the failure mode rankings. This approach is suitable for a few failure modes but can become impractical or lead to misleading results for more extensive problems. This fact motivated us to introduce an alternative approach for comparing different FMECA methods based on agreement coefficients, enabling a statistical comparison between rankings generated by independent raters. Despite its relevance, the application of agreement coefficients is limited in the FMECA context. Our proposed approach utilizes Cohen\u2019s kappa coefficient to evaluate the agreement between six FMECA configurations based on a type-2 fuzzy inference system and a reference FMECA ranking. We conducted an FMECA on power transformers to test our approach, identifying fourteen potential failure modes. Results show that, based on the agreement coefficient, our proposed approach proves effective for a statistical comparison of different FMECA methods rather than a qualitative comparison between rankings.<\/jats:p>","DOI":"10.3390\/systems13060450","type":"journal-article","created":{"date-parts":[[2025,6,9]],"date-time":"2025-06-09T06:46:01Z","timestamp":1749451561000},"page":"450","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Comparisons Between Quantitative FMECA Methods: A Case Study on Power Transformer Risk Assessments"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0113-8901","authenticated-orcid":false,"given":"Andr\u00e9s A.","family":"Z\u00fa\u00f1iga","sequence":"first","affiliation":[{"name":"IDMEC, Instituto Superior T\u00e9cnico, Universidade de Lisboa, 1049-001 Lisboa, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9674-5490","authenticated-orcid":false,"given":"Jo\u00e3o F. P.","family":"Fernandes","sequence":"additional","affiliation":[{"name":"IDMEC, Instituto Superior T\u00e9cnico, Universidade de Lisboa, 1049-001 Lisboa, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7072-5184","authenticated-orcid":false,"given":"Paulo J. C.","family":"Branco","sequence":"additional","affiliation":[{"name":"IDMEC, Instituto Superior T\u00e9cnico, Universidade de Lisboa, 1049-001 Lisboa, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2025,6,7]]},"reference":[{"key":"ref_1","unstructured":"(2018). Analysis Techniques for System Reliability \u2013 Procedure for Failure Mode and Effects Analysis (FMEA) (Standard No. IEC 60812:2006)."},{"key":"ref_2","unstructured":"Z\u00fa\u00f1iga, A.A., Fernandes, J.F.P., and Branco, P.J.C. (2023, January 21\u201322). A New Concordance Coefficients-Based Approach to Compare Improved FMECA Methods. Proceedings of the 1st International Conference on Challenges in Engineering, Medical, Economics & Education: Research & Solutions (CEMEERS-23), Lisbon, Portugal."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"e9339","DOI":"10.1097\/MD.0000000000009339","article-title":"Application of Failure Mode and Effect Analysis in Managing Catheter-Related Blood Stream Infection in Inten-sive Care Unit","volume":"96","author":"Li","year":"2017","journal-title":"Medicine"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/0951-8320(95)00068-D","article-title":"Fuzzy Logic Prioritization of Failures in a System Failure Mode, Effects and Criticality Analysis","volume":"50","author":"Bowles","year":"1995","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/j.cie.2014.07.018","article-title":"Evaluating the Risk of Healthcare Failure Modes Using Interval 2-Tuple Hybrid Weighted Distance Measure","volume":"78","author":"Liu","year":"2014","journal-title":"Comput. Ind. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"106885","DOI":"10.1016\/j.ress.2020.106885","article-title":"Failure Mode and Effect Analysis Improvement: A Systematic Literature Review and Future Research Agenda","volume":"199","author":"Huang","year":"2020","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Liu, H.C. (2016). FMEA Using Uncertainty Theories and MCDM Methods, Springer Science+Business Media Singapore.","DOI":"10.1007\/978-981-10-1466-6"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/S0951-8320(02)00179-5","article-title":"Modified Failure Mode and Effects Analysis Using Approximate Reasoning","volume":"79","author":"Pillay","year":"2003","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1058","DOI":"10.1109\/TR.2017.2754642","article-title":"Failure Mode and Effect Analysis Using Cloud Model Theory and PROMETHEE Method","volume":"66","author":"Liu","year":"2017","journal-title":"IEEE Trans. Reliab."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1109\/TR.2017.2778316","article-title":"Failure Mode and Effects Analysis by Using the House of Reliability-Based Rough VIKOR Approach","volume":"67","author":"Wang","year":"2018","journal-title":"IEEE Trans. Reliab."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"104616","DOI":"10.1016\/j.jlp.2021.104616","article-title":"Modified FMEA Hazard Identification for Cross-Country Petroleum Pipeline Using Fuzzy Rule Base and Approximate Reasoning","volume":"74","author":"Hassan","year":"2022","journal-title":"J. Loss Prev. Process Ind."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Jang, J.-S.R., Sun, C.-T., and Mizutani, E. (1997). Neuro-Fuzzy and Soft Computing: A Computational Approach to Leraning and Machine Intelligence, Pearson College Div.","DOI":"10.1109\/TAC.1997.633847"},{"key":"ref_13","first-page":"1","article-title":"Introduction to Grey Systems Theory","volume":"1","author":"Deng","year":"1989","journal-title":"J. Grey Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"979","DOI":"10.1080\/03088839.2018.1520401","article-title":"A Quantitative Risk Analysis by Using Interval Type-2 Fuzzy FMEA Approach: The Case of Oil Spill","volume":"45","author":"Akyuz","year":"2018","journal-title":"Marit. Policy Manag."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"4000","DOI":"10.1016\/j.eswa.2015.01.015","article-title":"Risk Prioritization in Failure Mode and Effects Analysis Using Interval Type-2 Fuzzy Sets","volume":"42","author":"Bozdag","year":"2015","journal-title":"Expert Syst. Appl."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"106163","DOI":"10.1016\/j.engfailanal.2022.106163","article-title":"Improved FMECA for Effective Risk Management Decision Making by Failure Modes Classification under Uncertainty","volume":"135","author":"Giallanza","year":"2022","journal-title":"Eng. Fail. Anal."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"105305","DOI":"10.1016\/j.engfailanal.2021.105305","article-title":"A Novel Failure Mode Effect and Criticality Analysis (FMECA) Using Fuzzy Rule-Based Method: A Case Study of Industrial Centrifugal Pump","volume":"123","author":"Gupta","year":"2021","journal-title":"Eng. Fail. Anal."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"105327","DOI":"10.1016\/j.engfailanal.2021.105327","article-title":"Fuzzy Risk Priority Number Assessment for Solar Gel Battery Manufacturing Defects","volume":"124","author":"Yahmadi","year":"2021","journal-title":"Eng. Fail. Anal."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"106134","DOI":"10.1016\/j.asoc.2020.106134","article-title":"Failure Mode and Effects Analysis (FMEA) for Risk Assessment Based on Interval Type-2 Fuzzy Evidential Reasoning Method","volume":"89","author":"Qin","year":"2020","journal-title":"Appl. Soft Comput. J."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Vieira, S.M., Kaymak, U., and Sousa, J.M.C. (2010, January 18\u201323). Cohen\u2019s Kappa Coefficient as a Performance Measure for Feature Selection. Proceedings of the International Conference on Fuzzy Systems, Barcelona, Spain.","DOI":"10.1109\/FUZZY.2010.5584447"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1038\/s41545-021-00108-3","article-title":"Detection of Untreated Sewage Discharges to Watercourses Using Machine Learning","volume":"4","author":"Hammond","year":"2021","journal-title":"npj Clean Water"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Agrawal, P., and Trivedi, B. (2020, January 6\u20138). Evaluating Machine Learning Classifiers to Detect Android Malware. Proceedings of the 2020 IEEE International Conference for Innovation in Technology (INOCON), Bangluru, India.","DOI":"10.1109\/INOCON50539.2020.9298290"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"59597","DOI":"10.1109\/ACCESS.2021.3073728","article-title":"Deep Learning for SARS COV-2 Genome Sequences","volume":"9","author":"Whata","year":"2021","journal-title":"IEEE Access"},{"key":"ref_24","unstructured":"Cherrier, N. (2021). Interpretable Machine Learning for CLAS12 Data Analysis. [Ph.D. Thesis, Universit\u00e9 Paris-Saclay]."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1214\/aoms\/1177732186","article-title":"The Problem of m Rankings","volume":"10","author":"Kendall","year":"1939","journal-title":"Ann. Math. Stat."},{"key":"ref_26","first-page":"115","article-title":"Correlation and Agreement: Overview and Clarification of Competing Concepts and Measures","volume":"28","author":"Liu","year":"2016","journal-title":"Shanghai Arch. Psychiatry"},{"key":"ref_27","unstructured":"Gwet, K.L. (2014). Handbook of Inter-Rater Reliability, Advanced Analytics, LLC. [4th ed.]."},{"key":"ref_28","first-page":"187","article-title":"Common Pitfalls in Statistical Analysis: Measures of Agreement","volume":"8","author":"Ranganathan","year":"2017","journal-title":"Perspect"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Landis, J.R., and Koch, G.G. (1977). The Measurement of Observer Agreement for Categorical Data. Biometrics, 33.","DOI":"10.2307\/2529310"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2123","DOI":"10.1213\/ANE.0000000000002924","article-title":"Agreement Analysis: What He Said, She Said versus You Said","volume":"126","author":"Vetter","year":"2018","journal-title":"Anesth. Analg."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A Coefficient of Agreement for Nominal Scales","volume":"20","author":"Cohen","year":"1960","journal-title":"Educ. Psychol. Meas."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"276","DOI":"10.11613\/BM.2012.031","article-title":"Lessons in Biostatistics Interrater Reliability: The Kappa Statistic","volume":"22","author":"McHugh","year":"2012","journal-title":"Biochem. Medica"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1016\/j.stamet.2009.03.002","article-title":"A Note on Cohen\u2019s Weighted Kappa Coefficient of Agreement with Linear Weights","volume":"6","author":"Mielke","year":"2009","journal-title":"Stat. Methodol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1093\/ptj\/85.3.257","article-title":"The Kappa Statistic in Reliability Studies: Use, Interpretation, and Sample Size Requirements","volume":"85","author":"Sim","year":"2005","journal-title":"Phys. Ther."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1037\/h0026256","article-title":"Weighted Kappa: Nominal Scale Agreement with Provision for Scaled Disagreement of Partial Credit","volume":"70","author":"Cohen","year":"1968","journal-title":"Psychol. Bull."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"3","DOI":"10.2307\/3315487","article-title":"Beyond Kappa: A Review of Interrater Agreement Measures","volume":"27","author":"Banerjee","year":"1999","journal-title":"Can. J. Stat."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"825","DOI":"10.1016\/j.eswa.2006.10.022","article-title":"Comparison of Classification Accuracy Using Cohen\u2019s Weighted Kappa","volume":"34","year":"2008","journal-title":"Expert Syst. Appl."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1016\/0895-4356(96)00011-X","article-title":"The Meaning of Kappa: Probabilistic Concepts of Reliability and Validity Revisited","volume":"49","year":"1996","journal-title":"J. Clin. Epidemiol."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1016\/j.stamet.2011.06.002","article-title":"Cohen\u2019s Kappa Is a Weighted Average","volume":"8","author":"Warrens","year":"2011","journal-title":"Stat. Methodol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1016\/j.stamet.2011.08.006","article-title":"Cohen\u2019s Quadratically Weighted Kappa Is Higher than Linearly Weighted Kappa for Tridiagonal Agreement Tables","volume":"9","author":"Warrens","year":"2012","journal-title":"Stat. Methodol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1037\/h0028106","article-title":"Large Sample Standard Errors of Kappa and Weighted Kappa","volume":"72","author":"Fleiss","year":"1969","journal-title":"Psychol. Bull."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Ross, S.M. (2021). Introduction to Probability and Statistics for Engineers and Scientists, Academic Press. [6th ed.].","DOI":"10.1016\/B978-0-12-824346-6.00010-7"},{"key":"ref_43","first-page":"143","article-title":"Reliability Assessment of Manufacturing Processes","volume":"3","author":"Karaulova","year":"2012","journal-title":"Int. J. Ind. Eng. Manag."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Okwesili, P.C. (2016). Risk Assessment Using Paired Comparison Expert Elicitation for Ranking of Compounding Outsourcing Facilities, The George Washington University.","DOI":"10.1109\/EMR.2016.2530646"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/j.procir.2016.02.112","article-title":"A Knowledge Based FMEA to Support Identification and Management of Vehicle Flexible Component Issues","volume":"44","author":"Renu","year":"2016","journal-title":"Procedia CIRP"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"707","DOI":"10.1111\/1754-9485.12762","article-title":"Failure Mode and Effects Analysis in a Paperless Radiotherapy Department","volume":"62","author":"Frewen","year":"2018","journal-title":"J. Med. Imaging Radiat. Oncol."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"516","DOI":"10.1002\/qre.2269","article-title":"A New Risk Prioritization Model for Failure Mode and Effects Analysis","volume":"34","author":"Anes","year":"2018","journal-title":"Qual. Reliab. Eng. Int."},{"key":"ref_48","unstructured":"Baleia, A.N.S. (2018). Failure Modes and Effects Analysis (FMEA) for Smart Electrical Distribution Systems. [Master\u2019s Thesis, Universidade de Lisboa]."},{"key":"ref_49","unstructured":"Lemos, G.d.R. (2022). Fuzzy Logic Applied to Failure Modes, Effects and Criticality Analysis (FMECA) in Smart Grids. [Master\u2019s Thesis, Universidade de Lisboa]."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Mendel, J.M. (2017). Uncertain Rule-Based Fuzzy Systems: Introduction and New Directions, Springer International Publishing. [2nd ed.].","DOI":"10.1007\/978-3-319-51370-6"},{"key":"ref_51","first-page":"1","article-title":"Classical Failure Modes and Effects Analysis in the Context of Smart Grid Cyber-Physical Systems","volume":"13","author":"Baleia","year":"2020","journal-title":"Energies"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Z\u00fa\u00f1iga, A.A., Baleia, A., Fernandes, J., and da Costa Branco, P.J. (2023). A New Concordance Coefficients-Based Approach to Compare Improved FMECA Methods. Authorea Preprints.","DOI":"10.36227\/techrxiv.15180237.v2"},{"key":"ref_53","unstructured":"Tarqu\u00ednio, J.P.S., Z\u00fa\u00f1iga, A., Fernandes, J., and Branco, P. (2023). Reliability analysis of the control and automation systems in electrical substations. TechRxivPreprints."},{"key":"ref_54","unstructured":"Sarquis, E., Z\u00fa\u00f1iga, A., Fernandes, J.F.P., and Branco, P.J.D.C. (2020, January 7\u201311). Failure rates in photovoltaic systems: A careful selection of quantitative data available in the literature. Proceedings of the European Photovoltaic Energy Conference and Exhibition EUPVSEC, Online."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Z\u00fa\u00f1iga, A.A., Fernandes, J.F.P., and Branco, P.J.C. (2019). A Fuzzy-based failure modes and effects analysis (FMEA) in smart grids. Information Technology and Systems: Proceedings of ICITS 2019, Springer International Publishing.","DOI":"10.1007\/978-3-030-11890-7_49"}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/13\/6\/450\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:48:15Z","timestamp":1760032095000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/13\/6\/450"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,7]]},"references-count":55,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2025,6]]}},"alternative-id":["systems13060450"],"URL":"https:\/\/doi.org\/10.3390\/systems13060450","relation":{},"ISSN":["2079-8954"],"issn-type":[{"type":"electronic","value":"2079-8954"}],"subject":[],"published":{"date-parts":[[2025,6,7]]}}}