{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T22:49:32Z","timestamp":1790722172670,"version":"4.1.0"},"reference-count":36,"publisher":"Public Library of Science (PLoS)","issue":"4","license":[{"start":{"date-parts":[[2024,4,18]],"date-time":"2024-04-18T00:00:00Z","timestamp":1713398400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>Hypothesis testing is a valuable method used to investigate ideas and test predictions arising from theories based on available data. In the context of critical system architecture, there is a need to effectively utilize hypothesis testing to identify faulty paths and improve system safety. This research aims to propose guidelines and best practices for presenting hypothesis testing in critical system architecture. The problem addressed in this study is the underutilization of hypothesis testing in life-critical system methods, resulting in a lack of identification of faulty paths. To address this challenge, we propose an enhanced pathway analysis technique that integrates error-derived information from a system\u2019s architectural description, thereby augmenting traditional hypothesis testing methods. By investigating various paths, we aim to identify false positive and false negative errors in life-critical system architecture. Furthermore, the proposed method is validated based on specific validation criteria for each step such as system boundary, assumption, content\/architecture, and traceability validations. Also, the method is evaluated based on our claims. The results of our research highlight the significance of tracing errors in early system knowledge. By leveraging the augmented hypothesis testing method, we are able to identify hazards, safety constraints, and specific causes of unsafe actions more effectively. The findings emphasize the importance of integrating early design knowledge into hypothesis testing for enhanced hazard identification and improved system safety.<\/jats:p>","DOI":"10.1371\/journal.pone.0299633","type":"journal-article","created":{"date-parts":[[2024,4,18]],"date-time":"2024-04-18T18:13:07Z","timestamp":1713463987000},"page":"e0299633","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":1,"title":["Enhancing system safety in critical architectures: Augmented hypothesis testing with early design knowledge"],"prefix":"10.1371","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1114-5040","authenticated-orcid":true,"given":"Fryad Khalid","family":"M. Rashid","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2024,4,18]]},"reference":[{"key":"pone.0299633.ref001","volume-title":"Statistics","author":"R. S. Witte","year":"2021"},{"key":"pone.0299633.ref002","volume-title":"Engineering a Safer World: Systems Thinking Applied to Safety","author":"N. G. Leveson","year":"2011"},{"issue":"2","key":"pone.0299633.ref003","first-page":"135","article-title":"Statistical Methods for Safety-Critical Systems Verification","volume":"36","author":"C. D. Johnson","year":"2019","journal-title":"Safety Engineering Journal"},{"key":"pone.0299633.ref004","doi-asserted-by":"crossref","first-page":"53671","DOI":"10.1109\/ACCESS.2023.3280414","article-title":"Discovering Hazards in IoT Architectures: A Safety Analysis Approach for Medical Use Cases","volume":"11","author":"F. K. M. Rashid","year":"2023","journal-title":"IEEE Access"},{"issue":"2","key":"pone.0299633.ref005","doi-asserted-by":"crossref","first-page":"e0211072","DOI":"10.1371\/journal.pone.0211072","article-title":"Systematically false positives in early warning signal analysis","volume":"14","author":"G J\u00e4ger","year":"2019","journal-title":"PLoS ONE"},{"key":"pone.0299633.ref006","doi-asserted-by":"crossref","unstructured":"N. An, M. Maile, D. Jiang, J. Mittag and H. Hartenstein. Balancing the requirements for a zero false positive\/negative Forward Collision Warning. 10th Annual Conference on Wireless On-demand Network Systems and Services (WONS), Banff, AB, Canada. 2013; pp. 191\u2013195.","DOI":"10.1109\/WONS.2013.6578346"},{"key":"pone.0299633.ref007","unstructured":"Singh, Sanskriti. Emphasis on the Minimization of False Negatives or False Positives in Binary Classification. arXiv preprint.2022. arXiv:2204.02526"},{"key":"pone.0299633.ref008","unstructured":"Salfner, Felix and Malek, Miroslaw. Reliability Modeling of Proactive Fault Handling. Publisher: Humboldt-Universit\u00e4t zu Berlin, Mathematisch-Naturwissenschaftliche Fakult\u00e4t II.2006 Institut f\u00fcr Informatik. http:\/\/dx.doi.org\/10.18452\/2471"},{"key":"pone.0299633.ref009","doi-asserted-by":"crossref","unstructured":"Matthias Rottmann, Kira Maag, Robin Chan, Fabian H\u00fcger, Peter Schlicht and Hanno Gottschalk. Detection of False Positive and False Negative Samples in Semantic Segmentation.arXiv. 2019. eprint:1912.03673.","DOI":"10.23919\/DATE48585.2020.9116288"},{"key":"pone.0299633.ref010","doi-asserted-by":"crossref","first-page":"106080","DOI":"10.1016\/j.ssci.2023.106080","article-title":"A proposed validation framework for the system theoretic process analysis (STPA) technique","volume":"162","author":"Reyhaneh Sadeghi","year":"2023","journal-title":"Safety Science"},{"key":"pone.0299633.ref011","unstructured":"M. E. Laarouchi. A safety approach for CPS-IoT. Ph.D. dissertation, Institut Polytechnique de Paris, Palaiseau, France, 2020. [Online]. Available: https:\/\/tel.archives-ouvertes.fr\/tel-03051734"},{"key":"pone.0299633.ref012","volume-title":"The Safety of Software\u2014Constructing and Assuring Arguments","author":"R. Weaver","year":"2003"},{"issue":"1","key":"pone.0299633.ref013","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1109\/MITP.2018.2883858","article-title":"IoT safety: State of the art","volume":"21","author":"J. Zalewski","year":"2019","journal-title":"IT Prof"},{"key":"pone.0299633.ref014","volume-title":"Testing Statistical Hypotheses","author":"E. L. Lehmann","year":"2005","edition":"3"},{"key":"pone.0299633.ref015","volume-title":"Mathematical Statistics and Data Analysis","author":"J. A. Rice","year":"2007","edition":"3"},{"key":"pone.0299633.ref016","volume-title":"Statistics for the Behavioral Sciences","author":"Gregory J. Privitera","year":"2018","edition":"3"},{"key":"pone.0299633.ref017","volume-title":"Introduction to Robust Estimation and Hypothesis Testing","author":"Rand R. Wilcox","year":"2022"},{"key":"pone.0299633.ref018","unstructured":"Architecture Analysis and Design Language (AADL), Standard SAEAS5506B. [Online]. 2012. Available: https:\/\/www.sae.org\/standards\/content\/as5506b\/"},{"key":"pone.0299633.ref019","unstructured":"SAE Architecture Analysis and Design Language (AADL) Annex Volume 1: Annex A: ARINC653 Annex, Annex C: Code Generation Annex, Annex E: Error Model Annex, SAE Standard SAE AS5506\/1A. 2015. [Online]. Available: https:\/\/www.sae.org\/standards\/content\/as5506\/1a\/"},{"key":"pone.0299633.ref020","unstructured":"Software Engineering Institute. Open Source AADL Tool Environment (OSATE), 2021. Version 2.9, o https:\/\/osate.org\/"},{"key":"pone.0299633.ref021","volume-title":"Model-Based Engineering With AADL: An Introduction to the SAE Architecture Analysis and Design Language","author":"P. Feiler","year":"2013"},{"key":"pone.0299633.ref022","unstructured":"P. H. Feiler et al. Architecture fault modeling and analysis with the error model annex, version 2, Carnegie Mellon Univ.\/Softw. Eng. Inst., 2016. Pittsburgh, PA, USA, Tech. Rep. CMU\/SEI-2016-TR-009, Jun."},{"key":"pone.0299633.ref023","unstructured":"J. Delange. AADL in Practice: Become an Expert of Software Architecture Modeling and Analysis. Reblochon Development, [Online]. Available: https:\/\/www.amazon.com\/AADL-Practice-softwarearchitecture-modeling\/dp\/0692899642; 2017"},{"key":"pone.0299633.ref024","unstructured":"F. Peter. Architecture-led safety analysis of the joint multi-role (JMR) joint common architecture (JCA) demonstration system. 2015. Carnegie Mellon Univ.\/Softw. Eng. Inst., Pittsburgh, PA, USA, Tech. Rep. CMU-SEI-2015-SR-032."},{"key":"pone.0299633.ref025","first-page":"209","author":"J. Forrester","year":"1980","journal-title":"Tests for building confidence in system dynamics models"},{"key":"pone.0299633.ref026","doi-asserted-by":"crossref","unstructured":"Lordos, G.C., Summers, S.E., Hoffman, J.A., De Weck, O.L., 2019. Human-machine interactions in apollo and lessons learned for living off the land on mars. IEEE Aerospace Conference. 2019, 1\u201317.","DOI":"10.1109\/AERO.2019.8741618"},{"issue":"1","key":"pone.0299633.ref027","article-title":"Expressing and communicating uncertainty in relation to quantitative risk analysis (QRA)","volume":"132","author":"R. Flage","year":"2009","journal-title":"Reliability and Risk Analysis: Theory and Application"},{"key":"pone.0299633.ref028","volume-title":"Challenging strategic planning assumptions: Theory, cases, and techniques","author":"R. Mason","year":"1981"},{"issue":"3","key":"pone.0299633.ref029","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/0377-2217(83)90257-6","article-title":"Model validation in operations research","volume":"14","author":"M. Landry","year":"1983","journal-title":"Eur. J. Oper. Res"},{"issue":"1","key":"pone.0299633.ref030","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/j.ssci.2017.04.006","article-title":"A systems approach to risk analysis validation for risk management","volume":"99","author":"J. Lathrop","year":"2017","journal-title":"Safety Science journal"},{"key":"pone.0299633.ref031","unstructured":"Eckerd, A., Landsbergen, D., Desai, A. The Validity Tests Used by Social Scientists and Decision Makers. 2011. P. 14. https:\/\/proceedings.systemdynamics.org\/2011\/proceed\/papers\/P1263.pdf"},{"issue":"1","key":"pone.0299633.ref032","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.ssci.2016.08.023","article-title":"Validity and validation of safety-related quantitative risk analysis: a review","volume":"99","author":"F. Goerlandt","year":"2017","journal-title":"Safety Science journal"},{"key":"pone.0299633.ref033","doi-asserted-by":"crossref","first-page":"xiv514","DOI":"10.1002\/9781118619179","volume-title":"Structural equations with latent variables","author":"K.A Bollen","year":"1989"},{"issue":"4","key":"pone.0299633.ref034","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1016\/S0925-7535(03)00047-X","article-title":"A new accident model for engineering safer systems","volume":"42","author":"N. Leveson","year":"2004","journal-title":"Safety Science journal"},{"key":"pone.0299633.ref035","volume-title":"A hazard analysis technique for the Internet of Things (IoT) and mobile gregory pope, CSQE","author":"J. Thomas","year":"2017"},{"key":"pone.0299633.ref036","volume-title":"An STPA primer: Version 1","author":"N. Leveson","year":"2013"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0299633","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,18]],"date-time":"2024-04-18T18:13:23Z","timestamp":1713464003000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0299633"}},"subtitle":[],"editor":[{"given":"Asadullah","family":"Shaikh","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2024,4,18]]},"references-count":36,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2024,4,18]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0299633","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,18]]}}}