{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,28]],"date-time":"2026-06-28T05:29:37Z","timestamp":1782624577949,"version":"3.54.5"},"reference-count":77,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2024,2,1]],"date-time":"2024-02-01T00:00:00Z","timestamp":1706745600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Commonwealth Center for Advanced Logistics Systems (CCALS) and the National Science Foundations (NSF) Center for Hardware and Embedded Systems Security and Trust (CHEST)","award":["1916760"],"award-info":[{"award-number":["1916760"]}]},{"name":"University of Virginia","award":["1916760"],"award-info":[{"award-number":["1916760"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>Artificial intelligence (AI) is advancing across technology domains including healthcare, commerce, the economy, the environment, cybersecurity, transportation, etc. AI will transform healthcare systems, bringing profound changes to diagnosis, treatment, patient care, data, medicines, devices, etc. However, AI in healthcare introduces entirely new categories of risk for assessment, management, and communication. For this topic, the framing of conventional risk and decision analyses is ongoing. This paper introduces a method to quantify risk as the disruption of the order of AI initiatives in healthcare systems, aiming to find the scenarios that are most and least disruptive to system order. This novel approach addresses scenarios that bring about a re-ordering of initiatives in each of the following three characteristic layers: purpose, structure, and function. In each layer, the following model elements are identified: 1. Typical research and development initiatives in healthcare. 2. The ordering criteria of the initiatives. 3. Emergent conditions and scenarios that could influence the ordering of the AI initiatives. This approach is a manifold accounting of the scenarios that could contribute to the risk associated with AI in healthcare. Recognizing the context-specific nature of risks and highlighting the role of human in the loop, this study identifies scenario s.06\u2014non-interpretable AI and lack of human\u2013AI communications\u2014as the most disruptive across all three layers of healthcare systems. This finding suggests that AI transparency solutions primarily target domain experts, a reasonable inclination given the significance of \u201chigh-stakes\u201d AI systems, particularly in healthcare. Future work should connect this approach with decision analysis and quantifying the value of information. Future work will explore the disruptions of system order in additional layers of the healthcare system, including the environment, boundary, interconnections, workforce, facilities, supply chains, and others.<\/jats:p>","DOI":"10.3390\/systems12020047","type":"journal-article","created":{"date-parts":[[2024,2,1]],"date-time":"2024-02-01T09:04:21Z","timestamp":1706778261000},"page":"47","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Risk Analysis of Artificial Intelligence in Medicine with a Multilayer Concept of System Order"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0475-8233","authenticated-orcid":false,"given":"Negin","family":"Moghadasi","sequence":"first","affiliation":[{"name":"Department of Systems and Information Engineering, University of Virginia, Charlottesville, VA 22903, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rupa S.","family":"Valdez","sequence":"additional","affiliation":[{"name":"Department of Systems and Information Engineering, University of Virginia, Charlottesville, VA 22903, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0539-0610","authenticated-orcid":false,"given":"Misagh","family":"Piran","sequence":"additional","affiliation":[{"name":"Department of Radiology, Nuclear Medicine and Molecular Imaging, Heart and Diabetes Center North-Rhine Westphalia, Ruhr University of Bochum, 44801 Bochum, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Negar","family":"Moghaddasi","sequence":"additional","affiliation":[{"name":"Department of Dentistry, Western University of Health Sciences, Pomona, CA 91766, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0823-8107","authenticated-orcid":false,"given":"Igor","family":"Linkov","sequence":"additional","affiliation":[{"name":"Department of Engineering and Public Policy, Carnegie Mellon University, Pittsburgh, PA 15213, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas L.","family":"Polmateer","sequence":"additional","affiliation":[{"name":"Department of Systems and Information Engineering, University of Virginia, Charlottesville, VA 22903, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Davis C.","family":"Loose","sequence":"additional","affiliation":[{"name":"Department of Systems and Information Engineering, University of Virginia, Charlottesville, VA 22903, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James H.","family":"Lambert","sequence":"additional","affiliation":[{"name":"Department of Systems and Information Engineering, University of Virginia, Charlottesville, VA 22903, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,2,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"4391","DOI":"10.1002\/sim.7501","article-title":"Practical Recommendations for Reporting F Ine\u2014G Ray Model Analyses for Competing Risk Data","volume":"36","author":"Austin","year":"2017","journal-title":"Stat. Med."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"991","DOI":"10.1146\/annurev.iy.12.040194.005015","article-title":"Tolerance, Danger, and the Extended Family","volume":"12","author":"Matzinger","year":"1994","journal-title":"Annu. Rev. Immunol."},{"key":"ref_3","first-page":"141","article-title":"Marketing Strategy: Learning by Doing","volume":"75","author":"Christensen","year":"1997","journal-title":"Harv. Bus. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"280","DOI":"10.1016\/j.ejor.2017.06.059","article-title":"Risk Analysis and Decision Theory: A Bridge","volume":"264","author":"Borgonovo","year":"2018","journal-title":"Eur. J. Oper. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1016\/j.ejor.2019.01.011","article-title":"Risk Analysis beyond Vulnerability and Resilience\u2014Characterizing the Defensibility of Critical Systems","volume":"276","author":"Bier","year":"2019","journal-title":"Eur. J. Oper. Res."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"108565","DOI":"10.1016\/j.ress.2022.108565","article-title":"Trust and Security of Electric Vehicle-to-Grid Systems and Hardware Supply Chains","volume":"225","author":"Moghadasi","year":"2022","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2218014","DOI":"10.1080\/22423982.2023.2218014","article-title":"Risk Communication and Perceptions about Lead Ammunition and Inuit Health in Nunavik, Canada","volume":"82","author":"Furgal","year":"2023","journal-title":"Int. J. Circumpolar Health"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Niemeier, R.T., Williams, P.R.D., Rossner, A., Clougherty, J.E., and Rice, G.E. (2020). A Cumulative Risk Perspective for Occupational Health and Safety (OHS) Professionals. Int. J. Environ. Res. Public Health, 17.","DOI":"10.3390\/ijerph17176342"},{"key":"ref_9","unstructured":"Harris, R. (2021). Patty\u2019s Industrial Hygiene, Wiley."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Binsaeed, R.H., Yousaf, Z., Grigorescu, A., Samoila, A., Chitescu, R.I., and Nassani, A.A. (2023). Knowledge Sharing Key Issue for Digital Technology and Artificial Intelligence Adoption. Systems, 11.","DOI":"10.3390\/systems11070316"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Huang, C.-C., Ruan, S.-J., Chen, H.H., Tu, Y.-W., and Chang, L.-C. (2019, January 15\u201318). Chinese Articulation Disorder-Correcting Application Based on Neural Networks. Proceedings of the 2019 IEEE 8th Global Conference on Consumer Electronics (GCCE), Osaka, Japan.","DOI":"10.1109\/GCCE46687.2019.9015371"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Lei, K.-Z., Ku, M.-Y., and Lee, S.-Y. (2022, January 7). Real-Time and Non-Contact Arrhythmia Recognition Algorithm for Hardware Implementation. Proceedings of the 2022 IEEE International Conference on Recent Advances in Systems Science and Engineering (RASSE), Tainan, Taiwan.","DOI":"10.1109\/RASSE54974.2022.9989597"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Elvas, L.B., Ferreira, J.C., Dias, M.S., and Ros\u00e1rio, L.B. (2023). Health Data Sharing towards Knowledge Creation. Systems, 11.","DOI":"10.3390\/systems11080435"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"102510","DOI":"10.1016\/j.technovation.2022.102510","article-title":"Healthcare System: Moving Forward with Artificial Intelligence","volume":"120","author":"Dicuonzo","year":"2023","journal-title":"Technovation"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Habchi, Y., Himeur, Y., Kheddar, H., Boukabou, A., Atalla, S., Chouchane, A., Ouamane, A., and Mansoor, W. (2023). AI in Thyroid Cancer Diagnosis: Techniques, Trends, and Future Directions. Systems, 11.","DOI":"10.3390\/systems11100519"},{"key":"ref_16","unstructured":"de Albuquerque, V.H.C., Srinivasu, P.N., Bhoi, A.K., and Briones, A.G. (2022). Advances in Medical Technologies and Clinical Practice, IGI Global."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"015","DOI":"10.1055\/s-0042-1742514","article-title":"Provocations for Reimagining Informatics Approaches to Health Equity","volume":"31","author":"Valdez","year":"2022","journal-title":"Yearb. Med. Inf."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2644","DOI":"10.1111\/risa.14128","article-title":"Data-driven Predictive Modeling in Risk Assessment: Challenges and Directions for Proper Uncertainty Representation","volume":"43","author":"Flage","year":"2023","journal-title":"Risk Anal."},{"key":"ref_19","unstructured":"Chen, C., Lin, K., Rudin, C., Shaposhnik, Y., Wang, S., and Wang, T. (2018). An Interpretable Model with Globally Consistent Explanations for Credit Risk. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1327","DOI":"10.1126\/science.abi7176","article-title":"Filling Gaps in Trustworthy Development of AI","volume":"374","author":"Avin","year":"2021","journal-title":"Science"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Jain, S., Luthra, M., Sharma, S., and Fatima, M. (2020, January 6\u20137). Trustworthiness of Artificial Intelligence. Proceedings of the 2020 6th International Conference on Advanced Computing and Communication Systems (ICACCS), Coimbatore, India.","DOI":"10.1109\/ICACCS48705.2020.9074237"},{"key":"ref_22","unstructured":"Tabassi, E. (2024, January 31). AI Risk Management Framework: AI RMF (1.0), Available online: https:\/\/tsapps.nist.gov\/publication\/get_pdf.cfm?pub_id=936225."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3276","DOI":"10.1109\/JIOT.2022.3144450","article-title":"Toward Trustworthy AI: Blockchain-Based Architecture Design for Accountability and Fairness of Federated Learning Systems","volume":"10","author":"Lo","year":"2023","journal-title":"IEEE Internet Things J."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2967","DOI":"10.1109\/JIOT.2021.3122019","article-title":"TRUST XAI: Model-Agnostic Explanations for AI With a Case Study on IIoT Security","volume":"10","author":"Zolanvari","year":"2023","journal-title":"IEEE Internet Things J."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ram\u00edrez-Guti\u00e9rrez, A.G., Solano Garc\u00eda, P., Morales Matamoros, O., Moreno Escobar, J.J., and Tejeida-Padilla, R. (2023). Systems Approach for the Adoption of New Technologies in Enterprises. Systems, 11.","DOI":"10.3390\/systems11100494"},{"key":"ref_26","unstructured":"Holt, J. (2021). Systems Engineering Demystified, Packt Publishing."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1002\/(SICI)1520-6858(1998)1:3<176::AID-SYS3>3.0.CO;2-L","article-title":"Systems Integration and Architecting: An Overview of Principles, Practices, and Perspectives","volume":"1","author":"Sage","year":"1998","journal-title":"Syst. Engin."},{"key":"ref_28","unstructured":"(2022). SEBoK Editorial Board Guide to the Systems Engineering Body of Knowledge (SEBoK), Stevens Institute of Technology. Version 2.7."},{"key":"ref_29","unstructured":"Walden, D.D., Roedler, G.J., Forsberg, K., Hamelin, R.D., Shortell, T.M., and International Council on Systems Engineering (2015). Systems Engineering Handbook: A Guide for System Life Cycle Processes and Activities, Wiley. [4th ed.]."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1147\/sj.211.0004","article-title":"Strategies for Information Requirements Determination","volume":"21","author":"Davis","year":"1982","journal-title":"IBM Syst. J."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Loose, D.C., Eddy, T.L., Polmateer, T.L., Manasco, M.C., Moghadasi, N., and Lambert, J.H. (2022, January 25). Managing Pandemic Resilience with Other Cascading Disruptions of a Socio-Technical System. Proceedings of the 2022 IEEE International Systems Conference (SysCon), Montreal, QC, Canada.","DOI":"10.1109\/SysCon53536.2022.9773915"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Moghadasi, N., Piran, M., Baek, S., Valdez, R.S., Porter, M.D., Johnson, D., and Lambert, J.H. (2023, January 5\u20138). Systems Analysis of Bias and Risk in AI Enabled Medical Diagnosis. Proceedings of the 2023 IEEE Symposium Series on Computational Intelligence (SSCI), Mexico City, Mexico.","DOI":"10.1109\/SSCI52147.2023.10371919"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"e24879","DOI":"10.2196\/24879","article-title":"Emotional Reactions to Cybersecurity Breach Situations: Scenario-Based Survey Study","volume":"23","author":"Budimir","year":"2021","journal-title":"J. Med. Internet Res."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1057\/palgrave.jors.2602550","article-title":"Behavioural Decision Theory for Multi-Criteria Decision Analysis: A Guided Tour","volume":"60","author":"Morton","year":"2009","journal-title":"J. Oper. Res. Soc."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Krantz, D.H., Luce, R.D., Suppes, P., and Tversky, A. (1971). Foundations of Measurement, Academic Press.","DOI":"10.1016\/B978-0-12-425401-5.50011-8"},{"key":"ref_36","unstructured":"Von Winterfeldt, D., and Edwards, W. (1986). Decision Analysis and Behavioral Research, Cambridge University Press."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1109\/JSYST.2018.2812864","article-title":"Evaluating Management Actions to Mitigate Disruptive Scenario Impacts in an E-Commerce Systems Integration Project","volume":"13","author":"Collier","year":"2019","journal-title":"IEEE Syst. J."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1002\/sys.21215","article-title":"Evaluating Deep Uncertainties in Strategic Priority-Setting with an Application to Facility Energy Investments","volume":"15","author":"Karvetski","year":"2012","journal-title":"Syst. Engin."},{"key":"ref_39","first-page":"935","article-title":"Common Mistakes in Making Value Trade-Offs","volume":"50","author":"Keeney","year":"2002","journal-title":"JSTOR"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1109\/TSMC.1979.4310245","article-title":"Decisions with Multiple Objectives: Preferences and Value Trade-Offs","volume":"9","author":"Keeney","year":"1979","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/0030-5073(81)90015-5","article-title":"A Comparison of Weight Approximation Techniques in Multiattribute Utility Decision Making","volume":"28","author":"Stillwell","year":"1981","journal-title":"Organ. Behav. Hum. Perform."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1109\/JSYST.2011.2134730","article-title":"Analyzing Risk Impact Factors Using Extended Fuzzy Cognitive Maps","volume":"5","author":"Lazzerini","year":"2011","journal-title":"IEEE Syst. J."},{"key":"ref_43","unstructured":"Keeney, R.L. (1992). Value-Focused Thinking: A Path to Creative Decisionmaking, Harvard Univ. Press."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Belton, V., and Stewart, T.J. (2002). Multiple Criteria Decision Analysis, Springer US.","DOI":"10.1007\/978-1-4615-1495-4"},{"key":"ref_45","unstructured":"Clemen, R.T. (2001). Making Hard Decisions with DecisionTools, Duxbury Thomson Learning. [2nd ed.]."},{"key":"ref_46","unstructured":"Karvetski, C.W., Lambert, J.H., and Linkov, I. (2022, June 13). Emergent Conditions and Multiple Criteria Analysis in Infrastructure Prioritization for Developing Countries\u2014Karvetski\u20142009\u2014Journal of Multi-Criteria Decision Analysis\u2014Wiley Online Library. Available online: https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/mcda.444."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"879603","DOI":"10.3389\/frai.2022.879603","article-title":"Transparency of AI in Healthcare as a Multilayered System of Accountabilities: Between Legal Requirements and Technical Limitations","volume":"5","author":"Kiseleva","year":"2022","journal-title":"Front. Artif. Intell."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1353","DOI":"10.1007\/s00146-021-01230-z","article-title":"In Principle Obstacles for Empathic AI: Why We Can\u2019t Replace Human Empathy in Healthcare","volume":"37","author":"Montemayor","year":"2022","journal-title":"AI Soc."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Abbas, S.W., Hamid, M., Alkanhel, R., and Abdallah, H.A. (2023). Official Statistics and Big Data Processing with Artificial Intelligence: Capacity Indicators for Public Sector Organizations. Systems, 11.","DOI":"10.3390\/systems11080424"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Bao, Y., Gong, W., and Yang, K. (2023). A Literature Review of Human\u2013AI Synergy in Decision Making: From the Perspective of Affordance Actualization Theory. Systems, 11.","DOI":"10.3390\/systems11090442"},{"key":"ref_51","unstructured":"Pagano, M. (2020). HEMI Fellow Sung Hoon Kang Receives Cohen Fund Grant for Work on a 3D-Printed Medical Device, Hopkins Extreme Materials Institute."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1109\/MIS.2023.3324470","article-title":"Artificial Intelligence Ethics and Trust: From Principles to Practice","volume":"38","author":"Chen","year":"2023","journal-title":"IEEE Intell. Syst."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Chinnasamy, P., Albakri, A., Khan, M., Raja, A.A., Kiran, A., and Babu, J.C. (2023). Smart Contract-Enabled Secure Sharing of Health Data for a Mobile Cloud-Based E-Health System. Appl. Sci., 13.","DOI":"10.3390\/app13063970"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1109\/MC.2022.3213181","article-title":"Three Levels of AI Transparency","volume":"56","author":"Haresamudram","year":"2023","journal-title":"Computer"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/978-3-030-04070-3_1","article-title":"Explainable AI and Fuzzy Logic Systems","volume":"Volume 11324","author":"Fagan","year":"2018","journal-title":"Theory and Practice of Natural Computing"},{"key":"ref_56","unstructured":"Arya, V., Bellamy, R.K.E., Chen, P.-Y., Dhurandhar, A., Hind, M., Hoffman, S.C., Houde, S., Liao, Q.V., Luss, R., and Mojsilovi\u0107, A. (2019). One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques. arXiv."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Bhattacharya, M., Penica, M., O\u2019Connell, E., Southern, M., and Hayes, M. (2023). Human-in-Loop: A Review of Smart Manufacturing Deployments. Systems, 11.","DOI":"10.3390\/systems11010035"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Celi, L.A., Cellini, J., Charpignon, M.-L., Dee, E.C., Dernoncourt, F., Eber, R., Mitchell, W.G., Moukheiber, L., Schirmer, J., and Situ, J. (2022). Sources of Bias in Artificial Intelligence That Perpetuate Healthcare Disparities\u2014A Global Review. PLoS Digit. Health, 1.","DOI":"10.1371\/journal.pdig.0000022"},{"key":"ref_59","unstructured":"Murray, S.G., Wachter, R., and Cucina, R.J. (2020). Discrimination By Artificial Intelligence In A Commercial Electronic Health Record\u2014A Case Study. Health Aff. Forefr."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1126\/science.aax2342","article-title":"Dissecting Racial Bias in an Algorithm Used to Manage the Health of Populations","volume":"366","author":"Obermeyer","year":"2019","journal-title":"Science"},{"key":"ref_61","unstructured":"Obermeyer, Z., Powers, B., Vogeli, C., and Mullainathan, S. (2019). Algorithmic Bias In Health Care: A Path Forward. Health Aff. Forefr."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1038\/s41746-021-00509-1","article-title":"Patient Apprehensions about the Use of Artificial Intelligence in Healthcare","volume":"4","author":"Richardson","year":"2021","journal-title":"Npj Digit. Med."},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Wang, B., Asan, O., and Mansouri, M. (2022, January 24). Patients\u2019 Perceptions of Integrating AI into Healthcare: Systems Thinking Approach. Proceedings of the 2022 IEEE International Symposium on Systems Engineering (ISSE), Vienna, Austria.","DOI":"10.1109\/ISSE54508.2022.10005383"},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1111\/j.1539-6924.2008.01030.x","article-title":"What\u2019s Wrong with Risk Matrices?","volume":"28","year":"2008","journal-title":"Risk Anal."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"651","DOI":"10.1111\/j.1539-6924.2005.00615.x","article-title":"Some Limitations of Qualitative Risk Rating Systems","volume":"25","author":"Babayev","year":"2005","journal-title":"Risk Anal."},{"key":"ref_66","unstructured":"Krisper, M. (2021). Problems with Risk Matrices Using Ordinal Scales. arXiv."},{"key":"ref_67","unstructured":"Rozell, D.J. (2015). A Cautionary Note on Qualitative Risk Ranking of Homeland Security Threats. J. NPS Cent. Homel. Def. Secur., Available online: https:\/\/www.hsaj.org\/articles\/1800."},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"(2023). Nature Editorials, dalking about Tomorrow\u2019s AI Doomsday When AI Poses Risks Today. Nature, 618, 885\u2013886.","DOI":"10.1038\/d41586-023-02094-7"},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1109\/MIS.2023.3322586","article-title":"Whom to Trust, How and Why: Untangling Artificial Intelligence Ethics Principles, Trustworthiness, and Trust","volume":"38","author":"Duenser","year":"2023","journal-title":"IEEE Intell. Syst."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1109\/MIS.2023.3320443","article-title":"The Importance of an Ethical Framework for Trust Calibration in AI","volume":"38","author":"Schmid","year":"2023","journal-title":"IEEE Intell. Syst."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1007\/978-3-031-10788-7_6","article-title":"Human Factors Engineering and User-Centered Design for Mobile Health Technology: Enhancing Effectiveness, Efficiency, and Satisfaction","volume":"Volume 12","author":"Duffy","year":"2023","journal-title":"Human-Automation Interaction"},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Palacio, S., Lucieri, A., Munir, M., Ahmed, S., Hees, J., and Dengel, A. (2021, January 11\u201317). XAI Handbook: Towards a Unified Framework for Explainable AI. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision Workshops (ICCVW), Montreal, BC, Canada.","DOI":"10.1109\/ICCVW54120.2021.00420"},{"key":"ref_73","doi-asserted-by":"crossref","unstructured":"Fan, Y., Liu, M., and Sun, G. (2023). An Interpretable Machine Learning Framework for Diagnosis and Prognosis of COVID-19. PLoS ONE, 18.","DOI":"10.1371\/journal.pone.0291961"},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1007\/978-3-030-83620-7_15","article-title":"Advances in XAI: Explanation Interfaces in Healthcare","volume":"Volume 212","author":"Lim","year":"2022","journal-title":"Handbook of Artificial Intelligence in Healthcare"},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s11604-023-01474-3","article-title":"Fairness of Artificial Intelligence in Healthcare: Review and Recommendations","volume":"42","author":"Ueda","year":"2023","journal-title":"Jpn. J. Radiol."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"52138","DOI":"10.1109\/ACCESS.2018.2870052","article-title":"Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)","volume":"6","author":"Adadi","year":"2018","journal-title":"IEEE Access"},{"key":"ref_77","first-page":"e48077","article-title":"The Quantum-Medical Nexus: Understanding the Impact of Quantum Technologies on Healthcare","volume":"15","author":"Shams","year":"2023","journal-title":"Cureus"}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/12\/2\/47\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:53:09Z","timestamp":1760104389000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/12\/2\/47"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,1]]},"references-count":77,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2024,2]]}},"alternative-id":["systems12020047"],"URL":"https:\/\/doi.org\/10.3390\/systems12020047","relation":{},"ISSN":["2079-8954"],"issn-type":[{"value":"2079-8954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,1]]}}}