{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T00:47:15Z","timestamp":1772239635109,"version":"3.50.1"},"reference-count":124,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2022,6,27]],"date-time":"2022-06-27T00:00:00Z","timestamp":1656288000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The factors complicating the specification of requirements for artificial intelligence systems (AIS) and their verification for the AIS creation and modernization are analyzed. The harmonization of definitions and building of a hierarchy of AIS characteristics for regulation of the development of techniques and tools for standardization, as well as evaluation and provision of requirements during the creation and implementation of AIS, is extremely important. The study aims to develop and demonstrate the use of quality models for artificial intelligence (AI), AI platform (AIP), and AIS based on the definition and ordering of characteristics. The principles of AI quality model development and its sequence are substantiated. Approaches to formulating definitions of AIS characteristics, methods of representation of dependencies, and hierarchies of characteristics are given. The definitions and harmonization options of hierarchical relations between 46 characteristics of AI and AIP are suggested. The quality models of AI, AIP, and AIS presented in analytical, tabular, and graph forms, are described. The so-called basic models with reduced sets of the most important characteristics are presented. Examples of AIS quality models for UAV video navigation systems and decision support systems for diagnosing diseases are described.<\/jats:p>","DOI":"10.3390\/s22134865","type":"journal-article","created":{"date-parts":[[2022,6,28]],"date-time":"2022-06-28T00:07:02Z","timestamp":1656374822000},"page":"4865","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":33,"title":["Quality Models for Artificial Intelligence Systems: Characteristic-Based Approach, Development and Application"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5352-077X","authenticated-orcid":false,"given":"Vyacheslav","family":"Kharchenko","sequence":"first","affiliation":[{"name":"Department of Computer Systems, Networks and Cybersecurity, National Aerospace University \u201cKhAI\u201d, 17, Chkalov Str., 61070 Kharkiv, Ukraine"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4084-2101","authenticated-orcid":false,"given":"Herman","family":"Fesenko","sequence":"additional","affiliation":[{"name":"Department of Computer Systems, Networks and Cybersecurity, National Aerospace University \u201cKhAI\u201d, 17, Chkalov Str., 61070 Kharkiv, Ukraine"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4672-6400","authenticated-orcid":false,"given":"Oleg","family":"Illiashenko","sequence":"additional","affiliation":[{"name":"Department of Computer Systems, Networks and Cybersecurity, National Aerospace University \u201cKhAI\u201d, 17, Chkalov Str., 61070 Kharkiv, Ukraine"}]}],"member":"1968","published-online":{"date-parts":[[2022,6,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Islam, M.R., Ahmed, M.U., Barua, S., and Begum, S. (2022). A Systematic Review of Explainable Artificial Intelligence in Terms of Different Application Domains and Tasks. Appl. Sci., 12.","DOI":"10.3390\/app12031353"},{"key":"ref_2","unstructured":"EU Commission (2022, June 04). High-Level Expert Group on Artificial Intelligence. Ethics Guidelines for Trustworthy AI. Available online: https:\/\/www.aepd.es\/sites\/default\/files\/2019-12\/ai-ethics-guidelines.pdf."},{"key":"ref_3","unstructured":"EU Commission (2022, June 04). High-Level Expert Group on Artificial Intelligence. The Assessment List for Trustworthy Artificial Intelligence (ALTAI). Available online: https:\/\/airegio.ems-carsa.com\/nfs\/programme_5\/call_3\/call_preparation\/ALTAI_final.pdf."},{"key":"ref_4","unstructured":"(2022, June 04). ISO\/IEC TR 24372:2021. Information Technology\u2014Artificial Intelligence (AI)\u2014Overview of Computational Approaches for AI Systems. Available online: https:\/\/www.iso.org\/standard\/78508.html."},{"key":"ref_5","unstructured":"(2022, June 04). ISO\/IEC TR 24030:2021 Information Technology\u2014Artificial Intelligence (AI)\u2014Use Cases. Available online: https:\/\/www.iso.org\/standard\/77610.html."},{"key":"ref_6","unstructured":"(2022, June 04). ISO\/IEC TR 24028:2020. Information Technology\u2014Artificial Intelligence\u2014Overview of Trustworthiness in Artificial Intelligence. Available online: https:\/\/www.iso.org\/standard\/77608.html."},{"key":"ref_7","unstructured":"(2022, June 04). ISO\/IEC 38507:2022. Information Technology\u2014Governance of IT\u2014Governance Implications of the Use of Artificial Intelligence by Organizations. Available online: https:\/\/www.iso.org\/standard\/77608.html."},{"key":"ref_8","unstructured":"(2022, June 04). ISO\/IEC TR 24029-1:2021. Artificial Intelligence (AI). Assessment of the Robustness of Neural Networks. Overview. Available online: https:\/\/www.iso.org\/standard\/77609.html."},{"key":"ref_9","unstructured":"(2022, June 04). IEC White Paper AI:2018. Artificial Intelligence Across Industries. Available online: https:\/\/www.en-standard.eu\/iec-white-paper-ai-2018-artificial-intelligence-across-industries\/."},{"key":"ref_10","unstructured":"(2022, June 04). ISO\/IEC TR 24027:2021. Information Technology\u2014Artificial Intelligence (AI)\u2014Bias in AI Systems and AI Aided Decision Making. Available online: https:\/\/www.iso.org\/standard\/77607.html."},{"key":"ref_11","unstructured":"(2022, June 04). IEEE 1232.3-2014\u2014IEEE Guide for the Use of Artificial Intelligence Exchange and Service Tie to All Test Environments (AI-ESTATE). Available online: https:\/\/ieeexplore.ieee.org\/document\/6922153."},{"key":"ref_12","unstructured":"(2022, June 04). IEEE 2941-2021\u2014IEEE Standard for Artificial Intelligence (AI) Model Representation, Compression, Distribution, and Management. Available online: https:\/\/ieeexplore.ieee.org\/document\/6922153."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"(2022, June 04). NISTIR 8312 Four Principles of Explainable Artificial Intelligence (September 2021). Available online: https:\/\/doi.org\/10.6028\/NIST.IR.8312.","DOI":"10.6028\/NIST.IR.8312"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"(2022, June 04). NISTIR 8367. Psychological Foundations of Explainability and Interpretability in Artificial Intelligence (April 2021). Available online: https:\/\/doi.org\/10.6028\/NIST.IR.8367.","DOI":"10.6028\/NIST.IR.8367"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"(2022, June 04). NIST Special Publication 1270. Towards a Standard for Identifying and Managing Bias in Artificial Intelligence (March 2022). Available online: https:\/\/doi.org\/10.6028\/NIST.SP.1270.","DOI":"10.6028\/NIST.SP.1270"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"(2022, June 04). Draft NISTIR 8269. A Taxonomy and Terminology of Adversarial Machine Learning (October 2019). Available online: https:\/\/doi.org\/10.6028\/NIST.IR.8269-draft.","DOI":"10.6028\/NIST.IR.8269-draft"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"(2022, June 04). Draft NISTIR 8332. Trust and Artificial Intelligence (March 2021). Available online: https:\/\/doi.org\/10.6028\/NIST.IR.8332-draft.","DOI":"10.6028\/NIST.IR.8332-draft"},{"key":"ref_18","unstructured":"NIST (2022, June 04). AI Risk Management Framework: Initial Draft (March 2022), Available online: https:\/\/www.nist.gov\/system\/files\/documents\/2022\/03\/17\/AI-RMF-1stdraft.pdf."},{"key":"ref_19","unstructured":"OECD (2022, June 04). Trustworthy AI in Education: Promises and Challenges. Available online: https:\/\/www.oecd.org\/education\/trustworthy-artificial-intelligence-in-education.pdf."},{"key":"ref_20","unstructured":"OECD (2022, June 04). Trustworthy AI in Health: Promises and Challenges. Available online: https:\/\/www.oecd.org\/health\/trustworthy-artificial-intelligence-in-health.pdf."},{"key":"ref_21","unstructured":"OECD (2022, June 04). Tools for Trustworthy AI: A Framework to Compare Implementation Tools. Available online: https:\/\/www.oecd.org\/science\/tools-for-trustworthy-ai-008232ec-en.htm."},{"key":"ref_22","unstructured":"UNESCO (2022, June 04). Recommendation on the Ethics of Artificial Intelligence. Available online: https:\/\/unesdoc.unesco.org\/ark:\/48223\/pf0000381137."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Christoforaki, M., and Beyan, O. (2022). AI Ethics\u2014A Bird\u2019s Eye View. Appl. Sci., 12.","DOI":"10.3390\/app12094130"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1007\/978-3-030-32236-6_51","article-title":"Explainable AI: A brief survey on history, research areas, approaches and challenges","volume":"Volume 11839","author":"Tang","year":"2019","journal-title":"Natural Language Processing and Chinese Computing"},{"key":"ref_25","first-page":"13","article-title":"Trustworthy AI","volume":"Volume 12600","author":"Braunschweig","year":"2021","journal-title":"Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Gordieiev, O., and Kharchenko, V. (2018, January 24\u201327). IT-oriented software quality models and evolution of the prevailing characteristics. Proceedings of the 2018 IEEE 9th International Conference on Dependable Systems, Services and Technologies (DESSERT), Kyiv, Ukraine.","DOI":"10.1109\/DESSERT.2018.8409162"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Yakovyna, V., Mayr, H.C., Nikitchenko, M., Zholtkevych, G., Spivakovsky, A., and Batsakis, S. (2016). Software quality standards and models evolution: Greenness and reliability issues. Information and Communication Technologies in Education, Research, and Industrial Applications, Springer.","DOI":"10.1007\/978-3-319-30246-1"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Gerstlacher, J., Groher, I., and Pl\u00f6sch, R. (2021). Green und Sustainable Software im Kontext von Software Qualit\u00e4tsmodellen. HMD Prax. Wirtsch.","DOI":"10.1365\/s40702-021-00821-0"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1007\/978-3-030-65854-0_4","article-title":"Software quality for AI: Where we are now?","volume":"Volume 404","author":"Winkler","year":"2021","journal-title":"Lecture Notes in Business Information Processing"},{"key":"ref_30","first-page":"1","article-title":"Quality characteristics of artificially intelligent systems","volume":"2800","author":"Smith","year":"2020","journal-title":"CEUR Workshop Proc."},{"key":"ref_31","unstructured":"(2022, June 04). ISO\/IEC 25010:2011. Systems and Software Engineering\u2014Systems and Software Quality Requirements and Evaluation (SQuaRE)\u2014System and Software Quality Models. Available online: https:\/\/www.iso.org\/standard\/35733.html."},{"key":"ref_32","first-page":"48","article-title":"Software individual requirement quality model","volume":"94","author":"Gordieiev","year":"2020","journal-title":"Radioelectron. Comput. Syst."},{"key":"ref_33","unstructured":"(2022, June 04). The Industrial Internet of Things. Trustworthiness Framework Foundations. An Industrial Internet Consortium Foundational Document. Version V1.00\u20142021-07-15. Available online: https:\/\/www.iiconsortium.org\/pdf\/Trustworthiness_Framework_Foundations.pdf."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Morley, J., Morton, C., Karpathakis, K., Taddeo, M., and Floridi, L. (2021). Towards a framework for evaluating the safety, acceptability and efficacy of AI systems for health: An initial synthesis. arXiv.","DOI":"10.2139\/ssrn.3826358"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Antoniadi, A.M., Du, Y., Guendouz, Y., Wei, L., Mazo, C., Becker, B.A., and Mooney, C. (2021). Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review. Appl. Sci., 11.","DOI":"10.3390\/app11115088"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Toreini, E., Aitken, M., Coopamootoo, K., Elliott, K., Zelaya, C.G., and van Moorsel, A. (2020, January 27\u201330). The relationship between trust in AI and trustworthy machine learning technologies. Proceedings of the Conference on Fairness, Accountability, and Transparency (FAT), Barcelona, Spain.","DOI":"10.1145\/3351095.3372834"},{"key":"ref_37","unstructured":"(2022, June 04). Cambridge Dictionary. Acceptability. Cambridge University Press. Available online: https:\/\/dictionary.cambridge.org\/dictionary\/english\/acceptability."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","article-title":"Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI","volume":"58","author":"Bennetot","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_39","unstructured":"Zoldi, S. (2022, June 04). What is Responsible AI?. Available online: https:\/\/www.fico.com\/blogs\/what-responsible-ai."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"52138","DOI":"10.1109\/ACCESS.2018.2870052","article-title":"Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)","volume":"6","author":"Adadi","year":"2018","journal-title":"IEEE Access"},{"key":"ref_41","unstructured":"Burciaga, A. (2022, June 04). Six Essential Elements of a Responsible AI Model. Available online: https:\/\/www.forbes.com\/sites\/forbestechcouncil\/2021\/09\/01\/six-essential-elements-of-a-responsible-ai-model\/?sh=39e32be56cf4."},{"key":"ref_42","unstructured":"(2022, June 04). Cambridge Dictionary. Awareness. Cambridge University Press. Available online: https:\/\/dictionary.cambridge.org\/dictionary\/english\/awareness."},{"key":"ref_43","unstructured":"Smith, G., Rustagi, I., and Haas, B. (2022, June 04). Mitigating Bias in Artificial Intelligence: An Equity Fluent Leadership Playbook. Available online: https:\/\/haas.berkeley.edu\/wp-content\/uploads\/UCB_Playbook_R10_V2_spreads2.pdf."},{"key":"ref_44","unstructured":"Dilmegani, C. (2022, June 04). Bias in AI: What it is, Types, Examples & 6 Ways to Fix it in 2022. Available online: https:\/\/research.aimultiple.com\/ai-bias\/."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Brotcke, L. (2022). Time to Assess Bias in Machine Learning Models for Credit Decisions. J. Risk Financ. Manag., 15.","DOI":"10.3390\/jrfm15040165"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"34","DOI":"10.17352\/ara.000011","article-title":"Artificial intelligence: Explainability, ethical issues and bias","volume":"5","author":"Alaa","year":"2021","journal-title":"Ann. Robot. Autom."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Roselli, D., Matthews, J., and Talagala, N. (2019, January 13\u201317). Managing bias in AI. Proceedings of the 2019 World Wide Web Conference (WWW), San Francisco, CA, USA.","DOI":"10.1145\/3308560.3317590"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1109\/MPULS.2018.2885857","article-title":"Engineering Bias in AI","volume":"10","author":"Weber","year":"2019","journal-title":"IEEE Pulse"},{"key":"ref_49","first-page":"50","article-title":"The Case for Causal AI","volume":"18","author":"Sgaier","year":"2020","journal-title":"Soc. Innov. Rev."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"e1312","DOI":"10.1002\/widm.1312","article-title":"Causability and Explainability of Artificial Intelligence in Medicine","volume":"9","author":"Holzinger","year":"2019","journal-title":"WIREs Data Min. Knowl. Discov."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"102551","DOI":"10.1016\/j.ijhcs.2020.102551","article-title":"The effects of explainability and causability on perception, trust, and acceptance: Implications for explainable AI","volume":"146","author":"Shin","year":"2020","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Zablocki, \u00c9., Ben-Younes, H., P\u00e9rez, P., and Cord, M. (2021). Explainability of vision-based autonomous driving systems: Review and challenges. arXiv.","DOI":"10.1007\/s11263-022-01657-x"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Linardatos, P., Papastefanopoulos, V., and Kotsiantis, S. (2021). Explainable AI: A Review of Machine Learning Interpretability Methods. Entropy, 23.","DOI":"10.3390\/e23010018"},{"key":"ref_54","unstructured":"(2022, June 04). Cambridge Dictionary. Comprehensibility. Cambridge University Press. Available online: https:\/\/dictionary.cambridge.org\/dictionary\/english\/comprehensibility."},{"key":"ref_55","unstructured":"Gohel, P., Singh, P., and Mohanty, M. (2021). Explainable AI: Current status and future directions. arXiv."},{"key":"ref_56","unstructured":"(2022, June 04). Cambridge Dictionary. Confidence. Cambridge University Press. Available online: https:\/\/dictionary.cambridge.org\/dictionary\/english\/confidence."},{"key":"ref_57","unstructured":"Yampolskiy, R. (2020). On Controllability of AI. arXiv."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"103655","DOI":"10.1016\/j.jbi.2020.103655","article-title":"The role of explainability in creating trustworthy artificial intelligence for health care: A comprehensive survey of the terminology, design choices, and evaluation strategies","volume":"113","author":"Markus","year":"2021","journal-title":"J. Biomed. Inform."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Ghajargar, M., Bardzell, J., Renner, A.S., Krogh, P.G., H\u00f6\u00f6k, K., Cuartielles, D., Boer, L., and Wiberg, M. (2021, January 14\u201317). From \u201cExplainable AI\u201d to \u201cGraspable AI\u201d. Proceedings of the 15th International Conference on Tangible, Embedded, and Embodied Interaction (TEI), New York, NY, USA.","DOI":"10.1145\/3430524.3442704"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1007\/s43681-021-00069-w","article-title":"Ethical funding for trustworthy AI: Proposals to address the responsibilities of funders to ensure that projects adhere to trustworthy AI practice","volume":"2","author":"Gardner","year":"2022","journal-title":"AI Ethics"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1007\/s43681-020-00022-3","article-title":"Management perspective of ethics in artificial intelligence","volume":"1","year":"2021","journal-title":"AI Ethics"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"2749","DOI":"10.1007\/s11948-020-00228-y","article-title":"In AI We Trust: Ethics, Artificial Intelligence, and Reliability","volume":"26","author":"Ryan","year":"2020","journal-title":"Sci. Eng. Ethics"},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Bogina, V., Hartman, A., Kuflik, T., and Shulner-Tal, A. (2021). Educating Software and AI Stakeholders About Algorithmic Fairness, Accountability, Transparency and Ethics. Int. J. Artif. Intell. Educ.","DOI":"10.1007\/s40593-021-00248-0"},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Chen, F., and Zhou, J. (2022). AI and ethics\u2014Operationalizing responsible AI. Humanity Driven AI, Springer International Publishing.","DOI":"10.1007\/978-3-030-72188-6"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1007\/s13218-020-00636-z","article-title":"Measuring the Quality of Explanations: The System Causability Scale (SCS)","volume":"34","author":"Holzinger","year":"2020","journal-title":"KI\u2014K\u00fcnstliche Intell."},{"key":"ref_66","unstructured":"Sovrano, F., and Vitali, F. (2021). An Objective Metric for Explainable AI: How and Why to Estimate the Degree of Explainability. arXiv."},{"key":"ref_67","unstructured":"(2022, June 04). Cambridge Dictionary. Exactness. Cambridge University Press. Available online: https:\/\/dictionary.cambridge.org\/dictionary\/english\/exactness."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"615","DOI":"10.3390\/make3030032","article-title":"Classification of Explainable Artificial Intelligence Methods through Their Output Formats","volume":"3","author":"Vilone","year":"2021","journal-title":"Mach. Learn. Knowl. Extr."},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Dosilovic, F.K., Brcic, M., and Hlupic, N. (2018, January 21\u201325). Explainable artificial intelligence: A survey. Proceedings of the 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), Opatija, Croatia.","DOI":"10.23919\/MIPRO.2018.8400040"},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/s11747-019-00710-5","article-title":"Explainable AI: From Black Box to Glass Box","volume":"48","author":"Rai","year":"2020","journal-title":"J. Acad. Mark. Sci."},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"Mir\u00f3-Nicolau, M., Moy\u00e0-Alcover, G., and Jaume-i-Cap\u00f3, A. (2022). Evaluating Explainable Artificial Intelligence for X-ray Image Analysis. Appl. Sci., 12.","DOI":"10.3390\/app12094459"},{"key":"ref_72","unstructured":"Vilone, G., and Longo, L. (2020). Explainable Artificial Intelligence: A Systematic Review. arXiv."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1007\/s12369-021-00790-w","article-title":"Designing AI for Explainability and Verifiability: A Value Sensitive Design Approach to Avoid Artificial Stupidity in Autonomous Vehicles","volume":"14","author":"Umbrello","year":"2022","journal-title":"Int. J. Soc. Robot."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1080\/10580530.2020.1849465","article-title":"Explainable Artificial Intelligence: Objectives, Stakeholders, and Future Research Opportunities","volume":"39","author":"Meske","year":"2022","journal-title":"Inf. Syst. Manag."},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"4793","DOI":"10.1109\/TNNLS.2020.3027314","article-title":"A Survey on Explainable Artificial Intelligence","volume":"32","author":"Toward","year":"2021","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_76","first-page":"5","article-title":"Towards explainable artificial intelligence","volume":"Volume 1","author":"Samek","year":"2019","journal-title":"Explainable AI: Interpreting, Explaining and Visualizing Deep Learning"},{"key":"ref_77","doi-asserted-by":"crossref","unstructured":"Degas, A., Islam, M.R., Hurter, C., Barua, S., Rahman, H., Poudel, M., Ruscio, D., Ahmed, M.U., Begum, S., and Rahman, M.A. (2022). A Survey on Artificial Intelligence (AI) and eXplainable AI in Air Traffic Management: Current Trends and Development with Future Research Trajectory. Appl. Sci., 12.","DOI":"10.3390\/app12031295"},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"e5","DOI":"10.1017\/S0269888921000011","article-title":"Argumentation and explainable artificial intelligence: A survey","volume":"36","author":"Vassiliades","year":"2021","journal-title":"Knowl. Eng. Rev."},{"key":"ref_79","doi-asserted-by":"crossref","unstructured":"G\u00f3rski, \u0141., and Ramakrishna, S. (2021, January 21\u201325). Explainable artificial intelligence, lawyer\u2019s perspective. Proceedings of the 18th International Conference on Artificial Intelligence and Law (ICAIL), New York, NY, USA.","DOI":"10.1145\/3462757.3466145"},{"key":"ref_80","doi-asserted-by":"crossref","unstructured":"Hanif, A., Zhang, X., and Wood, S. (2021, January 25\u201329). A survey on explainable artificial intelligence techniques and challenges. Proceedings of the 2021 IEEE 25th International Enterprise Distributed Object Computing Workshop (EDOCW), Gold Coast, Australia.","DOI":"10.1109\/EDOCW52865.2021.00036"},{"key":"ref_81","unstructured":"Omeiza, D., Webb, H., Jirotka, M., and Kunze, L. (2021). Explanations in Autonomous Driving: A Survey. IEEE Trans. Intell. Transp. Syst., 1\u201321."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-3-030-57321-8_1","article-title":"Explainable artificial intelligence: Concepts, applications, research challenges and visions","volume":"Volume 12279","author":"Holzinger","year":"2020","journal-title":"Machine Learning and Knowledge Extraction"},{"key":"ref_83","doi-asserted-by":"crossref","unstructured":"Gade, K., Geyik, S.C., Kenthapadi, K., Mithal, V., and Taly, A. (2019, January 4\u20138). Explainable AI in industry. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA.","DOI":"10.1145\/3292500.3332281"},{"key":"ref_84","first-page":"507","article-title":"Exploration of explainable AI in context of human\u2013machine interface for the assistive driving system","volume":"Volume 12034","author":"Nguyen","year":"2020","journal-title":"Intelligent Information and Database Systems"},{"key":"ref_85","first-page":"524","article-title":"A survey of explainable artificial intelligence decision","volume":"41","author":"Kong","year":"2021","journal-title":"Syst. Eng. Theory Pract."},{"key":"ref_86","first-page":"126","article-title":"Metrics, Explainability and the European AI Act Proposal","volume":"5","author":"Sovrano","year":"2022","journal-title":"J"},{"key":"ref_87","doi-asserted-by":"crossref","unstructured":"Clinciu, M.A., and Hastie, H.F. (2019, January 29). A survey of explainable AI terminology. Proceedings of the 1st Workshop on Interactive Natural Language Technology for Explainable Artificial Intelligence (NL4XAI), Tokyo, Japan.","DOI":"10.18653\/v1\/W19-8403"},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"e1391","DOI":"10.1002\/widm.1391","article-title":"A historical perspective of explainable Artificial Intelligence","volume":"11","author":"Confalonieri","year":"2020","journal-title":"WIREs Data Min. Knowl. Discov."},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1007\/s13347-022-00510-w","article-title":"From Responsibility to Reason-Giving Explainable Artificial Intelligence","volume":"35","author":"Baum","year":"2022","journal-title":"Philos. Technol."},{"key":"ref_90","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Bellamy, R.K.E., Singh, M., and Liao, Q.V. (2020, January 25\u201330). Introduction to AI fairness. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3334480.3375059"},{"key":"ref_91","first-page":"3","article-title":"The myth of complete AI-fairness","volume":"Volume 12721","author":"Tucker","year":"2021","journal-title":"Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics"},{"key":"ref_92","doi-asserted-by":"crossref","unstructured":"Bartneck, C., L\u00fctge, C., Wagner, A., and Welsh, S. (2021). Chapter 4\u2014Trust and fairness in AI systems. Springer Briefs in Ethics. An Introduction to Ethics in Robotics and AI, Springer International Publishing.","DOI":"10.1007\/978-3-030-51110-4"},{"key":"ref_93","doi-asserted-by":"crossref","unstructured":"Hazirbas, C., Bitton, J., Dolhansky, B., Pan, J., Gordo, A., and Ferrer, C.C. (2021). Towards Measuring Fairness in AI: The Casual Conversations Dataset. arXiv.","DOI":"10.1109\/TBIOM.2021.3132237"},{"key":"ref_94","first-page":"271","article-title":"A systematic review of fairness in artificial intelligence algorithms","volume":"Volume 12896","author":"Dennehy","year":"2021","journal-title":"Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics"},{"key":"ref_95","unstructured":"NIST (2022, June 04). Glossary. Fit to Purpose, Available online: https:\/\/csrc.nist.gov\/glossary\/term\/fit_for_purpose."},{"key":"ref_96","unstructured":"(2022, June 04). Cambridge Dictionary. Fruitfulness. Cambridge University Press. Available online: https:\/\/dictionary.cambridge.org\/dictionary\/english\/fruitfulness."},{"key":"ref_97","unstructured":"(2022, June 04). Cambridge Dictionary. Governance. Cambridge University Press. Available online: https:\/\/dictionary.cambridge.org\/dictionary\/english\/governance."},{"key":"ref_98","unstructured":"Mathieson, S.A. (2022, June 04). How to Make AI Greener and More Efficient. Available online: https:\/\/www.computerweekly.com\/feature\/How-to-make-AI-greener-and-more-efficient."},{"key":"ref_99","unstructured":"(2022, June 04). Cambridge Dictionary. Greenness. Cambridge University Press. Available online: https:\/\/dictionary.cambridge.org\/dictionary\/english\/greenness."},{"key":"ref_100","unstructured":"(2022, June 04). Cambridge Dictionary. Informativeness. Cambridge University Press. Available online: https:\/\/dictionary.cambridge.org\/dictionary\/english\/informativeness."},{"key":"ref_101","unstructured":"(2022, June 04). Cambridge Dictionary. Impartiality. Cambridge University Press. Available online: https:\/\/dictionary.cambridge.org\/dictionary\/english\/impartiality."},{"key":"ref_102","unstructured":"Weld, D.S., and Bansal, G. (2018). The challenge of crafting intelligible intelligence. arXiv."},{"key":"ref_103","doi-asserted-by":"crossref","unstructured":"Gilpin, L.H., Bau, D., Yuan, B.Z., Bajwa, A., Specter, M., and Kagal, L. (2018, January 1\u20134). Explaining explanations: An overview of interpretability of machine learning. Proceedings of the 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA) 2018, Turin, Italy.","DOI":"10.1109\/DSAA.2018.00018"},{"key":"ref_104","unstructured":"(2022, June 04). Cambridge Dictionary. Literacy. Cambridge University Press. Available online: https:\/\/dictionary.cambridge.org\/dictionary\/english\/literacy."},{"key":"ref_105","unstructured":"Wright, D. (2022, June 04). Understanding \u201cTrustworthy\u201d AI: NIST Proposes Model to Measure and Enhance User Trust in AI Systems. Available online: https:\/\/www.jdsupra.com\/legalnews\/understanding-trustworthy-ai-nist-6387341."},{"key":"ref_106","unstructured":"(2022, June 04). Cambridge Dictionary. Similarity. Cambridge University Press. Available online: https:\/\/dictionary.cambridge.org\/dictionary\/english\/similarity."},{"key":"ref_107","unstructured":"(2022, June 04). Cambridge Dictionary. Suitability. Cambridge University Press. Available online: https:\/\/dictionary.cambridge.org\/dictionary\/english\/suitability."},{"key":"ref_108","first-page":"3","article-title":"Concepts of green IT engineering: Taxonomy, principles and implementation","volume":"Volume 74","author":"Kharchenko","year":"2017","journal-title":"Green IT Engineering: Concepts, Models, Complex Systems Architectures"},{"key":"ref_109","doi-asserted-by":"crossref","unstructured":"Mora-Cantallops, M., S\u00e1nchez-Alonso, S., Garc\u00eda-Barriocanal, E., and Sicilia, M.-A. (2021). Traceability for Trustworthy AI: A Review of Models and Tools. Big Data Cogn. Comput., 5.","DOI":"10.3390\/bdcc5020020"},{"key":"ref_110","doi-asserted-by":"crossref","first-page":"100050","DOI":"10.1016\/j.patter.2020.100050","article-title":"When Autonomous Systems Meet Accuracy and Transferability through AI: A Survey","volume":"1","author":"Zhang","year":"2020","journal-title":"Patterns"},{"key":"ref_111","unstructured":"Twin, A. (2022, June 04). Value Proposition. Available online: https:\/\/www.investopedia.com\/terms\/v\/valueproposition.asp."},{"key":"ref_112","unstructured":"(2022, June 04). Cambridge Dictionary. Verifiability. Cambridge University Press. Available online: https:\/\/dictionary.cambridge.org\/dictionary\/english\/verifiability."},{"key":"ref_113","unstructured":"(2022, June 04). Defense Innovation Board: AI Principles: Recommendations on the Ethical Use of Artificial Intelligence by the Department of Defense, Available online: https:\/\/media.defense.gov\/2019\/Oct\/31\/2002204458\/-1\/-1\/0\/DIB_AI_PRINCIPLES_PRIMARY_DOCUMENT.PDF."},{"key":"ref_114","unstructured":"European Commission for the Efficiency of Justice (CEPEJ) (2022, June 04). European Ethical Charter on the Use of Artificial Intelligence in Judicial Systems and Their Environment. Available online: https:\/\/rm.coe.int\/ethical-charter-en-for-publication-4-december-2018\/16808f699c."},{"key":"ref_115","first-page":"1","article-title":"Basic model of non-functional characteristics for assessment of artificial intelligence quality","volume":"2","author":"Kharchenko","year":"2022","journal-title":"Radioelectron. Comput. Syst."},{"key":"ref_116","unstructured":"Kharchenko, V., Kor, A.L., and Rucinski, A. (2018). Chapter 9\u2014An internet of drone-based multi-version post-severe accident monitoring system: Structures and reliability. Dependable IoT for Human and Industry: Modeling, Architecting, Implementation, River Publishers."},{"key":"ref_117","doi-asserted-by":"crossref","unstructured":"Moskalenko, V., Moskalenko, A., Korobov, A., and Semashko, V. (2019). The Model and Training Algorithm of Compact Drone Autonomous Visual Navigation System. Data, 4.","DOI":"10.3390\/data4010004"},{"key":"ref_118","doi-asserted-by":"crossref","unstructured":"Fedorenko, M., Kharchenko, V., Lutay, L., and Yehorova, Y. (2016, January 14\u201317). The processing of the diagnostic data in a medical information-analytical system using a network of neuro modules with relearning. Proceedings of the 2016 IEEE East-West Design & Test Symposium (EWDTS), Yerevan, Armenia.","DOI":"10.1109\/EWDTS.2016.7807653"},{"key":"ref_119","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1007\/978-3-319-07013-1_21","article-title":"Evolution of software quality models in context of the standard ISO 25010","volume":"Volume 286","author":"Zamojski","year":"2014","journal-title":"Advances in Intelligent Systems and Computing"},{"key":"ref_120","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1007\/978-3-030-65854-0_3","article-title":"Quality assurance for AI-based systems: Overview and challenges (introduction to interactive session)","volume":"Volume 404","author":"Winkler","year":"2021","journal-title":"Lecture Notes in Business Information Processing"},{"key":"ref_121","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1007\/978-3-319-19216-1_37","article-title":"Advanced security assurance case based on ISO\/IEC 15408","volume":"Volume 365","author":"Zamojski","year":"2015","journal-title":"Advances in Intelligent Systems and Computing"},{"key":"ref_122","first-page":"17","article-title":"Security-informed safety: If it\u2019s not secure, it\u2019s not safe","volume":"Volume 8166","author":"Tonetta","year":"2013","journal-title":"Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)"},{"key":"ref_123","doi-asserted-by":"crossref","first-page":"139","DOI":"10.15588\/1607-3274-2020-4-14","article-title":"Conception and application of dependable Internet of Things based systems","volume":"4","author":"Illiashenko","year":"2020","journal-title":"Radio Electron. Comput. Sci. Control"},{"key":"ref_124","doi-asserted-by":"crossref","unstructured":"Siebert, J., Joeckel, L., Heidrich, J., Trendowicz, A., Nakamichi, K., Ohashi, K., Namba, I., Yamamoto, R., and Aoyama, M. (2021). Construction of a quality model for machine learning systems. Software Qual. J.","DOI":"10.1007\/s11219-021-09557-y"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/13\/4865\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:39:19Z","timestamp":1760139559000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/13\/4865"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,27]]},"references-count":124,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["s22134865"],"URL":"https:\/\/doi.org\/10.3390\/s22134865","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,27]]}}}