{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T21:03:42Z","timestamp":1790197422374,"version":"4.1.0"},"reference-count":45,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2025,6,22]],"date-time":"2025-06-22T00:00:00Z","timestamp":1750550400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["101135932"],"award-info":[{"award-number":["101135932"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>This paper presents the AI Trustworthiness Assessment Framework (AI_TAF), a comprehensive methodology for evaluating and mitigating trustworthiness risks across all stages of an AI system\u2019s lifecycle. The framework accounts for the criticality of the system based on its intended application, the maturity level of the AI teams responsible for ensuring trust, and the organisation\u2019s risk tolerance regarding trustworthiness. By integrating both technical safeguards and sociopsychological considerations, AI_TAF adopts a human-centric approach to risk management, supporting the development of trustworthy AI systems across diverse organisational contexts and at varying levels of human\u2013AI maturity. Crucially, the framework underscores that achieving trust in AI requires a rigorous assessment and advancement of the trustworthiness maturity of the human actors involved in the AI lifecycle. Only through this human-centric enhancement can AI teams be adequately prepared to provide effective oversight of AI systems.<\/jats:p>","DOI":"10.3390\/computers14070243","type":"journal-article","created":{"date-parts":[[2025,6,23]],"date-time":"2025-06-23T04:50:05Z","timestamp":1750654205000},"page":"243","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["AI_TAF: A Human-Centric Trustworthiness Risk Assessment Framework for AI Systems"],"prefix":"10.3390","volume":"14","author":[{"given":"Eleni","family":"Seralidou","sequence":"first","affiliation":[{"name":"trustilio B.V., Vijzelstraat 68, 1017 HL Amsterdam, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kitty","family":"Kioskli","sequence":"additional","affiliation":[{"name":"trustilio B.V., Vijzelstraat 68, 1017 HL Amsterdam, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8885-040X","authenticated-orcid":false,"given":"Theofanis","family":"Fotis","sequence":"additional","affiliation":[{"name":"trustilio B.V., Vijzelstraat 68, 1017 HL Amsterdam, The Netherlands"},{"name":"School of Education, Sport & Health Sciences, University of Brighton, Brighton BN19PH, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nineta","family":"Polemi","sequence":"additional","affiliation":[{"name":"trustilio B.V., Vijzelstraat 68, 1017 HL Amsterdam, The Netherlands"},{"name":"Department of Informatics, University of Piraeus, 185 34 Piraeus, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,6,22]]},"reference":[{"key":"ref_1","unstructured":"OECD (2025, May 01). Governing with Artificial Intelligence: Are Governments Ready? OECD Artificial Intelligence Papers. Available online: https:\/\/www.oecd.org\/content\/dam\/oecd\/en\/publications\/reports\/2024\/06\/governing-with-artificial-intelligence_f0e316f5\/26324bc2-en.pdf."},{"key":"ref_2","unstructured":"National Institute of Standards and Technology (2025, May 01). Artificial Intelligence Risk Management Framework (AI RMF 1.0), Available online: https:\/\/nvlpubs.nist.gov\/nistpubs\/ai\/nist.ai.100-1.pdf."},{"key":"ref_3","unstructured":"European Commission (2025, May 01). Proposal for a Regulation of the European Parliament and of the Council Laying Down Harmonised Rules on Artificial Intelligence (Artificial Intelligence Act) and Amending Certain Union Legislative Acts (COM\/2021\/206 Final). Available online: https:\/\/eur-lex.europa.eu\/legal-content\/EN\/TXT\/?uri=CELEX%3A52021PC0206."},{"key":"ref_4","unstructured":"European Commission (2025, May 01). Artificial Intelligence Act: Regulation of AI in the European Union. Available online: https:\/\/digital-strategy.ec.europa.eu\/en\/policies\/european-approach-artificial-intelligence."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1007\/s11023-018-9482-5","article-title":"AI4People\u2014An ethical framework for a good AI society","volume":"28","author":"Floridi","year":"2018","journal-title":"Minds Mach."},{"key":"ref_6","unstructured":"European Parliament & Council (2025, May 01). Regulation (EU) 2024\/1689 of the European Parliament and of the Council of 13 June 2024 Laying Down Harmonised Rules on Artificial Intelligence (Artificial Intelligence Act). Official Journal of the European Union. Available online: https:\/\/eur-lex.europa.eu."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"22718","DOI":"10.1109\/ACCESS.2024.3364387","article-title":"Trustworthiness Assurance Assessment for High-Risk AI-Based Systems","volume":"12","author":"Stettinger","year":"2024","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1038\/s42256-019-0088-2","article-title":"The global landscape of AI ethics guidelines","volume":"1","author":"Jobin","year":"2019","journal-title":"Nat. Mach. Intell."},{"key":"ref_9","first-page":"138","article-title":"Estimating attackers\u2019 profiles results in more realistic vulnerability severity scores","volume":"Volume 53","author":"Kioskli","year":"2022","journal-title":"Proceedings of the 13th International Conference on Applied Human factors and Ergonomics (AHFE2022)"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kioskli, K., Fotis, T., Nifakos, S., and Mouratidis, H. (2023). The Importance of conceptualising the human-centric approach in maintaining and promoting cybersecurity-hygiene in healthcare 4.0. Appl. Sci., 13.","DOI":"10.3390\/app13063410"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Kioskli, K., Seralidou, E., and Polemi, N. (2025). A Practical Human-Centric Risk Management (HRM) Methodology. Electronics, 14.","DOI":"10.3390\/electronics14030486"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1007\/s11023-020-09517-8","article-title":"The ethics of AI ethics: An evaluation of guidelines","volume":"30","author":"Hagendorff","year":"2020","journal-title":"Minds Mach."},{"key":"ref_13","first-page":"511","article-title":"Ethics-based auditing of automated decision-making systems","volume":"36","author":"Floridi","year":"2021","journal-title":"AI Soc."},{"key":"ref_14","unstructured":"(2023). Information Technology\u2014Artificial Intelligence\u2014Guidance on Risk Management (Standard No. ISO\/IEC 23894:2023). Available online: https:\/\/www.iso.org\/standard\/81228.html."},{"key":"ref_15","unstructured":"(2018). Information Technology\u2014Security Techniques\u2014Information Security Management Guidelines for Smart Cities (Standard No. ISO\/IEC 27090:2018). Available online: https:\/\/www.iso.org\/standard\/73906.html."},{"key":"ref_16","unstructured":"(2015). Information Technology\u2014Security Techniques\u2014Guidance for Incident Sharing (Standard No. ISO\/IEC 27091:2015). Available online: https:\/\/www.iso.org\/standard\/60803.html."},{"key":"ref_17","unstructured":"(2023). Information Technology\u2014Artificial Intelligence\u2014AI System Life Cycle Processes (Standard No. ISO\/IEC 5338:2023). Available online: https:\/\/www.iso.org\/standard\/81229.html."},{"key":"ref_18","unstructured":"European Telecommunications Standards Institute (2023). TC SAI Activity Report 2023, ETSI. Available online: https:\/\/www.etsi.org\/committee-activity\/activity-report-sai."},{"key":"ref_19","unstructured":"(2023). Information Technology\u2014Artificial Intelligence\u2014Management System (Standard No. ISO\/IEC 42001:2023). Available online: https:\/\/www.iso.org\/standard\/81230.html."},{"key":"ref_20","unstructured":"European Union Agency for Cybersecurity (ENISA) (2025, May 01). Framework for AI cybersecurity practices (FAICP). . Available online: https:\/\/www.enisa.europa.eu\/publications\/multilayer-framework-for-good-cybersecurity-practices-for-ai."},{"key":"ref_21","unstructured":"OWASP Foundation (2025, May 01). OWASP AI Exchange: AI Security & Privacy Guide. Available online: https:\/\/owaspai.org\/."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Polemi, N., Praca, I., Kioskli, K., and Becue, A. (2024). Challenges and Efforts in Managing AI Trustworthiness Risks: A state of knowledge. Front. Big Data, 7.","DOI":"10.3389\/fdata.2024.1381163"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kioskli, K., Ramfos, A., Taylor, S., Maglaras, L., and Lugo, R. (2024, January 22\u201327). Optimizing AI System Security: An Ecosystem Recommendation to Socio-Technical Risk Management. Proceedings of the 15th International Conference on Applied Human Factors and Ergonomics (AHFE), Nice, France. AHFE Open Access Series.","DOI":"10.54941\/ahfe1005635"},{"key":"ref_24","unstructured":"(2018). AI Fairness 360 (AIF360), IBM Research. Available online: https:\/\/github.com\/Trusted-AI\/AIF360."},{"key":"ref_25","unstructured":"(2019). AI Explainability 360 (AIX360), IBM Research. Available online: https:\/\/github.com\/Trusted-AI\/AIX360."},{"key":"ref_26","unstructured":"(2021). Adversarial Robustness Toolbox (ART), IBM Research. Available online: https:\/\/github.com\/Trusted-AI\/adversarial-robustness-toolbox."},{"key":"ref_27","unstructured":"Fairlearn Contributors (2020). Fairlearn, Microsoft. Available online: https:\/\/github.com\/fairlearn\/fairlearn."},{"key":"ref_28","unstructured":"Google PAIR (2019). What-If Tool, Google. Available online: https:\/\/github.com\/PAIR-code\/what-if-tool."},{"key":"ref_29","unstructured":"Deepchecks, Inc. (2022). DeepChecks, Deepchecks. Available online: https:\/\/github.com\/deepchecks\/deepchecks."},{"key":"ref_30","unstructured":"TensorFlow (2022). Model Card Toolkit, TensorFlow. Available online: https:\/\/github.com\/tensorflow\/model-card-toolkit."},{"key":"ref_31","first-page":"305","article-title":"A socio-technical approach to cyber risk assessment","volume":"14","author":"Kioskli","year":"2020","journal-title":"Int. J. Electr. Comput. Eng."},{"key":"ref_32","unstructured":"European Commission (2020). Ethics Guidelines for Trustworthy AI, European Commission. Available online: https:\/\/digital-strategy.ec.europa.eu\/en\/library\/ethics-guidelines-trustworthy-ai."},{"key":"ref_33","first-page":"134","article-title":"Governance of artificial intelligence: A risk and guideline-based approach","volume":"34","author":"Yu","year":"2019","journal-title":"AI Soc."},{"key":"ref_34","unstructured":"OECD (2020). OECD Framework for the Classification of AI Systems. OECD Digital Economy Papers, OECD Publishing. No. 331."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Florea, N.V., and Croitoru, G. (2025). The Impact of Artificial Intelligence on Communication Dynamics and Performance in Organizational Leadership. Adm. Sci., 15.","DOI":"10.3390\/admsci15020033"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"100066","DOI":"10.1016\/j.chbah.2024.100066","article-title":"Confirmation bias in AI-assisted decision-making: AI triage recommendations congruent with expert judgments increase psychologist trust and recommendation acceptance","volume":"2","author":"Bashkirova","year":"2024","journal-title":"Comput. Hum. Behav. Artif. Hum."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"100138","DOI":"10.1016\/j.caeai.2023.100138","article-title":"Opportunities of artificial intelligence for supporting complex problem-solving: Findings from a scoping review","volume":"4","author":"Joksimovic","year":"2023","journal-title":"Comput. Educ. Artif. Intell."},{"key":"ref_38","first-page":"109","article-title":"Organizational Enablers of Artificial Intelligence Adoption in Public Institutions: A Systematic Literature Review","volume":"22","author":"Tomazevic","year":"2024","journal-title":"Cent. Eur. Public Adm. Rev."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Reuel, A., Connolly, P., Jafari Meimandi, K., Tewari, S., Wiatrak, J., Venkatesh, D., and Kochenderfer, M. (2024). Responsible AI in the global context: Maturity model and survey. arXiv.","DOI":"10.1145\/3715275.3732165"},{"key":"ref_40","unstructured":"MITRE Corporation (2025, May 10). MITRE ATT&CK\u00ae: Groups. Available online: https:\/\/attack.mitre.org\/groups\/."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Kioskli, K., and Polemi, D. (2020, January 8\u201310). Measuring Psychosocial and Behavioural Factors Improves Attack Potential Estimates. Proceedings of the 2020 15th International Conference for Internet Technology and Secured Transactions (ICITST), London, UK.","DOI":"10.23919\/ICITST51030.2020.9351343"},{"key":"ref_42","unstructured":"European Union Agency for Cybersecurity (2020). Artificial Intelligence Threat Landscape, European Union Agency for Cybersecurity. Available online: https:\/\/www.enisa.europa.eu\/publications\/artificial-intelligence-cybersecurity-challenges."},{"key":"ref_43","unstructured":"(2022). Information Security, Cybersecurity and Privacy Protection\u2013Guidance on Managing Information Security risks (Standard No. ISO\/IEC 27005:2022). Available online: https:\/\/www.iso.org\/standard\/80585.html."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"(2022). Information Security, Cybersecurity and Privacy Protection\u2013Information Security Management Systems\u2013Requirements (Standard No. ISO\/IEC 27001:2022). Available online: https:\/\/www.iso.org\/standard\/82875.html.","DOI":"10.2307\/j.ctv30qq13d"},{"key":"ref_45","unstructured":"OWASP Foundation (2025, May 10). Threats Through Use. OWASP AI Exchange. Available online: https:\/\/owaspai.org\/docs\/2_threats_through_use\/."}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/7\/243\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:56:42Z","timestamp":1760032602000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/7\/243"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,22]]},"references-count":45,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2025,7]]}},"alternative-id":["computers14070243"],"URL":"https:\/\/doi.org\/10.3390\/computers14070243","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,22]]}}}