{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T21:03:42Z","timestamp":1790197422273,"version":"4.1.0"},"reference-count":45,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2025,11,6]],"date-time":"2025-11-06T00:00:00Z","timestamp":1762387200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Union\u2019s Horizon Programme","doi-asserted-by":"publisher","award":["101135932"],"award-info":[{"award-number":["101135932"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>The integration of Artificial Intelligence (AI) systems into critical decision-making processes necessitates robust mechanisms to ensure trustworthiness, ethical compliance, and human oversight. This paper introduces trustSense, a novel assessment framework and tool designed to evaluate the maturity of human oversight practices in AI governance. Building upon principles from trustworthy AI, cybersecurity readiness, and privacy-by-design, trustSense employs a structured questionnaire-based approach to capture an organisation\u2019s oversight capabilities across multiple dimensions. The tool supports diverse user roles and provides tailored feedback to guide risk mitigation strategies. Its calculation module synthesises responses to generate maturity scores, enabling organisations to benchmark their practices and identify improvement pathways. The design and implementation of trustSense are grounded in user-centred methodologies, with defined personas, user flows, and a privacy-preserving architecture. Security considerations and data protection are integrated into all stages of development, ensuring compliance with relevant regulations. Validation results demonstrate the tool\u2019s effectiveness in providing actionable insights for enhancing AI oversight maturity. By combining measurement, guidance, and privacy-aware design, trustSense offers a practical solution for organisations seeking to operationalise trust in AI systems. This work contributes to the discourse on governance of trustworthy AI systems by providing a scalable, transparent, and empirically validated human maturity assessment tool.<\/jats:p>","DOI":"10.3390\/computers14110483","type":"journal-article","created":{"date-parts":[[2025,11,7]],"date-time":"2025-11-07T10:56:45Z","timestamp":1762513005000},"page":"483","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["trustSense: Measuring Human Oversight Maturity for Trustworthy AI"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0143-0216","authenticated-orcid":false,"given":"Kitty","family":"Kioskli","sequence":"first","affiliation":[{"name":"trustilio B.V., Vijzelstraat 68, 1017 HL Amsterdam, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8885-040X","authenticated-orcid":false,"given":"Theofanis","family":"Fotis","sequence":"additional","affiliation":[{"name":"trustilio B.V., Vijzelstraat 68, 1017 HL Amsterdam, The Netherlands"},{"name":"School of Education, Sport & Health Sciences, University of Brighton, Brighton BN1 9PH, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2832-2960","authenticated-orcid":false,"given":"Eleni","family":"Seralidou","sequence":"additional","affiliation":[{"name":"trustilio B.V., Vijzelstraat 68, 1017 HL Amsterdam, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marios","family":"Passaris","sequence":"additional","affiliation":[{"name":"trustilio B.V., Vijzelstraat 68, 1017 HL Amsterdam, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nineta","family":"Polemi","sequence":"additional","affiliation":[{"name":"trustilio B.V., Vijzelstraat 68, 1017 HL Amsterdam, The Netherlands"},{"name":"Department of Informatics, University of Piraeus, 185 34 Piraeus, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,11,6]]},"reference":[{"key":"ref_1","unstructured":"Russell, S., and Norvig, P. (2020). Artificial Intelligence: A Modern Approach, Pearson. [4th ed.]."},{"key":"#cr-split#-ref_2.1","unstructured":"European Union (2024). Regulation"},{"key":"#cr-split#-ref_2.2","unstructured":"(EU) 2024\/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence (Artificial Intelligence Act). Off. J. Eur. Union L, 1689, 1-139."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1007\/s11023-018-9482-5","article-title":"AI4People, an ethical framework for a good AI society: Opportunities, risks, principles, and recommendations","volume":"28","author":"Floridi","year":"2018","journal-title":"Minds Mach."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1038\/s42256-019-0088-2","article-title":"The global landscape of AI ethics guidelines","volume":"1","author":"Jobin","year":"2019","journal-title":"Nat. Mach. Intell."},{"key":"ref_5","unstructured":"ENISA (2020). Artificial Intelligence Cybersecurity Challenges, European Union Agency for Cybersecurity. Available online: https:\/\/www.enisa.europa.eu\/publications\/artificial-intelligence-cybersecurity-challenges."},{"key":"ref_6","unstructured":"OECD (2022). OECD Framework for the Classification of AI Systems, Organisation for Economic Co-operation and Development. Available online: https:\/\/oecd.ai\/en\/classification."},{"key":"ref_7","unstructured":"NIST (2023). AI Risk Management Framework (AI RMF 1.0) (NIST AI 100-1), National Institute of Standards and Technology."},{"key":"ref_8","unstructured":"(2023). Information Technology Artificial Intelligence Guidance on Risk Management (Standard No. ISO\/IEC 23894:2023). Available online: https:\/\/www.iso.org\/standard\/77304.html."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1057\/s42984-020-00007-w","article-title":"Knowledge in the grey zone: AI and cybersecurity","volume":"1","author":"Stevens","year":"2020","journal-title":"Digit. War"},{"key":"ref_10","first-page":"63","article-title":"Towards a human-centric AI trustworthiness risk management framework","volume":"Volume 127","author":"Moallem","year":"2024","journal-title":"Human Factors in Cybersecurity; Proceedings of the AHFE 2024 International Conference, Nice, France, 24\u201327 July 2024"},{"key":"ref_11","unstructured":"European Commission (2025, August 01). Directive (EU) 2022\/2555 on Measures for a High Common Level of Cybersecurity Across the Union (NIS2 Directive). Available online: https:\/\/eur-lex.europa.eu\/eli\/dir\/2022\/2555\/oj."},{"key":"ref_12","unstructured":"ENISA (2023). NIS2 Directive Overview, European Union Agency for Cybersecurity. Available online: https:\/\/www.enisa.europa.eu\/topics\/awareness-and-cyber-hygiene\/raising-awareness-campaigns\/network-and-information-systems-directive-2-nis2."},{"key":"ref_13","unstructured":"European Commission (2025, August 01). Assessment List for Trustworthy Artificial Intelligence (ALTAI): Self-Assessment. Available online: https:\/\/digital-strategy.ec.europa.eu\/en\/library\/assessment-list-trustworthy-artificial-intelligence-altai-self-assessment."},{"key":"ref_14","unstructured":"(2025, August 01). The General Purpose AI Code of Practice. Available online: https:\/\/digital-strategy.ec.europa.eu\/en\/policies\/contents-code-gpai."},{"key":"ref_15","unstructured":"Oxford Insights (2025, August 01). Trustworthy AI Self-Assessment [Spreadsheet]. Available online: https:\/\/oxfordinsights.com\/wp-content\/uploads\/2023\/12\/Trustworthy-AI-Self-Assessment-2023.xlsx."},{"key":"ref_16","unstructured":"Oxford Insights (2025, August 01). Government AI Readiness Index 2024. Available online: https:\/\/oxfordinsights.com\/wp-content\/uploads\/2024\/12\/2024-Government-AI-Readiness-Index-2.pdf."},{"key":"ref_17","unstructured":"Alan Turing Institute (2025, August 01). Trustworthiness Assessment Tool (Digital Identity). Available online: https:\/\/www.turing.ac.uk\/TDI\/trustworthiness-assessment-tool."},{"key":"ref_18","unstructured":"AI4Belgium (2025, August 15). Tool for Assessing the Trustworthiness of An Organization\u2019s AI. Available online: https:\/\/altai.ai4belgium.be\/."},{"key":"ref_19","unstructured":"KPMG (2025, August 01). An Illustrative AI Risk and Controls Guide. Available online: https:\/\/kpmg.com\/us\/en\/articles\/ai-risk-and-control-guide-gated.html."},{"key":"ref_20","unstructured":"KPMG (2025, August 01). AI Trust Services. Available online: https:\/\/kpmg.com\/xx\/en\/what-we-do\/services\/ai\/ai-trust-services.html."},{"key":"ref_21","unstructured":"ICO (2022). AI and Data Protection Risk Toolkit, Information Commissioner\u2019s Office. Available online: https:\/\/ico.org.uk\/for-organisations\/uk-gdpr-guidance-and-resources\/artificial-intelligence\/guidance-on-ai-and-data-protection\/ai-and-data-protection-risk-toolkit\/."},{"key":"ref_22","unstructured":"Z-Inspection\u00ae (2025, August 15). Z-Inspection\u00ae Tool. Available online: https:\/\/z-inspection.org\/."},{"key":"ref_23","unstructured":"IBM (2025, August 01). AI Fairness 360 (AIF360). Available online: https:\/\/research.ibm.com\/blog\/ai-fairness-360."},{"key":"ref_24","unstructured":"Microsoft (2025, August 01). Assess AI Systems by Using the Responsible AI Dashboard (Azure Machine Learning Documentation). Available online: https:\/\/learn.microsoft.com\/en-us\/azure\/machine-learning\/concept-responsible-ai-dashboard."},{"key":"ref_25","unstructured":"Li, Z., Kong, C., Yu, Y., Wu, Q., Jiang, X., Cheung, N.-M., Wen, B., Kot, A., and Jiang, X. (2025). SAVER: Mitigating hallucinations in large vision-language models via style-aware visual early revision. arXiv."},{"key":"ref_26","unstructured":"FAITH Project. Federated Artificial Intelligence Solution for Monitoring Mental Health Status After Cancer Treatment (FAITH), European Commission. Available online: https:\/\/faith-ec-project.eu\/."},{"key":"ref_27","unstructured":"THEMIS 5.0 Project. Human-Centered Trustworthiness Optimisation in Hybrid Decision Support (THEMIS 5.0), European Commission. Available online: https:\/\/www.themis-trust.eu\/."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Seralidou, E., Kioskli, K., Fotis, T., and Polemi, N. (2025). AI_TAF: A human-centric trustworthiness risk assessment framework for AI systems. Computers, 14.","DOI":"10.3390\/computers14070243"},{"key":"ref_29","unstructured":"Qi, P., Liu, B., Di, S., Liu, J., Pei, J., Yi, J., and Zhou, B. (2021). Trustworthy AI: From principles to practices. arXiv."},{"key":"ref_30","unstructured":"OECD (2025, August 15). Catalogue of Tools & Metrics for Trustworthy AI. Available online: https:\/\/oecd.ai\/en\/catalogue\/overview."},{"key":"ref_31","unstructured":"Government of Canada (2025, June 24). Algorithmic Impact Assessment (AIA). Available online: https:\/\/www.canada.ca\/en\/government\/system\/digital-government\/digital-government-innovations\/responsible-use-ai\/algorithmic-impact-assessment.html."},{"key":"ref_32","first-page":"305","article-title":"A socio-technical approach to cyber risk assessment","volume":"14","author":"Kioskli","year":"2020","journal-title":"Int. J. Electr. Comput. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Kioskli, K., and Polemi, N. (2021, January 8\u201310). Measuring psychosocial and behavioural factors improves attack potential estimates. Proceedings of the 15th International Conference for Internet Technology and Secured Transactions (ICITST 2020), London, UK.","DOI":"10.23919\/ICITST51030.2020.9351343"},{"key":"#cr-split#-ref_34.1","unstructured":"Ahram, T., and Karwowski, W. (2022). Estimating attackers' profiles results in more realistic vulnerability severity scores. Human Factors in Cybersecurity"},{"key":"#cr-split#-ref_34.2","unstructured":"Proceedings of the AHFE International Conference, New York, NY, USA, 24-28 July 2022, AHFE Open Access."},{"key":"#cr-split#-ref_35.1","unstructured":"Moallem, A., and Kioskli, K. (2025). Charting trustworthiness: A socio-technical perspective on AI and human factors. Human Factors in Cybersecurity"},{"key":"#cr-split#-ref_35.2","unstructured":"Proceedings of the AHFE 2025 International Conference, Honolulu, HI, USA, 8-10 December 2025, AHFE Open Access."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1007\/s12193-020-00329-9","article-title":"Effects of personality traits on user trust in human\u2013machine collaborations","volume":"14","author":"Zhou","year":"2020","journal-title":"J. Multimodal User Interfaces"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2021","DOI":"10.1007\/s12525-022-00594-4","article-title":"Is trust in artificial intelligence systems related to user personality? Review of empirical evidence and future research directions","volume":"32","author":"Riedl","year":"2022","journal-title":"Electron. Mark."},{"key":"ref_38","first-page":"4115","article-title":"Psychological traits and appropriate reliance: Factors shaping trust in AI","volume":"41","author":"Kuper","year":"2024","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"ref_39","unstructured":"Morana, S., Gnewuch, U., Jung, D., and Granig, C. (2020, January 15\u201317). The effect of anthropomorphism on investment decision-making with robo-advisor chatbots. Proceedings of the 28th European Conference on Information Systems (ECIS), Marrakech, Morocco. Available online: https:\/\/aisel.aisnet.org\/ecis2020_rp\/63."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1111\/jbl.12198","article-title":"Logistics innovation and social sustainability: How to prevent an artificial divide in human\u2013computer interaction","volume":"40","author":"Klumpp","year":"2019","journal-title":"J. Bus. Logist."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1251","DOI":"10.1080\/10447318.2022.2138826","article-title":"A systematic literature review of user trust in AI-enabled systems: An HCI perspective","volume":"40","author":"Bach","year":"2022","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1007\/s10606-021-09392-6","article-title":"Brokerbot: A cryptocurrency chatbot in the socio-technical gap of trust","volume":"30","author":"Lee","year":"2021","journal-title":"Comput. Support. Coop. Work"}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/11\/483\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,7]],"date-time":"2025-11-07T11:15:54Z","timestamp":1762514154000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/14\/11\/483"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,6]]},"references-count":45,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2025,11]]}},"alternative-id":["computers14110483"],"URL":"https:\/\/doi.org\/10.3390\/computers14110483","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,6]]}}}