{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,6]],"date-time":"2026-07-06T15:59:44Z","timestamp":1783353584252,"version":"3.54.6"},"reference-count":38,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2024,6,7]],"date-time":"2024-06-07T00:00:00Z","timestamp":1717718400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IDT"],"published-print":{"date-parts":[[2024,6,7]]},"abstract":"<jats:p>Artificial Intelligence (AI) has pervaded everyday life, reshaping the landscape of business, economy, and society through the alteration of interactions and connections among stakeholders and citizens. Nevertheless, the widespread adoption of AI presents significant risks and hurdles, sparking apprehension regarding the trustworthiness of AI systems by humans. Lately, numerous governmental entities have introduced regulations and principles aimed at fostering trustworthy AI systems, while companies, research institutions, and public sector organizations have released their own sets of principles and guidelines for ensuring ethical and trustworthy AI. Additionally, they have developed methods and software toolkits to aid in evaluating and improving the attributes of trustworthiness. The present paper aims to explore this evolution by analysing and supporting the trustworthiness of AI systems. We commence with an examination of the characteristics inherent in trustworthy AI, along with the corresponding principles and standards associated with them. We then examine the methods and tools that are available to designers and developers in their quest to operationalize trusted AI systems. Finally, we outline research challenges towards end-to-end engineering of trustworthy AI by-design.<\/jats:p>","DOI":"10.3233\/idt-240366","type":"journal-article","created":{"date-parts":[[2024,6,18]],"date-time":"2024-06-18T11:57:06Z","timestamp":1718711826000},"page":"837-854","source":"Crossref","is-referenced-by-count":12,"title":["Exploring the landscape of trustworthy artificial intelligence: Status and challenges"],"prefix":"10.1177","volume":"18","author":[{"given":"Gregoris","family":"Mentzas","sequence":"first","affiliation":[{"name":"Information Management Unit, Institute of Communication and Computer Systems (ICCS), School of Electrical and Computer Engineering, National Technical University of Athens (NTUA), Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mattheos","family":"Fikardos","sequence":"additional","affiliation":[{"name":"Information Management Unit, Institute of Communication and Computer Systems (ICCS), School of Electrical and Computer Engineering, National Technical University of Athens (NTUA), Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katerina","family":"Lepenioti","sequence":"additional","affiliation":[{"name":"Information Management Unit, Institute of Communication and Computer Systems (ICCS), School of Electrical and Computer Engineering, National Technical University of Athens (NTUA), Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dimitris","family":"Apostolou","sequence":"additional","affiliation":[{"name":"Department of Informatics, University of Piraeus, Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","reference":[{"issue":"1","key":"10.3233\/IDT-240366_ref1","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1145\/3624699","article-title":"On specifying for trustworthiness","volume":"67","author":"Abeywickrama","year":"2023","journal-title":"Communications of the ACM"},{"issue":"8","key":"10.3233\/IDT-240366_ref7","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MC.2020.2996587","article-title":"A research agenda for hybrid intelligence: Augmenting human intellect with collaborative, adaptive, responsible, and explainable artificial intelligence","volume":"53","author":"Akata","year":"2020","journal-title":"Computer"},{"issue":"3","key":"10.3233\/IDT-240366_ref10","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1007\/s10676-022-09634-1","article-title":"Characteristics and challenges in the industries towards responsible AI: A systematic literature review","volume":"24","author":"Anagnostou","year":"2022","journal-title":"Ethics and Information Technology"},{"key":"10.3233\/IDT-240366_ref15","first-page":"17","article-title":"TAII Framework for Trustworthy AI Systems","volume":"2","author":"Baker-Brunnbauer","year":"2021","journal-title":"ROBONOMICS: The Journal of the Automated Economy"},{"issue":"3","key":"10.3233\/IDT-240366_ref20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3514257","article-title":"An agile new research framework for hybrid human-AI teaming: Trust, transparency, and transferability","volume":"12","author":"Caldwell","year":"2022","journal-title":"ACM Transactions on Interactive Intelligent Systems (TiiS)"},{"issue":"12","key":"10.3233\/IDT-240366_ref21","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1145\/3430368","article-title":"Operationalizing AI ethics principles","volume":"63","author":"Canca","year":"2020","journal-title":"Communications of the ACM"},{"issue":"6","key":"10.3233\/IDT-240366_ref25","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1109\/MIS.2023.3324470","article-title":"Artificial intelligence ethics and trust: From principles to practice","volume":"38","author":"Chen","year":"2023","journal-title":"IEEE Intelligent Systems"},{"key":"10.3233\/IDT-240366_ref41","doi-asserted-by":"crossref","first-page":"107574","DOI":"10.1016\/j.chb.2022.107574","article-title":"Supporting Human-AI Teams: Transparency, explainability, and situation awareness","volume":"140","author":"Endsley","year":"2023","journal-title":"Computers in Human Behavior"},{"issue":"4","key":"10.3233\/IDT-240366_ref42","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1177\/15553434221133288","article-title":"Special issue on human-AI teaming and special issue on AI in healthcare","volume":"16","author":"Endsley","year":"2022","journal-title":"Journal of Cognitive Engineering and Decision Making"},{"issue":"5","key":"10.3233\/IDT-240366_ref43","doi-asserted-by":"crossref","first-page":"1709","DOI":"10.1007\/s10796-021-10186-w","article-title":"Artificial intelligence and business value: A literature review","volume":"24","author":"Enholm","year":"2022","journal-title":"Information Systems Frontiers"},{"issue":"2","key":"10.3233\/IDT-240366_ref52","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1007\/s00146-022-01445-8","article-title":"Investing in AI for social good: An analysis of European national strategies","volume":"38","author":"Foffano","year":"2023","journal-title":"AI & Society"},{"issue":"11","key":"10.3233\/IDT-240366_ref53","doi-asserted-by":"crossref","first-page":"12387","DOI":"10.1007\/s10462-023-10448-w","article-title":"Neurosymbolic AI: The 3 rd wave","volume":"56","author":"Garcez","year":"2023","journal-title":"Artificial Intelligence Review"},{"issue":"2","key":"10.3233\/IDT-240366_ref58","doi-asserted-by":"crossref","first-page":"627","DOI":"10.5465\/annals.2018.0057","article-title":"Human trust in artificial intelligence: Review of empirical research","volume":"14","author":"Glikson","year":"2020","journal-title":"Academy of Management Annals"},{"issue":"1","key":"10.3233\/IDT-240366_ref60","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1007\/s11023-020-09517-8","article-title":"The ethics of AI ethics: An evaluation of guidelines","volume":"30","author":"Hagendorff","year":"2020","journal-title":"Minds and Machines"},{"issue":"1","key":"10.3233\/IDT-240366_ref61","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1007\/s11023-020-09517-8","article-title":"The ethics of AI ethics: An evaluation of guidelines","volume":"30","author":"Hagendorff","year":"2020","journal-title":"Minds and Machines"},{"issue":"4","key":"10.3233\/IDT-240366_ref64","doi-asserted-by":"crossref","first-page":"904","DOI":"10.3390\/ai4040046","article-title":"From trustworthy principles to a trustworthy development process: The need and elements of trusted development of AI systems","volume":"4","author":"Hohma","year":"2023","journal-title":"AI"},{"issue":"9","key":"10.3233\/IDT-240366_ref76","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1038\/s42256-019-0088-2","article-title":"The global landscape of AI ethics guidelines","volume":"1","author":"Jobin","year":"2019","journal-title":"Nature Machine Intelligence"},{"issue":"9","key":"10.3233\/IDT-240366_ref77","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1038\/s42256-019-0088-2","article-title":"The global landscape of AI ethics guidelines","volume":"1","author":"Jobin","year":"2019","journal-title":"Nature Machine Intelligence"},{"key":"10.3233\/IDT-240366_ref78","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1007\/s00146-017-0781-9","article-title":"AI, agency and responsibility: The VW fraud case and beyond","volume":"34","author":"Johnson","year":"2019","journal-title":"Ai & Society"},{"issue":"2","key":"10.3233\/IDT-240366_ref80","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3491209","article-title":"Trustworthy artificial intelligence: A review","volume":"55","author":"Kaur","year":"2022","journal-title":"ACM Computing Surveys (CSUR)"},{"issue":"2","key":"10.3233\/IDT-240366_ref85","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1145\/1989098.1989101","article-title":"What does it mean to trust facebook? Examining technology and interpersonal trust beliefs","volume":"42","author":"Lankton","year":"2011","journal-title":"ACM SIGMIS Database: The Data Base for Advances in Information Systems"},{"issue":"9","key":"10.3233\/IDT-240366_ref86","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3555803","article-title":"Trustworthy AI: From principles to practices","volume":"55","author":"Li","year":"2023","journal-title":"ACM Computing Surveys"},{"issue":"1","key":"10.3233\/IDT-240366_ref88","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3546872","article-title":"Trustworthy ai: A computational perspective","volume":"14","author":"Liu","year":"2022","journal-title":"ACM Transactions on Intelligent Systems and Technology"},{"key":"10.3233\/IDT-240366_ref89","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.futures.2017.03.006","article-title":"The forthcoming Artificial Intelligence (AI) revolution: Its impact on society and firms","volume":"90","author":"Makridakis","year":"2017","journal-title":"Futures"},{"issue":"2","key":"10.3233\/IDT-240366_ref96","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1985347.1985353","article-title":"Trust in a specific technology: An investigation of its components and measures","volume":"2","author":"Mcknight","year":"2011","journal-title":"ACM Transactions on Management Information Systems (TMIS)"},{"issue":"11","key":"10.3233\/IDT-240366_ref102","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1038\/s42256-019-0114-4","article-title":"Principles alone cannot guarantee ethical AI","volume":"1","author":"Mittelstadt","year":"2019","journal-title":"Nature Machine Intelligence"},{"issue":"2","key":"10.3233\/IDT-240366_ref103","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1007\/s43681-022-00171-7","article-title":"Operationalising AI governance through ethics-based auditing: An industry case study","volume":"3","author":"M\u00f6kander","year":"2023","journal-title":"AI and Ethics"},{"issue":"3","key":"10.3233\/IDT-240366_ref104","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1109\/THMS.2022.3172516","article-title":"Editorial special issue interaction with artificial intelligence systems: New human-centered perspectives and challenges","volume":"52","author":"Monaro","year":"2022","journal-title":"IEEE Transactions on Human-Machine Systems"},{"issue":"4","key":"10.3233\/IDT-240366_ref105","doi-asserted-by":"crossref","first-page":"2141","DOI":"10.1007\/s11948-019-00165-5","article-title":"From what to how: An initial review of publicly available AI ethics tools, methods and research to translate principles into practices","volume":"26","author":"Morley","year":"2020","journal-title":"Science and Engineering Ethics"},{"key":"10.3233\/IDT-240366_ref107","doi-asserted-by":"publisher","DOI":"10.51593\/20220029"},{"issue":"6","key":"10.3233\/IDT-240366_ref119","doi-asserted-by":"crossref","first-page":"852","DOI":"10.1109\/TAI.2021.3133846","article-title":"Recent advances in trustworthy explainable artificial intelligence: Status, challenges, and perspectives","volume":"3","author":"Rawal","year":"2021","journal-title":"IEEE Transactions on Artificial Intelligence"},{"issue":"3","key":"10.3233\/IDT-240366_ref126","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1109\/MIS.2023.3268724","article-title":"Neurosymbolic artificial intelligence (why, what, and how)","volume":"38","author":"Sheth","year":"2023","journal-title":"IEEE Intelligent Systems"},{"issue":"6","key":"10.3233\/IDT-240366_ref127","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1080\/10447318.2020.1741118","article-title":"Human-centered artificial intelligence: Reliable, safe & trustworthy","volume":"36","author":"Shneiderman","year":"2020","journal-title":"International Journal of Human-Computer Interaction"},{"issue":"3","key":"10.3233\/IDT-240366_ref128","doi-asserted-by":"crossref","first-page":"109","DOI":"10.17705\/1thci.00131","article-title":"Human-centered artificial intelligence: Three fresh ideas","volume":"12","author":"Shneiderman","year":"2020","journal-title":"AIS Transactions on Human-Computer Interaction"},{"issue":"3","key":"10.3233\/IDT-240366_ref131","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1109\/MC.2023.3287563","article-title":"Human-centered trustworthy framework: A human-computer interaction perspective","volume":"57","author":"Sousa","year":"2024","journal-title":"Computer"},{"key":"10.3233\/IDT-240366_ref137","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1007\/s12525-020-00441-4","article-title":"Trustworthy artificial intelligence","volume":"31","author":"Thiebes","year":"2021","journal-title":"Electronic Markets"},{"issue":"4","key":"10.3233\/IDT-240366_ref145","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1145\/3328485","article-title":"Toward human-centered AI: A perspective from human-computer interaction","volume":"26","author":"Xu","year":"2019","journal-title":"Interactions"},{"key":"10.3233\/IDT-240366_ref146","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1109\/TTS.2021.3066209","article-title":"Z-Inspection: A process to assess trustworthy AI","volume":"2","author":"Zicari","year":"2021","journal-title":"IEEE Transactions on Technology and Society"}],"container-title":["Intelligent Decision Technologies"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/IDT-240366","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:24:01Z","timestamp":1777454641000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/IDT-240366"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,7]]},"references-count":38,"journal-issue":{"issue":"2"},"URL":"https:\/\/doi.org\/10.3233\/idt-240366","relation":{},"ISSN":["1872-4981","1875-8843"],"issn-type":[{"value":"1872-4981","type":"print"},{"value":"1875-8843","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,7]]}}}