{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,30]],"date-time":"2026-05-30T05:02:51Z","timestamp":1780117371548,"version":"3.54.0"},"reference-count":96,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T00:00:00Z","timestamp":1768953600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T00:00:00Z","timestamp":1768953600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Universidade Aberta"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Univ Access Inf Soc"],"published-print":{"date-parts":[[2026,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Chatbots are software applications that allow users to access information and services in various public administration fields. However, as chatbot technologies advance, only certain features meet the specific needs of the public sector, namely in the justice field and computer crime awareness. With a growing number of products available, careful evaluation is critical to determining which functionalities best support these requirements. By examining key characteristics and features, we intended to identify existing research gaps and enhance the design and evaluation of chatbots to increase their effectiveness and utility in the public sector, namely for computer crime awareness. Following the PRISMA-ScR guidelines for scoping reviews, relevant studies were identified in several digital library databases during April 2023. Of the 301 studies identified, 22 were included in the review. In addition to the\n                    <jats:italic>Architecture for Public Service Chatbots<\/jats:italic>\n                    guidelines, the findings revealed other key themes, including concepts influencing chatbot design, research methodologies shaping chatbot artefacts, technologies impacting chatbots, architectural frameworks, chatbot tool development, and methods in chatbot evaluation. The design and evaluation of public chatbots should account for ethical concerns, transparency, and fairness. Design Science Research was the methodology identified for developing chatbot artefacts. Deterministic, rule-based, and goal-oriented chatbots provide auditability, while cloud-based services and AI technologies offer security, scalability, and interoperability. There are external evaluation methods, such as user feedback, performance metrics, and usability. One of the principal areas of future research should prioritise the integration of AI and cloud computing in generative models, such as ChatGPT, with a focus on data protection and ethical considerations.\n                  <\/jats:p>","DOI":"10.1007\/s10209-025-01307-2","type":"journal-article","created":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T07:03:15Z","timestamp":1768978995000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["\u201cDesign and evaluation of public chatbots for computer crime awareness: A scoping review\u201d"],"prefix":"10.1007","volume":"25","author":[{"given":"Lu\u00eds","family":"Pimentel","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria do Ros\u00e1rio","family":"Matos Bernardo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"T\u00e2nia","family":"Rocha","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,1,21]]},"reference":[{"key":"1307_CR1","unstructured":"Hasan, I., Rizvi, S., Jain, S., Huria, S.: The AI enabled Chatbot framework for intelligent citizen-government interaction for delivery of services, In: 8th International Conference on Computing for Sustainable Global Development (INDIACom), Mar. 2021, pp. 601\u2013606. (2021)"},{"issue":"2","key":"1307_CR2","doi-asserted-by":"publisher","first-page":"358","DOI":"10.1016\/j.giq.2018.10.001","volume":"36","author":"A Androutsopoulou","year":"2019","unstructured":"Androutsopoulou, A., Karacapilidis, N., Loukis, E., Charalabidis, Y.: Transforming the communication between citizens and government through AI-guided chatbots. Gov. Inf. Q. 36(2), 358\u2013367 (2019). https:\/\/doi.org\/10.1016\/j.giq.2018.10.001","journal-title":"Gov. Inf. Q."},{"key":"1307_CR3","doi-asserted-by":"publisher","unstructured":"Tao, C., Longya, R., Xian, G.: AI innovation for advancing public service: the case of China\u2019s first administrative approval Bureau, In: ACM International Conference Proceeding Series, in dg.o 2019. New York, NY, USA: Association for Computing Machinery, pp. 100\u2013108. (2019). https:\/\/doi.org\/10.1145\/3325112.3325243","DOI":"10.1145\/3325112.3325243"},{"key":"1307_CR4","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/INFOTEH48170.2020.9066343","volume":"no March","author":"D Sivcevic","year":"2020","unstructured":"Sivcevic, D., Kosanin, I., Nedeljkovic, S., Nikolic, V., Kuk, K., Nogo, S.: Possibilities of used intelligence based agents in instant messaging on e-government services. In: 2020 19th Int. Symp. INFOTEH-JAHORINA INFOTEH 2020\u2014Proc. no March, 18\u201320 (2020). https:\/\/doi.org\/10.1109\/INFOTEH48170.2020.9066343","journal-title":"2020 19th Int. Symp. INFOTEH-JAHORINA INFOTEH 2020 - Proc."},{"key":"1307_CR5","doi-asserted-by":"publisher","unstructured":"Cantador, I., Viejo-Tard\u00edo, J., Cort\u00e9s-Cediel, M.E., Rodr\u00edguez Bol\u00edvar, M.P.: A chatbot for searching and exploring open data: Implementation and evaluation in E-Government. ACM Int. Conf. Proceeding Ser. 168\u2013179 (2021). https:\/\/doi.org\/10.1145\/3463677.3463681","DOI":"10.1145\/3463677.3463681"},{"key":"1307_CR6","doi-asserted-by":"publisher","DOI":"10.1080\/0960085X.2022.2096490","author":"P Vassilakopoulou","year":"2022","unstructured":"Vassilakopoulou, P., Haug, A., Salvesen, L.M., Pappas, I.O.: Developing human\/AI interactions for chat-based customer services: lessons learned from the Norwegian government. Eur. J. Inform. Syst. (2022). https:\/\/doi.org\/10.1080\/0960085X.2022.2096490","journal-title":"Eur. J. Inform. Syst."},{"key":"1307_CR7","doi-asserted-by":"publisher","DOI":"10.1080\/14719037.2022.2063935","author":"G Maragno","year":"2022","unstructured":"Maragno, G., Tangi, L., Gastaldi, L., Benedetti, M.: AI as an organizational agent to nurture: effectively introducing chatbots in public entities. Public. Manage. Rev. (2022). https:\/\/doi.org\/10.1080\/14719037.2022.2063935","journal-title":"Public. Manage. Rev."},{"key":"1307_CR8","doi-asserted-by":"publisher","first-page":"117893","DOI":"10.1016\/j.eswa.2022.117893","volume":"207","author":"J Yoo","year":"2022","unstructured":"Yoo, J., Cho, Y.: ICSA: Intelligent chatbot security assistant using Text-CNN and multi-phase real-time defense against SNS phishing attacks. Expert Syst. Appl. 207, 117893 (2022). https:\/\/doi.org\/10.1016\/j.eswa.2022.117893","journal-title":"Expert Syst. Appl."},{"key":"1307_CR9","doi-asserted-by":"publisher","unstructured":"Akkaya, C., Krcmar, H.: Potential use of digital assistants by governments for citizen services: the case of Germany, In: ACM International Conference Proceeding Series, in dg.o 2019. New York, NY, USA: Association for Computing Machinery, pp. 81\u201390. (2019). https:\/\/doi.org\/10.1145\/3325112.3325241","DOI":"10.1145\/3325112.3325241"},{"key":"1307_CR10","doi-asserted-by":"publisher","unstructured":"Di. Nazareno, A., De Melo, Monteiro, I.T.: Communication and Personality: How COVID-19 government chatbots express themselves, In: ACM International Conference Proceeding Series, in IHC \u201921. New York, NY, USA: Association for Computing Machinery, (2021). https:\/\/doi.org\/10.1145\/3472301.3484362","DOI":"10.1145\/3472301.3484362"},{"key":"1307_CR11","doi-asserted-by":"publisher","unstructured":"Stamatis, A., Gerontas, A., Dasyras, A., Tambouris, E.: Using chatbots and life events to provide public service information, In: ACM International Conference Proceeding Series, in ICEGOV \u201920. New York, NY, USA: Association for Computing Machinery, pp. 54\u201361. (2020). https:\/\/doi.org\/10.1145\/3428502.3428509","DOI":"10.1145\/3428502.3428509"},{"key":"1307_CR12","doi-asserted-by":"publisher","unstructured":"Beris, T., et al.: Towards a decentralized, trusted, intelligent and linked public sector: a report from the Greek trenches, In: The Web Conference\u2014Companion of the World Wide Web Conference, WWW 2019, in WWW \u201919. New York, NY, USA: Association for Computing Machinery, 2019, pp. 840\u2013849. (2019). https:\/\/doi.org\/10.1145\/3308560.3317077","DOI":"10.1145\/3308560.3317077"},{"issue":"3","key":"1307_CR13","doi-asserted-by":"publisher","first-page":"101714","DOI":"10.1016\/j.giq.2022.101714","volume":"39","author":"C van Noordt","year":"2022","unstructured":"van Noordt, C., Misuraca, G.: Artificial intelligence for the public sector: results of landscaping the use of AI in government across the European union. Gov. Inf. Q. 39(3), 101714 (2022). https:\/\/doi.org\/10.1016\/j.giq.2022.101714","journal-title":"Gov. Inf. Q."},{"key":"1307_CR14","doi-asserted-by":"publisher","unstructured":"van Noordt, C., Misuraca, G.: New wine in old bottles: chatbots in government: exploring the transformative impact of chatbots in public service delivery. In: Lecture Notes in Computer Science (including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11686, pp. 49\u201359. LNCS (2019). https:\/\/doi.org\/10.1007\/978-3-030-27397-2_5","DOI":"10.1007\/978-3-030-27397-2_5"},{"key":"1307_CR15","doi-asserted-by":"publisher","unstructured":"Pimentel, L., Bernardo, M.D.R.M., Rocha, T.: The role of chatbots in e-government: the awareness of computer crime in Portugal, In: 18th Iberian Conference on Information Systems and Technologies (CISTI), Jun. 2023, pp. 1\u20136. (2023). https:\/\/doi.org\/10.23919\/CISTI58278.2023.10212085","DOI":"10.23919\/CISTI58278.2023.10212085"},{"key":"1307_CR16","unstructured":"ARRS - Slovenian Research: Annual Report on Internal Security 2022. [Online]. (2022). Available: https:\/\/www.aris-rs.si\/en\/gradivo\/dokum\/inc\/23\/LP-ARRS-2022-eng.pdf"},{"key":"1307_CR17","unstructured":"National Cyber Security Centre (NCSC): Cybersecurity in Portugal\u2014risks and conflicts Report\u20143rd Edition., 2022. [Online]. Available: https:\/\/www.cncs.gov.pt\/docs\/relatorio-riscosconflitos2022-obciber-cncs.pdf"},{"key":"1307_CR18","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1080\/tam.5.1.1.37","volume":"11","author":"A Kalache","year":"2003","unstructured":"Kalache, A., Gatti, A.: Active ageing: A policy framework. Adv. Gerontol. = Uspekhi gerontologii \/ Rossiiskaia Akademiia nauk. Gerontologicheskoe Obshchestvo. 11, 7\u201318 (2003). https:\/\/doi.org\/10.1080\/tam.5.1.1.37","journal-title":"Adv. Gerontol. = Uspekhi gerontologii \/ Rossiiskaia Akademiia nauk. Gerontologicheskoe Obshchestvo"},{"issue":"4","key":"1307_CR19","doi-asserted-by":"publisher","first-page":"906","DOI":"10.1093\/bjsw\/bcy037","volume":"48","author":"LA Fenge","year":"2018","unstructured":"Fenge, L.A., Lee, S.: Understanding the risks of financial scams as part of elder abuse prevention. Br. J. Soc. Work. 48(4), 906\u2013923 (2018). https:\/\/doi.org\/10.1093\/bjsw\/bcy037","journal-title":"Br. J. Soc. Work"},{"issue":"3","key":"1307_CR20","doi-asserted-by":"publisher","first-page":"324","DOI":"10.1108\/JFC-03-2013-0014","volume":"20","author":"MD Reisig","year":"2013","unstructured":"Reisig, M.D., Holtfreter, K.: Shopping fraud victimization among the elderly. J. Financ. Crime. 20(3), 324\u2013337 (2013). https:\/\/doi.org\/10.1108\/JFC-03-2013-0014","journal-title":"J. Financ Crime."},{"key":"1307_CR21","doi-asserted-by":"publisher","unstructured":"Burnes, D., Henderson, C.R., Sheppard, C., Zhao, R., Pillemer, K., Lachs, M.S.: Prevalence of financial fraud and scams among older adults in the united states: a systematic review and Meta-Analysis. American J. Pub. Health. 107(8), e13\u2013e21 (2017). https:\/\/doi.org\/10.2105\/AJPH.2017.303821","DOI":"10.2105\/AJPH.2017.303821"},{"key":"1307_CR22","doi-asserted-by":"publisher","unstructured":"Leukfeldt, R., Edward, E.R., Kleemans: Cybercrime, money mules and situational crime prevention. In: Rutger Leukfeldt, E.R. (Edward) Kleemans (eds.) Criminal Networks and Law Enforcement. Routledge. pp. 75\u201389, (2019). https:\/\/doi.org\/10.4324\/9781351176194-5","DOI":"10.4324\/9781351176194-5"},{"key":"1307_CR23","doi-asserted-by":"publisher","unstructured":"Oliveira, D., et al.: Dissecting spear phishing emails for older vs young adults: on the interplay of weapons of influence and life domains in predicting susceptibility to phishing, (2017). https:\/\/doi.org\/10.1145\/10.1145\/3025453.3025831","DOI":"10.1145\/10.1145\/3025453.3025831"},{"key":"1307_CR24","doi-asserted-by":"publisher","first-page":"24","DOI":"10.2174\/1745017902016010024","volume":"16","author":"A Coluccia","year":"2020","unstructured":"Coluccia, A., Pozza, A., Ferretti, F., Carabellese, F., Masti, A., Gualtieri, G.: Online romance scams: relational dynamics and psychological characteristics of the victims and scammers. A scoping review. Clin. Pract. Epidemiol. Ment Health. 16, 24\u201335 (2020). https:\/\/doi.org\/10.2174\/1745017902016010024","journal-title":"Clin. Pract. Epidemiol. Ment Health"},{"key":"1307_CR25","doi-asserted-by":"publisher","unstructured":"Huang, J.M., Stringhini, G., Yong, P.: Quit playing games with my heart: understanding online dating scams, In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9148, no. June, pp. 216\u2013236, (2015). https:\/\/doi.org\/10.1007\/978-3-319-20550-2_12","DOI":"10.1007\/978-3-319-20550-2_12"},{"key":"1307_CR26","doi-asserted-by":"publisher","first-page":"100398","DOI":"10.1016\/j.dcm.2020.100398","volume":"35","author":"P Anesa","year":"2020","unstructured":"Anesa, P.: Lovextortion: Persuasion strategies in romance cybercrime. Discourse Context Media. 35, 100398 (2020). https:\/\/doi.org\/10.1016\/j.dcm.2020.100398","journal-title":"Discourse Context Media"},{"key":"1307_CR27","doi-asserted-by":"publisher","unstructured":"Osakwe, J., Mutelo, S., Shilamba, M.: Artificial Intelligence: a veritable tool for governance in developing countries, In: 3rd International Multidisciplinary Information Technology and Engineering Conference (IMITEC), 2021, pp. 1\u20136. (2021). https:\/\/doi.org\/10.1109\/IMITEC52926.2021.9714584","DOI":"10.1109\/IMITEC52926.2021.9714584"},{"key":"1307_CR28","unstructured":"Kumar, Mukund, A.: Review of select innovations and emerging trends in E-Governance. Int. J. Res. Eng. Sci. Manage., 3, 8, 65\u201368 (2020)"},{"issue":"3","key":"1307_CR29","doi-asserted-by":"publisher","first-page":"101577","DOI":"10.1016\/j.giq.2021.101577","volume":"38","author":"A Zuiderwijk","year":"2021","unstructured":"Zuiderwijk, A., Chen, Y.-C., Salem, F.: Implications of the use of artificial intelligence in public governance: a systematic literature review and a research agenda. Gov. Inf. Q. 38(3), 101577 (2021). https:\/\/doi.org\/10.1016\/j.giq.2021.101577","journal-title":"Gov. Inf. Q."},{"key":"1307_CR30","first-page":"3830","volume":"05","author":"S Khokhawat","year":"2021","unstructured":"Khokhawat, S., Jain, I., Shekhar, G., Choudhary, S., Narooka, P.: Efficient chatbot for crime awareness system. Int. Res. J. Modernization Eng. Technol. Sci. no. 05, 3830\u20133835 (2021)","journal-title":"Int. Res. J. Modernization Eng. Technol. Sci."},{"key":"1307_CR31","unstructured":"Hamad, S., Yeferny, T.: A chatbot for information security, In: IJCSNS International Journal of Computer Science and Network Security, vol. 20, no. 4, pp. 287\u2013291, [Online]. (2020). Available: https:\/\/arxiv.org\/abs\/2012.00826"},{"key":"1307_CR32","unstructured":"Hari Prasad, D., Vijayakumar, V.: Intelligent chatbot development for text based cyberbullying prevention. Int. J. New. Innovations Eng. Technol.  17(1), 73\u201381. (2021)"},{"key":"1307_CR33","unstructured":"Budiman, M.A., Aminanto, M.E.: Use of intelligence based agents to deal with cyber crime. Budapest Int. Res. Critics Instit. (BIRCI-Journal). 5(1), 3679\u20133685. (2022)"},{"issue":"22","key":"1307_CR34","doi-asserted-by":"publisher","first-page":"26","DOI":"10.5120\/ijca2020920743","volume":"175","author":"S Srivastava","year":"2020","unstructured":"Srivastava, S., Srivastava, K., Arora, N.: Exploration of a solution-centric crime awareness tool. Int. J. Comput. Appl. no. 175(22), 26\u201332 (2020). https:\/\/doi.org\/10.5120\/ijca2020920743","journal-title":"Int. J. Comput. Appl."},{"key":"1307_CR35","doi-asserted-by":"publisher","unstructured":"Hajal, G.E., Abi Zeid, R., Daou, Ducq, Y.: Human firewall: cyber awareness using WhatApp AI Chatbot, In: IEEE 3rd International Multidisciplinary Conference on Engineering Technology (IMCET), 2021, pp. 66\u201370. (2021). https:\/\/doi.org\/10.1109\/IMCET53404.2021.9665642","DOI":"10.1109\/IMCET53404.2021.9665642"},{"key":"1307_CR36","doi-asserted-by":"crossref","unstructured":"Banire, B., Thani, D.A., Yang, Y.: Addressing cyber security accessibility: a qualitative study, In: 34th British HCI Workshop and Doctoral Consortium 34, pp. 1\u20135. (2021)","DOI":"10.14236\/ewic\/HCI2021-W5.2"},{"key":"1307_CR37","doi-asserted-by":"crossref","unstructured":"He, J., Xin, C.: Developing an AI-powered chatbot to support the administration of middle and high school cybersecurity camps. J Cybersec Educat., Res Pract. 1, 6. (2021)","DOI":"10.62915\/2472-2707.1077"},{"key":"1307_CR38","doi-asserted-by":"publisher","unstructured":"Rita, M.N., Shava, F.B.: Chatbot driven web-based platform for online safety and sexual exploitation awareness and reporting in Namibia, In: icABCD 2021\u20134th International Conference on Artificial Intelligence, Big Data, Computing and Data Communication Systems, Proceedings, pp. 1\u20135. (2021). https:\/\/doi.org\/10.1109\/icABCD51485.2021.9519375","DOI":"10.1109\/icABCD51485.2021.9519375"},{"key":"1307_CR39","doi-asserted-by":"publisher","unstructured":"Piccolo, L.S.G., Troullinou, P., Alani, H.: Chatbots to Support Children in Coping with Online Threats: Socio-technical Requirements, In: DIS 2021 - Proceedings of the 2021 ACM Designing Interactive Systems Conference: Nowhere and Everywhere, in DIS \u201921. New York, NY, USA: Association for Computing Machinery, pp. 1504\u20131517. (2021). https:\/\/doi.org\/10.1145\/3461778.3462114","DOI":"10.1145\/3461778.3462114"},{"key":"1307_CR40","doi-asserted-by":"publisher","unstructured":"Laorden, C., Gal\u00e1n-Garc\u00eda, P., Santos, I., Sanz, B., Hidalgo, J.M.G., Bringas, P.G.: Negobot: A conversational agent based on game theory for the detection of paedophile behaviour, In: Advances in Intelligent Systems and Computing, vol. 189 AISC, pp. 261\u2013270. (2013). https:\/\/doi.org\/10.1007\/978-3-642-33018-6_27","DOI":"10.1007\/978-3-642-33018-6_27"},{"key":"1307_CR41","doi-asserted-by":"publisher","unstructured":"Murcia Trivi\u00f1o, J., Moreno Rodr\u00edguez, S., D\u00edaz L\u00f3pez, D.O., G\u00f3mez M\u00e1rmol, F.: C3-Sex: a Chatbot to Chase Cyber Perverts, In: IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC\/PiCom\/CBDCom\/CyberSciTech), 2019, pp. 50\u201357. (2019). https:\/\/doi.org\/10.1109\/DASC\/PiCom\/CBDCom\/CyberSciTech.2019.00024","DOI":"10.1109\/DASC\/PiCom\/CBDCom\/CyberSciTech.2019.00024"},{"key":"1307_CR42","doi-asserted-by":"publisher","unstructured":"Nirala, K.K., Singh, N.K., Purani, V.S.: A survey on providing customer and public administration based services using AI: Chatbot. Multimed. Tools Appl. 81(16), 22215\u201322246 (2022). https:\/\/doi.org\/10.1007\/s11042-021-11458-y","DOI":"10.1007\/s11042-021-11458-y"},{"key":"1307_CR43","doi-asserted-by":"publisher","first-page":"100006","DOI":"10.1016\/j.mlwa.2020.100006","volume":"2","author":"E Adamopoulou","year":"2020","unstructured":"Adamopoulou, E., Moussiades, L.: Chatbots: History, technology, and applications. Mach. Learn. Appl. no. 2, 100006 (2020). https:\/\/doi.org\/10.1016\/j.mlwa.2020.100006 July","journal-title":"Mach. Learn. Appl."},{"key":"1307_CR44","doi-asserted-by":"publisher","first-page":"100139","DOI":"10.1016\/j.chbr.2021.100139","volume":"4","author":"A Manzoor","year":"2021","unstructured":"Manzoor, A., Jannach, D.: Conversational recommendation based on end-to-end learning: how far are we? Computers Hum. Behav. Rep. no. 4, 100139 (2021). https:\/\/doi.org\/10.1016\/j.chbr.2021.100139","journal-title":"Computers Hum. Behav. Rep."},{"key":"1307_CR45","unstructured":"OpenAI, C.G.P.T.: Accessed: Apr. 23, 2023. [Online]. Available: https:\/\/chatgpt.com\/gpts"},{"key":"1307_CR46","unstructured":"M. S. Do Ros\u00e1rio Valverde and A. F. F. Couto e Vasconcelos, chatbot in the online provision of government services. In: Atas Da Conferencia Da Associa\u00e7\u00e3o Portuguesa De Sistemas De Informa\u00e7\u00e3o, (2019)"},{"key":"1307_CR47","doi-asserted-by":"publisher","unstructured":"Susar, D., Aquaro, V.: Artificial intelligence: opportunities and challenges for the public sector, In: ACM International Conference Proceeding Series, in ICEGOV \u201919, vol. Part F1481. New York, NY, USA: Association for Computing Machinery, pp. 418\u2013426. (2019). https:\/\/doi.org\/10.1145\/3326365.3326420","DOI":"10.1145\/3326365.3326420"},{"issue":"3","key":"1307_CR48","doi-asserted-by":"publisher","first-page":"45","DOI":"10.2753\/MIS0742-1222240302","volume":"24","author":"K Peffers","year":"2007","unstructured":"Peffers, K., Tuunanen, T., Rothenberger, M.A., Chatterjee, S.: A design science research methodology for information systems research. J. Manage. Inform. Syst. 24(3), 45\u201377 (2007). https:\/\/doi.org\/10.2753\/MIS0742-1222240302","journal-title":"J. Manage. Inform. Syst."},{"key":"1307_CR49","unstructured":"Kitchenham Stuart, C.: Guidelines for performing systematic literature reviews in software engineering, In: Technical report, Ver. 2.3 EBSE Technical Report. EBSE, vol. 1, no. January pp. 1\u201354, 2007. (2007)"},{"key":"1307_CR50","doi-asserted-by":"publisher","first-page":"467","DOI":"10.7326\/M18-0850","volume":"169","author":"AC Tricco","year":"2018","unstructured":"Tricco, A.C., et al.: PRISMA extension for scoping reviews (PRISMA-ScR): Checklist and explanation. Ann. Intern. Med. no. 169, 467\u2013473 (2018). https:\/\/doi.org\/10.7326\/M18-0850","journal-title":"Ann. Intern. Med."},{"key":"1307_CR51","doi-asserted-by":"publisher","unstructured":"Pimentel, L., do Ros\u00e1rio, M., Bernardo, Rocha, T.: The implementation of public chatbots to raise awareness of computer crime. Int. J. Hum. Comput. Interact. 1\u201323 (2025). https:\/\/doi.org\/10.1080\/10447318.2025.2508302","DOI":"10.1080\/10447318.2025.2508302"},{"key":"1307_CR52","doi-asserted-by":"publisher","first-page":"8474","DOI":"10.1109\/ACCESS.2022.3143323","volume":"10","author":"GA Santos","year":"2022","unstructured":"Santos, G.A., de Andrade, G.G., Silva, G.R.S., Duarte, F.C.M., Da Costa, J.P.J., de Sousa, R.T.: A conversation-driven approach for chatbot management. IEEE Access. 10, 8474\u20138486 (2022). https:\/\/doi.org\/10.1109\/ACCESS.2022.3143323","journal-title":"IEEE Access."},{"key":"1307_CR53","unstructured":"Kumar, R., Ali, M.M.: A review on chatbot design and implementation techniques. Int Res J Eng Technol (IRJET). 7(11), 2791\u20132800. (2020)"},{"issue":"16","key":"1307_CR54","doi-asserted-by":"publisher","first-page":"22215","DOI":"10.1007\/s11042-021-11458-y","volume":"81","author":"KK Nirala","year":"2022","unstructured":"Nirala, K.K., Singh, N.K., Purani, V.S.: A survey on providing customer and public administration based services using AI: Chatbot. Multimed. Tools Appl. 81(16), 22215\u201322246 (2022). https:\/\/doi.org\/10.1007\/s11042-021-11458-y","journal-title":"Multimed Tools Appl."},{"key":"1307_CR55","unstructured":"Lommatzsch,A., Katins, J. : An information retrieval-based approach for building intuitive chatbots for large knowledge bases, in Lernen, Wissen, Daten, Analysen (LWDA 2019), CEUR Workshop Proceedings, vol. 2454, pp. 343\u2013352 (2019)."},{"key":"1307_CR56","doi-asserted-by":"publisher","first-page":"e6426","DOI":"10.1002\/cpe.6426","volume":"33","author":"M Hasal","year":"2021","unstructured":"Hasal, M., Nowakov\u00e1, J., Saghair, K.A., Abdulla, H., Sn\u00e1\u0161el, V., Ogiela, L.: Chatbots: security, privacy, data protection, and social aspects. Concurr. Comput. no. 33, e6426 (2021). https:\/\/doi.org\/10.1002\/cpe.6426","journal-title":"Concurr Comput."},{"key":"1307_CR57","first-page":"399","volume":"VIII","author":"J Reis","year":"2023","unstructured":"Reis, J., Melao, N.: Artificial Intelligence, politics and state modernization. Proelium. VIII, 399\u2013432 (2023)","journal-title":"Proelium"},{"key":"1307_CR58","doi-asserted-by":"publisher","unstructured":"Mohammad Forkan, A.R., Prakash Jayaraman, P., Kang, Y.-B., Morshed, A.: ECHO: A tool for empirical evaluation cloud chatbots, In: 2020 20th IEEE\/ACM International Symposium on Cluster, Cloud and Internet Computing (CCGRID), May pp. 669\u2013672. (2020). https:\/\/doi.org\/10.1109\/CCGrid49817.2020.00-26","DOI":"10.1109\/CCGrid49817.2020.00-26"},{"key":"1307_CR59","doi-asserted-by":"publisher","unstructured":"Bang, J., Kim, S., Nam, J.W., Yang, D.G.: Ethical Chatbot Design for Reducing Negative Effects of Biased Data and Unethical Conversations. In: International Conference on Platform Technology and Service, PlatCon 2021 - Proceedings, 2021. (2021). https:\/\/doi.org\/10.1109\/PlatCon53246.2021.9680760","DOI":"10.1109\/PlatCon53246.2021.9680760"},{"key":"1307_CR60","doi-asserted-by":"publisher","unstructured":"de Lacerda, A.R.T., Aguiar, C.S.R.: FLOSS FAQ Chatbot Project Reuse: How to Allow Nonexperts to Develop a Chatbot. In: Proceedings of the 15th International Symposium on Open Collaboration, in OpenSym \u201919. New York, NY, USA: Association for Computing Machinery, (2019). https:\/\/doi.org\/10.1145\/3306446.3340823","DOI":"10.1145\/3306446.3340823"},{"key":"1307_CR61","doi-asserted-by":"publisher","unstructured":"H\u00f6hn, S., Bongard-Blanchy, K.: Heuristic Evaluation of COVID-19 Chatbots. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Feb. pp. 131\u2013144. (2021). https:\/\/doi.org\/10.1007\/978-3-030-68288-0_9","DOI":"10.1007\/978-3-030-68288-0_9"},{"key":"1307_CR62","doi-asserted-by":"publisher","DOI":"10.54941\/ahfe1001712","author":"M Vanhauer","year":"2022","unstructured":"Vanhauer, M., Raimer, S.: Heuristic evaluation of public service chatbots. Usability User Experience. no. (2022). https:\/\/doi.org\/10.54941\/ahfe1001712","journal-title":"Usability User Experience"},{"key":"1307_CR63","doi-asserted-by":"publisher","unstructured":"Pollini, A., Caforio, A.: Participation and iterative experiments: designing alternative futures with migrants and service providers. Soc. Sci. 10(10) (2021). https:\/\/doi.org\/10.3390\/socsci10100363","DOI":"10.3390\/socsci10100363"},{"key":"1307_CR64","doi-asserted-by":"publisher","unstructured":"Antoniadis, P., Tambouris, E.: PassBot: A Chatbot for Providing Information on Getting a Greek Passport, In: Proceedings of the 14th International Conference on Theory and Practice of Electronic Governance, in ICEGOV \u201921. New York, NY, USA: Association for Computing Machinery, pp. 292\u2013297. (2022). https:\/\/doi.org\/10.1145\/3494193.3494233","DOI":"10.1145\/3494193.3494233"},{"key":"1307_CR65","doi-asserted-by":"publisher","unstructured":"Hevner, A., Storey, V.: Research challenges for the design of human-artificial intelligence systems (HAIS). ACM Trans. Manage. Inf. Syst. 14(1). ( 2023). https:\/\/doi.org\/10.1145\/3549547","DOI":"10.1145\/3549547"},{"key":"1307_CR66","first-page":"26","volume":"18","author":"D-M Park","year":"2022","unstructured":"Park, D.-M., Jeong, S.-S., Seo, Y.-S.: Systematic review on chatbot techniques and applications. J. Inf. Process. Syst. 18, 26\u201347. (2022)","journal-title":"J. Inf. Process. Syst."},{"key":"1307_CR67","doi-asserted-by":"publisher","unstructured":"Wilson, L., Marasoiu, M.: The Development and use of chatbots in public health: scoping review. JMIR Hum. Factors.  9(4), e35882. (2022). https:\/\/doi.org\/10.2196\/35882","DOI":"10.2196\/35882"},{"key":"1307_CR68","doi-asserted-by":"publisher","unstructured":"Damij, N., Bhattacharya, S.: The Role of AI Chatbots in Mental Health Related Public Services in a (Post)Pandemic World: A Review and Future Research Agenda, In: IEEE Technology and Engineering Management Conference (TEMSCON EUROPE), Apr. 2022, pp. 152\u2013159. (2022). https:\/\/doi.org\/10.1109\/TEMSCONEUROPE54743.2022.9801962","DOI":"10.1109\/TEMSCONEUROPE54743.2022.9801962"},{"key":"1307_CR69","doi-asserted-by":"publisher","unstructured":"Gerontas, A.: Towards an E-Government Semantic Interoperability Assessment Framework, In: Proceedings of the 13th International Conference on Theory and Practice of Electronic Governance, in ICEGOV \u201920. New York, NY, USA: Association for Computing Machinery, pp. 767\u2013774. (2020). https:\/\/doi.org\/10.1145\/3428502.3428617","DOI":"10.1145\/3428502.3428617"},{"key":"1307_CR70","doi-asserted-by":"publisher","unstructured":"Tambouris, E., Tarabanis, K.: Towards Inclusive Integrated Public Service (IPS) Co-Creation and Provision, In: DG.O2021: The 22nd Annual International Conference on Digital Government Research, in DG.O\u201921. New York, NY, USA: Association for Computing Machinery, pp. 458\u2013462. (2021). https:\/\/doi.org\/10.1145\/3463677.3463726","DOI":"10.1145\/3463677.3463726"},{"key":"1307_CR71","doi-asserted-by":"publisher","first-page":"15332","DOI":"10.1109\/ACCESS.2020.2966919","volume":"8","author":"G Daniel","year":"2020","unstructured":"Daniel, G., Cabot, J., Deruelle, L., Derras, M.: Xatkit: A multimodal Low-Code chatbot development framework. IEEE Access. 8, 15332\u201315346 (2020). https:\/\/doi.org\/10.1109\/ACCESS.2020.2966919","journal-title":"IEEE Access."},{"key":"1307_CR72","unstructured":"European Commission: Architecture for public service chatbots (ISA2 Program), Directorate-General for Informatics, Accessed: Feb. 25, 2023. [Online]. (2019). Available: https:\/\/joinup.ec.europa.eu\/sites\/default\/files\/news\/2019-09\/ISA2_Architecture for public service chatbots.pdf"},{"key":"1307_CR73","unstructured":"Tambouris, E: Using chatbots and semantics to exploit public sector information, in Proc. EGOV-CeDEM-ePart 2018, Danube University Krems, Austria, pp. 125-132 (2018). ,."},{"key":"1307_CR74","doi-asserted-by":"publisher","unstructured":"de Andrade, G.G., Silva, G.R.S., J\u00fanior, F.C.M.D., Santos, G.A., de Mendon\u00e7a, F.L.L., de Sousa, R.T.: EvaTalk: A chatbot system for the brazilian government virtual school, In: ICEIS 2020\u2014Proceedings of the 22nd International Conference on Enterprise Information Systems, pp. 556\u2013562. (2020). https:\/\/doi.org\/10.5220\/0009418605560562","DOI":"10.5220\/0009418605560562"},{"key":"1307_CR75","doi-asserted-by":"publisher","first-page":"75","DOI":"10.2307\/25148625","volume":"28","author":"A Hevner","year":"2004","unstructured":"Hevner, A., et al.: Design science in information systems research. Manage. Inform. Syst. Q. 28, 75\u2013105 (2004)","journal-title":"Manage. Inform. Syst. Q."},{"issue":"3","key":"1307_CR76","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1006\/imms.1993.1022","volume":"38","author":"FD Davis","year":"1993","unstructured":"Davis, F.D.: User acceptance of information technology: system characteristics, user perceptions and behavioral impacts. Int. J. Man. Mach. Stud. 38(3), 475\u2013487 (1993). https:\/\/doi.org\/10.1006\/imms.1993.1022","journal-title":"Int. J. Man. Mach. Stud."},{"key":"1307_CR77","unstructured":"European Commission: Core Public Service Vocabulary (CPSV), Accessed: Feb. 25, 2023. [Online]. (2013). Available: https:\/\/joinup.ec.europa.eu\/collection\/semantic-interoperability-community-semic\/solution\/core-public-service-vocabulary"},{"key":"1307_CR78","unstructured":"European Commission, The European cloud strategy, no: pp. 6\u20138. [Online]. (2019). Available: https:\/\/ec.europa.eu\/info\/publications\/european-commission-cloud-strategy_en"},{"key":"1307_CR79","doi-asserted-by":"crossref","unstructured":"Sedoc, J., Ippolito, D., Kirubarajan, A., Thirani, J., Ungar, L., Callison-Burch, C.: ChatEval: A Tool for Chatbot Evaluation, In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics (Demonstrations), Association for Computational Linguistics, 2019, pp. 60\u201365. [Online]. Available: (2019). http:\/\/aclweb.org\/anthology\/N19-4011","DOI":"10.18653\/v1\/N19-4011"},{"key":"1307_CR80","unstructured":"Peras, D.: \u00a9, In: Economic and Social Development: Book of Proceedings, pp. 89\u201397, (2018)"},{"issue":"6","key":"1307_CR81","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1080\/10447310802205776","volume":"24","author":"A Bangor","year":"2008","unstructured":"Bangor, A., Kortum, P.T., Miller, J.T.: An empirical evaluation of the system usability scale. Int. J. Hum. Comput. Interact. 24(6), 574\u2013594 (2008). https:\/\/doi.org\/10.1080\/10447310802205776","journal-title":"Int. J. Hum. Comput. Interact."},{"key":"1307_CR82","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1016\/j.procs.2015.09.273","volume":"67","author":"AI Martins","year":"2015","unstructured":"Martins, A.I., Rosa, A.F., Queir\u00f3s, A., Silva, A., Rocha, N.P.: European Portuguese validation of the system usability scale (SUS). Procedia Comput. Sci. 67, 293\u2013300 (2015). https:\/\/doi.org\/10.1016\/j.procs.2015.09.273","journal-title":"Procedia Comput. Sci."},{"key":"1307_CR83","unstructured":"Russell-rose, T.: A Framework for chatbot evaluation\u2014DZone. Accessed: May 21, 2023. [Online]. Available: https:\/\/dzone.com\/articles\/a-framework-for-chatbot-evaluation"},{"key":"1307_CR84","doi-asserted-by":"crossref","unstructured":"Walker, M.A., Litman, D.J., Kamm, C.A., Abella, A.: Paradise: a framework for evaluating spoken dialogue agents, CoRR, vol. cmp-lg\/9704004, 1997, [Online]. Available: http:\/\/arxiv.org\/abs\/cmp-lg\/9704004","DOI":"10.3115\/979617.979652"},{"key":"1307_CR85","doi-asserted-by":"publisher","unstructured":"Papineni, K., Roukos, S., Ward, T., Zhu, W.-J.: BLEU: A Method for Automatic Evaluation of Machine Translation, In: Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, in ACL \u201902. USA: Association for Computational Linguistics, pp. 311\u2013318. (2002). https:\/\/doi.org\/10.3115\/1073083.1073135","DOI":"10.3115\/1073083.1073135"},{"key":"1307_CR86","doi-asserted-by":"publisher","unstructured":"Shawar, B.A., Atwell, E.: Different measurements metrics to evaluate a chatbot system, In: Conference: Proceedings of the NAACL\u201907 Workshop: Bridging the Gap: Academic and Industrial Research in Dialog Technologies, pp. 89\u201396. (2007). https:\/\/doi.org\/10.3115\/1556328.1556341","DOI":"10.3115\/1556328.1556341"},{"key":"1307_CR87","doi-asserted-by":"publisher","first-page":"268","DOI":"10.1007\/978-3-319-39510-4_25","volume-title":"Human-Computer Interaction. Theory, Design, Development and Practice","author":"N Bevan","year":"2016","unstructured":"Bevan, N., Carter, J., Earthy, J., Geis, T., Harker, S.: New ISO standards for usability, usability reports and usability measures. In: Kurosu, M. (ed.) in human-computer interaction. Theory, design, development and practice, pp. 268\u2013278. Springer International Publishing, Cham (2016)"},{"key":"1307_CR88","unstructured":"Usability.gov, System Usability Scale (SUS). [Online]. Available: https:\/\/www.usability.gov\/how-to-and-tools\/methods\/system-usability-scale.html"},{"key":"1307_CR89","unstructured":"Brooke, J.: SUS: a retrospective, J. Usability Studies. 8(2), 29\u201340. (2013)"},{"key":"1307_CR90","unstructured":"Creswell, J.W., Creswell, J.D.: Research Defign: Qualitative, Quantitative, and Mixed M ethods Approaches. Sage publications, Washington. (2018)"},{"key":"1307_CR91","doi-asserted-by":"publisher","unstructured":"Jain, M., Kumar, P., Kota, R., Patel, S.N.: Evaluating and informing the design of chatbots, In: DIS\u2014Proceedings of the 2018 Designing Interactive Systems Conference, pp. 895\u2013906, 2018, (2018). https:\/\/doi.org\/10.1145\/3196709.3196735","DOI":"10.1145\/3196709.3196735"},{"key":"1307_CR92","doi-asserted-by":"publisher","unstructured":"Makasi, T., Nili, A., Desouza, K., Tate, M.: Chatbot-mediated public service delivery: a public service value-based framework. First Monday. 25(12) (2020). https:\/\/doi.org\/10.5210\/fm.v25i12.10598","DOI":"10.5210\/fm.v25i12.10598"},{"key":"1307_CR93","doi-asserted-by":"publisher","unstructured":"Antoniadis, P., Tambouris, E.: PassBot: a chatbot for providing information on Getting a Greek Passport, In: ACM International Conference Proceeding Series, in ICEGOV \u201921. New York, NY, USA: Association for Computing Machinery, pp. 292\u2013297. (2021). https:\/\/doi.org\/10.1145\/3494193.3494233","DOI":"10.1145\/3494193.3494233"},{"key":"1307_CR94","doi-asserted-by":"publisher","unstructured":"Davis, F.D.: Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. 13(3), 319\u2013340. (1989). https:\/\/doi.org\/10.2307\/249008","DOI":"10.2307\/249008"},{"key":"1307_CR95","doi-asserted-by":"publisher","unstructured":"Segura-Tinoco, A., Holgado-S\u00e1nchez, A., Cantador, I., Cort\u00e9s-Cediel, M.E., Rodr\u00edguez Bol\u00edvar, M.P.: A Conversational agent for argument-driven E-participation, In: ACM International Conference Proceeding Series, in dg.o 2022. New York, NY, USA: Association for Computing Machinery, pp. 191\u2013205. (2022). https:\/\/doi.org\/10.1145\/3543434.3543447","DOI":"10.1145\/3543434.3543447"},{"key":"1307_CR96","doi-asserted-by":"publisher","unstructured":"Boone, H.N., Boone, D.A.: Analyzing likert data. J. Ext. 50(2) (2012). https:\/\/doi.org\/10.34068\/joe.50.02.48","DOI":"10.34068\/joe.50.02.48"}],"container-title":["Universal Access in the Information Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10209-025-01307-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10209-025-01307-2","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10209-025-01307-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,30]],"date-time":"2026-05-30T04:53:54Z","timestamp":1780116834000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10209-025-01307-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,21]]},"references-count":96,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2026,6]]}},"alternative-id":["1307"],"URL":"https:\/\/doi.org\/10.1007\/s10209-025-01307-2","relation":{},"ISSN":["1615-5289","1615-5297"],"issn-type":[{"value":"1615-5289","type":"print"},{"value":"1615-5297","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,21]]},"assertion":[{"value":"21 October 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 December 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 January 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"39"}}