{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T22:39:14Z","timestamp":1776206354450,"version":"3.50.1"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2023,6,1]],"date-time":"2023-06-01T00:00:00Z","timestamp":1685577600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,6,1]],"date-time":"2023-06-01T00:00:00Z","timestamp":1685577600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["V00784X\/1"],"award-info":[{"award-number":["V00784X\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/S035362\/1"],"award-info":[{"award-number":["EP\/S035362\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Pers Ubiquit Comput"],"published-print":{"date-parts":[[2023,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Chatbot-based tools are becoming pervasive in multiple domains from commercial websites to rehabilitation applications. Only recently, an eleven-item satisfaction inventory was developed (the ChatBot Usability Scale, BUS-11) to help designers in the assessment process of their systems. The BUS-11 has been validated in multiple contexts and languages, i.e., English, German, Dutch, and Spanish. This scale forms a solid platform enabling designers to rapidly assess chatbots both during and after the design process. The present work aims to adapt and validate the BUS-11 inventory in Italian. A total of 1360 questionnaires were collected which related to a total of 10 Italian chatbot-based systems using the BUS-11 inventory and also using the lite version of the Usability Metrics for User eXperience for convergent validity purposes. The Italian version of the BUS-11 was adapted in terms of the wording of one item, and a Multi-Group Confirmatory Factorial Analysis was performed to establish the factorial structure of the scale and compare the effects of the wording adaptation. Results indicate that the adapted Italian version of the scale matches the expected factorial structure of the original scale. The Italian BUS-11 is highly reliable (Cronbach alpha: 0.921), and it correlates to other measures of satisfaction (e.g., UMUX-Lite, \u03c4b\u2009=\u20090.67; <jats:italic>p<\/jats:italic>\u2009&lt;\u2009.001) by also offering specific insights regarding the chatbots\u2019 characteristics. The Italian BUS-11 can be confidently used by chatbot designers to assess the satisfaction of their users during formative or summative tests.<\/jats:p>","DOI":"10.1007\/s00779-023-01731-2","type":"journal-article","created":{"date-parts":[[2023,6,1]],"date-time":"2023-06-01T08:02:33Z","timestamp":1685606553000},"page":"2161-2170","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Ciao AI: the Italian adaptation and validation of the Chatbot Usability Scale"],"prefix":"10.1007","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3591-3577","authenticated-orcid":false,"given":"Simone","family":"Borsci","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3088-3735","authenticated-orcid":false,"given":"Elisa","family":"Prati","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2601-7009","authenticated-orcid":false,"given":"Alessio","family":"Malizia","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0240-4087","authenticated-orcid":false,"given":"Martin","family":"Schmettow","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2122-8077","authenticated-orcid":false,"given":"Alan","family":"Chamberlain","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5681-0633","authenticated-orcid":false,"given":"Stefano","family":"Federici","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,6,1]]},"reference":[{"key":"1731_CR1","doi-asserted-by":"publisher","first-page":"100006","DOI":"10.1016\/j.mlwa.2020.100006","volume":"2","author":"E Adamopoulou","year":"2020","unstructured":"Adamopoulou E, Moussiades L (2020) Chatbots: history, technology, and applications. Machine Learning with Appl 2:100006. https:\/\/doi.org\/10.1016\/j.mlwa.2020.100006","journal-title":"Machine Learning with Appl"},{"issue":"24","key":"1731_CR2","doi-asserted-by":"publisher","first-page":"3186","DOI":"10.1097\/00007632-200012150-00014","volume":"25","author":"DE Beaton","year":"2000","unstructured":"Beaton DE, Bombardier C, Guillemin F, Ferraz MB (2000) Guidelines for the process of cross-cultural adaptation of self-report measures. Spine 25(24):3186\u20133191. https:\/\/doi.org\/10.1097\/00007632-200012150-00014","journal-title":"Spine"},{"issue":"8","key":"1731_CR3","doi-asserted-by":"publisher","first-page":"484","DOI":"10.1080\/10447318.2015.1064648","volume":"31","author":"S Borsci","year":"2015","unstructured":"Borsci S, Federici S, Bacci S, Gnaldi M, Bartolucci F (2015) Assessing user satisfaction in the era of user experience: comparison of the SUS, UMUX, and UMUX-LITE as a function of product experience. Int J Human-Computer Interact 31(8):484\u2013495. https:\/\/doi.org\/10.1080\/10447318.2015.1064648","journal-title":"Int J Human-Computer Interact"},{"issue":"5","key":"1731_CR4","doi-asserted-by":"publisher","first-page":"519","DOI":"10.1080\/0144929X.2018.1541255","volume":"38","author":"S Borsci","year":"2019","unstructured":"Borsci S, Federici S, Malizia A, De Filippis ML (2019) Shaking the usability tree: why usability is not a dead end, and a constructive way forward. Behav Inform Technol 38(5):519\u2013532. https:\/\/doi.org\/10.1080\/0144929X.2018.1541255","journal-title":"Behav Inform Technol"},{"key":"1731_CR5","doi-asserted-by":"publisher","DOI":"10.1007\/s00146-021-01383-x","author":"S Borsci","year":"2022","unstructured":"Borsci S, Lehtola VV, Nex F, Yang MY, Augustijn E-W, Bagheriye L, Brune C, Kounadi O, Li J, Moreira J, Van Der Nagel J, Veldkamp B, Le DV, Wang M, Wijnhoven F, Wolterink JM, Zurita-Milla R (2022) Embedding artificial intelligence in society: looking beyond the EU AI master plan using the culture cycle. AI & Soc. https:\/\/doi.org\/10.1007\/s00146-021-01383-x","journal-title":"AI & Soc"},{"issue":"1","key":"1731_CR6","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1007\/s00779-021-01582-9","volume":"26","author":"S Borsci","year":"2022","unstructured":"Borsci S, Malizia A, Schmettow M, van der Velde F, Tariverdiyeva G, Balaji D, Chamberlain A (2022) The Chatbot Usability Scale: the design and pilot of a usability scale for interaction with AI-based conversational agents. Pers Ubiquit Comput 26(1):95\u2013119. https:\/\/doi.org\/10.1007\/s00779-021-01582-9","journal-title":"Pers Ubiquit Comput"},{"key":"1731_CR7","doi-asserted-by":"publisher","unstructured":"Borsci S, Schmettow M, Malizia A et al (2023) A confirmatory factorial analysis of the chatbot usability scale: a multilanguage validation. Pers Ubiquit Comput 27:317\u2013330. https:\/\/doi.org\/10.1007\/s00779-022-01690-0","DOI":"10.1007\/s00779-022-01690-0"},{"issue":"1","key":"1731_CR8","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1080\/1743727X.2015.1070823","volume":"40","author":"GTL Brown","year":"2017","unstructured":"Brown GTL, Harris LR, O\u2019Quin C, Lane KE (2017) Using multi-group confirmatory factor analysis to evaluate cross-cultural research: identifying and understanding non-invariance. International Journal of Research & Method in Education 40(1):66\u201390. https:\/\/doi.org\/10.1080\/1743727X.2015.1070823","journal-title":"International Journal of Research & Method in Education"},{"key":"1731_CR9","doi-asserted-by":"publisher","unstructured":"Caldarini G, Jaf S, McGarry K (2022) A literature survey of recent advances in chatbots. Information 13(1):41. https:\/\/doi.org\/10.3390\/info13010041","DOI":"10.3390\/info13010041"},{"issue":"2","key":"1731_CR10","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1207\/s15328007sem0902_5","volume":"9","author":"GW Cheung","year":"2002","unstructured":"Cheung GW, Rensvold RB (2002) Evaluating goodness-of-fit indexes for testing measurement invariance. Struct Equ Model 9(2):233\u2013255. https:\/\/doi.org\/10.1207\/s15328007sem0902_5","journal-title":"Struct Equ Model"},{"issue":"4","key":"1731_CR11","doi-asserted-by":"publisher","first-page":"584","DOI":"10.1037\/0022-006X.55.4.584","volume":"55","author":"DA Cole","year":"1987","unstructured":"Cole DA (1987) Utility of confirmatory factor analysis in test validation research. J Consult Clin Psychol 55(4):584","journal-title":"J Consult Clin Psychol"},{"key":"1731_CR12","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-021-01690-7","author":"ED D\u2019Urso","year":"2021","unstructured":"D\u2019Urso ED, De Roover K, Vermunt JK, Tijmstra J (2021) Scale length does matter: recommendations for measurement invariance testing with categorical factor analysis and item response theory approaches. Behav Res Methods. https:\/\/doi.org\/10.3758\/s13428-021-01690-7","journal-title":"Behav Res Methods"},{"key":"1731_CR13","doi-asserted-by":"publisher","unstructured":"Saracco R (2022) Perspectives on AI adoption in Italy, the role of the Italian AI Strategy. Discov Artif Intell 2:9. https:\/\/doi.org\/10.1007\/s44163-022-00025-5","DOI":"10.1007\/s44163-022-00025-5"},{"issue":"7","key":"1731_CR14","doi-asserted-by":"publisher","first-page":"832","DOI":"10.1080\/17483107.2020.1775313","volume":"15","author":"S Federici","year":"2020","unstructured":"Federici S, de Filippis ML, Mele ML, Borsci S, Bracalenti M, Gaudino G, Cocco A, Amendola M, Simonetti E (2020) Inside pandora\u2019s box: a systematic review of the assessment of the perceived quality of chatbots for people with disabilities or special needs. Disabil Rehabilit: Assist Technol 15(7):832\u2013837. https:\/\/doi.org\/10.1080\/17483107.2020.1775313","journal-title":"Disabil Rehabilit: Assist Technol"},{"key":"1731_CR15","unstructured":"Gupta S, Chen Y (2022) Supporting inclusive learning using chatbots? A chatbot-led interview study.\u00a0J Inf Syst Educ\u00a033(1):98\u2013108"},{"key":"1731_CR16","unstructured":"Hair JF, Black WC, Babin BJ, Anderson RE, Tatham RL (2014) Pearson new international edition. Multivariate data analysis, 7th Edn. Pearson Education Limited Harlow, Essex"},{"issue":"1","key":"1731_CR17","doi-asserted-by":"publisher","first-page":"726","DOI":"10.1186\/s12889-022-13115-x","volume":"22","author":"L He","year":"2022","unstructured":"He L, Basar E, Wiers RW, Antheunis ML, Krahmer E (2022) Can chatbots help to motivate smoking cessation? A study on the effectiveness of motivational interviewing on engagement and therapeutic alliance. BMC Public Health 22(1):726. https:\/\/doi.org\/10.1186\/s12889-022-13115-x","journal-title":"BMC Public Health"},{"issue":"2","key":"1731_CR18","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1016\/j.intmar.2013.12.002","volume":"28","author":"LD Hollebeek","year":"2014","unstructured":"Hollebeek LD, Glynn MS, Brodie RJ (2014) Consumer brand engagement in social media: conceptualization, scale development and validation. J Interact Mark 28(2):149\u2013165. https:\/\/doi.org\/10.1016\/j.intmar.2013.12.002","journal-title":"J Interact Mark"},{"issue":"1","key":"1731_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/10705519909540118","volume":"6","author":"L Hu","year":"1999","unstructured":"Hu L, Bentler PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling 6(1):1\u201355","journal-title":"Struct Equ Modeling"},{"key":"1731_CR20","unstructured":"ISO (2010) ISO 9241\u2013210:2010 Ergonomics of human-system interaction\u2013Part 210: Human-centred design for interactive systems. Brussels, BE: CEN"},{"key":"1731_CR21","unstructured":"ISO (2018) ISO 9241\u201311 Ergonomic requirements for office work with visual display terminals\u2013Part 11: Guidance on usability. Brussels, BE: CEN"},{"key":"1731_CR22","doi-asserted-by":"publisher","unstructured":"Jenneboer L, Herrando C, Constantinides E (2022) The impact of chatbots on customer loyalty: A systematic literature review. J Theor Appl Electron Commer Res 17(1):212\u2013229. https:\/\/doi.org\/10.3390\/jtaer17010011","DOI":"10.3390\/jtaer17010011"},{"key":"1731_CR23","doi-asserted-by":"publisher","first-page":"107329","DOI":"10.1016\/j.chb.2022.107329","volume":"134","author":"H Jiang","year":"2022","unstructured":"Jiang H, Cheng Y, Yang J, Gao S (2022) AI-powered chatbot communication with customers: dialogic interactions, satisfaction, engagement, and customer behavior. Computers Human Behav 134:107329. https:\/\/doi.org\/10.1016\/j.chb.2022.107329","journal-title":"Computers Human Behav"},{"key":"1731_CR24","doi-asserted-by":"crossref","unstructured":"Lewis JR, Utesch BS, Maher DE (2013) UMUX-LITE: when there\u2019s no time for the SUS proceedings of the SIGCHI conference on human factors in computing systems, Paris. France DOI 10(1145\/2470654):2481287","DOI":"10.1145\/2470654.2481287"},{"key":"1731_CR25","doi-asserted-by":"crossref","unstructured":"ReportLinker (2021) North America and Europe chatbot market-growth, trends, COVID-19 impact, and forecasts (2021\u20132026). Retrieved July 2 from:\u00a0https:\/\/www.globenewswire.com\/news-release\/2021\/10\/27\/2321521\/0\/en\/North-America-and-Europe-Chatbot-Market-Growth-Trends-COVID-19-Impact-and-Forecasts-2021-2026.html","DOI":"10.1016\/j.focat.2021.08.004"},{"issue":"1\u20132","key":"1731_CR26","first-page":"87","volume":"40","author":"H Scheff\u00e9","year":"1953","unstructured":"Scheff\u00e9 H (1953) A method for judging all contrasts in the analysis of variance. Biometrika 40(1\u20132):87\u2013110","journal-title":"Biometrika"},{"key":"1731_CR27","unstructured":"Spagnolo E (2022) The artificial intelligence market is growing in Italy. Retrieved July 2 from:\u00a0https:\/\/en.cryptonomist.ch\/2022\/02\/07\/the-artificial-intelligence-market-is-growing-in-italy\/"},{"key":"1731_CR28","doi-asserted-by":"publisher","first-page":"53","DOI":"10.5116\/ijme.4dfb.8dfd","volume":"2","author":"M Tavakol","year":"2011","unstructured":"Tavakol M, Dennick R (2011) Making sense of Cronbach\u2019s alpha. Int J Med Educ 2:53\u201355. https:\/\/doi.org\/10.5116\/ijme.4dfb.8dfd","journal-title":"Int J Med Educ"},{"issue":"2","key":"1731_CR29","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1016\/j.ijresmar.2006.11.002","volume":"24","author":"PC Verhoef","year":"2007","unstructured":"Verhoef PC, Neslin SA, Vroomen B (2007) Multichannel customer management: understanding the research-shopper phenomenon. Int J Res Mark 24(2):129\u2013148. https:\/\/doi.org\/10.1016\/j.ijresmar.2006.11.002","journal-title":"Int J Res Mark"}],"container-title":["Personal and Ubiquitous Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00779-023-01731-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00779-023-01731-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00779-023-01731-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,29]],"date-time":"2023-12-29T16:11:15Z","timestamp":1703866275000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00779-023-01731-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,1]]},"references-count":29,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2023,12]]}},"alternative-id":["1731"],"URL":"https:\/\/doi.org\/10.1007\/s00779-023-01731-2","relation":{},"ISSN":["1617-4909","1617-4917"],"issn-type":[{"value":"1617-4909","type":"print"},{"value":"1617-4917","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,1]]},"assertion":[{"value":"3 October 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 May 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 June 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}