{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T21:40:57Z","timestamp":1785534057099,"version":"3.56.0"},"reference-count":37,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Hum Factors"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec sec-type=\"background\">\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Chatbots are increasingly deployed across various domains; however, systematic evaluation of their usability remains limited, particularly in non-Western contexts. The 11-item Chatbot Usability Scale (BUS-11), a multidimensional instrument grounded in human-computer interaction theory, has demonstrated strong psychometric properties in prior studies; however, a validated Chinese version does not exist, despite China being one of the largest chatbot markets.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"objective\">\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This study aimed to translate, culturally adapt, and validate the BUS-11 for Chinese users.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"methods\">\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Following established cross-cultural adaptation procedures, the scale was forward- and back-translated, reviewed by an expert committee, and pilot-tested for clarity and feasibility. A main validation study was then conducted with 214 participants, who completed 438 evaluations of the chatbots across 10 widely used systems.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"results\">\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Psychometric analyses demonstrated excellent scale-level content validity index (ie, 0.92), strong internal consistency (Cronbach \u03b1=0.92), and a clear 3-factor structure (Accessibility, Interaction Process Quality, and Information Quality), explaining 56.1% of the variance. Meanwhile, privacy or security and response time were retained as single-item indicators. The Chinese BUS-11 was concise, user-friendly, and psychometrically robust.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec sec-type=\"conclusions\">\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>This work fills a critical gap by providing the first validated instrument for assessing chatbot usability in Chinese contexts, enabling reliable cross-cultural comparisons and supporting both research and practical design evaluation in human-computer interaction.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2196\/84971","type":"journal-article","created":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T22:05:08Z","timestamp":1771538708000},"page":"e84971-e84971","source":"Crossref","is-referenced-by-count":1,"title":["Chatbot Usability Scale in Chinese Users: Cross-Cultural Adaptation and Validation Study"],"prefix":"10.2196","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0271-8409","authenticated-orcid":false,"given":"Haoming","family":"Ma","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-8190-2477","authenticated-orcid":false,"given":"Runyuan","family":"Pei","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-0740-5858","authenticated-orcid":false,"given":"Sijia","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-8859-2423","authenticated-orcid":false,"given":"Aoqi","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-6992-4710","authenticated-orcid":false,"given":"Xingyi","family":"Tang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2436-6870","authenticated-orcid":false,"given":"Meihua","family":"Piao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,4,6]]},"reference":[{"key":"R1","doi-asserted-by":"crossref","unstructured":"Nagarhalli TP Vaze V Rana NK . A review of current trends in the development of chatbot systems. In: Rana N , editor. Presented at: 2020 6th International Conference on Advanced Computing and Communication Systems (ICACCS); Mar 6-7, 2020; Coimbatore, India. [doi: 10.1109\/ICACCS48705.2020.9074420]","DOI":"10.1109\/ICACCS48705.2020.9074420"},{"key":"R2","doi-asserted-by":"publisher","DOI":"10.1177\/2055207619871808","article-title":"Acceptability of artificial intelligence (AI)-led chatbot services in healthcare: a mixed-methods study","volume":"5","author":"Nadarzynski","journal-title":"Digit Health"},{"issue":"2","key":"R3","doi-asserted-by":"publisher","first-page":"358","DOI":"10.1016\/j.giq.2018.10.001","article-title":"Transforming the communication between citizens and government through AI-guided chatbots","volume":"36","author":"Androutsopoulou","journal-title":"Gov Inf Q"},{"issue":"2","key":"R4","doi-asserted-by":"publisher","first-page":"200","DOI":"10.1080\/17543266.2021.1990417","article-title":"Chatbot design approaches for fashion e-commerce: an interdisciplinary review","volume":"15","author":"Landim","journal-title":"Int J Fash Des Technol Educ"},{"key":"R5","unstructured":"Li FL Qiu M Chen H Wang X Gao X . AliMe Assist: an intelligent assistant for creating an innovative e-commerce experience. In: Huang J , editor. Presented at: Proceedings of the 2017 ACM Conference on Information and Knowledge Management; Nov 6-10, 2017; Singapore. 2017.URL: https:\/\/www.researchgate.net\/publication\/320885511_AliMe_Assist_An_Intelligent_Assistant_for_Creating_an_Innovative_E-commerce_Experience [Accessed 27-03-2026]"},{"issue":"2","key":"R6","doi-asserted-by":"publisher","first-page":"534","DOI":"10.1177\/0894439320980132","article-title":"Understanding the determinants in the different government AI adoption stages: evidence of local government chatbots in China","volume":"40","author":"Wang","journal-title":"Soc Sci Comput Rev"},{"issue":"2","key":"R7","doi-asserted-by":"publisher","DOI":"10.2196\/36831","article-title":"Use of health care chatbots among young people in China during the omicron wave of COVID-19: evaluation of the user experience of and satisfaction with the technology","volume":"9","author":"Shan","journal-title":"JMIR Hum Factors"},{"issue":"2","key":"R8","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1080\/10447318.2022.2118244","article-title":"Towards user-centric guidelines for chatbot conversational design","volume":"40","author":"Silva","journal-title":"Int J Hum Comput"},{"issue":"2","key":"R9","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1016\/j.ijhcs.2005.06.002","article-title":"Current practice in measuring usability: challenges to usability studies and research","volume":"64","author":"Hornb\u00e6k","journal-title":"Int J Hum Comput Stud"},{"issue":"1","key":"R10","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1007\/s00779-021-01582-9","article-title":"The Chatbot Usability Scale: the design and pilot of a usability scale for interaction with AI-based conversational agents","volume":"26","author":"Borsci","journal-title":"Pers Ubiquit Comput"},{"key":"R11","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3145323","article-title":"Experimentation for chatbot usability evaluation: a secondary study","volume":"10","author":"Ren","journal-title":"IEEE Access"},{"issue":"11n12","key":"R12","doi-asserted-by":"publisher","first-page":"1673","DOI":"10.1142\/S0218194019400163","article-title":"Evaluation techniques for chatbot usability: a systematic mapping study","volume":"29","author":"Ren","journal-title":"Int J Soft Eng Knowl Eng"},{"key":"R13","doi-asserted-by":"crossref","unstructured":"Holmes S . Towards validating a chatbot usability scale. In: International Conference on Human-Computer Interaction. Springer; [doi: 10.1007\/978-3-031-35708-4_24]","DOI":"10.1007\/978-3-031-35708-4_24"},{"issue":"6","key":"R14","doi-asserted-by":"publisher","first-page":"2161","DOI":"10.1007\/s00779-023-01731-2","article-title":"Ciao AI: the Italian adaptation and validation of the Chatbot Usability Scale","volume":"27","author":"Borsci","journal-title":"Pers Ubiquit Comput"},{"issue":"24","key":"R15","doi-asserted-by":"publisher","first-page":"3186","DOI":"10.1097\/00007632-200012150-00014","article-title":"Guidelines for the process of cross-cultural adaptation of self-report measures","volume":"25","author":"Beaton","journal-title":"Spine (Phila Pa 1976)"},{"issue":"10","key":"R16","doi-asserted-by":"publisher","first-page":"953","DOI":"10.1080\/10447318.2019.1700644","article-title":"Chinese System Usability Scale: translation, revision, psychological measurement","volume":"36","author":"Wang","journal-title":"Int J Hum-Comput Int"},{"key":"R17","doi-asserted-by":"crossref","unstructured":"Bolpagni M Gabrielli S . Development of a comprehensive evaluation scale for LLM-powered counseling chatbots (CES-LCC) using the edelphi method. Public Health and Healthcare. Preprint posted online on 2025. [doi: 10.20944\/preprints202501.1621.v1]","DOI":"10.20944\/preprints202501.1621.v1"},{"issue":"5","key":"R18","doi-asserted-by":"publisher","first-page":"300","DOI":"10.1097\/00006199-200109000-00008","article-title":"An adaptation of Brislin\u2019s translation model for cross-cultural research","volume":"50","author":"Jones","journal-title":"Nurs Res"},{"issue":"5","key":"R19","doi-asserted-by":"publisher","first-page":"1147","DOI":"10.1007\/s11136-018-1798-3","article-title":"COSMIN guideline for systematic reviews of patient-reported outcome measures","volume":"27","author":"Prinsen","journal-title":"Qual Life Res"},{"issue":"3","key":"R20","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1177\/135910457000100301","article-title":"Back-translation for cross-cultural research","volume":"1","author":"Brislin","journal-title":"J Cross Cult Psychol"},{"issue":"5","key":"R21","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1145\/3236669","article-title":"Chatbots: changing user needs and motivations","volume":"25","author":"Brandtzaeg","journal-title":"Interactions"},{"key":"R22","unstructured":"Norman D . The Design of Everyday Things. Hachette UK; 2013. ISBN: 0465072992"},{"key":"R23","unstructured":"Rogers EM Singhal A Quinlan MM . Diffusion of innovations. In: An Integrated Approach to Communication Theory and Research. Routledge; 2014:432-448. URL: https:\/\/www.taylorfrancis.com\/chapters\/edit\/10.4324\/9780203887011-36\/diffusion-innovations-everett-rogers-arvind-singhal-margaret-quinlan [Accessed 27-03-2026]"},{"issue":"5","key":"R24","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1111\/j.1467-8721.2009.01647.x","article-title":"Aging and information technology use: potential and barriers","volume":"18","author":"Charness","journal-title":"Curr Dir Psychol Sci"},{"issue":"6","key":"R25","first-page":"382","volume":"35","author":"Lynn","journal-title":"Nurs Res"},{"issue":"1","key":"R26","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1007\/BF02291575","article-title":"An index of factorial simplicity","volume":"39","author":"Kaiser","journal-title":"Psychometrika"},{"issue":"6","key":"R27","doi-asserted-by":"publisher","first-page":"1033","DOI":"10.1007\/s00779-024-01834-4","article-title":"Re-examining the chatBot Usability Scale (BUS-11) to assess user experience with customer relationship management chatbots","volume":"28","author":"Borsci","journal-title":"Pers Ubiquit Comput"},{"issue":"6","key":"R28","doi-asserted-by":"publisher","first-page":"806","DOI":"10.1177\/0011000006288127","article-title":"Scale development research: a content analysis and recommendations for best practices","volume":"34","author":"Worthington","journal-title":"Couns Psychol"},{"key":"R29","volume":"4","author":"McDonald","journal-title":"Isjlp"},{"issue":"1","key":"R30","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1111\/jcom.12276","article-title":"Online privacy concerns and privacy management: a meta-analytical review","volume":"67","author":"Baruh","journal-title":"J Commun"},{"issue":"2","key":"R31","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1207\/s15516709cog1202_4","article-title":"Cognitive load during problem solving: effects on learning","volume":"12","author":"Sweller","journal-title":"Cogn Sci"},{"key":"R32","unstructured":"Brooke J . SUS: a \u201cquick and dirty\u201d usability scale. In: Usability Evaluation In Industry. CRC Press; 1996:4-7. URL: http:\/\/taylorfrancis.com\/chapters\/edit\/10.1201\/9781498710411-35\/sus-quick-dirty-usability-scale-john-brooke [Accessed 27-03-2026]"},{"issue":"2","key":"R33","doi-asserted-by":"publisher","first-page":"22","DOI":"10.5430\/ijhe.v2n2p22","article-title":"Faculty use of established and emerging technologies in higher education: a unified theory of acceptance and use of technology perspective","volume":"2","author":"Lewis","journal-title":"IJHE"},{"issue":"1","key":"R34","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1177\/109442810031002","article-title":"A review and synthesis of the measurement invariance literature: suggestions, practices, and recommendations for organizational research","volume":"3","author":"Vandenberg","journal-title":"Organ Res Methods"},{"issue":"3","key":"R35","doi-asserted-by":"publisher","first-page":"390","DOI":"10.7334\/psicothema2019.306","article-title":"International Test Commission guidelines for test adaptation: a criterion checklist","volume":"32","author":"Hern\u00e1ndez","journal-title":"Psicothema"},{"issue":"9","key":"R36","doi-asserted-by":"publisher","first-page":"1248","DOI":"10.1093\/jamia\/ocy072","article-title":"Conversational agents in healthcare: a systematic review","volume":"25","author":"Laranjo","journal-title":"J Am Med Inform Assoc"},{"key":"R37","unstructured":"Brown T . Confirmatory Factor Analysis for Applied Research. 2nd ed. The Guilford Press; 2015. URL: https:\/\/psycnet.apa.org\/record\/2015-10560-000 [Accessed 27-03-2026]"}],"container-title":["JMIR Human Factors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/humanfactors.jmir.org\/2026\/1\/e84971","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:19:05Z","timestamp":1782843545000},"score":1,"resource":{"primary":{"URL":"https:\/\/humanfactors.jmir.org\/2026\/1\/e84971"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,6]]},"references-count":37,"URL":"https:\/\/doi.org\/10.2196\/84971","relation":{},"ISSN":["2292-9495"],"issn-type":[{"value":"2292-9495","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,6]]},"article-number":"v13i2e84971"}}