{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T08:57:16Z","timestamp":1773392236906,"version":"3.50.1"},"reference-count":24,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,10,30]],"date-time":"2023-10-30T00:00:00Z","timestamp":1698624000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:p>The Artificial-Social-Agent (ASA) questionnaire is an instrument for evaluating human-ASA interaction. It consists of 19 constructs and related dimensions measured by either 24 questionnaire items (short version) or 90 questionnaire items (long version). The questionnaire was built and validated by a research community effort to make evaluation results more comparable between agents and findings more generalizable. The current questionnaire is in English, which limits its use to only a population with an adequate command of the English language. Translating the questionnaire into more languages allows for the inclusion of other populations and the possibility of comparing them. Therefore, this paper presents a Mandarin Chinese translation of the questionnaire. After three construction cycles that included forward and backward translation, we gave both the final version of the translated and original English questionnaire to 242 bilingual crowd-workers to evaluate 14 ASAs. Results show on average a good level of correlation on the construct\/dimension level (ICC <jats:italic>M<\/jats:italic> = 0.79, <jats:italic>SD<\/jats:italic> = 0.09, range [0.61, 0.95]) and on the item level (ICC <jats:italic>M<\/jats:italic> = 0.62, <jats:italic>SD<\/jats:italic> = 0.14, range [0.19, 0.92]) between the two languages for the long version, and for the short version (ICC <jats:italic>M<\/jats:italic> = 0.66, <jats:italic>SD<\/jats:italic> = 0.12, range [0.41, 0.92]). The analysis also established correction values for converting questionnaire item scores between Chinese and English questionnaires. Moreover, we also found systematic differences in English questionnaire scores between the bilingual sample and a previously collected mixed-international English-speaking sample. We hope this and the Chinese questionnaire translation will motivate researchers to study human-ASA interaction among a Chinese literate population and to study cultural similarities and differences in this area.<\/jats:p>","DOI":"10.3389\/fcomp.2023.1149305","type":"journal-article","created":{"date-parts":[[2023,10,30]],"date-time":"2023-10-30T09:52:46Z","timestamp":1698659566000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Mandarin Chinese translation of the Artificial-Social-Agent questionnaire instrument for evaluating human-agent interaction"],"prefix":"10.3389","volume":"5","author":[{"given":"Fengxiang","family":"Li","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Siska","family":"Fitrianie","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Merijn","family":"Bruijnes","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amal","family":"Abdulrahman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fu","family":"Guo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Willem-Paul","family":"Brinkman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2023,10,30]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1111\/j.1524-4733.2007.00292.x","article-title":"Literature review of methods to translate health-related quality of life questionnaires for use in multinational clinical trials","volume":"11","author":"Acquadro","year":"2008","journal-title":"Value Health"},{"key":"B2","doi-asserted-by":"publisher","first-page":"3186","DOI":"10.1097\/00007632-200012150-00014","article-title":"Guidelines for the process of cross-cultural adaptation of self-report measures","volume":"25","author":"Beaton","year":"2000","journal-title":"Spine"},{"key":"B3","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1093\/ageing\/afw192","article-title":"English translation and validation of the sarqol, a quality of life questionnaire specific for sarcopenia","volume":"46","author":"Beaudart","year":"2017","journal-title":"Age Ageing"},{"key":"B4","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1046\/j.1365-2648.1999.00891.x","article-title":"Translation of questionnaires and issues of equivalence","volume":"29","author":"Chang","year":"1999","journal-title":"J. Adv. Nurs"},{"key":"B5","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1037\/1040-3590.6.4.284","article-title":"Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology","volume":"6","author":"Cicchetti","year":"1994","journal-title":"Psychol. Assess"},{"key":"B6","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1037\/0033-2909.112.1.155","article-title":"A power primer","volume":"112","author":"Cohen","year":"1992","journal-title":"Psychol. Bull"},{"key":"B7","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1177\/0163278716648191","article-title":"Translation quality assessment in health research: a functionalist alternative to back-translation","volume":"40","author":"Colina","year":"2017","journal-title":"Eval. Health Prof"},{"key":"B8","volume-title":"Ethnologue: Languages of the World, 25th Edn","author":"Eberhard","year":"2022"},{"key":"B9","volume-title":"Multilevel Modeling Using R","author":"Finch","year":"2014"},{"key":"B10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3514197.3549612","article-title":"\u201cThe artificial-social-agent questionnaire: establishing the long and short questionnaire versions,\u201d","volume-title":"Proceedings of the 22nd ACM International Conference on Intelligent Virtual Agents","author":"Fitrianie","year":"2022"},{"key":"B11","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1145\/3472306.3478341","article-title":"\u201cQuestionnaire items for evaluating artificial social agents-expert generated, content validated and reliability analysed,\u201d","author":"Fitrianie","year":"2021","journal-title":"Proceedings of the 21st ACM International Conference on Intelligent Virtual Agents"},{"key":"B12","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1145\/3308532.3329421","article-title":"\u201cWhat are we measuring anyway? A literature survey of questionnaires used in studies reported in the intelligent virtual agent conferences,\u201d","volume-title":"Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents","author":"Fitrianie","year":"2019"},{"key":"B13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3383652.3423873","article-title":"\u201cThe 19 unifying questionnaire constructs of artificial social agents: an IVA community analysis,\u201d","author":"Fitrianie","year":"2020","journal-title":"Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents"},{"key":"B14","doi-asserted-by":"publisher","first-page":"61","DOI":"10.3109\/03009749509099285","article-title":"Cross-cultural adaptation and validation of health status measures","volume":"24","author":"Guillemin","year":"1995","journal-title":"Scand. J. Rheumatol"},{"key":"B15","doi-asserted-by":"publisher","first-page":"1417","DOI":"10.1016\/0895-4356(93)90142-N","article-title":"Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines","volume":"46","author":"Guillemin","year":"1993","journal-title":"J. Clin. Epidemiol"},{"key":"B16","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A guideline of selecting and reporting intraclass correlation coefficients for reliability research","volume":"15","author":"Koo","year":"2016","journal-title":"J. Chiropr. Med"},{"key":"B17","doi-asserted-by":"publisher","first-page":"573","DOI":"10.1037\/a0029146","article-title":"Bayesian estimation supersedes the t test","volume":"142","author":"Kruschke","year":"2013","journal-title":"J. Exp. Psychol"},{"key":"B18","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1742-4755-10-25","article-title":"The sexual quality of life-female (SQOL-F) questionnaire: translation and psychometric properties of the Iranian version","volume":"10","author":"Maasoumi","year":"2013","journal-title":"Reprod. Health"},{"key":"B19","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1145\/2974804.2974813","article-title":"\u201cInvestigating effects of professional status and ethnicity in human-agent interaction,\u201d","volume-title":"Proceedings of the Fourth International Conference on Human Agent Interaction","author":"Obaid","year":"2016"},{"key":"B20","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1007\/s10055-013-0231-z","article-title":"Human perception of a conversational virtual human: an empirical study on the effect of emotion and culture","volume":"17","author":"Qu","year":"2013","journal-title":"Virt. Real"},{"key":"B21","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1016\/j.jval.2013.10.006","article-title":"From translation to version management: a history and review of methods for the cultural adaptation of the Euroqol five-dimensional questionnaire","volume":"17","author":"Rabin","year":"2014","journal-title":"Value Health"},{"key":"B22","first-page":"74","article-title":"\u201cMarhaba, how may I help you? Effects of politeness and culture on robot acceptance and anthropomorphization,\u201d","volume-title":"2014 9th ACM\/IEEE International Conference on Human-Robot Interaction (HRI)","author":"Salem","year":"2014"},{"key":"B23","doi-asserted-by":"publisher","first-page":"484","DOI":"10.1016\/j.jpain.2009.09.014","article-title":"Translation to Portuguese and validation of the Douleur Neuropathique 4 questionnaire","volume":"11","author":"Santos","year":"2010","journal-title":"J. Pain"},{"key":"B24","doi-asserted-by":"publisher","first-page":"S80","DOI":"10.4103\/sja.SJA_203_17","article-title":"Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine","volume":"11","author":"Tsang","year":"2017","journal-title":"Saudi J. Anaesth"}],"updated-by":[{"DOI":"10.3389\/fcomp.2024.1421070","type":"corrigendum","label":"Corrigendum","source":"publisher","updated":{"date-parts":[[2024,5,13]],"date-time":"2024-05-13T00:00:00Z","timestamp":1715558400000}}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2023.1149305\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,13]],"date-time":"2024-05-13T07:44:57Z","timestamp":1715586297000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2023.1149305\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,30]]},"references-count":24,"alternative-id":["10.3389\/fcomp.2023.1149305"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2023.1149305","relation":{"corrigendum":[{"id-type":"doi","id":"10.3389\/fcomp.2024.1421070","asserted-by":"object"}]},"ISSN":["2624-9898"],"issn-type":[{"value":"2624-9898","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,30]]},"article-number":"1149305"}}