{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,5]],"date-time":"2026-02-05T05:18:12Z","timestamp":1770268692455,"version":"3.49.0"},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2021,3,7]],"date-time":"2021-03-07T00:00:00Z","timestamp":1615075200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,3,7]],"date-time":"2021-03-07T00:00:00Z","timestamp":1615075200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100008769","name":"Julius-Maximilians-Universit\u00e4t W\u00fcrzburg","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100008769","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Multimodal User Interfaces"],"published-print":{"date-parts":[[2021,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Having a mixed-cultural membership becomes increasingly common in our modern society. It is thus beneficial in several ways to create Intelligent Virtual Agents (IVAs) that reflect a mixed-cultural background as well, e.g., for educational settings. For research with such IVAs, it is essential that they are classified as non-native by members of a target culture. In this paper, we focus on variations of IVAs\u2019 speech to create the impression of non-native speakers that are identified as such by speakers of two different mother tongues. In particular, we investigate grammatical mistakes and identify thresholds beyond which the agents is clearly categorised as a non-native speaker. Therefore, we conducted two experiments: one for native speakers of German, and one for native speakers of English. Results of the German study indicate that beyond 10% of word order mistakes and 25% of infinitive mistakes German-speaking IVAs are perceived as non-native speakers. Results of the English study indicate that beyond 50% of omission mistakes and 50% of infinitive mistakes English-speaking IVAs are perceived as non-native speakers. We believe these thresholds constitute helpful guidelines for computational approaches of non-native speaker generation, simplifying research with IVAs in mixed-cultural settings.<\/jats:p>","DOI":"10.1007\/s12193-021-00369-9","type":"journal-article","created":{"date-parts":[[2021,3,7]],"date-time":"2021-03-07T17:02:30Z","timestamp":1615136550000},"page":"229-238","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["Non-native speaker perception of Intelligent Virtual Agents in two languages: the impact of amount and type of grammatical mistakes"],"prefix":"10.1007","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0453-0725","authenticated-orcid":false,"given":"David","family":"Obremski","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jean-Luc","family":"Lugrin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Philipp","family":"Schaper","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Birgit","family":"Lugrin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,3,7]]},"reference":[{"key":"369_CR1","unstructured":"Aylett R, Hall L, Tazzyman S, Endrass B, Andr\u00e9 E, Ritter C, Nazir A, Paiva A, Hofstede G, Kappas A (2014) Werewolves, cheats, and cultural sensitivity. In: International conference on autonomous agents and multiagent systems (AAMAS 2014). IFAAMAS, pp 1085\u20131092"},{"key":"369_CR2","unstructured":"Aylett R, Vannini N, Andre E, Paiva A, Enz S, Hall L (2009) But that was in another country: agents and intercultural empathy. In: 8th international conference on autonomous agents and multiagent systems (AAMAS 2009). IFAAMAS, pp 329\u2013336"},{"issue":"3","key":"369_CR3","doi-asserted-by":"publisher","first-page":"717","DOI":"10.1016\/j.lingua.2009.05.007","volume":"120","author":"M Bader","year":"2010","unstructured":"Bader M, Haeussler J (2010) Word order in German: a corpus study. Lingua 120(3):717\u2013762. https:\/\/doi.org\/10.1016\/j.lingua.2009.05.007","journal-title":"Lingua"},{"issue":"1","key":"369_CR4","first-page":"5","volume":"46","author":"JW Berry","year":"1997","unstructured":"Berry JW (1997) Immigration, acculturation, and adaptation. Appl Psychol 46(1):5\u201334","journal-title":"Appl Psychol"},{"key":"369_CR5","first-page":"153","volume":"7","author":"T Cseh\u00f3","year":"2009","unstructured":"Cseh\u00f3 T (2009) Zum Einfluss des Foreigner Talk auf die Entstehung des Migrantendeutsch. Germanistische Studien 7:153\u2013168","journal-title":"Germanistische Studien"},{"key":"369_CR6","unstructured":"Endrass B, Andr\u00e9 E, Huang L, Gratch J (2010) A data-driven approach to model culture-specific communication management styles for virtual agents. In: van\u00a0der Hoek W, Kaminka GA, Lesp\u00e9rance Y, Luck M, Sen S (eds) 9th international conference on autonomous agents and multiagent systems (AAMAS 2010), vol\u00a01. IFAAMAS, pp 99\u2013108. http:\/\/dblp.uni-trier.de\/db\/conf\/atal\/aamas2010.html#EndrassAHG10"},{"issue":"2","key":"369_CR7","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1007\/s10458-012-9218-5","volume":"27","author":"B Endrass","year":"2013","unstructured":"Endrass B, Andr\u00e9 E, Rehm M, Nakano Y (2013) Investigating culture-related aspects of behavior for virtual characters. Auton Agents Multi Agent Syst 27(2):277\u2013304","journal-title":"Auton Agents Multi Agent Syst"},{"key":"369_CR8","doi-asserted-by":"crossref","unstructured":"Endrass B, Nakano YI, Lipi AA, Rehm M, Andr\u00e9 E (2011) Culture-related topic selection in small talk conversations across Germany and Japan. In: Vilhj\u00e1lmsson HH, Kopp S, Marsella S, Th\u00f3risson KR (eds) 11th international conference on Intelligent Virtual Agents (IVA 2011), LNCS, vol 6895. Springer, pp 1\u201313. http:\/\/dblp.uni-trier.de\/db\/conf\/iva\/iva2011.html#EndrassNLRA11","DOI":"10.1007\/978-3-642-23974-8_1"},{"issue":"1","key":"369_CR9","first-page":"1","volume":"17","author":"CA Ferguson","year":"1975","unstructured":"Ferguson CA (1975) Toward a characterization of English foreigner talk. Anthropol Linguist 17(1):1\u201314","journal-title":"Anthropol Linguist"},{"key":"369_CR10","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1007\/978-3-642-39112-5_50","volume-title":"Artificial intelligence in education","author":"S Finkelstein","year":"2013","unstructured":"Finkelstein S, Yarzebinski E, Vaughn C, Ogan A, Cassell J (2013) The effects of culturally congruent educational technologies on student achievement. In: Lane HC, Yacef K, Mostow J, Pavlik P (eds) Artificial intelligence in education. Springer, Berlin, pp 493\u2013502"},{"issue":"4","key":"369_CR11","doi-asserted-by":"publisher","first-page":"348","DOI":"10.1080\/00909889409365409","volume":"22","author":"MM Gill","year":"1994","unstructured":"Gill MM (1994) Accent and stereotypes: their effect on perceptions of teachers and lecture comprehension. J Appl Commun Res 22(4):348\u2013361. https:\/\/doi.org\/10.1080\/00909889409365409","journal-title":"J Appl Commun Res"},{"key":"369_CR12","unstructured":"Gumperz JJ (2009) The speech community. In: Duranti A (ed) Linguistic anthropology: a reader. Wiley Linguistic anthropology: a reader, vol 1, p 66"},{"key":"369_CR13","doi-asserted-by":"crossref","unstructured":"Iacobelli F, Cassell J (2007) Ethnic identity and engagement in embodied conversational agents. In: 7th international conference on Intelligent Virtual Agents (IVA \u201907). Springer, pp 57\u201363","DOI":"10.1007\/978-3-540-74997-4_6"},{"key":"369_CR14","unstructured":"Johnson WL, Valente A (2008) Collaborative authoring of serious games for language and culture. In: Proceedings of SimTecT, vol 2008"},{"key":"369_CR15","unstructured":"Johnson WL, Zaker SB (2012) The power of social simulation for Chinese language teaching. In: Proceedings of TCLT7"},{"key":"369_CR16","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1007\/s00146-014-0568-1","volume":"32","author":"P Khooshabeh","year":"2017","unstructured":"Khooshabeh P, Dehghani M, Nazarian A, Gratch J (2017) The cultural influence model: when accented natural language spoken by virtual characters matters. AI Soc 32:9\u201316","journal-title":"AI Soc"},{"key":"369_CR17","doi-asserted-by":"publisher","unstructured":"Lee J, Seneff S (2008) An analysis of grammatical errors in non-native speech in English. In: 2008 IEEE spoken language technology workshop, pp 89\u201392. https:\/\/doi.org\/10.1109\/SLT.2008.4777847","DOI":"10.1109\/SLT.2008.4777847"},{"key":"369_CR18","doi-asserted-by":"publisher","unstructured":"Lugrin B, Eckstein B, Bergmann K, Heindl C (2018) Adapted foreigner-directed communication towards virtual agents. In: 18th international conference on Intelligent Virtual Agents, IVA \u201918. ACM, pp 59\u201364. https:\/\/doi.org\/10.1145\/3267851.3267859","DOI":"10.1145\/3267851.3267859"},{"key":"369_CR19","unstructured":"Mascarenhas S, Dias J, Afonso N, Enz S, Paiva A (2009) Using rituals to express cultural differences in synthetic characters. In: Proceedings of The 8th international conference on autonomous agents and multiagent systems, vol 1, pp 305\u2013312"},{"key":"369_CR20","unstructured":"Mascarenhas S, Silva A, Paiva A, Aylett R, Kistler F et al (2013) Traveller: an intercultural training system with intelligent agents. In: Proceedings of 12th international conference on autonomous agents and multiagent systems (AAMAS 2013)"},{"key":"369_CR21","volume-title":"Wired for speech: how voice activates and advances the human\u2013computer relationship","author":"CI Nass","year":"2005","unstructured":"Nass CI, Brave S (2005) Wired for speech: how voice activates and advances the human\u2013computer relationship. MIT Press, Cambridge"},{"key":"369_CR22","doi-asserted-by":"publisher","unstructured":"Obremski D, Lugrin JL, Schaper P, Lugrin B (2019) Non-native speaker generation and perception for mixed-cultural settings. In: Proceedings of the 19th ACM international conference on Intelligent Virtual Agents, IVA \u201919. ACM, New York, NY, USA, pp 105\u2013107. https:\/\/doi.org\/10.1145\/3308532.3329427.","DOI":"10.1145\/3308532.3329427"},{"key":"369_CR23","unstructured":"Richards J (1971) Error analysis and second language strategies. The text of an invited lecture given at Indiana University, Bloomington, p\u00a028"},{"key":"369_CR24","first-page":"81","volume":"2","author":"RG Rumbaut","year":"2015","unstructured":"Rumbaut RG (2015) Assimilation of immigrants. James D. Wright (editor-in-chief). Int Encycl Soc Behav Sci 2:81\u201387","journal-title":"Int Encycl Soc Behav Sci"},{"key":"369_CR25","doi-asserted-by":"crossref","unstructured":"Sedlatschek A (2009) Contemporary Indian English: variation and change. John Benjamins. https:\/\/www.jbe-platform.com\/content\/books\/9789027290120","DOI":"10.1075\/veaw.g38"},{"key":"369_CR26","unstructured":"Ting SH, Mahadhir M, Chang SL (2010) Grammatical errors in spoken English of university students in oral communication course. GEMA Online\u00ae J Lang Stud 10(1):53\u201370"},{"key":"369_CR27","unstructured":"Valente A, Johnson WL, Vilhj\u00e1lmsson HH (2006) The tactical language and culture training system: a demonstration. In: AAAI, pp 1955\u20131957"}],"container-title":["Journal on Multimodal User Interfaces"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12193-021-00369-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12193-021-00369-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12193-021-00369-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,5,7]],"date-time":"2021-05-07T12:42:52Z","timestamp":1620391372000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12193-021-00369-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,7]]},"references-count":27,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,6]]}},"alternative-id":["369"],"URL":"https:\/\/doi.org\/10.1007\/s12193-021-00369-9","relation":{},"ISSN":["1783-7677","1783-8738"],"issn-type":[{"value":"1783-7677","type":"print"},{"value":"1783-8738","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,7]]},"assertion":[{"value":"4 November 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 February 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 March 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}