{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T11:21:37Z","timestamp":1773141697934,"version":"3.50.1"},"reference-count":45,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,3,1]],"date-time":"2023-03-01T00:00:00Z","timestamp":1677628800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100020963","name":"Moonshot Research and Development Program","doi-asserted-by":"publisher","award":["JPMJPS 2011 JSPS KAKENHI"],"award-info":[{"award-number":["JPMJPS 2011 JSPS KAKENHI"]}],"id":[{"id":"10.13039\/501100020963","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p><jats:bold>Introduction:<\/jats:bold> In this study, the development of a social robot, capable of giving speech simultaneously in more than one language was in mind. However, the negative effect of background noise on speech comprehension is well-documented in previous works. This deteriorating effect is more highlighted when the background noise has speech-like properties. Hence, the presence of speech as the background noise in a simultaneously speaking bilingual robot can be fatal for the speech comprehension of each person listening to the robot.<\/jats:p><jats:p><jats:bold>Methods:<\/jats:bold> To improve speech comprehension and consequently, user experience in the intended bilingual robot, the effect of time expansion on speech comprehension in a multi-talker speech scenario was investigated. Sentence recognition, speech comprehension, and subjective evaluation tasks were implemented in the study.<\/jats:p><jats:p><jats:bold>Results:<\/jats:bold> The obtained results suggest that a reduced speech rate, leading to an expansion in the speech time, in addition to increased pause duration in both the target and background speeches can lead to statistically significant improvement in both sentence recognition, and speech comprehension of participants. More interestingly, participants got a higher score in the time-expanded multi-talker speech than in the standard-speed single-talker speech in the speech comprehension and, in the sentence recognition task. However, this positive effect could not be attributed merely to the time expansion, as we could not repeat the same positive effect in a time-expanded single-talker speech.<\/jats:p><jats:p><jats:bold>Discussion:<\/jats:bold> The results obtained in this study suggest a facilitating effect of the presence of the background speech in a simultaneously speaking bilingual robot provided that both languages are presented in a time-expanded manner. The implications of such a simultaneously speaking robot are discussed.<\/jats:p>","DOI":"10.3389\/frobt.2022.1032811","type":"journal-article","created":{"date-parts":[[2023,3,1]],"date-time":"2023-03-01T16:25:05Z","timestamp":1677687905000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Expansion in speech time can restore comprehension in a simultaneously speaking bilingual robot"],"prefix":"10.3389","volume":"9","author":[{"given":"Hamed","family":"Pourfannan","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hamed","family":"Mahzoon","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuichiro","family":"Yoshikawa","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hiroshi","family":"Ishiguro","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2023,3,1]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1043","DOI":"10.1126\/science.aaz3468","article-title":"Distinct sensitivity to spectrotemporal modulation supports brain asymmetry for speech and melody","volume":"367","author":"Albouy","year":"2020","journal-title":"Science"},{"key":"B2","doi-asserted-by":"publisher","first-page":"715","DOI":"10.1037\/0022-3514.37.5.715","article-title":"Effects of pitch and speech rate on personal attributions","volume":"37","author":"Apple","year":"1979","journal-title":"J. Personality Soc. Psychol."},{"key":"B3","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1111\/j.1467-9450.2004.00422.x","article-title":"The effects of noise and gender on children\u2019s episodic and semantic memory","volume":"45","author":"Boman","year":"2004","journal-title":"Scand. J. Psychol."},{"key":"B4","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1044\/1092-4388(2003\/007","article-title":"Speaking clearly for children with learning disabilities","volume":"46","author":"Bradlow","year":"2003","journal-title":"J. speech, Lang. Hear. Res. JSLHR"},{"key":"B5","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1044\/2018_aja-17-0061","article-title":"Immediate passage comprehension and encoding of information into long-term memory in children with normal hearing: The effect of voice quality and multitalker babble noise","volume":"27","author":"Br\u00e4nnstr\u00f6m","year":"2018","journal-title":"Am. J. audiology"},{"key":"B6","doi-asserted-by":"publisher","first-page":"778","DOI":"10.3389\/fpsyg.2015.00778","article-title":"Relatively effortless listening promotes understanding and recall of medical instructions in older adults","volume":"6","author":"DiDonato","year":"2015","journal-title":"Front. Psychol."},{"key":"B7","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1109\/ICCPS.2014.7062261","article-title":"Effect of speech rate for sentences on speech intelligibility","author":"Du","year":"2014"},{"key":"B8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/RO-MAN46459.2019.8956329","article-title":"Lindsey the tour guide robot - usage patterns in a museum long-term deployment","author":"Duchetto","year":"2019"},{"key":"B9","doi-asserted-by":"publisher","first-page":"175","DOI":"10.3758\/bf03193146","article-title":"G*power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences","volume":"39","author":"Faul","year":"2007","journal-title":"Behav. Res. methods"},{"key":"B10","doi-asserted-by":"publisher","first-page":"1241","DOI":"10.1044\/1092-4388(2007\/087","article-title":"Talker differences in clear and conversational speech: Acoustic characteristics of vowels","volume":"50","author":"Ferguson","year":"2007","journal-title":"J. speech, Lang. Hear. Res. JSLHR"},{"key":"B11","doi-asserted-by":"publisher","first-page":"181","DOI":"10.3109\/17549507.2013.845690","article-title":"The slower the better? Does the speaker\u2019s speech rate influence children\u2019s performance on a language comprehension test?","volume":"16","author":"Haake","year":"2014","journal-title":"Int. J. Speech-Language Pathology"},{"key":"B12","doi-asserted-by":"publisher","first-page":"431","DOI":"10.1080\/14640748708401797","article-title":"The effects of amount of processing on recall and recognition","volume":"39","author":"Hanley","year":"1987","journal-title":"Q. J. Exp. Psychol. Sect. A"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-85349-9","article-title":"The coming robot revolution","author":"Hanson","year":"2009"},{"key":"B14","doi-asserted-by":"publisher","first-page":"e65096","DOI":"10.7554\/eLife.65096","article-title":"Linguistic processing of task-irrelevant speech at a cocktail party","volume":"10","author":"Har-shai Yahav","year":"2021","journal-title":"eLife"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1145\/3173386.3177028","article-title":"Bon appetit! robot persuasion for food recommendation","author":"Herse","year":"2018"},{"key":"B16","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1027\/1015-5759\/a000223","article-title":"The digit span backwards task","volume":"1","author":"Hilbert","year":"2015","journal-title":"Eur. J. Psychol. Assess."},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1145\/2559636.2559784","article-title":"The receptionist robot","author":"Holthaus","year":"2014","journal-title":"Recept. robot"},{"key":"B18","doi-asserted-by":"publisher","first-page":"2924","DOI":"10.3889\/oamjms.2019.742","article-title":"The effect of noise exposure on cognitive performance and brain activity patterns","volume":"7","author":"Jafari","year":"2019","journal-title":"Open Access Macedonian J. Med. Sci."},{"key":"B19","volume-title":"Attention and effort","author":"Kahneman","year":"1973"},{"key":"B20","doi-asserted-by":"publisher","first-page":"1337","DOI":"10.1121\/1.381436","article-title":"Development of a test of speech intelligibility in noise using sentence materials with controlled word predictability","volume":"31","author":"Kalikow","year":"1977","journal-title":"J. Acoust. Soc. Am."},{"key":"B21","doi-asserted-by":"publisher","first-page":"64","DOI":"10.4103\/1463-1741.36982","article-title":"Effects of irrelevant speech and traffic noise on speech perception and cognitive performance in elementary school children","volume":"9","author":"Klatte","year":"2007","journal-title":"Noise health"},{"key":"B22","author":"Lewis","year":"1998","journal-title":"Cross-cultural Clin. Interv. Compr. Clin. Psychol"},{"key":"B23","first-page":"209","volume-title":"The influence of comma- and period-pause duration on the listener\u2019s impression of speeches made in Mandarin Chinese","author":"Lin","year":"2021"},{"key":"B24","doi-asserted-by":"publisher","first-page":"778018","DOI":"10.3389\/fpsyg.2022.778018","article-title":"How pause duration influences impressions of English speech: Comparison between native and non-native speakers","volume":"13","author":"Liu","year":"2022","journal-title":"Front. Psychol."},{"key":"B25","volume-title":"Irrelevant borders: Perspectives of globalization","author":"Mohanty","year":"2018"},{"key":"B26","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-030-05204-1_21","article-title":"Social robots in public spaces: A meta-review","volume-title":"10th international conference, ICSR 2018","author":"Mubin","year":"2018"},{"key":"B27","volume-title":"Translator robots","year":"2015"},{"key":"B28","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1080\/09658210050117762","article-title":"Disruption of comprehension by the meaning of irrelevant sound","volume":"8","author":"Oswald","year":"2000","journal-title":"Memory"},{"key":"B29","doi-asserted-by":"publisher","first-page":"204","DOI":"10.1097\/aud.0000000000000494","article-title":"Listening effort: How the cognitive consequences of acoustic challenge are reflected in brain and behavior","volume":"39","author":"Peelle","year":"2018","journal-title":"Ear Hear."},{"key":"B30","doi-asserted-by":"publisher","first-page":"434","DOI":"10.1044\/jshr.2904.434","article-title":"Speaking clearly for the hard of hearing. ii: Acoustic characteristics of clear and conversational speech","volume":"29","author":"Picheny","year":"1986","journal-title":"J. speech Hear. Res."},{"key":"B31","article-title":"Toward a simultaneously speaking bilingual robot: Primary study on optimal voice characteristics","author":"Pourfannan","year":"2022"},{"key":"B32","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1016\/S0022-5371(82)90521-7","article-title":"Disruption of short-term memory by unattended speech: Implications for the structure of working memory","volume":"21","author":"Salam\u00e9","year":"1982","journal-title":"J. Verbal Learn. Verbal Behav."},{"key":"B33","doi-asserted-by":"publisher","first-page":"408","DOI":"10.1075\/is.13.3.05shi","article-title":"What is the appropriate speech rate for a communication robot?","volume":"13","author":"Shimada","year":"2012","journal-title":"Interact. Stud."},{"key":"B34","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1016\/0001-6918(85)90025-3","article-title":"The effects of different types of noise on semantic processing and syntactic reasoning","volume":"58","author":"Smith","year":"1985","journal-title":"Acta Psychol."},{"key":"B35","doi-asserted-by":"publisher","first-page":"840","DOI":"10.1111\/j.1469-7610.2007.01749.x","article-title":"Listen to the noise: Noise is beneficial for cognitive performance in adhd","volume":"48","author":"Soderlund","year":"2007","journal-title":"J. child Psychol. psychiatry, allied Discip."},{"key":"B36","article-title":"How many passengers are flying right now?","year":"2017"},{"key":"B37","volume-title":"Olympic robots","year":"2017"},{"key":"B38","volume-title":"Globalization: A very short introduction","author":"Steger","year":"2017"},{"key":"B39","volume-title":"Counseling the culturally diverse: Theory and practice","author":"Sue","year":"2016"},{"key":"B40","doi-asserted-by":"publisher","first-page":"264","DOI":"10.1250\/ast.32.264","article-title":"Effects of pause duration and speech rate on sentence intelligibility in younger and older adult listeners","volume":"32","author":"Tanaka","year":"2011","journal-title":"Acoust. Sci. Technol."},{"key":"B41","doi-asserted-by":"publisher","first-page":"1750","DOI":"10.1037\/0278-7393.26.6.1750","article-title":"The irrelevant sound effect: Does speech play a special role?","volume":"26","author":"Tremblay","year":"2000","journal-title":"J. Exp. Psychol. Learn. Mem. cognition"},{"key":"B42","doi-asserted-by":"publisher","first-page":"385","DOI":"10.2307\/3587015","article-title":"Speech rate and listening comprehension: Further evidence of the relationship","volume":"26","author":"Weinstein-Shr","year":"1992","journal-title":"TESOL Q."},{"key":"B43","volume-title":"Xiaomingbot: A multilingual robot news reporter","author":"Xu","year":"2020"},{"key":"B44","doi-asserted-by":"publisher","first-page":"459","DOI":"10.1002\/cne.920180503","article-title":"The relation of strength of stimulus to rapidity of habit-formation","volume":"18","author":"Yerkes","year":"1908","journal-title":"Psychol Neurosci."},{"key":"B45","doi-asserted-by":"publisher","first-page":"327","DOI":"10.18178\/ijiet.2020.10.5.1384","article-title":"Evaluation of teaching assistant robot for programming classes","volume":"10","author":"Yoshino","year":"2020","journal-title":"Int. J. Inf. Educ. Technol."}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2022.1032811\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,1]],"date-time":"2023-03-01T16:25:11Z","timestamp":1677687911000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2022.1032811\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,1]]},"references-count":45,"alternative-id":["10.3389\/frobt.2022.1032811"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2022.1032811","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,1]]},"article-number":"1032811"}}