{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,22]],"date-time":"2025-12-22T18:22:08Z","timestamp":1766427728131,"version":"3.37.3"},"reference-count":50,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2022,2,11]],"date-time":"2022-02-11T00:00:00Z","timestamp":1644537600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,2,11]],"date-time":"2022-02-11T00:00:00Z","timestamp":1644537600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000923","name":"Australian Research Council","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000923","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Australian Government Research Training Program Scholarship"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Intel Serv Robotics"],"published-print":{"date-parts":[[2022,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The role of a human assistant, such as receptionist, is to provide specific information to the public. Questions asked by the public are often context dependent and related to the environment where the assistant is situated. Should similar behaviour and questions be expected when a social robot offers the same assistant service to visitors? Would it be sufficient for the robot to answer only service-specific questions, or is it necessary to design the robot to answer more general questions? This paper aims to answer these research questions by investigating the question-asking behaviour of the public when interacting with a question-answering social robot. We conducted the study at a university event that was open to the public. Results demonstrate that almost no participants asked context-specific questions to the robot. Rather, unrelated questions were common and included queries about the robot\u2019s personal preferences, opinions, thoughts and emotional state. This finding contradicts popular belief and common sense expectations from what is otherwise observed during similar human\u2013human interactions. In addition, we found that incorporating non-context-specific questions in a robot\u2019s database increases the success rate of its question-answering system.\n<\/jats:p>","DOI":"10.1007\/s11370-022-00411-z","type":"journal-article","created":{"date-parts":[[2022,2,11]],"date-time":"2022-02-11T21:05:23Z","timestamp":1644613523000},"page":"411-426","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["An in-the-wild study to find type of questions people ask to a social robot providing question-answering service"],"prefix":"10.1007","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6570-4808","authenticated-orcid":false,"given":"Syed Ali","family":"Raza","sequence":"first","affiliation":[]},{"given":"Jonathan","family":"Vitale","sequence":"additional","affiliation":[]},{"given":"Meg","family":"Tonkin","sequence":"additional","affiliation":[]},{"given":"Benjamin","family":"Johnston","sequence":"additional","affiliation":[]},{"given":"Richard","family":"Billingsley","sequence":"additional","affiliation":[]},{"given":"Sarita","family":"Herse","sequence":"additional","affiliation":[]},{"given":"Mary-Anne","family":"Williams","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,2,11]]},"reference":[{"key":"411_CR1","doi-asserted-by":"crossref","unstructured":"Paepcke S, Takayama L (2010) Judging a bot by its cover: An experiment on expectation setting for personal robots. In: 2010 5th ACM\/IEEE international conference on human-robot interaction (HRI), IEEE, pp 45\u201352","DOI":"10.1109\/HRI.2010.5453268"},{"key":"411_CR2","doi-asserted-by":"crossref","unstructured":"De\u00a0Graaf M, Ben\u00a0Allouch S (2014) Expectation setting and personality attribution in HRI. In: Proceedings of the 2014 ACM\/IEEE international conference on human-robot interaction, ACM, pp 144\u2013145","DOI":"10.1145\/2559636.2559796"},{"issue":"3","key":"411_CR3","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1561\/1100000005","volume":"1","author":"MA Goodrich","year":"2008","unstructured":"Goodrich MA, Schultz AC et al (2008) Human-robot interaction: a survey. Found Trends Hum-Comput Interact 1(3):203\u2013275","journal-title":"Found Trends Hum-Comput Interact"},{"issue":"4","key":"411_CR4","doi-asserted-by":"publisher","first-page":"525","DOI":"10.1177\/0018720816644364","volume":"58","author":"TB Sheridan","year":"2016","unstructured":"Sheridan TB (2016) Human-robot interaction: status and challenges. Hum Factors 58(4):525\u2013532","journal-title":"Hum Factors"},{"issue":"2","key":"411_CR5","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1007\/s12369-013-0178-y","volume":"5","author":"I Leite","year":"2013","unstructured":"Leite I, Martinho C, Paiva A (2013) Social robots for long-term interaction: A survey. Int J Soc Robot 5(2):291\u2013308","journal-title":"Int J Soc Robot"},{"key":"411_CR6","doi-asserted-by":"crossref","unstructured":"Lee MK, Makatchev M (2009) How do people talk with a robot? An analysis of human-robot dialogues in the real world. In: CHI\u201909 extended abstracts on human factors in computing systems, ACM, pp 3769\u20133774","DOI":"10.1145\/1520340.1520569"},{"key":"411_CR7","doi-asserted-by":"crossref","unstructured":"Lee MK, Kiesler S, Forlizzi J (2010) Receptionist or information kiosk: How do people talk with a robot? In: Proceedings of the 2010 ACM conference on Computer supported cooperative work, ACM, pp 31\u201340","DOI":"10.1145\/1718918.1718927"},{"key":"411_CR8","doi-asserted-by":"crossref","unstructured":"Jokinen K (2018) Dialogue models for socially intelligent robots. In: International conference on social robotics, Springer, pp 127\u2013138","DOI":"10.1007\/978-3-030-05204-1_13"},{"key":"411_CR9","doi-asserted-by":"crossref","unstructured":"Wainer J, Feil-Seifer DJ, Shell DA, Mataric MJ (2007) Embodiment and human-robot interaction: A task-based perspective. In: The 16th IEEE international symposium on robot and human interactive communication, 2007. RO-MAN 2007, IEEE, pp 872\u2013877","DOI":"10.1109\/ROMAN.2007.4415207"},{"issue":"3","key":"411_CR10","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1016\/S1389-0417(02)00050-5","volume":"3","author":"K Dautenhahn","year":"2002","unstructured":"Dautenhahn K, Ogden B, Quick T (2002) From embodied to socially embedded agents-implications for interaction-aware robots. Cogn Syst Res 3(3):397\u2013428","journal-title":"Cogn Syst Res"},{"issue":"5853","key":"411_CR11","doi-asserted-by":"publisher","first-page":"1088","DOI":"10.1126\/science.1145803","volume":"318","author":"R Pfeifer","year":"2007","unstructured":"Pfeifer R, Lungarella M, Iida F (2007) Self-organization, embodiment, and biologically inspired robotics. Science 318(5853):1088\u20131093","journal-title":"Science"},{"key":"411_CR12","unstructured":"Ziemke T (2003) What\u2019s that thing called embodiment? In: Proceedings of the annual meeting of the cognitive science society, vol\u00a025"},{"key":"411_CR13","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1016\/j.ijhcs.2015.01.001","volume":"77","author":"J Li","year":"2015","unstructured":"Li J (2015) The benefit of being physically present: a survey of experimental works comparing copresent robots, telepresent robots and virtual agents. Int J Hum-Comput Stud 77:23\u201337. https:\/\/doi.org\/10.1016\/j.ijhcs.2015.01.001","journal-title":"Int J Hum-Comput Stud"},{"issue":"5","key":"411_CR14","doi-asserted-by":"publisher","first-page":"445","DOI":"10.1162\/105474603322761261","volume":"12","author":"S Zhao","year":"2003","unstructured":"Zhao S (2003) Toward a taxonomy of copresence. Presence Teleoper Virtual Environ 12(5):445\u2013455","journal-title":"Presence Teleoper Virtual Environ"},{"key":"411_CR15","doi-asserted-by":"crossref","unstructured":"Tonkin M, Vitale J, Ojha S, Clark J, Pfeiffer S, Judge W, Wang X, Williams MA (2017) Embodiment, privacy and social robots: May I remember you? In: Proceedings of the 9th international conference on social robotics (ICSR 2017), Tsukuba, Japan, November 22\u201324, 2017, Springer International Publishing, pp 506\u2013515, 10.1007\/978-3-319-70022-950, https:\/\/doi.org\/10.1007\/978-3-319-70022-9_50","DOI":"10.1007\/978-3-319-70022-9_50"},{"issue":"5","key":"411_CR16","doi-asserted-by":"publisher","first-page":"962","DOI":"10.1109\/TRO.2007.904904","volume":"23","author":"T Kanda","year":"2007","unstructured":"Kanda T, Sato R, Saiwaki N, Ishiguro H (2007) A two-month field trial in an elementary school for long-term human-robot interaction. IEEE Trans Rob 23(5):962\u2013971","journal-title":"IEEE Trans Rob"},{"key":"411_CR17","doi-asserted-by":"crossref","unstructured":"Sung J, Christensen HI, Grinter RE (2009) Robots in the wild: Understanding long-term use. In: Proceedings of the 4th ACM\/IEEE international conference on human robot interaction, ACM, pp 45\u201352","DOI":"10.1145\/1514095.1514106"},{"key":"411_CR18","doi-asserted-by":"crossref","unstructured":"Huttenrauch H, Eklundh KS (2002) Fetch-and-carry with CERO: observations from a long-term user study with a service robot. In: Proceedings. 11th IEEE international workshop on robot and human interactive communication, IEEE, pp 158\u2013163","DOI":"10.1109\/ROMAN.2002.1045615"},{"key":"411_CR19","doi-asserted-by":"crossref","unstructured":"Pacchierotti E, Christensen HI, Jensfelt P (2006) Design of an office-guide robot for social interaction studies. In: 2006 IEEE\/RSJ international conference on intelligent robots and systems, IEEE, pp 4965\u20134970","DOI":"10.1109\/IROS.2006.282519"},{"key":"411_CR20","unstructured":"Nisimura R, Nishihara Y, Tsurumi R, Lee A, Saruwatari H, Shikano K (2003) Takemaru-kun: Speech-oriented information system for real world research platform. In: Proceedings international workshop on language understanding and agents for real world interaction"},{"issue":"2","key":"411_CR21","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1145\/763693.763694","volume":"21","author":"D Moldovan","year":"2003","unstructured":"Moldovan D, Pa\u015fca M, Harabagiu S, Surdeanu M (2003) Performance issues and error analysis in an open-domain question answering system. ACM Trans Inf Syst (TOIS) 21(2):133\u2013154","journal-title":"ACM Trans Inf Syst (TOIS)"},{"issue":"6","key":"411_CR22","doi-asserted-by":"publisher","first-page":"895","DOI":"10.3233\/SW-160247","volume":"8","author":"K H\u00f6ffner","year":"2017","unstructured":"H\u00f6ffner K, Walter S, Marx E, Usbeck R, Lehmann J, Ngonga Ngomo AC (2017) Survey on challenges of question answering in the semantic web. Semantic Web 8(6):895\u2013920","journal-title":"Semantic Web"},{"key":"411_CR23","doi-asserted-by":"crossref","unstructured":"Nuccio C, Augello A, Gaglio S, Pilato G (2018) Interaction capabilities of a robotic receptionist. In: International conference on intelligent interactive multimedia systems and services, Springer, pp 171\u2013180","DOI":"10.1007\/978-3-319-59480-4_18"},{"key":"411_CR24","unstructured":"Yu L, Hermann KM, Blunsom P, Pulman S (2014) Deep learning for answer sentence selection. arXiv preprint arXiv:1412.1632"},{"key":"411_CR25","unstructured":"Kumar A, Irsoy O, Ondruska P, Iyyer M, Bradbury J, Gulrajani I, Zhong V, Paulus R, Socher R (2016) Ask me anything: Dynamic memory networks for natural language processing. In: International conference on machine learning, pp 1378\u20131387"},{"key":"411_CR26","doi-asserted-by":"crossref","unstructured":"Kim KM, Heo MO, Choi SH, Zhang BT (2017) Deepstory: Video story qa by deep embedded memory networks. arXiv preprint arXiv:1707.00836","DOI":"10.24963\/ijcai.2017\/280"},{"key":"411_CR27","doi-asserted-by":"crossref","unstructured":"Xu H, Saenko K (2016) Ask, attend and answer: Exploring question-guided spatial attention for visual question answering. In: European conference on computer vision, Springer, pp 451\u2013466","DOI":"10.1007\/978-3-319-46478-7_28"},{"key":"411_CR28","doi-asserted-by":"crossref","unstructured":"Purington A, Taft JG, Sannon S, Bazarova NN, Taylor SH (2017) Alexa is my new BFF: Social roles, user satisfaction, and personification of the amazon echo. In: Proceedings of the 2017 CHI conference extended abstracts on human factors in computing systems, ACM, pp 2853\u20132859","DOI":"10.1145\/3027063.3053246"},{"key":"411_CR29","doi-asserted-by":"crossref","unstructured":"L\u00f3pez G, Quesada L, Guerrero LA (2017) Alexa vs. Siri vs. Cortana vs. Google Assistant: A comparison of speech-based natural user interfaces. In: International conference on applied human factors and ergonomics, Springer, pp 241\u2013250","DOI":"10.1007\/978-3-319-60366-7_23"},{"key":"411_CR30","doi-asserted-by":"crossref","unstructured":"Kopp S, Gesellensetter L, Kr\u00e4mer NC, Wachsmuth I (2005) A conversational agent as museum guide\u2013design and evaluation of a real-world application. In: International workshop on intelligent virtual agents, Springer, pp 329\u2013343","DOI":"10.1007\/11550617_28"},{"key":"411_CR31","doi-asserted-by":"crossref","unstructured":"Luger E, Sellen A (2016) Like having a really bad PA: The gulf between user expectation and experience of conversational agents. In: Proceedings of the 2016 CHI conference on human factors in computing systems, ACM, pp 5286\u20135297","DOI":"10.1145\/2858036.2858288"},{"key":"411_CR32","doi-asserted-by":"crossref","unstructured":"Sugiyama H, Meguro T, Higashinaka R (2017) Evaluation of question-answering system about conversational agent\u2019s personality. In: Dialogues with social robots, Springer, pp 183\u2013194","DOI":"10.1007\/978-981-10-2585-3_14"},{"key":"411_CR33","doi-asserted-by":"crossref","unstructured":"Cantrell R, Scheutz M, Schermerhorn P, Wu X (2010) Robust spoken instruction understanding for HRI. In: Proceedings of the 5th ACM\/IEEE international conference on human-robot interaction, IEEE Press, pp 275\u2013282","DOI":"10.1109\/HRI.2010.5453184"},{"key":"411_CR34","doi-asserted-by":"crossref","unstructured":"Cruz-Sandoval D, Eyssel F, Favela J, Sandoval EB (2017) Towards a conversational corpus for human-robot conversations. In: Proceedings of the companion of the 2017 ACM\/IEEE international conference on human-robot interaction, ACM, pp 99\u2013100","DOI":"10.1145\/3029798.3038344"},{"key":"411_CR35","doi-asserted-by":"crossref","unstructured":"Ben-Youssef A, Clavel C, Essid S, Bilac M, Chamoux M, Lim A (2017) UE-HRI: A new dataset for the study of user engagement in spontaneous human-robot interactions. In: Proceedings of the 19th ACM international conference on multimodal interaction, ACM, New York, NY, USA, ICMI 2017, pp 464\u2013472, 10.1145\/3136755.3136814, http:\/\/doi.acm.org\/10.1145\/3136755.3136814","DOI":"10.1145\/3136755.3136814"},{"key":"411_CR36","unstructured":"Bohus D, Saw CW, Horvitz E (2014) Directions robot: In-the-wild experiences and lessons learned. In: Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems, international foundation for autonomous agents and multiagent systems, pp 637\u2013644"},{"key":"411_CR37","doi-asserted-by":"crossref","unstructured":"Guo S, Lenchner J, Connell J, Dholakia M, Muta H (2017) Conversational bootstrapping and other tricks of a concierge robot. In: Proceedings of the 2017 ACM\/IEEE international conference on human-robot interaction, ACM, pp 73\u201381","DOI":"10.1145\/2909824.3020232"},{"key":"411_CR38","doi-asserted-by":"crossref","unstructured":"Iwamura Y, Shiomi M, Kanda T, Ishiguro H, Hagita N (2011) Do elderly people prefer a conversational humanoid as a shopping assistant partner in supermarkets? In: 2011 6th ACM\/IEEE international conference on human-robot interaction (HRI), pp 449\u2013457, 10.1145\/1957656.1957816","DOI":"10.1145\/1957656.1957816"},{"issue":"6","key":"411_CR39","first-page":"38","volume":"18","author":"L Philips","year":"2000","unstructured":"Philips L (2000) The double metaphone search algorithm. C\/C++ Users J 18(6):38\u201343","journal-title":"C\/C++ Users J"},{"key":"411_CR40","doi-asserted-by":"crossref","unstructured":"Mutlu B, Forlizzi J (2008) Robots in organizations: the role of workflow, social, and environmental factors in human-robot interaction. In: 2008 3rd ACM\/IEEE international conference on human-robot interaction (HRI), IEEE, pp 287\u2013294","DOI":"10.1145\/1349822.1349860"},{"key":"411_CR41","volume-title":"Real world research","author":"C Robson","year":"2016","unstructured":"Robson C, McCartan K (2016) Real world research. Wiley, New York"},{"key":"411_CR42","doi-asserted-by":"crossref","unstructured":"Moreno-S\u00e1nchez I, Font-Clos F, Corral \u00c1 (2016) Large-scale analysis of Zipf\u2019s law in English texts. PloS One 11(1):e0147073","DOI":"10.1371\/journal.pone.0147073"},{"key":"411_CR43","doi-asserted-by":"publisher","DOI":"10.4324\/9780203793206","volume-title":"Discovery of grounded theory: strategies for qualitative research","author":"BG Glaser","year":"2017","unstructured":"Glaser BG, Strauss AL (2017) Discovery of grounded theory: strategies for qualitative research. Routledge, London"},{"issue":"2\u20133","key":"411_CR44","first-page":"105","volume":"4","author":"A Thomaz","year":"2016","unstructured":"Thomaz A, Hoffman G, Cakmak M (2016) Computational human-robot interaction. Found Trends Robot 4(2\u20133):105\u2013223","journal-title":"Found Trends Robot"},{"key":"411_CR45","doi-asserted-by":"crossref","unstructured":"Tonkin M, Vitale J, Herse S, Williams MA, Judge W, Wang X (2018) Design methodology for the UX of HRI: A field study of a commercial social robot at an airport. In: Proceedings of the 2018 ACM\/IEEE international conference on human-robot interaction, ACM, pp 407\u2013415","DOI":"10.1145\/3171221.3171270"},{"key":"411_CR46","volume-title":"The media equation: How people treat computers, television, and new media like real people and places","author":"B Reeves","year":"1996","unstructured":"Reeves B, Nass CI (1996) The media equation: How people treat computers, television, and new media like real people and places. Cambridge University Press, Cambridge"},{"key":"411_CR47","doi-asserted-by":"crossref","unstructured":"Hoffmann L, Kr\u00e4mer NC, Lam-Chi A, Kopp S (2009) Media equation revisited: Do users show polite reactions towards an embodied agent? In: International workshop on intelligent virtual agents, Springer, pp 159\u2013165","DOI":"10.1007\/978-3-642-04380-2_19"},{"key":"411_CR48","doi-asserted-by":"crossref","unstructured":"Foster ME, Gaschler A, Giuliani M, Isard A, Pateraki M, Petrick R (2012) Two people walk into a bar: Dynamic multi-party social interaction with a robot agent. In: Proceedings of the 14th ACM international conference on Multimodal interaction, ACM, pp 3\u201310","DOI":"10.1145\/2388676.2388680"},{"key":"411_CR49","doi-asserted-by":"crossref","unstructured":"Lee MK, Kiesler S, Forlizzi J, Srinivasa S, Rybski P (2010) Gracefully mitigating breakdowns in robotic services. In: 2010 5th ACM\/IEEE international conference on human-robot interaction (HRI), IEEE, pp 203\u2013210","DOI":"10.1109\/HRI.2010.5453195"},{"issue":"1","key":"411_CR50","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1111\/0022-4537.00153","volume":"56","author":"C Nass","year":"2000","unstructured":"Nass C, Moon Y (2000) Machines and mindlessness: Social responses to computers. J Soc Issues 56(1):81\u2013103","journal-title":"J Soc Issues"}],"container-title":["Intelligent Service Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11370-022-00411-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11370-022-00411-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11370-022-00411-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,7,13]],"date-time":"2022-07-13T08:33:26Z","timestamp":1657701206000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11370-022-00411-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,11]]},"references-count":50,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,7]]}},"alternative-id":["411"],"URL":"https:\/\/doi.org\/10.1007\/s11370-022-00411-z","relation":{},"ISSN":["1861-2776","1861-2784"],"issn-type":[{"type":"print","value":"1861-2776"},{"type":"electronic","value":"1861-2784"}],"subject":[],"published":{"date-parts":[[2022,2,11]]},"assertion":[{"value":"7 November 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 December 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 February 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}