{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T15:55:39Z","timestamp":1784217339029,"version":"3.55.0"},"reference-count":106,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2024,4,4]],"date-time":"2024-04-04T00:00:00Z","timestamp":1712188800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,4,4]],"date-time":"2024-04-04T00:00:00Z","timestamp":1712188800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100008769","name":"Julius-Maximilians-Universit\u00e4t W\u00fcrzburg","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100008769","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Multimodal User Interfaces"],"published-print":{"date-parts":[[2024,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Storytelling is a long-established tradition and listening to stories is still a popular leisure activity. Caused by technization, storytelling media expands, e.g., to social robots acting as multi-modal storytellers, using different multimodal behaviours such as facial expressions or body postures. With the overarching goal to automate robotic storytelling, we have been annotating stories with emotion labels which the robot can use to automatically adapt its behavior. With it, three different approaches are compared in two studies in this paper: 1) manual labels by human annotators (MA), 2) software-based word-sensitive annotation using the Linguistic Inquiry and Word Count program (LIWC), and 3) a machine learning based approach (ML). In an online study showing videos of a storytelling robot, the annotations were validated, with LIWC and MA achieving the best, and ML the worst results. In a laboratory user study, the three versions of the story were compared regarding transportation and cognitive absorption, revealing no significant differences but a positive trend towards MA. On this empirical basis, the <jats:italic>Automated Robotic Storyteller<\/jats:italic> was implemented using manual annotations. Future iterations should include other robots and modalities, fewer emotion labels and their probabilities.<\/jats:p>","DOI":"10.1007\/s12193-024-00429-w","type":"journal-article","created":{"date-parts":[[2024,4,4]],"date-time":"2024-04-04T15:02:26Z","timestamp":1712242946000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Towards the development of an automated robotic storyteller: comparing approaches for emotional story annotation for non-verbal expression via body language"],"prefix":"10.1007","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5345-6501","authenticated-orcid":false,"given":"Sophia C.","family":"Steinhaeusser","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Albin","family":"Zehe","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peggy","family":"Schnetter","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andreas","family":"Hotho","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Birgit","family":"Lugrin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,4,4]]},"reference":[{"issue":"4","key":"429_CR1","doi-asserted-by":"publisher","first-page":"665","DOI":"10.2307\/3250951","volume":"24","author":"R Agarwal","year":"2000","unstructured":"Agarwal R, Karahanna E (2000) Time flies when you\u2019re having fun: cognitive absorption and beliefs about information technology usage. MIS Q 24(4):665. https:\/\/doi.org\/10.2307\/3250951","journal-title":"MIS Q"},{"key":"429_CR2","unstructured":"Ahn Le Q, d\u2019Alessandro C, Deroo O, et\u00a0al (2010) Towards a storytelling humanoid robot. In: Association for the advancement of artificial (ed) 2010 AAAI Fall Symposium Series"},{"key":"429_CR3","unstructured":"Aldebaran Robotics (2016) Choregraphe [Software] https:\/\/www.ald.softbankrobotics.com\/en"},{"key":"429_CR4","unstructured":"Alexandrova IV, Volkova EP, Kloos U, et\u00a0al (2010) Short paper: virtual storyteller in immersive virtual environments using fairy tales annotated for emotion states. Citeseer 65\u201368"},{"key":"429_CR5","doi-asserted-by":"publisher","unstructured":"Alm CO, Roth D, Sproat R (2005) Emotions from text: machine learning for text-based emotion prediction. In: Mooney RJ (ed) Proceedings of the conference on human language technology and empirical methods in natural language processing-HLT \u201905. Association for Computational Linguistics, Morristown, NJ, USA, pp 579\u2013586. https:\/\/doi.org\/10.3115\/1220575.1220648","DOI":"10.3115\/1220575.1220648"},{"issue":"2","key":"429_CR6","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1080\/15213269.2014.987400","volume":"18","author":"M Appel","year":"2015","unstructured":"Appel M, Gnambs T, Richter T et al (2015) The transportation scale-short form (TS-SF). Media Psychol 18(2):243\u2013266. https:\/\/doi.org\/10.1080\/15213269.2014.987400","journal-title":"Media Psychol"},{"issue":"106","key":"429_CR7","doi-asserted-by":"publisher","first-page":"749","DOI":"10.1016\/j.chb.2021.106749","volume":"120","author":"M Appel","year":"2021","unstructured":"Appel M, Lugrin B, K\u00fchle M et al (2021) The emotional robotic storyteller: on the influence of affect congruency on narrative transportation, robot perception, and persuasion. Comput Hum Behav 120(106):749. https:\/\/doi.org\/10.1016\/j.chb.2021.106749","journal-title":"Comput Hum Behav"},{"key":"429_CR8","doi-asserted-by":"publisher","unstructured":"Augello A, Pilato G (2019) An annotated corpus of stories and gestures for a robotic storyteller. In: 2019 Third IEEE international conference on robotic computing (IRC). IEEE, pp 630\u2013635. https:\/\/doi.org\/10.1109\/IRC.2019.00127","DOI":"10.1109\/IRC.2019.00127"},{"key":"429_CR9","doi-asserted-by":"publisher","unstructured":"Augello A, Infantino I, Maniscalco U, et\u00a0al (2019) Narrob: a humanoid social storyteller with emotional expression capabilities. In: Samsonovich AV (ed) Biologically inspired cognitive architectures 2018, Advances in Intelligent Systems and Computing, vol 848. Springer International Publishing, Cham, pp 9\u201315. https:\/\/doi.org\/10.1007\/978-3-319-99316-4_2","DOI":"10.1007\/978-3-319-99316-4_2"},{"key":"429_CR10","doi-asserted-by":"crossref","unstructured":"Aylett R (2022) Interactive narrative and story-telling. In: Lugrin B, Pelachaud C, Traum D (eds) The handbook on socially interactive agents-volume 2: interactivity, platforms, application. 20 Years of Research on Embodied Conversational Agents, Intelligent Virtual Agents, and Social Robotics, Association for Computing Machinery, pp 463\u2013491","DOI":"10.1145\/3563659.3563674"},{"key":"429_CR11","unstructured":"Beck A, Stevens B, Bard KA (2009) Comparing perception of affective body movements displayed by actors and animated characters. In: Proceedings of the symposium on mental states, emotions, and their embodiment, pp 169\u2013178"},{"key":"429_CR12","doi-asserted-by":"publisher","unstructured":"Beck A, Canamero L, Bard KA (2010) Towards an affect space for robots to display emotional body language. In: 19th international symposium in robot and human interactive communication. IEEE, pp 464\u2013469. https:\/\/doi.org\/10.1109\/ROMAN.2010.5598649","DOI":"10.1109\/ROMAN.2010.5598649"},{"key":"429_CR13","doi-asserted-by":"publisher","unstructured":"Beck A, Ca\u00f1amero L, Damiano L, et\u00a0al (2011) Children interpretation of emotional body language displayed by a robot. In: Social robotics, lecture notes in computer science, vol 7072. Springer Berlin Heidelberg, Berlin, Heidelberg, pp 62\u201370. https:\/\/doi.org\/10.1007\/978-3-642-25504-5_7","DOI":"10.1007\/978-3-642-25504-5_7"},{"issue":"2","key":"429_CR14","doi-asserted-by":"publisher","first-page":"25","DOI":"10.3390\/robotics9020025","volume":"9","author":"A Bono","year":"2020","unstructured":"Bono A, Augello A, Pilato G et al (2020) An act-r based humanoid social robot to manage storytelling activities. Robotics 9(2):25. https:\/\/doi.org\/10.3390\/robotics9020025","journal-title":"Robotics"},{"key":"429_CR15","unstructured":"Brown TB, Mann B, Ryder N, et\u00a0al (2020) Language models are few-shot learners. arXiv preprint arXiv:2005.14165"},{"key":"429_CR16","doi-asserted-by":"publisher","unstructured":"Buechel S, Modersohn L, Hahn U (2021) Towards label-agnostic emotion embeddings. In: Proceedings of the 2021 conference on empirical methods in natural language processing. Association for Computational Linguistics, Online and Punta Cana, Dominican Republic, pp 9231\u20139249. https:\/\/doi.org\/10.18653\/v1\/2021.emnlp-main.728, https:\/\/aclanthology.org\/2021.emnlp-main.728","DOI":"10.18653\/v1\/2021.emnlp-main.728"},{"issue":"3","key":"429_CR17","doi-asserted-by":"publisher","first-page":"375","DOI":"10.2307\/1772644","volume":"12","author":"J Cassell","year":"1991","unstructured":"Cassell J, McNeill D (1991) Gestures and the poetics of prose. Poetics Today 12(3):375\u2013404","journal-title":"Poetics Today"},{"key":"429_CR18","doi-asserted-by":"crossref","unstructured":"Cassell J, Vilhj\u00e1lmsson HH, Bickmore T (2001) Beat: the behavior expression animation toolkit. In: Pocock L (ed) Proceedings of the 28th annual conference on Computer graphics and interactive techniques. ACM, New York, NY, pp 477\u2013486","DOI":"10.1145\/383259.383315"},{"key":"429_CR19","doi-asserted-by":"publisher","unstructured":"Cho K, van Merri\u00ebnboer B, Gulcehre C, et\u00a0al (2014) Learning phrase representations using RNN encoder\u2013decoder for statistical machine translation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). Association for Computational Linguistics, Doha, Qatar, pp 1724\u20131734. https:\/\/doi.org\/10.3115\/v1\/D14-1179, https:\/\/www.aclweb.org\/anthology\/D14-1179","DOI":"10.3115\/v1\/D14-1179"},{"key":"429_CR20","doi-asserted-by":"publisher","unstructured":"Clavel C, Plessier J, Martin JC, et\u00a0al (2009) Combining facial and postural expressions of emotions in a virtual character. In: Intelligent virtual agents, lecture notes in computer science, vol 5773. Springer Berlin Heidelberg, Berlin, Heidelberg, pp 287\u2013300. https:\/\/doi.org\/10.1007\/978-3-642-04380-2_31","DOI":"10.1007\/978-3-642-04380-2_31"},{"issue":"03","key":"429_CR21","doi-asserted-by":"publisher","first-page":"1850006","DOI":"10.1142\/S0219843618500068","volume":"15","author":"S Costa","year":"2018","unstructured":"Costa S, Brunete A, Bae BC et al (2018) Emotional storytelling using virtual and robotic agents. Int J Human Robot 15(03):1850006. https:\/\/doi.org\/10.1142\/S0219843618500068","journal-title":"Int J Human Robot"},{"key":"429_CR22","doi-asserted-by":"crossref","unstructured":"Declerck T, Scheidel A, Lendvai P (2011) Proppian content descriptors in an integrated annotation schema for fairy tales. In: Language technology for cultural heritage. Springer, pp 155\u2013170, Berlin","DOI":"10.1007\/978-3-642-20227-8_9"},{"key":"429_CR23","unstructured":"Devlin J, Chang MW, Lee K, et\u00a0al (2018) Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805"},{"key":"429_CR24","unstructured":"Doukhan D, Rosset S, Rilliard A, et\u00a0al (2012) Text and speech corpora for text-to-speech synthesis of tales. In: Proceedings of the 8th international conference on language resources and evaluation, pp 1003\u20131010"},{"key":"429_CR25","unstructured":"Duffy BR, Rooney C, O\u2019Hare GMP, et\u00a0al (1999) What is a social robot? In: 10th Irish conference on artificial intelligence & cognitive science. http:\/\/hdl.handle.net\/10197\/4412"},{"issue":"19","key":"429_CR26","first-page":"344","volume":"3","author":"P Ekman","year":"1984","unstructured":"Ekman P (1984) Expression and the nature of emotion. Approaches to emotion 3(19):344","journal-title":"Approaches to emotion"},{"key":"429_CR27","unstructured":"Ekman P (ed) (1997) What the face reveals: basic and applied studies of spontaneous expression using the facial action coding system (FACS). Series in affective science, Oxford Univ. Press, New York, NY. http:\/\/www.loc.gov\/catdir\/enhancements\/fy0605\/96036655-d.html"},{"key":"429_CR28","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1002\/0470013494.ch3","volume-title":"Handbook of cognition and emotion","author":"P Ekman","year":"1999","unstructured":"Ekman P (1999) Basic emotions. In: Dalgleish T, Power MJ (eds) Handbook of cognition and emotion. Wiley, Chichester, pp 45\u201360. https:\/\/doi.org\/10.1002\/0470013494.ch3"},{"key":"429_CR29","doi-asserted-by":"crossref","unstructured":"Ekman P (2004) Emotional and conversational nonverbal signals. In: Language, knowledge, and representation. Academic Publishers, pp 39\u201350, Cambridge","DOI":"10.1007\/978-1-4020-2783-3_3"},{"key":"429_CR30","unstructured":"El Maarouf I, Villaneau J (eds) (2012) A French Fairy Tale Corpus syntactically and semantically annotated"},{"issue":"4","key":"429_CR31","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1007\/s12369-013-0200-4","volume":"5","author":"MS Erden","year":"2013","unstructured":"Erden MS (2013) Emotional postures for the humanoid-robot nao. Int J Soc Robot 5(4):441\u2013456","journal-title":"Int J Soc Robot"},{"key":"429_CR32","unstructured":"Forgas JP, Laham SM (2016) Halo effects. In: Pohl R (ed) Cognitive illusions. Ebrary online, Routledge, Abingdon, Oxon, pp 276\u2013290"},{"issue":"3","key":"429_CR33","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1007\/s10579-011-9140-5","volume":"46","author":"V Francisco","year":"2012","unstructured":"Francisco V, Herv\u00e1s R, Peinado F et al (2012) Emotales: creating a corpus of folk tales with emotional annotations. Lang Resour Eval 46(3):341\u2013381","journal-title":"Lang Resour Eval"},{"key":"429_CR34","unstructured":"Frijda NH (2001) The emotions. In: Studies in emotion and social interaction, Cambridge University Press, Cambridge"},{"key":"429_CR35","unstructured":"Gelin R, d\u2019Alessandro C, Anh Le Q, et\u00a0al (2010) Towards a storytelling humanoid robot. In: Dialog with robots. Association for the Advancement of Artificial Intelligence, pp 137\u2013138"},{"key":"429_CR36","unstructured":"Giordano R (2018) Wordlist Maker-list unique words, count total words. https:\/\/design215.com\/toolbox\/wordlist.php"},{"key":"429_CR37","unstructured":"Goossens N, Aarts R, Vogt P (2019) Storytelling with a social robot. Robots for Learning R4L"},{"issue":"5","key":"429_CR38","doi-asserted-by":"publisher","first-page":"701","DOI":"10.1037\/0022-3514.79.5.701","volume":"79","author":"MC Green","year":"2000","unstructured":"Green MC, Brock TC (2000) The role of transportation in the persuasiveness of public narratives. J Pers Soc Psychol 79(5):701\u2013721. https:\/\/doi.org\/10.1037\/\/0022-3514.79.5.701","journal-title":"J Pers Soc Psychol"},{"key":"429_CR39","doi-asserted-by":"publisher","unstructured":"Grzyb B, Vigliocco G (2020) Beyond robotic speech: mutual benefits to cognitive psychology and artificial intelligence from the study of multimodal communication. https:\/\/doi.org\/10.31234\/osf.io\/h5dxy","DOI":"10.31234\/osf.io\/h5dxy"},{"key":"429_CR40","unstructured":"Haas M (2014) Weakly supervised learning for compositional sentiment recognition. PhD thesis, Heidelberg University"},{"key":"429_CR41","first-page":"1","volume":"329","author":"T Habermas","year":"2011","unstructured":"Habermas T (2011) Moralische Emotionen: \u00c4rger in Alltagserz\u00e4hlungen. Jenseits des Individuums-Emotion und Organisation, Vandenhoeck Ruprecht, G\u00f6ttingen 329:1\u2013350","journal-title":"Jenseits des Individuums-Emotion und Organisation, Vandenhoeck Ruprecht, G\u00f6ttingen"},{"key":"429_CR42","doi-asserted-by":"publisher","unstructured":"Ham J, Bokhorst R, Cuijpers R, et\u00a0al (2011) Making robots persuasive: the influence of combining persuasive strategies (gazing and gestures) by a storytelling robot on its persuasive power. In: Social robotics, lecture notes in computer science, vol 7072. Springer Berlin Heidelberg, Berlin, Heidelberg, pp 71\u201383. https:\/\/doi.org\/10.1007\/978-3-642-25504-5_8","DOI":"10.1007\/978-3-642-25504-5_8"},{"key":"429_CR43","doi-asserted-by":"crossref","unstructured":"H\u00e4ring M, Bee N, Andr\u00e9 E (2011) Creation and evaluation of emotion expression with body movement, sound and eye color for humanoid robots. IEEE, pp 204\u2013209","DOI":"10.1109\/ROMAN.2011.6005263"},{"key":"429_CR44","doi-asserted-by":"publisher","unstructured":"Hashimoto T, Hitramatsu S, Tsuji T, et\u00a0al (2006) Development of the face robot saya for rich facial expressions. In: 2006 SICE-ICASE international joint conference. IEEE, pp 5423\u20135428. https:\/\/doi.org\/10.1109\/SICE.2006.315537","DOI":"10.1109\/SICE.2006.315537"},{"key":"429_CR45","doi-asserted-by":"publisher","unstructured":"Hegel F, Muhl C, Wrede B, et\u00a0al (2009) Understanding social robots. In: 2009 second international conferences on advances in computer-human interactions. IEEE, pp 169\u2013174. https:\/\/doi.org\/10.1109\/ACHI.2009.51","DOI":"10.1109\/ACHI.2009.51"},{"key":"429_CR46","doi-asserted-by":"publisher","first-page":"104096","DOI":"10.1016\/j.robot.2022.104096","volume":"154","author":"M Iovino","year":"2022","unstructured":"Iovino M, Scukins E, Styrud J et al (2022) A survey of behavior trees in robotics and AI. Robot Auton Syst 154:104096. https:\/\/doi.org\/10.1016\/j.robot.2022.104096","journal-title":"Robot Auton Syst"},{"key":"429_CR47","doi-asserted-by":"crossref","unstructured":"Izui T, Milleville I, Sakka S, et\u00a0al (2015) Expressing emotions using gait of humanoid robot. IEEE, pp 241\u2013245","DOI":"10.1109\/ROMAN.2015.7333614"},{"key":"429_CR48","doi-asserted-by":"publisher","unstructured":"Karreman D, Sepulveda Bradford G, van Dijk B, et\u00a0al (2013) What happens when a robot favors someone? How a tour guide robot uses gaze behavior to address multiple persons while storytelling about art. In: 2013 8th ACM\/IEEE international conference on human-robot interaction (HRI). IEEE, pp 157\u2013158. https:\/\/doi.org\/10.1109\/HRI.2013.6483549","DOI":"10.1109\/HRI.2013.6483549"},{"key":"429_CR49","unstructured":"Kim E, Klinger R (2018) A survey on sentiment and emotion analysis for computational literary studies. arXiv preprint arXiv:1808.03137"},{"key":"429_CR50","doi-asserted-by":"publisher","unstructured":"Kim E, Klinger R (2019) Frowning Frodo, wincing Leia, and a seriously great friendship: learning to classify emotional relationships of fictional characters. In: Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, pp 647\u2013653. https:\/\/doi.org\/10.18653\/v1\/N19-1067, https:\/\/www.aclweb.org\/anthology\/N19-1067","DOI":"10.18653\/v1\/N19-1067"},{"key":"429_CR51","doi-asserted-by":"publisher","unstructured":"Kolog EA, Montero CS, Sutinen E (2016) Annotation agreement of emotions in text: the influence of counsellors\u2019 emotional state on their emotion perception. In: 2016 IEEE 16th international conference on advanced learning technologies (ICALT). IEEE, pp 357\u2013359. https:\/\/doi.org\/10.1109\/ICALT.2016.21","DOI":"10.1109\/ICALT.2016.21"},{"issue":"3","key":"429_CR52","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1109\/T-AFFC.2013.18","volume":"4","author":"U Krcadinac","year":"2013","unstructured":"Krcadinac U, Pasquier P, Jovanovic J et al (2013) Synesketch: an open source library for sentence-based emotion recognition. IEEE Trans Affect Comput 4(3):312\u2013325. https:\/\/doi.org\/10.1109\/T-AFFC.2013.18","journal-title":"IEEE Trans Affect Comput"},{"key":"429_CR53","doi-asserted-by":"publisher","first-page":"28","DOI":"10.3389\/fpsyg.2013.00028","volume":"4","author":"ME Kret","year":"2013","unstructured":"Kret ME, Stekelenburg JJ, Roelofs K et al (2013) Perception of face and body expressions using electromyography, pupillometry and gaze measures. Front Psychol 4:28. https:\/\/doi.org\/10.3389\/fpsyg.2013.00028","journal-title":"Front Psychol"},{"issue":"1","key":"429_CR54","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","volume":"33","author":"JR Landis","year":"1977","unstructured":"Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33(1):159. https:\/\/doi.org\/10.2307\/2529310","journal-title":"Biometrics"},{"key":"429_CR55","unstructured":"LimeSurvey GmbH (2021) LimeSurvey https:\/\/www.limesurvey.org\/de\/"},{"key":"429_CR56","doi-asserted-by":"publisher","DOI":"10.1017\/9781108639286","volume-title":"Sentiment analysis: mining opinions, sentiments, and emotions","author":"B Liu","year":"2020","unstructured":"Liu B (2020) Sentiment analysis: mining opinions, sentiments, and emotions. Cambridge University Press, Cambridge"},{"issue":"2","key":"429_CR57","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1007\/s11042-011-0813-2","volume":"59","author":"V Lombardo","year":"2012","unstructured":"Lombardo V, Damiano R (2012) Semantic annotation of narrative media objects. Multimed Tools Appl 59(2):407\u2013439","journal-title":"Multimed Tools Appl"},{"key":"429_CR58","volume-title":"The secret cave or John Lee\u2019s adventure","author":"HP Lovecraft","year":"1959","unstructured":"Lovecraft HP (1959) The secret cave or John Lee\u2019s adventure. Arkham House, Sauk City"},{"key":"429_CR59","doi-asserted-by":"publisher","DOI":"10.1145\/3477322","volume-title":"The handbook on socially interactive agents","author":"B Lugrin","year":"2021","unstructured":"Lugrin B, Pelachaud C, Traum D (2021) The handbook on socially interactive agents. ACM, New York. https:\/\/doi.org\/10.1145\/3477322"},{"key":"429_CR60","unstructured":"Mehrabian A (2017) Nonverbal communication. Routledge, Taylor and Francis Group, Abingdon, Oxon and New York"},{"key":"429_CR61","doi-asserted-by":"publisher","unstructured":"Munezero M, Montero CS, Mozgovoy M, et\u00a0al (2013) Exploiting sentiment analysis to track emotions in students\u2019 learning diaries. In: Laakso MJ, Simon (eds) Proceedings of the 13th Koli calling international conference on computing education research-Koli Calling \u201913. ACM Press, New York, New York, USA, pp 145\u2013152. https:\/\/doi.org\/10.1145\/2526968.2526984","DOI":"10.1145\/2526968.2526984"},{"key":"429_CR62","doi-asserted-by":"publisher","unstructured":"Pang B, Lee L (2008) Opinion mining and sentiment analysis. Found Trends\u00ae Inf Retr 2(1\u20132):1\u2013135. https:\/\/doi.org\/10.1561\/1500000011","DOI":"10.1561\/1500000011"},{"key":"429_CR63","first-page":"130","volume-title":"Automatic emotion annotation of movie dialogue using WordNet","author":"SB Park","year":"2011","unstructured":"Park SB, Yoo E, Kim H et al (2011) Automatic emotion annotation of movie dialogue using WordNet. Springer, Berlin, pp 130\u2013139"},{"key":"429_CR64","unstructured":"Pelachaud C, Gelin R, Martin JC, et\u00a0al (2010) Expressive gestures displayed by a humanoid robot during a storytelling application. In: AISB\u20192010 symposium new frontiers in human-robot interaction. Leicester"},{"key":"429_CR65","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1145\/3477322.3477331","volume-title":"The handbook on socially interactive agents","author":"C Pelachaud","year":"2021","unstructured":"Pelachaud C, Busso C, Heylen D (2021) Multimodal behavior modeling for socially interactive agents. In: Lugrin B, Pelachaud C, Traum D (eds) The handbook on socially interactive agents. ACM, New York, pp 259\u2013310. https:\/\/doi.org\/10.1145\/3477322.3477331"},{"key":"429_CR66","unstructured":"Pennebaker JW (2015) LIWC2015 [Software]. https:\/\/liwc.wpengine.com\/"},{"key":"429_CR67","unstructured":"Pennebaker JW, Boyd RL, Jordan K, et\u00a0al (2015) The development and psychometric properties of LIWC2015"},{"issue":"4\u20135","key":"429_CR68","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1177\/053901882021004003","volume":"21","author":"R Plutchik","year":"1982","unstructured":"Plutchik R (1982) A psychoevolutionary theory of emotions. Soc Sci Inf 21(4\u20135):529\u2013553. https:\/\/doi.org\/10.1177\/053901882021004003","journal-title":"Soc Sci Inf"},{"issue":"4","key":"429_CR69","doi-asserted-by":"publisher","first-page":"344","DOI":"10.1511\/2001.28.344","volume":"89","author":"R Plutchik","year":"2001","unstructured":"Plutchik R (2001) The nature of emotions: human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. Am Sci 89(4):344\u2013350","journal-title":"Am Sci"},{"key":"429_CR70","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1016\/j.neunet.2018.03.014","volume":"107","author":"AH Qureshi","year":"2018","unstructured":"Qureshi AH, Nakamura Y, Yoshikawa Y et al (2018) Intrinsically motivated reinforcement learning for human-robot interaction in the real-world. Neural Netw Off J Int Neural Netw Soc 107:23\u201333. https:\/\/doi.org\/10.1016\/j.neunet.2018.03.014","journal-title":"Neural Netw Off J Int Neural Netw Soc"},{"issue":"4S","key":"429_CR71","doi-asserted-by":"publisher","first-page":"340","DOI":"10.4314\/jfas.v9i4s.20","volume":"9","author":"I Ramli","year":"2018","unstructured":"Ramli I, Jamil N, Seman N et al (2018) The first Malay language storytelling text-to-speech (TTS) corpus for humanoid robot storytellers. J Fundam Appl Sci 9(4S):340. https:\/\/doi.org\/10.4314\/jfas.v9i4s.20","journal-title":"J Fundam Appl Sci"},{"key":"429_CR72","unstructured":"robopec (2021) Reeti: an expressive and communicating robot [Hardware]. https:\/\/www.robopec.com\/en\/constructions\/others\/reeti-robopec\/"},{"issue":"6","key":"429_CR73","doi-asserted-by":"publisher","first-page":"1161","DOI":"10.1037\/h0077714","volume":"39","author":"JA Russell","year":"1980","unstructured":"Russell JA (1980) A circumplex model of affect. J Pers Soc Psychol 39(6):1161\u20131178. https:\/\/doi.org\/10.1037\/h0077714","journal-title":"J Pers Soc Psychol"},{"key":"429_CR74","doi-asserted-by":"publisher","unstructured":"Salem M, Eyssel F, Rohlfing K, et\u00a0al (2011) Effects of gesture on the perception of psychological anthropomorphism: a case study with a humanoid robot. In: Social robotics, lecture notes in computer science, vol 7072. Springer Berlin Heidelberg, Berlin, Heidelberg, pp 31\u201341. https:\/\/doi.org\/10.1007\/978-3-642-25504-5_4","DOI":"10.1007\/978-3-642-25504-5_4"},{"key":"429_CR75","doi-asserted-by":"publisher","unstructured":"Seyeditabari A, Tabari N, Zadrozny W (????) Emotion detection in text: a review. https:\/\/doi.org\/10.48550\/arXiv.1806.00674","DOI":"10.48550\/arXiv.1806.00674"},{"key":"429_CR76","unstructured":"Simon-Kucher & Partners (2020) Welche genres lesen sie unabh\u00e4ngig vom format? https:\/\/de.statista.com\/statistik\/daten\/studie\/1189038\/umfrage\/gelesene-genres-von-buechern\/"},{"key":"429_CR77","unstructured":"SoftBank Robotics (2017) NAOqi Python SDK [Software]"},{"key":"429_CR78","unstructured":"SoftBank Robotics (2018) NAO: V6 [Hardware] https:\/\/www.softbankrobotics.com\/emea\/en\/nao"},{"key":"429_CR79","unstructured":"SoftBank Robotics (2021) Pepper [Hardware]. https:\/\/www.softbankrobotics.com\/emea\/en\/pepper"},{"key":"429_CR80","doi-asserted-by":"publisher","unstructured":"Song S, Yamada S (2017) Expressing emotions through color, sound, and vibration with an appearance-constrained social robot. In: Proceedings of the 2017 ACM\/IEEE international conference on human-robot interaction-HRI \u201917. ACM Press, New York, New York, USA, pp 2\u201311. https:\/\/doi.org\/10.1145\/2909824.3020239","DOI":"10.1145\/2909824.3020239"},{"key":"429_CR81","doi-asserted-by":"crossref","unstructured":"Steinhaeusser SC, Lugrin B (2022) Effects of colored leds in robotic storytelling on storytelling experience and robot perception. In: 2022 17th ACM\/IEEE international conference on human-robot interaction (HRI), IEEE, pp 1053\u20131058","DOI":"10.1109\/HRI53351.2022.9889469"},{"key":"429_CR82","doi-asserted-by":"crossref","unstructured":"Steinhaeusser SC, Lugrin B (in press) Eeffects of number of voices and voice type on storytelling experience and robot perception. In: Savery R (ed) Sound and robotics. CRC Press, pp 9\u201332, Boca Raton","DOI":"10.1201\/9781003320470-2"},{"key":"429_CR83","doi-asserted-by":"publisher","unstructured":"Steinhaeusser SC, Gabel JJ, Lugrin B (2021a) Your new friend nao vs. robot no. 783-effects of personal or impersonal framing in a robotic storytelling use case. In: Companion of the 2021 ACM\/IEEE international conference on human-robot interaction. ACM, New York, NY, USA, pp 334\u2013338. https:\/\/doi.org\/10.1145\/3434074.3447187","DOI":"10.1145\/3434074.3447187"},{"key":"429_CR84","doi-asserted-by":"publisher","unstructured":"Steinhaeusser SC, Schaper P, Bediako Akuffo O, et\u00a0al (2021b) Anthropomorphize me! Effects of robot gender on listeners\u2019 perception of the social robot NAO in a storytelling use case. In: Companion of the 2021 ACM\/IEEE international conference on human-robot interaction. ACM, New York, NY, USA, pp p 529\u2013534. https:\/\/doi.org\/10.1145\/3434074.3447228","DOI":"10.1145\/3434074.3447228"},{"key":"429_CR85","doi-asserted-by":"publisher","unstructured":"Steinhaeusser SC, Schaper P, Lugrin B (2021c) Comparing a robotic storyteller versus audio book with integration of sound effects and background music. In: Companion of the 2021 ACM\/IEEE international conference on human-robot interaction. ACM, New York, NY, USA, pp 328\u2013333. https:\/\/doi.org\/10.1145\/3434074.3447186","DOI":"10.1145\/3434074.3447186"},{"key":"429_CR86","doi-asserted-by":"publisher","unstructured":"Striepe H, Lugrin B (2017) There once was a robot storyteller: measuring the effects of emotion and non-verbal behaviour. In: Social robotics, lecture notes in computer science, vol 10652. Springer International Publishing, Cham, pp 126\u2013136. https:\/\/doi.org\/10.1007\/978-3-319-70022-9_13","DOI":"10.1007\/978-3-319-70022-9_13"},{"key":"429_CR87","doi-asserted-by":"crossref","unstructured":"Striepe H, Donnermann M, Lein M, et\u00a0al (2019) Modeling and evaluating emotion, contextual head movement and voices for a social robot storyteller. Int J Soc Robot 1\u201317. https:\/\/doi.org\/10.1007\/s12369-019-00570-7","DOI":"10.1007\/s12369-019-00570-7"},{"issue":"4","key":"429_CR88","doi-asserted-by":"publisher","first-page":"555","DOI":"10.1007\/s12369-019-00524-z","volume":"11","author":"C Tsiourti","year":"2019","unstructured":"Tsiourti C, Weiss A, Wac K et al (2019) Multimodal integration of emotional signals from voice, body, and context: effects of (in)congruence on emotion recognition and attitudes towards robots. Int J Soc Robot 11(4):555\u2013573. https:\/\/doi.org\/10.1007\/s12369-019-00524-z","journal-title":"Int J Soc Robot"},{"issue":"4","key":"429_CR89","doi-asserted-by":"publisher","first-page":"394","DOI":"10.1037\/0096-3445.123.4.394","volume":"123","author":"P Valdez","year":"1994","unstructured":"Valdez P, Mehrabian A (1994) Effects of color on emotions. J Exp Psychol Gen 123(4):394","journal-title":"J Exp Psychol Gen"},{"issue":"5","key":"429_CR90","doi-asserted-by":"publisher","first-page":"797","DOI":"10.1086\/673383","volume":"40","author":"T van Laer","year":"2014","unstructured":"van Laer T, de Ruyter K, Visconti LM et al (2014) The extended transportation-imagery model: a meta-analysis of the antecedents and consequences of consumers\u2019 narrative transportation. J Consum Res 40(5):797\u2013817. https:\/\/doi.org\/10.1086\/673383","journal-title":"J Consum Res"},{"key":"429_CR91","unstructured":"Vaswani A, Shazeer N, Parmar N, et\u00a0al (2017) Attention is all you need. In: Advances in neural information processing systems, vol\u00a030. Curran Associates, Inc. https:\/\/proceedings.neurips.cc\/paper\/2017\/file\/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf"},{"issue":"3","key":"429_CR92","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1002\/ejsp.570","volume":"39","author":"LA Vaughn","year":"2009","unstructured":"Vaughn LA, Hesse SJ, Petkova Z et al (2009) this story is right on: the impact of regulatory fit on narrative engagement and persuasion. Eur J Soc Psychol 39(3):447\u2013456. https:\/\/doi.org\/10.1002\/ejsp.570","journal-title":"Eur J Soc Psychol"},{"key":"429_CR93","unstructured":"VERBI GmbH (2018) MAXQDA2018 [Software]"},{"key":"429_CR94","doi-asserted-by":"publisher","unstructured":"Verma R, Sarkar P, Rao KS (2015) Conversion of neutral speech to storytelling style speech. In: 2015 eighth international conference on advances in pattern recognition (ICAPR). IEEE, pp 1\u20136. https:\/\/doi.org\/10.1109\/ICAPR.2015.7050705","DOI":"10.1109\/ICAPR.2015.7050705"},{"key":"429_CR95","unstructured":"Volkova EP, Mohler BJ, Meurers D, et\u00a0al (2010) Emotional perception of fairy tales: achieving agreement in emotion annotation of text. In: Proceedings of the NAACL HLT 2010 workshop on computational approaches to analysis and generation of emotion in text. Association for Computational Linguistics, USA, CAAGET \u201910, pp 98\u2013106"},{"issue":"3","key":"429_CR96","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1080\/01973533.2010.495659","volume":"32","author":"M Weisbuch","year":"2010","unstructured":"Weisbuch M, Ambady N, Clarke AL et al (2010) On being consistent: the role of verbal-nonverbal consistency in first impressions. Basic Appl Soc Psychol 32(3):261\u2013268. https:\/\/doi.org\/10.1080\/01973533.2010.495659","journal-title":"Basic Appl Soc Psychol"},{"issue":"2","key":"429_CR97","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1026\/0012-1924.54.2.85","volume":"54","author":"M Wolf","year":"2008","unstructured":"Wolf M, Horn AB, Mehl MR et al (2008) Computergest\u00fctzte quantitative Textanalyse: \u00c4quivalenz und Robustheit der deutschen Version des Linguistic Inquiry and Word Count. Diagnostica 54(2):85\u201398","journal-title":"Diagnostica"},{"key":"429_CR98","doi-asserted-by":"crossref","unstructured":"Xu J, Broekens J, Hindriks K, et\u00a0al (2015) Effects of a robotic storyteller\u2019s moody gestures on storytelling perception. IEEE, pp 449\u2013455","DOI":"10.1109\/ACII.2015.7344609"},{"key":"429_CR99","doi-asserted-by":"publisher","unstructured":"Xu J, Broekens J, Hindriks K, et\u00a0al (92014) Effects of bodily mood expression of a robotic teacher on students. In: 2014 IEEE\/RSJ international conference on intelligent robots and systems. IEEE, pp 2614\u20132620. https:\/\/doi.org\/10.1109\/IROS.2014.6942919","DOI":"10.1109\/IROS.2014.6942919"},{"key":"429_CR100","doi-asserted-by":"publisher","unstructured":"Yamashita Y, Ishihara H, Ikeda T, et\u00a0al (2016) Path analysis for the halo effect of touch sensations of robots on their personality impressions. In: Social robotics, lecture notes in computer science, vol 9979. Springer International Publishing, Cham, pp 502\u2013512. https:\/\/doi.org\/10.1007\/978-3-319-47437-3_49","DOI":"10.1007\/978-3-319-47437-3_49"},{"key":"429_CR101","doi-asserted-by":"publisher","unstructured":"Yin D, Meng T, Chang KW (2020) SentiBERT: a transferable transformer-based architecture for compositional sentiment semantics. In: Proceedings of the 58th annual meeting of the association for computational linguistics. Association for Computational Linguistics, Online, pp 3695\u20133706. https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.341, https:\/\/www.aclweb.org\/anthology\/2020.acl-main.341","DOI":"10.18653\/v1\/2020.acl-main.341"},{"key":"429_CR102","doi-asserted-by":"publisher","unstructured":"Zabala U, Rodriguez I, Lazkano E (2022) Towards an automatic generation of natural gestures for a storyteller robot. In: 2022 31st ieee international conference on robot and human interactive communication (RO-MAN). IEEE, pp 1209\u20131215. https:\/\/doi.org\/10.1109\/RO-MAN53752.2022.9900532","DOI":"10.1109\/RO-MAN53752.2022.9900532"},{"key":"429_CR103","doi-asserted-by":"publisher","unstructured":"Zecca M, Mizoguchi Y, Endo K, et\u00a0al (2009) Whole body emotion expressions for kobian humanoid robot\u2014preliminary experiments with different emotional patterns. In: RO-MAN 2009-the 18th IEEE international symposium on robot and human interactive communication. IEEE, pp 381\u2013386. https:\/\/doi.org\/10.1109\/ROMAN.2009.5326184","DOI":"10.1109\/ROMAN.2009.5326184"},{"key":"429_CR104","doi-asserted-by":"crossref","unstructured":"Zehe A, Becker M, Jannidis F, et\u00a0al (2017) Towards sentiment analysis on german literature. In: Joint German\/Austrian conference on artificial intelligence (K\u00fcnstliche Intelligenz), Springer, pp 387\u2013394","DOI":"10.1007\/978-3-319-67190-1_36"},{"key":"429_CR105","unstructured":"Zehe A, Arns J, Hettinger L, et\u00a0al (2020) Harrymotions-classifying relationships in harry potter based on emotion analysis. In: 5th SwissText & 16th KONVENS joint conference"},{"key":"429_CR106","doi-asserted-by":"publisher","unstructured":"Zhang Z, Niu Y, Wu S, et\u00a0al (2018) Analysis of influencing factors on humanoid robots\u2019 emotion expressions by body language. In: Huang T, Lv J, Sun C, et\u00a0al (eds) Advances in neural networks\u2013ISNN 2018, Lecture Notes in Computer Science, vol 10878. Springer International Publishing, Cham, pp 775\u2013785. https:\/\/doi.org\/10.1007\/978-3-319-92537-0_88","DOI":"10.1007\/978-3-319-92537-0_88"}],"container-title":["Journal on Multimodal User Interfaces"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12193-024-00429-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12193-024-00429-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12193-024-00429-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,26]],"date-time":"2024-11-26T11:21:59Z","timestamp":1732620119000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12193-024-00429-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,4]]},"references-count":106,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,12]]}},"alternative-id":["429"],"URL":"https:\/\/doi.org\/10.1007\/s12193-024-00429-w","relation":{},"ISSN":["1783-7677","1783-8738"],"issn-type":[{"value":"1783-7677","type":"print"},{"value":"1783-8738","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,4]]},"assertion":[{"value":"15 May 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 March 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 April 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}