{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T14:58:19Z","timestamp":1740149899771,"version":"3.37.3"},"reference-count":71,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,5,23]],"date-time":"2023-05-23T00:00:00Z","timestamp":1684800000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,5,23]],"date-time":"2023-05-23T00:00:00Z","timestamp":1684800000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Multimodal User Interfaces"],"published-print":{"date-parts":[[2023,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>With technological developments, individuals are increasingly able to delegate tasks to autonomous agents that act on their behalf. This may cause individuals to behave more fairly, as involving an agent representative encourages individuals to strategise ahead and therefore adhere to social norms of fairness. Research suggests that an audio smiling agent may further promote fairness as it provides a signal of honesty and trust. What is still unclear is whether presenting a multimodal smiling agent (by using visual and auditory cues) rather than a unimodal smiling agent as normally available commercially (using only an auditory cue e.g., Siri) could amplify the impact of smiles. In the present study, participants (<jats:italic>N<\/jats:italic>\u2009=\u200986) played an ultimatum game either directly with another player (control), through a smiling multimodal and unimodal agent or through a neutral multimodal and unimodal agent. Participants\u2019 task was to offer a number of tickets to the other player from a fixed amount. Results showed that when playing the ultimatum game through a smiling multimodal agent, participants offered more tickets to the other player compared to the control condition and the other agent conditions. Hence, exploiting multisensory perception to enhance an agent\u2019s expression may be key for increasing individuals' pro-social behaviour when interacting through such an agent.\n<\/jats:p>","DOI":"10.1007\/s12193-023-00403-y","type":"journal-article","created":{"date-parts":[[2023,5,23]],"date-time":"2023-05-23T10:02:14Z","timestamp":1684836134000},"page":"65-77","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Investigating the influence of agent modality and expression on agent-mediated fairness behaviours"],"prefix":"10.1007","volume":"17","author":[{"given":"Hiu Lam","family":"Yip","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5354-5600","authenticated-orcid":false,"given":"Karin","family":"Petrini","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,5,23]]},"reference":[{"key":"403_CR1","unstructured":"Apple (n.d.) Siri [Photograph]. Apple. https:\/\/www.apple.com\/uk\/siri\/"},{"issue":"3","key":"403_CR2","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1109\/TAFFC.2018.2811465","volume":"11","author":"P Arias","year":"2018","unstructured":"Arias P, Soladie C, Bouafif O, Roebel A, Seguier R, Aucouturier JJ (2018) Realistic transformation of facial and vocal smiles in real-time audiovisual streams. IEEE Trans Affect Comput 11(3):507\u2013518","journal-title":"IEEE Trans Affect Comput"},{"key":"403_CR3","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/j.newideapsych.2018.12.005","volume":"54","author":"A Arvanitis","year":"2019","unstructured":"Arvanitis A, Papadatou-Pastou M, Hantzi A (2019) Agreement in the ultimatum game: An analysis of interpersonal and intergroup context on the basis of the consensualistic approach to negotiation. New Ideas Psychol 54:15\u201326","journal-title":"New Ideas Psychol"},{"key":"403_CR4","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1016\/j.socec.2013.08.009","volume":"47","author":"J Avrahami","year":"2013","unstructured":"Avrahami J, G\u00fcth W, Hertwig R, Kareev Y, Otsubo H (2013) Learning (not) to yield: An experimental study of evolving ultimatum game behavior. J Socio-Econ 47:47\u201354","journal-title":"J Socio-Econ"},{"issue":"1","key":"403_CR5","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1007\/s12369-010-0082-7","volume":"3","author":"WA Bainbridge","year":"2011","unstructured":"Bainbridge WA, Hart JW, Kim ES, Scassellati B (2011) The benefits of interactions with physically present robots over video-displayed agents. Int J Soc Robot 3(1):41\u201352","journal-title":"Int J Soc Robot"},{"issue":"1","key":"403_CR6","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1111\/j.1749-6632.2009.04504.x","volume":"1167","author":"JA Barraza","year":"2009","unstructured":"Barraza JA, Zak PJ (2009) Empathy toward strangers triggers oxytocin release and subsequent generosity. Ann N Y Acad Sci 1167(1):182\u2013189","journal-title":"Ann N Y Acad Sci"},{"key":"403_CR7","unstructured":"Barthel H, Quen\u00e9 H (2015) Acoustic-phonetic properties of smiling revised: Measurements on a natural video corpus. In: Proceedings of the 18th international congress of phonetic sciences"},{"key":"403_CR8","doi-asserted-by":"crossref","unstructured":"Bartlett MS (1935) The effect of non-normality on the t distribution. In: Mathematical proceedings of the Cambridge philosophical society, vol 31, no 2. Cambridge University Press, pp 223\u2013231","DOI":"10.1017\/S0305004100013311"},{"issue":"5","key":"403_CR9","doi-asserted-by":"publisher","first-page":"456","DOI":"10.1162\/105474603322761270","volume":"12","author":"F Biocca","year":"2003","unstructured":"Biocca F, Harms C, Burgoon JK (2003) Toward a more robust theory and measure of social presence: review and suggested criteria. Presence Teleoper Virtual Environ 12(5):456\u2013480","journal-title":"Presence Teleoper Virtual Environ"},{"key":"403_CR10","doi-asserted-by":"publisher","first-page":"1017","DOI":"10.3389\/fpsyg.2017.01017","volume":"8","author":"AR Bland","year":"2017","unstructured":"Bland AR, Roiser JP, Mehta MA, Schei T, Sahakian BJ, Robbins TW, Elliott R (2017) Cooperative behavior in the ultimatum game and prisoner\u2019s dilemma depends on players\u2019 contributions. Front Psychol 8:1017","journal-title":"Front Psychol"},{"key":"403_CR11","doi-asserted-by":"crossref","unstructured":"Bogdanovych A, Simoff SJ, Sierra C, Berger H (2005) Implicit training of virtual shopping assistants in 3D electronic institutions. e-commerce","DOI":"10.1145\/1082473.1082639"},{"key":"403_CR12","unstructured":"Boyer S (2018) SimpleSpectrum\u2014free audio spectrum generator (+WebGL!). Unity Asset Store. https:\/\/assetstore.unity.com\/packages\/tools\/audio\/simplespectrum-free-audio-spectrum-generator-webgl-85294"},{"key":"403_CR13","unstructured":"Brown WM, Moore C (2002) Chapter 3: smile asymmetries and reputation as reliable indicators of likelihood to cooperate: an evolutionary analysis. In: Advances in psychology research, vol 11. Nova Science Publishers, New York, pp 59\u201378"},{"key":"403_CR14","doi-asserted-by":"crossref","unstructured":"Cafaro A, Vilhj\u00e1lmsson HH, Bickmore T, Heylen D, J\u00f3hannsd\u00f3ttir KR, Valgar\u00f0sson GS (2012) First impressions: users\u2019 judgments of virtual agents\u2019 personality and interpersonal attitude in first encounters. In: International conference on intelligent virtual agents. Springer, Berlin, pp 67\u201380","DOI":"10.1007\/978-3-642-33197-8_7"},{"issue":"1","key":"403_CR15","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1016\/j.evolhumbehav.2014.08.001","volume":"36","author":"S Centorrino","year":"2015","unstructured":"Centorrino S, Djemai E, Hopfensitz A, Milinski M, Seabright P (2015) Honest signaling in trust interactions: smiles rated as genuine induce trust and signal higher earning opportunities. Evol Hum Behav 36(1):8\u201316","journal-title":"Evol Hum Behav"},{"key":"403_CR16","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1007\/s12559-015-9362-8","volume":"8","author":"JA Cervantes","year":"2016","unstructured":"Cervantes JA, Rodr\u00edguez LF, L\u00f3pez S, Ramos F, Robles F (2016) Autonomous agents and ethical decision-making. Cogn Comput 8:278\u2013296","journal-title":"Cogn Comput"},{"key":"403_CR17","unstructured":"Cipriani J (2015) Cortana [photograph]. Cnet. https:\/\/www.cnet.com\/how-to\/how-to-get-cortana-on-your-android-device\/"},{"key":"403_CR18","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1016\/j.brainres.2008.04.023","volume":"1242","author":"O Collignon","year":"2008","unstructured":"Collignon O, Girard S, Gosselin F, Roy S, Saint-Amour D, Lassonde M, Lepore F (2008) Audio-visual integration of emotion expression. Brain Res 1242:126\u2013135","journal-title":"Brain Res"},{"key":"403_CR19","doi-asserted-by":"crossref","unstructured":"Cowell AJ, Stanney KM (2003) Embodiment and interaction guidelines for designing credible, trustworthy embodied conversational agents. In: International workshop on intelligent virtual agents. Springer, Berlin, pp 301\u2013309","DOI":"10.1007\/978-3-540-39396-2_50"},{"issue":"3","key":"403_CR20","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1080\/026999300378824","volume":"14","author":"B De Gelder","year":"2000","unstructured":"De Gelder B, Vroomen J (2000) The perception of emotions by ear and by eye. Cogn Emot 14(3):289\u2013311","journal-title":"Cogn Emot"},{"key":"403_CR21","doi-asserted-by":"publisher","first-page":"168","DOI":"10.1016\/j.ijhcs.2018.09.008","volume":"122","author":"R De Kleijn","year":"2019","unstructured":"De Kleijn R, van Es L, Kachergis G, Hommel B (2019) Anthropomorphization of artificial agents leads to fair and strategic, but not altruistic behavior. Int J Hum Comput Stud 122:168\u2013173","journal-title":"Int J Hum Comput Stud"},{"key":"403_CR22","unstructured":"de Melo CM, Marsella S, Gratch J (2017) Increasing fairness by delegating decisions to autonomous agents. In: AAMAS, pp 419\u2013425"},{"issue":"1","key":"403_CR23","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1007\/s10458-017-9376-6","volume":"32","author":"CM de Melo","year":"2018","unstructured":"de Melo CM, Marsella S, Gratch J (2018) Social decisions and fairness change when people\u2019s interests are represented by autonomous agents. Auton Agent Multi-Agent Syst 32(1):163\u2013187","journal-title":"Auton Agent Multi-Agent Syst"},{"key":"403_CR24","unstructured":"DeVault D, Artstein R, Benn G, Dey T, Fast E, Gainer A, Morency LP (2014) SimSensei Kiosk: a virtual human interviewer for healthcare decision support. In: Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems, pp 1061\u20131068"},{"issue":"01","key":"403_CR25","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1055\/s-0041-1726510","volume":"30","author":"T Dingler","year":"2021","unstructured":"Dingler T, Kwasnicka D, Wei J, Gong E, Oldenburg B (2021) The use and promise of conversational agents in digital health. Yearb Med Inform 30(01):191\u2013199","journal-title":"Yearb Med Inform"},{"key":"403_CR26","unstructured":"Domingos FE, Terrucha I, Suchon R, Gruji\u0107 J, Burguillo JC, Santos FC, Lenaerts T (2021) Delegation to autonomous agents promotes cooperation in collective-risk dilemmas. arXiv e-prints, arXiv-2103"},{"issue":"4","key":"403_CR27","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1016\/j.specom.2007.10.001","volume":"50","author":"A Drahota","year":"2008","unstructured":"Drahota A, Costall A, Reddy V (2008) The vocal communication of different kinds of smile. Speech Commun 50(4):278\u2013287","journal-title":"Speech Commun"},{"key":"403_CR28","doi-asserted-by":"crossref","unstructured":"El Haddad K, Torre I, Gilmartin E, \u00c7akmak H, Dupont S, Dutoit T, Campbell N (2017) Introducing AmuS: the amused speech database. In: Proceedings of the statistical language and speech processing: 5th international conference, SLSP 2017, Le Mans, France, October 23\u201325, 2017, vol 5, pp 229\u2013240. Springer","DOI":"10.1007\/978-3-319-68456-7_19"},{"issue":"4","key":"403_CR29","doi-asserted-by":"publisher","first-page":"864","DOI":"10.1037\/0033-295X.114.4.864","volume":"114","author":"N Epley","year":"2007","unstructured":"Epley N, Waytz A, Cacioppo JT (2007) On seeing human: a three-factor theory of anthropomorphism. Psychol Rev 114(4):864","journal-title":"Psychol Rev"},{"issue":"1","key":"403_CR30","first-page":"36","volume":"137","author":"J F\u00f6cker","year":"2011","unstructured":"F\u00f6cker J, Gondan M, R\u00f6der B (2011) Preattentive processing of audio-visual emotional signals. Acta Physiol (Oxf) 137(1):36\u201347","journal-title":"Acta Physiol (Oxf)"},{"key":"403_CR31","unstructured":"Gjersoe N, Wortham RH (2019) What behaviours lead children to anthropomorphise robots? Louis-Philippe Demers\u2019s keynote talk \u2018Experiencing the Machine Alterity\u2019 offered unique insights into situated bodies in motion and how we perceive their agency beyond morphological mimicry. Demers is Director of the Creative Lab at QUT, 24"},{"issue":"6","key":"403_CR32","doi-asserted-by":"publisher","first-page":"2380","DOI":"10.1016\/j.chb.2011.07.017","volume":"27","author":"RE Guadagno","year":"2011","unstructured":"Guadagno RE, Swinth KR, Blascovich J (2011) Social evaluations of embodied agents and avatars. Comput Hum Behav 27(6):2380\u20132385","journal-title":"Comput Hum Behav"},{"key":"403_CR33","doi-asserted-by":"crossref","unstructured":"Heerink M, Kr\u00f6se B, Evers V, Wielinga B (2008) The influence of social presence on acceptance of a companion robot by older people","DOI":"10.14198\/JoPha.2008.2.2.05"},{"key":"403_CR34","unstructured":"Honda Motor Co. (n.d.). ASIMO [photograph]. ASIMO. https:\/\/asimo.honda.com\/"},{"issue":"1","key":"403_CR35","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1080\/02763869.2018.1404391","volume":"37","author":"MB Hoy","year":"2018","unstructured":"Hoy MB (2018) Alexa, Siri, Cortana, and more: an introduction to voice assistants. Med Ref Serv Q 37(1):81\u201388","journal-title":"Med Ref Serv Q"},{"issue":"2","key":"403_CR36","doi-asserted-by":"publisher","first-page":"696","DOI":"10.1109\/TII.2016.2607148","volume":"13","author":"S Karnouskos","year":"2016","unstructured":"Karnouskos S, Leitao P (2016) Key contributing factors to the acceptance of agents in industrial environments. IEEE Trans Ind Inf 13(2):696\u2013703","journal-title":"IEEE Trans Ind Inf"},{"key":"403_CR37","unstructured":"Krales AH (2018) Alexa [photograph]. You can now set Amazon\u2019s Alexa as your default voice assistant on android. https:\/\/www.theverge.com\/2018\/5\/7\/17328758\/amazon-alexa-default-voice-assistant-android"},{"issue":"2","key":"403_CR38","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1002\/ijop.12087","volume":"50","author":"K Krys","year":"2015","unstructured":"Krys K, Hansen K, Xing C, Espinosa AD, Szarota P, Morales MF (2015) It is better to smile to women: gender modifies perception of honesty of smiling individuals across cultures. Int J Psychol 50(2):150\u2013154","journal-title":"Int J Psychol"},{"key":"403_CR39","doi-asserted-by":"crossref","unstructured":"Kwak SS, Kim Y, Kim E, Shin C, Cho K (2013) What makes people empathize with an emotional robot? The impact of agency and physical embodiment on human empathy for a robot. In: 2013 IEEE Ro-man. IEEE, pp 180\u2013185","DOI":"10.1109\/ROMAN.2013.6628441"},{"key":"403_CR40","doi-asserted-by":"publisher","first-page":"705164","DOI":"10.3389\/frai.2021.705164","volume":"4","author":"A Laitinen","year":"2021","unstructured":"Laitinen A, Sahlgren O (2021) AI systems and respect for human autonomy. Front Artif Intell 4:705164","journal-title":"Front Artif Intell"},{"key":"403_CR41","unstructured":"Lasarcyk E, Trouvain J (2008) Spread lips\u2009+\u2009raised larynx\u2009+\u2009higher f0\u2009=\u2009smiled speech? An articulatory synthesis approach. In: Proceedings of ISSP, pp 43\u201348"},{"issue":"10","key":"403_CR42","doi-asserted-by":"publisher","first-page":"962","DOI":"10.1016\/j.ijhcs.2006.05.002","volume":"64","author":"KM Lee","year":"2006","unstructured":"Lee KM, Jung Y, Kim J, Kim SR (2006) Are physically embodied social agents better than disembodied social agents?: The effects of physical embodiment, tactile interaction, and people\u2019s loneliness in human\u2013robot interaction. Int J Hum Comput Stud 64(10):962\u2013973","journal-title":"Int J Hum Comput Stud"},{"issue":"5","key":"403_CR43","doi-asserted-by":"publisher","first-page":"727","DOI":"10.1007\/s12369-017-0420-0","volume":"9","author":"N Lee","year":"2017","unstructured":"Lee N, Kim J, Kim E, Kwon O (2017) The influence of politeness behavior on user compliance with social robots in a healthcare service setting. Int J Soc Robot 9(5):727\u2013743","journal-title":"Int J Soc Robot"},{"key":"403_CR44","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1016\/j.ijhcs.2015.01.001","volume":"77","author":"J Li","year":"2015","unstructured":"Li J (2015) The benefit of being physically present: a survey of experimental works comparing copresent robots, telepresent robots and virtual agents. Int J Hum Comput Stud 77:23\u201337","journal-title":"Int J Hum Comput Stud"},{"key":"403_CR45","doi-asserted-by":"crossref","unstructured":"Martin JC, Clavel C, Courgeon M, Ammi M, Amorim MA, Tsalamlal Y, Gaffary Y (2018) How do users perceive multimodal expressions of affects? In: The handbook of multimodal-multisensor interfaces: signal processing, architectures, and detection of emotion and cognition, vol 2, pp 263\u2013285","DOI":"10.1145\/3107990.3108001"},{"issue":"45","key":"403_CR46","doi-asserted-by":"publisher","first-page":"16518","DOI":"10.1073\/pnas.0507650102","volume":"102","author":"HK Meeren","year":"2005","unstructured":"Meeren HK, van Heijnsbergen CC, de Gelder B (2005) Rapid perceptual integration of facial expression and emotional body language. Proc Natl Acad Sci 102(45):16518\u201316523","journal-title":"Proc Natl Acad Sci"},{"key":"403_CR47","doi-asserted-by":"crossref","unstructured":"Menczer F, Street WN, Vishwakarma N, Monge AE, Jakobsson M (2002) IntelliShopper: a proactive, personal, private shopping assistant. In: Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part, vol 3, pp 1001\u20131008","DOI":"10.1145\/545056.545059"},{"key":"403_CR48","doi-asserted-by":"crossref","unstructured":"Morimoto D, Even J, Kanda T (2020) Can a robot handle customers with unreasonable complaints? In: Proceedings of the 2020 ACM\/IEEE international conference on human-robot interaction, pp 579\u2013587","DOI":"10.1145\/3319502.3374830"},{"issue":"3","key":"403_CR49","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1017\/S1930297500006045","volume":"8","author":"P Mussel","year":"2013","unstructured":"Mussel P, G\u00f6ritz AS, Hewig J (2013) The value of a smile: Facial expression affects ultimatum-game responses. Judgm Decis Mak 8(3):381\u2013385","journal-title":"Judgm Decis Mak"},{"key":"403_CR50","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s42452-020-2192-7","volume":"2","author":"J Nakanishi","year":"2020","unstructured":"Nakanishi J, Kuramoto I, Baba J, Ogawa K, Yoshikawa Y, Ishiguro H (2020) Continuous hospitality with social robots at a hotel. SN Appl Sci 2:1\u201313","journal-title":"SN Appl Sci"},{"issue":"5485","key":"403_CR51","doi-asserted-by":"publisher","first-page":"1773","DOI":"10.1126\/science.289.5485.1773","volume":"289","author":"MA Nowak","year":"2000","unstructured":"Nowak MA, Page KM, Sigmund K (2000) Fairness versus reason in the ultimatum game. Science 289(5485):1773\u20131775","journal-title":"Science"},{"key":"403_CR52","doi-asserted-by":"publisher","first-page":"1101","DOI":"10.1006\/bulm.2002.0321","volume":"64","author":"KM Page","year":"2002","unstructured":"Page KM, Nowak MA (2002) Empathy leads to fairness. Bull Math Biol 64:1101\u20131116","journal-title":"Bull Math Biol"},{"key":"403_CR53","unstructured":"Pal Robotics (n.d.) REEM [photograph]. Pal robotics. https:\/\/pal-robotics.com\/robots\/reem-c\/"},{"issue":"2","key":"403_CR54","doi-asserted-by":"publisher","first-page":"192","DOI":"10.1007\/s11031-011-9206-0","volume":"35","author":"S Paulmann","year":"2011","unstructured":"Paulmann S, Pell MD (2011) Is there an advantage for recognizing multi-modal emotional stimuli? Motiv Emot 35(2):192\u2013201","journal-title":"Motiv Emot"},{"issue":"1","key":"403_CR55","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/srep44062","volume":"7","author":"J Peterburs","year":"2017","unstructured":"Peterburs J, Voegler R, Liepelt R, Schulze A, Wilhelm S, Ocklenburg S, Straube T (2017) Processing of fair and unfair offers in the ultimatum game under social observation. Sci Rep 7(1):1\u201312","journal-title":"Sci Rep"},{"issue":"3","key":"403_CR56","doi-asserted-by":"publisher","first-page":"376","DOI":"10.1111\/desc.12127","volume":"17","author":"K Petrini","year":"2014","unstructured":"Petrini K, Remark A, Smith L, Nardini M (2014) When vision is not an option: children\u2019s integration of auditory and haptic information is suboptimal. Dev Sci 17(3):376\u2013387","journal-title":"Dev Sci"},{"key":"403_CR57","doi-asserted-by":"publisher","first-page":"116","DOI":"10.3389\/fpsyg.2015.00611","volume":"9","author":"L Piwek","year":"2015","unstructured":"Piwek L, Pollick F, Petrini K (2015) Audiovisual integration of emotional signals from others\u2019 social interactions. Front Psychol 9:116","journal-title":"Front Psychol"},{"key":"403_CR58","doi-asserted-by":"publisher","first-page":"200","DOI":"10.1016\/j.evolhumbehav.2011.09.003","volume":"33","author":"LI Reed","year":"2012","unstructured":"Reed LI, Zeglen KN, Schmidt KL (2012) Facial expressions as honest signals of cooperative intent in a one-shot anonymous prisoner\u2019s dilemma game. Evol Hum Behav 33:200\u2013209. https:\/\/doi.org\/10.1016\/j.evolhumbehav.2011.09.003","journal-title":"Evol Hum Behav"},{"key":"403_CR59","doi-asserted-by":"crossref","unstructured":"Riek LD, Rabinowitch TC, Chakrabarti B, Robinson P (2009) How anthropomorphism affects empathy toward robots. In: Proceedings of the 4th ACM\/IEEE international conference on human robot interaction, pp 245\u2013246","DOI":"10.1145\/1514095.1514158"},{"issue":"5626","key":"403_CR60","doi-asserted-by":"publisher","first-page":"1755","DOI":"10.1126\/science.1082976","volume":"300","author":"AG Sanfey","year":"2003","unstructured":"Sanfey AG, Rilling JK, Aronson JA, Nystrom LE, Cohen JD (2003) The neural basis of economic decision-making in the ultimatum game. Science 300(5626):1755\u20131758","journal-title":"Science"},{"key":"403_CR61","doi-asserted-by":"crossref","unstructured":"Scalco A, Ceschi A, Sartori R, Rubaltelli E (2015) Exploring selfish versus altruistic behaviors in the ultimatum game with an agent-based model. In: trends in practical applications of agents, multi-agent systems and sustainability: the PAAMS collection, pp 199\u2013206","DOI":"10.1007\/978-3-319-19629-9_22"},{"key":"403_CR62","doi-asserted-by":"crossref","unstructured":"Sheldon KM, Corcoran M, Sheldon M (2021) Duchenne smiles as honest signals of chronic positive mood. Perspect Psychol Sci 1745691620959831","DOI":"10.1177\/1745691620959831"},{"key":"403_CR63","doi-asserted-by":"crossref","unstructured":"Thellman S, Silvervarg A, Gulz A, Ziemke T (2016) Physical vs. virtual agent embodiment and effects on social interaction. In: Proceedings of the intelligent virtual agents: 16th international conference, IVA 2016, Los Angeles, CA, USA, September 20\u201323, 2016, vol 16. Springer, pp 412\u2013415","DOI":"10.1007\/978-3-319-47665-0_44"},{"key":"403_CR64","unstructured":"Tian L, Oviatt S, Muszynski M, Chamberlain BC, Healey J, Sano A (2022) Emotion-aware human\u2013robot interaction and social robots. Appl Affect Comput"},{"key":"403_CR65","doi-asserted-by":"publisher","first-page":"106215","DOI":"10.1016\/j.chb.2019.106215","volume":"105","author":"I Torre","year":"2020","unstructured":"Torre I, Goslin J, White L (2020) If your device could smile: people trust happy-sounding artificial agents more. Comput Hum Behav 105:106215","journal-title":"Comput Hum Behav"},{"key":"403_CR66","first-page":"179","volume":"34","author":"MI Tortosa","year":"2013","unstructured":"Tortosa MI, Strizhko T, Capizzi M, Ruz M (2013) Interpersonal effects of emotion in a multi-round trust game. Psicol\u00f3gica 34:179\u2013198","journal-title":"Psicol\u00f3gica"},{"issue":"4","key":"403_CR67","doi-asserted-by":"publisher","first-page":"555","DOI":"10.1007\/s12369-019-00524-z","volume":"11","author":"C Tsiourti","year":"2019","unstructured":"Tsiourti C, Weiss A, Wac K, Vincze M (2019) Multimodal integration of emotional signals from voice, body, and context: effects of (in) congruence on emotion recognition and attitudes towards robots. Int J Soc Robot 11(4):555\u2013573","journal-title":"Int J Soc Robot"},{"issue":"3","key":"403_CR68","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1037\/1528-3542.7.3.487","volume":"7","author":"J Van den Stock","year":"2007","unstructured":"Van den Stock J, Righart R, De Gelder B (2007) Body expressions influence recognition of emotions in the face and voice. Emotion 7(3):487","journal-title":"Emotion"},{"key":"403_CR69","doi-asserted-by":"crossref","unstructured":"Van Kleef GA, De Dreu CK, Manstead AS (2010) An interpersonal approach to emotion in social decision making: the emotions as social information model. In: Advances in experimental social psychology. Academic Press, vol 42, pp 45\u201396","DOI":"10.1016\/S0065-2601(10)42002-X"},{"key":"403_CR70","unstructured":"Ward S (2015) Sleek toon bot (free). Unity asset store. https:\/\/assetstore.unity.com\/packages\/3d\/characters\/robots\/sleek-toon-bot-free-34490"},{"issue":"50","key":"403_CR71","doi-asserted-by":"publisher","first-page":"20364","DOI":"10.1073\/pnas.1212126109","volume":"109","author":"T Yamagishi","year":"2012","unstructured":"Yamagishi T, Horita Y, Mifune N, Hashimoto H, Li Y, Shinada M et al (2012) Rejection of unfair offers in the ultimatum game is no evidence of strong reciprocity. Proc Natl Acad Sci 109(50):20364\u201320368","journal-title":"Proc Natl Acad Sci"}],"container-title":["Journal on Multimodal User Interfaces"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12193-023-00403-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12193-023-00403-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12193-023-00403-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,8]],"date-time":"2023-06-08T10:18:26Z","timestamp":1686219506000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12193-023-00403-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,23]]},"references-count":71,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,6]]}},"alternative-id":["403"],"URL":"https:\/\/doi.org\/10.1007\/s12193-023-00403-y","relation":{},"ISSN":["1783-7677","1783-8738"],"issn-type":[{"type":"print","value":"1783-7677"},{"type":"electronic","value":"1783-8738"}],"subject":[],"published":{"date-parts":[[2023,5,23]]},"assertion":[{"value":"6 January 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 April 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 May 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}