{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T15:00:24Z","timestamp":1775055624418,"version":"3.50.1"},"reference-count":91,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2023,7,23]],"date-time":"2023-07-23T00:00:00Z","timestamp":1690070400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,7,23]],"date-time":"2023-07-23T00:00:00Z","timestamp":1690070400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Humanities and Social Change International Foundation"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["AI &amp; Soc"],"published-print":{"date-parts":[[2024,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Dialogue systems, from Virtual Personal Assistants such as Siri, Cortana, and Alexa to state-of-the-art systems such as BlenderBot3 and ChatGPT, are already widely available, used in a variety of applications, and are increasingly part of many people\u2019s lives. However, the task of enabling them to use empathetic language more convincingly is still an emerging research topic. Such systems generally make use of complex neural networks to learn the patterns of typical human language use, and the interactions in which the systems participate are usually mediated either via interactive text-based or speech-based interfaces. In human\u2013human interaction, empathy has been shown to promote prosocial behaviour and improve interaction. In the context of dialogue systems, to advance the understanding of how perceptions of empathy affect interactions, it is necessary to bring greater clarity to how empathy is measured and assessed. Assessing the way dialogue systems create perceptions of empathy brings together a range of technological, psychological, and ethical considerations that merit greater scrutiny than they have received so far. However, there is currently no widely accepted evaluation method for determining the degree of empathy that any given system possesses (or, at least, appears to possess). Currently, different research teams use a variety of automated metrics, alongside different forms of subjective human assessment such as questionnaires, self-assessment measures and narrative engagement scales. This diversity of evaluation practice means that, given two DSs, it is usually impossible to determine which of them conveys the greater degree of empathy in its dialogic exchanges with human users. Acknowledging this problem, the present article provides an overview of how empathy is measured in human\u2013human interactions and considers some of the ways it is currently measured in human\u2013DS interactions. Finally, it introduces a novel third-person analytical framework, called the Empathy Scale for Human\u2013Computer Communication (ESHCC), to support greater uniformity in how perceived empathy is measured during interactions with state-of-the-art DSs.<\/jats:p>","DOI":"10.1007\/s00146-023-01715-z","type":"journal-article","created":{"date-parts":[[2023,7,23]],"date-time":"2023-07-23T13:01:36Z","timestamp":1690117296000},"page":"2233-2247","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":30,"title":["Measuring perceived empathy in dialogue systems"],"prefix":"10.1007","volume":"39","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5904-0045","authenticated-orcid":false,"given":"Shauna","family":"Concannon","sequence":"first","affiliation":[]},{"given":"Marcus","family":"Tomalin","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,7,23]]},"reference":[{"issue":"1","key":"1715_CR1","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1007\/s12369-014-0253-z","volume":"7","author":"M Asada","year":"2015","unstructured":"Asada M (2015a) Towards artificial empathy. Int J Soc Robot 7(1):19\u201333. https:\/\/doi.org\/10.1007\/s12369-014-0253-z","journal-title":"Int J Soc Robot"},{"key":"1715_CR2","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1016\/j.neures.2014.12.002","volume":"90","author":"M Asada","year":"2015","unstructured":"Asada M (2015b) Development of artificial empathy. Neurosci Res 90:41\u201350. https:\/\/doi.org\/10.1016\/j.neures.2014.12.002","journal-title":"Neurosci Res"},{"issue":"3","key":"1715_CR3","doi-asserted-by":"publisher","first-page":"38","DOI":"10.3390\/philosophies4030038","volume":"4","author":"M Asada","year":"2019","unstructured":"Asada M (2019) Artificial pain may induce empathy, morality, and ethics in the conscious mind of robots. Philosophies 4(3):38. https:\/\/doi.org\/10.3390\/philosophies4030038","journal-title":"Philosophies"},{"issue":"5","key":"1715_CR4","doi-asserted-by":"publisher","first-page":"587","DOI":"10.1037\/emo0000162","volume":"16","author":"D Atkins","year":"2016","unstructured":"Atkins D, Uskul AK, Cooper NR (2016) Culture shapes empathic responses to physical and social pain. Emotion 16(5):587\u2013601. https:\/\/doi.org\/10.1037\/emo0000162","journal-title":"Emotion"},{"key":"1715_CR5","volume-title":"Zero degrees of empathy: a new theory of human cruelty","author":"S Baron-Cohen","year":"2011","unstructured":"Baron-Cohen S (2011) Zero degrees of empathy: a new theory of human cruelty. Penguin, UK"},{"issue":"4","key":"1715_CR7","doi-asserted-by":"publisher","first-page":"803","DOI":"10.1007\/s00146-018-0825-9","volume":"34","author":"C Bassett","year":"2019","unstructured":"Bassett C (2019) The computational therapeutic: exploring Weizenbaum\u2019s ELIZA as a history of the present. AI Soc 34(4):803\u2013812. https:\/\/doi.org\/10.1007\/s00146-018-0825-9","journal-title":"AI Soc"},{"issue":"1","key":"1715_CR8","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1111\/j.1751-2409.2009.01013.x","volume":"3","author":"CD Batson","year":"2009","unstructured":"Batson CD, Ahmad NY (2009) Using empathy to improve intergroup attitudes and relations. Soc Issues Policy Rev 3(1):141\u2013177. https:\/\/doi.org\/10.1111\/j.1751-2409.2009.01013.x","journal-title":"Soc Issues Policy Rev"},{"key":"1715_CR9","doi-asserted-by":"publisher","unstructured":"Batson CD (2009) These things called empathy: eight related but distinct phenomena. The social neuroscience of empathy. In: Decety J, Ickes W (eds) Social neuroscience. The social neuroscience of empathy. MIT Press, p 3\u201315. https:\/\/doi.org\/10.7551\/mitpress\/9780262012973.003.0002","DOI":"10.7551\/mitpress\/9780262012973.003.0002"},{"key":"1715_CR10","doi-asserted-by":"publisher","unstructured":"Batson CD, Lishner, DA, Stocks, EL (2015) The empathy\u2013altruism hypothesis. In: Schroeder DA, Graziano WG (eds) The Oxford handbook of prosocial behavior. Oxford University Press, Oxford, p 259\u2013268. https:\/\/doi.org\/10.1093\/oxfordhb\/9780195399813.013.023","DOI":"10.1093\/oxfordhb\/9780195399813.013.023"},{"key":"1715_CR11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1146\/annurev-neuro-062111-150536","volume":"35","author":"BC Bernhardt","year":"2012","unstructured":"Bernhardt BC, Singer T (2012) The neural basis of empathy. Annu Rev Neurosci 35:1\u201323. https:\/\/doi.org\/10.1146\/annurev-neuro-062111-150536","journal-title":"Annu Rev Neurosci"},{"issue":"9","key":"1715_CR12","doi-asserted-by":"publisher","first-page":"2355","DOI":"10.1016\/j.pragma.2009.12.012","volume":"42","author":"HP Branigan","year":"2010","unstructured":"Branigan HP, Pickering MJ, Pearson J, McLean JF (2010) Linguistic alignment between people and computers. J Pragmat 42(9):2355\u20132368. https:\/\/doi.org\/10.1016\/j.pragma.2009.12.012","journal-title":"J Pragmat"},{"key":"1715_CR94","doi-asserted-by":"publisher","unstructured":"Brave S, Nass C, Hutchinson K (2005) Computers that care: investigating the effects of orientation of emotion exhibited by an embodied computer agent. Int J Hum Comput Stud 62(2):161\u201378. https:\/\/doi.org\/10.1016\/j.ijhcs.2004.11.002","DOI":"10.1016\/j.ijhcs.2004.11.002"},{"key":"1715_CR13","doi-asserted-by":"publisher","unstructured":"Cameron G, Cameron D, Megaw G, Bond R, Mulvenna M, O\u2019Neill S, Armour C, McTear M (2017) Towards a chatbot for digital counselling. In: Proceedings of the 31st international BCS human computer interaction conference (HCI 2017), vol 31. pp 1\u20137. https:\/\/doi.org\/10.14236\/ewic\/HCI2017.24","DOI":"10.14236\/ewic\/HCI2017.24"},{"key":"1715_CR14","doi-asserted-by":"publisher","unstructured":"Charrier L, Rieger A, Galdeano A, Cordier A, Lefort M, Hassas S (2019) The rope scale: a measure of how empathic a robot is perceived. In: 2019 14th ACM\/IEEE international conference on human-rsobot interaction (HRI), p 656\u2013657. https:\/\/doi.org\/10.1109\/HRI.2019.8673082","DOI":"10.1109\/HRI.2019.8673082"},{"key":"1715_CR15","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2020.1841438","author":"AP Chaves","year":"2020","unstructured":"Chaves AP, Gerosa MA (2020) How should my chatbot interact? A survey on social characteristics in human\u2013chatbot interaction design. Int J Hum-Comput Interact. https:\/\/doi.org\/10.1080\/10447318.2020.1841438","journal-title":"Int J Hum-Comput Interact"},{"issue":"2","key":"1715_CR16","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1145\/3166054.3166058","volume":"19","author":"H Chen","year":"2017","unstructured":"Chen H, Liu X, Yin D, Tang J (2017) A survey on dialogue systems: recent advances and new frontiers. ACM Sigkdd Explor Newsl 19(2):25\u201335. https:\/\/doi.org\/10.1145\/3166054.3166058","journal-title":"ACM Sigkdd Explor Newsl"},{"key":"1715_CR17","volume-title":"The mask of sanity","author":"H Cleckley","year":"1976","unstructured":"Cleckley H (1976) The mask of sanity, 5th edn. Mosby, St. Louis","edition":"5"},{"key":"1715_CR18","unstructured":"Concannon S, Healey P, Purver M (2015) Shifting opinions: experiments on agreement and disagreement in dialogue. In: Proceedings of the 19th workshop on the semantics and pragmatics of dialogue (goDIAL), SEMDIAL, pp 15\u201323"},{"key":"1715_CR20","doi-asserted-by":"publisher","first-page":"87","DOI":"10.30658\/hmc.6.6","volume":"6","author":"S Concannon","year":"2023","unstructured":"Concannon S, Roberts I, Tomalin M (2023) An interactional account of empathy in human-machine communication. Hum-Mach Commun 6:87\u2013116. https:\/\/doi.org\/10.30658\/hmc.6.6","journal-title":"Hum-Mach Commun"},{"issue":"8","key":"1715_CR21","doi-asserted-by":"publisher","first-page":"3046","DOI":"10.3390\/s22083046","volume":"22","author":"K Daher","year":"2022","unstructured":"Daher K, Saad D, Mugellini E, Lalanne D, Abou Khaled O (2022) Empathic and empathetic systematic review to standardize the development of reliable and sustainable empathic systems. Sensors 22(8):3046. https:\/\/doi.org\/10.3390\/s22083046","journal-title":"Sensors"},{"issue":"1","key":"1715_CR22","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1037\/0022-3514.44.1.113","volume":"44","author":"MH Davis","year":"1983","unstructured":"Davis MH (1983) Measuring individual differences in empathy: evidence for a multidimensional approach. J Pers Soc Psychol 44(1):113\u2013126. https:\/\/doi.org\/10.1037\/0022-3514.44.1.113","journal-title":"J Pers Soc Psychol"},{"issue":"10","key":"1715_CR23","doi-asserted-by":"publisher","first-page":"435","DOI":"10.1016\/j.tics.2006.08.008","volume":"10","author":"F De Vignemont","year":"2006","unstructured":"De Vignemont F, Singer T (2006) The empathic brain: how, when and why? Trends Cogn Sci 10(10):435\u2013441. https:\/\/doi.org\/10.1016\/j.tics.2006.08.008","journal-title":"Trends Cogn Sci"},{"issue":"1","key":"1715_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.dcn.2011.05.003","volume":"2","author":"J Decety","year":"2012","unstructured":"Decety J, Svetlova M (2012) Putting together phylogenetic and ontogenetic perspectives on empathy. Dev Cogn Neurosci 2(1):1\u201324. https:\/\/doi.org\/10.1016\/j.dcn.2011.05.003","journal-title":"Dev Cogn Neurosci"},{"issue":"3","key":"1715_CR25","doi-asserted-by":"publisher","first-page":"e12570","DOI":"10.1111\/desc.12570","volume":"21","author":"J Decety","year":"2018","unstructured":"Decety J, Meidenbauer KL, Cowell JM (2018) The development of cognitive empathy and concern in preschool children: a behavioral neuroscience investigation. Dev Sci 21(3):e12570. https:\/\/doi.org\/10.1111\/desc.12570","journal-title":"Dev Sci"},{"issue":"3","key":"1715_CR26","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1017\/S1352465813000039","volume":"42","author":"SE Decker","year":"2014","unstructured":"Decker SE, Nich C, Carroll KM, Martino S (2014) Development of the therapist empathy scale. Behav Cogn Psychother 42(3):339\u2013354. https:\/\/doi.org\/10.1017\/S1352465813000039","journal-title":"Behav Cogn Psychother"},{"key":"1715_CR93","unstructured":"Dial M (2018) Heartificial empathy: putting heart into business and artificial intelligence. N.p., DigitalProof Press"},{"key":"1715_CR27","doi-asserted-by":"publisher","DOI":"10.4324\/9780203929902","volume-title":"Theory of mind: how children understand others\u2019 thoughts and feelings","author":"M Doherty","year":"2008","unstructured":"Doherty M (2008) Theory of mind: how children understand others\u2019 thoughts and feelings. Psychology Press"},{"issue":"1","key":"1715_CR28","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1521\/pedi.2013.27.1.67","volume":"27","author":"G Domes","year":"2013","unstructured":"Domes G, Hollerbach P, Vohs K, Mokros A, Habermeyer E (2013) Emotional empathy and psychopathy in offenders: an experimental study. J Pers Disord 27(1):67\u201384. https:\/\/doi.org\/10.1521\/pedi.2013.27.1.67","journal-title":"J Pers Disord"},{"key":"1715_CR29","doi-asserted-by":"publisher","first-page":"71","DOI":"10.7551\/mitpress\/9780262012973.003.0007","volume":"6","author":"N Eisenberg","year":"2009","unstructured":"Eisenberg N, Eggum ND (2009) Empathic responding: sympathy and personal distress. Soc Neurosci Empathy 6:71\u201383. https:\/\/doi.org\/10.7551\/mitpress\/9780262012973.003.0007","journal-title":"Soc Neurosci Empathy"},{"key":"1715_CR30","doi-asserted-by":"publisher","unstructured":"Eisenberg N, Spinard TL, Knafo-Noam A (2015) Prosocial development. In: Lamb ME, Lerner RM (eds) Handbook of child psychology and developmental science, 7th edn, vol 3. John Wiley & Sons Inc, New York. https:\/\/doi.org\/10.1002\/9781118963418.childpsy315","DOI":"10.1002\/9781118963418.childpsy315"},{"issue":"2","key":"1715_CR31","doi-asserted-by":"publisher","first-page":"e19","DOI":"10.2196\/mental.7785","volume":"4","author":"KK Fitzpatrick","year":"2017","unstructured":"Fitzpatrick KK, Darcy A, Vierhile M (2017) Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (woebot): a randomized controlled trial. JMIR Ment Health 4(2):e19. https:\/\/doi.org\/10.2196\/mental.7785","journal-title":"JMIR Ment Health"},{"issue":"11","key":"1715_CR32","doi-asserted-by":"publisher","first-page":"2128","DOI":"10.1016\/j.pec.2017.05.004","volume":"100","author":"RM Frankel","year":"2017","unstructured":"Frankel RM (2017) The evolution of empathy research: models, muddles, and mechanisms. Patient Educ Couns 100(11):2128\u20132130. https:\/\/doi.org\/10.1016\/j.pec.2017.05.004","journal-title":"Patient Educ Couns"},{"issue":"4","key":"1715_CR33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1111\/cpsp.12298","volume":"26","author":"F Grondin","year":"2019","unstructured":"Grondin F, Lomanowska A, Jackson P (2019) Empathy in computer-mediated interactions: a conceptual framework for research and clinical practice. Clin Psychol Sci Pract 26(4):1\u201317. https:\/\/doi.org\/10.1111\/cpsp.12298","journal-title":"Clin Psychol Sci Pract"},{"issue":"1","key":"1715_CR34","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1177\/1461444819858","volume":"22","author":"AL Guzman","year":"2020","unstructured":"Guzman AL, Lewis SC (2020) Artificial intelligence and communication: a human\u2013machine communication research agenda. New Media Soc 22(1):70\u201386. https:\/\/doi.org\/10.1177\/1461444819858","journal-title":"New Media Soc"},{"issue":"3","key":"1715_CR35","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1080\/00224545.2018.1477442","volume":"159","author":"JA Hall","year":"2019","unstructured":"Hall JA, Schwartz R (2019) Empathy present and future. J Soc Psychol 159(3):225\u2013243. https:\/\/doi.org\/10.1080\/00224545.2018.1477442","journal-title":"J Soc Psychol"},{"issue":"1","key":"1715_CR36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1472-6920-7-24","volume":"7","author":"JM Hemmerdinger","year":"2007","unstructured":"Hemmerdinger JM, Stoddart SD, Lilford RJ (2007) A systematic review of tests of empathy in medicine. BMC Med Educ 7(1):1\u20138. https:\/\/doi.org\/10.1186\/1472-6920-7-24","journal-title":"BMC Med Educ"},{"key":"1715_CR37","unstructured":"Hills AH (2001) Empathy and offender behavior: The motivational context. In Traverso GB, Bognoli L (eds) Psychology and law in a changing world: new trends in theory, practice and research, Psychology Press, pp 51\u201364"},{"key":"1715_CR38","first-page":"47","volume-title":"Empathy and its development","author":"ML Hoffman","year":"1987","unstructured":"Hoffman ML (1987) The contribution of empathy to justice and moral judgment. In: Eisenberg N, Strayer J (eds) Empathy and its development. Cambridge University Press, Cambridge, pp 47\u201380"},{"key":"1715_CR39","doi-asserted-by":"crossref","unstructured":"Hojat M (2016) Empathy in health professions education and primary care. Springer International, Cham","DOI":"10.1007\/978-3-319-27625-0"},{"issue":"9","key":"1715_CR40","doi-asserted-by":"publisher","first-page":"1563","DOI":"10.1176\/appi.ajp.159.9.1563","volume":"159","author":"M Hojat","year":"2002","unstructured":"Hojat M, Gonnella JS, Nasca TJ, Mangione S, Vergare M, Magee M (2002) Physician empathy: definition, components, measurement, and relationship to gender and specialty. Am J Psychiatry 159(9):1563\u20131569. https:\/\/doi.org\/10.1176\/appi.ajp.159.9.1563","journal-title":"Am J Psychiatry"},{"issue":"5","key":"1715_CR41","doi-asserted-by":"publisher","first-page":"899","DOI":"10.1007\/s10459-018-9839-9","volume":"23","author":"M Hojat","year":"2018","unstructured":"Hojat M, DeSantis J, Shannon SC, Mortensen LH, Speicher MR, Bragan L, LaNoue M, Calabrese LH (2018) The Jefferson scale of empathy: a nationwide study of measurement properties, underlying components, latent variable structure, and national norms in medical students. Adv Health Sci Educ 23(5):899\u2013920. https:\/\/doi.org\/10.1007\/s10459-018-9839-9","journal-title":"Adv Health Sci Educ"},{"issue":"2","key":"1715_CR42","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1080\/03601277.2020.1712058","volume":"46","author":"H Hong","year":"2020","unstructured":"Hong H, Han A (2020) A systematic review on empathy measurement tools for care professionals. Educ Gerontol 46(2):72\u201383. https:\/\/doi.org\/10.1080\/03601277.2020.1712058","journal-title":"Educ Gerontol"},{"key":"1715_CR43","doi-asserted-by":"publisher","unstructured":"James J, Watson CI, MacDonald B (2018) Artificial empathy in social robots: an analysis of emotions in speech. In: 2018 27th IEEE international symposium on robot and human interactive communication (RO-MAN). IEEE, p 632\u2013637. https:\/\/doi.org\/10.1109\/ROMAN.2018.8525652","DOI":"10.1109\/ROMAN.2018.8525652"},{"issue":"2","key":"1715_CR44","doi-asserted-by":"publisher","first-page":"214","DOI":"10.1080\/03057240.2018.1482531","volume":"48","author":"P Jami Yaghoubi","year":"2019","unstructured":"Jami Yaghoubi P, Mansouri B, Thoma SJ, Han H (2019) An investigation of the divergences and convergences of trait empathy across two cultures. Journal of Moral Education 48(2):214\u2013229. https:\/\/doi.org\/10.1080\/03057240.2018.1482531","journal-title":"Journal of Moral Education"},{"key":"1715_CR91","doi-asserted-by":"publisher","unstructured":"Jolliffe D, Farrington DP (2006) Development and validation of the Basic Empathy Scale. J Adolesc 29(4):589\u2013611. https:\/\/doi.org\/10.1016\/j.adolescence.2005.08.010","DOI":"10.1016\/j.adolescence.2005.08.010"},{"issue":"1","key":"1715_CR45","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.ijchp.2018.07.004","volume":"19","author":"LH J\u00fctten","year":"2019","unstructured":"J\u00fctten LH, Mark RE, Sitskoorn MM (2019) Empathy in informal dementia caregivers and its relationship with depression, anxiety, and burden. Int J Clin Health Psychol 19(1):12\u201321. https:\/\/doi.org\/10.1016\/j.ijchp.2018.07.004","journal-title":"Int J Clin Health Psychol"},{"key":"1715_CR46","doi-asserted-by":"publisher","DOI":"10.12987\/9780300240924","volume-title":"Empathy: a history","author":"S Lanzoni","year":"2018","unstructured":"Lanzoni S (2018) Empathy: a history. Yale University Press"},{"issue":"9","key":"1715_CR47","doi-asserted-by":"publisher","first-page":"1557","DOI":"10.1037\/xge0000639","volume":"148","author":"JJ Lee","year":"2019","unstructured":"Lee JJ, Hardin AE, Parmar B, Gino F (2019) The interpersonal costs of dishonesty: how dishonest behavior reduces individuals\u2019 ability to read others\u2019 emotions. J Exp Psychol Gen 148(9):1557\u20131574. https:\/\/doi.org\/10.1037\/xge0000639","journal-title":"J Exp Psychol Gen"},{"key":"1715_CR48","doi-asserted-by":"publisher","unstructured":"Leino K, Leinonen J, Singh M, Virpioja S, Kurimo M (2020) FinChat: corpus and evaluation setup for finnish chat conversations on everyday topics. Proc. Interspeech 2020. p 429\u2013433. https:\/\/doi.org\/10.21437\/Interspeech.2020-2511","DOI":"10.21437\/Interspeech.2020-2511"},{"key":"1715_CR49","doi-asserted-by":"publisher","unstructured":"Lin C-Y, Och FJ (2004) Automatic evaluation of machine translation quality using longest common subsequence and skip-bigram statistics. In: Proceedings of the 42nd annual meeting of the association for computational linguistics. p 605\u2013612. https:\/\/doi.org\/10.3115\/1218955.1219032","DOI":"10.3115\/1218955.1219032"},{"key":"1715_CR50","doi-asserted-by":"publisher","unstructured":"Liu CW, Lowe R, Serban IV, Noseworthy M, Charlin L, Pineau J (2016) How NOT to evaluate your dialogue system: an empirical study of unsupervised evaluation metrics for dialogue response generation. In: Proceedings of the 2016 conference on empirical methods in natural language processing. p 2122\u20132132. https:\/\/doi.org\/10.18653\/v1\/D16-1230","DOI":"10.18653\/v1\/D16-1230"},{"key":"1715_CR51","doi-asserted-by":"publisher","first-page":"1198","DOI":"10.1007\/s11747-022-00892-5","volume":"50","author":"Y Liu-Thompkins","year":"2022","unstructured":"Liu-Thompkins Y, Okazaki S, Li H (2022) Artificial empathy in marketing interactions: bridging the human-AI gap in affective and social customer experience. J Acad Mark Sci 50:1198\u20131218. https:\/\/doi.org\/10.1007\/s11747-022-00892-5","journal-title":"J Acad Mark Sci"},{"key":"1715_CR52","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2020.06.011","author":"Y Ma","year":"2020","unstructured":"Ma Y, Nguyen K, Xing F, Cambria E (2020) A survey on empathetic dialogue systems. Inf Fusion. https:\/\/doi.org\/10.1016\/j.inffus.2020.06.011","journal-title":"Inf Fusion"},{"key":"1715_CR53","doi-asserted-by":"publisher","first-page":"1","DOI":"10.4324\/9781315282015","volume-title":"The routledge handbook to philosophy of empathy","author":"HL Maibom","year":"2017","unstructured":"Maibom HL (2017) Introduction to philosophy of empathy. The routledge handbook to philosophy of empathy. Routledge, New York, pp 1\u201310"},{"issue":"2","key":"1715_CR54","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1016\/0272-7358(95)00002-7","volume":"15","author":"WL Marshall","year":"1995","unstructured":"Marshall WL, Hudson SM, Jones R, Fernandez YM (1995) Empathy in sex offenders. Clin Psychol Rev 15(2):99\u2013113. https:\/\/doi.org\/10.1016\/0272-7358(95)00002-7","journal-title":"Clin Psychol Rev"},{"key":"1715_CR55","doi-asserted-by":"publisher","DOI":"10.4135\/9781526451293","volume-title":"Emotional AI: the rise of empathic media","author":"A McStay","year":"2018","unstructured":"McStay A (2018) Emotional AI: the rise of empathic media. Sage"},{"issue":"6","key":"1715_CR56","doi-asserted-by":"publisher","first-page":"699","DOI":"10.1093\/fampra\/cmh621","volume":"21","author":"SW Mercer","year":"2004","unstructured":"Mercer SW, Maxwell M, Heaney D, Watt GC (2004) The consultation and relational empathy (CARE) measure: development and preliminary validation and reliability of an empathy-based consultation process measure. Fam Pract 21(6):699\u2013705. https:\/\/doi.org\/10.1093\/fampra\/cmh621","journal-title":"Fam Pract"},{"issue":"3","key":"1715_CR57","doi-asserted-by":"publisher","first-page":"328","DOI":"10.1093\/fampra\/cmh730","volume":"22","author":"SW Mercer","year":"2005","unstructured":"Mercer SW, McConnachie A, Maxwell M, Heaney D, Watt GC (2005) Relevance and practical use of the consultation and relational empathy (CARE) measure in general practice. Fam Pract 22(3):328\u2013334. https:\/\/doi.org\/10.1093\/fampra\/cmh730","journal-title":"Fam Pract"},{"issue":"6","key":"1715_CR58","doi-asserted-by":"publisher","first-page":"101","DOI":"10.2196\/10148","volume":"20","author":"RR Morris","year":"2018","unstructured":"Morris RR, Kouddous K, Kshirsagar R, Schueller SM (2018) Towards an artificially empathic conversational agent for mental health applications: system design and user perceptions. J Med Internet Res 20(6):101\u2013148. https:\/\/doi.org\/10.2196\/10148","journal-title":"J Med Internet Res"},{"key":"1715_CR59","doi-asserted-by":"publisher","unstructured":"Neumann DL, Chan RC, Boyle GJ, Wang Y, Westbury HR (2015) Measures of empathy: self-report, behavioral, and neuroscientific approaches. In: Measures of personality and social psychological constructs. Academic Press, p 257\u2013289. https:\/\/doi.org\/10.1016\/B978-0-12-386915-9.00010-3","DOI":"10.1016\/B978-0-12-386915-9.00010-3"},{"key":"1715_CR60","unstructured":"OpenAI, ChatGPT (2022) Optimizing language models for dialogue. https:\/\/web.archive.org\/web\/20230205020039\/https:\/\/openai.com\/blog\/chatgpt\/. Accessed 30 Nov 2022"},{"issue":"1","key":"1715_CR61","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2996188","volume":"17","author":"J Otterbacher","year":"2017","unstructured":"Otterbacher J, Ang CS, Litvak M, Atkins D (2017) Show me you care: trait empathy, linguistic style, and mimicry on facebook. ACM Trans Internet Technol 17(1):1\u201322. https:\/\/doi.org\/10.1145\/2996188","journal-title":"ACM Trans Internet Technol"},{"issue":"3","key":"1715_CR62","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2912150","volume":"7","author":"A Paiva","year":"2017","unstructured":"Paiva A, Leite I, Boukricha H, Wachsmuth I (2017) Empathy in virtual agents and robots: a survey. ACM Trans Interact Intell Syst (TiiS) 7(3):1\u201340. https:\/\/doi.org\/10.1145\/2912150","journal-title":"ACM Trans Interact Intell Syst (TiiS)"},{"key":"1715_CR63","doi-asserted-by":"publisher","unstructured":"Papineni K, Roukos S, Ward T, Zhu WJ (2002) BLEU: a method for automatic evaluation of machine translation. In: Proceedings of the 40th annual meeting of the association for computational linguistics. Association for Computational Linguistics, pp 311\u2013318. https:\/\/doi.org\/10.3115\/1073083.1073135","DOI":"10.3115\/1073083.1073135"},{"issue":"1","key":"1715_CR64","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1521\/pedi_2014_28_145","volume":"29","author":"DM Pfabigan","year":"2015","unstructured":"Pfabigan DM, Seidel EM, Wucherer AM, Keckeis K, Derntl B, Lamm C (2015) Affective empathy differs in male violent offenders with high-and low-trait psychopathy. J Pers Disord 29(1):42\u201361. https:\/\/doi.org\/10.1521\/pedi_2014_28_145","journal-title":"J Pers Disord"},{"key":"1715_CR65","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/1140.001.0001","volume-title":"Affective computing","author":"R Picard","year":"1997","unstructured":"Picard R (1997) Affective computing. The MIT Press, Cambridge"},{"issue":"2","key":"1715_CR66","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1558\/japl.v7i2.145","volume":"7","author":"G Pounds","year":"2011","unstructured":"Pounds G (2011) Empathy as \u2018appraisal\u2019: developing a new language-based approach to the exploration of clinical empathy. J Appl Linguist Prof Pract 7(2):139\u2013162. https:\/\/doi.org\/10.1558\/japl.v7i2.145","journal-title":"J Appl Linguist Prof Pract"},{"key":"1715_CR67","doi-asserted-by":"publisher","DOI":"10.1075\/cilt.92","volume-title":"Paralanguage a linguistic and interdisciplinary approach to interactive speech and sounds","author":"F Poyatos","year":"1993","unstructured":"Poyatos F (1993) Paralanguage a linguistic and interdisciplinary approach to interactive speech and sounds. John Bemjamins, Amsterdam"},{"key":"1715_CR68","doi-asserted-by":"publisher","unstructured":"Putta H, Daher K, Kamali ME, Khaled OA, Lalanne D, Mugellini E (2022) Empathy scale adaptation for artificial agents: a review with a new subscale proposal. In: 8th International conference on control, decision and information technologies, Istanbul, Turkey, p 699\u2013704. https:\/\/doi.org\/10.1109\/CoDIT55151.2022.9803993","DOI":"10.1109\/CoDIT55151.2022.9803993"},{"key":"1715_CR69","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2022.3226693","author":"AS Raamkumar","year":"2022","unstructured":"Raamkumar AS, Yang Y (2022) Empathetic conversational systems: a review of current advances, gaps, and opportunities. IEEE Trans Affect Comput. https:\/\/doi.org\/10.1109\/TAFFC.2022.3226693","journal-title":"IEEE Trans Affect Comput"},{"key":"1715_CR70","doi-asserted-by":"publisher","unstructured":"Rashkin H, Smith EM, Li M, Boureau, YL (2019) Towards empathetic open-domain conversation models: a new benchmark and dataset. In: Proceedings of the 57th annual meeting of the association for computational linguistics. p 5370\u20135381. https:\/\/doi.org\/10.18653\/v1\/P19-1534","DOI":"10.18653\/v1\/P19-1534"},{"issue":"4","key":"1715_CR71","doi-asserted-by":"publisher","first-page":"545","DOI":"10.1007\/s10862-015-9479-9","volume":"37","author":"EV Robinson","year":"2015","unstructured":"Robinson EV, Rogers R (2015) Empathy faking in psychopathic offenders: the vulnerability of empathy measures. J Psychopathol Behav Assess 37(4):545\u2013552. https:\/\/doi.org\/10.1007\/s10862-015-9479-9","journal-title":"J Psychopathol Behav Assess"},{"issue":"4","key":"1715_CR72","doi-asserted-by":"publisher","first-page":"237","DOI":"10.3917\/rne.074.0237","volume":"7","author":"S Shamay-Tsoory","year":"2015","unstructured":"Shamay-Tsoory S (2015) The neuropsychology of empathy: evidence from lesion studies. Rev Neuropsychol 7(4):237\u2013243","journal-title":"Rev Neuropsychol"},{"key":"1715_CR73","unstructured":"Shuster K, Xu J, Komeili M, Ju D, Smith EM, Roller S, Ung M, Chen M, Arora K, Lane J, Behrooz M, Ngan W, Poff S, Goyal N, Szlam A, Boureau Y-L, Kambadur M, Weston J (2022) \u2018BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage\u2019. https:\/\/arxiv.org\/pdf\/2208.03188.pdf. Accessed 25 June 2023"},{"key":"1715_CR74","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1111\/j.1749-6632.2009.04418.x","volume":"1156","author":"T Singer","year":"2009","unstructured":"Singer T, Lamm C (2009) The social neuroscience of empathy. Ann N Y Acad Sci 1156:81\u201396","journal-title":"Ann N Y Acad Sci"},{"key":"1715_CR89","doi-asserted-by":"publisher","unstructured":"Stephan A (2015) Empathy for artificial agents. Int J of Soc Robotics 7:111\u2013116. https:\/\/doi.org\/10.1007\/s12369-014-0260-0","DOI":"10.1007\/s12369-014-0260-0"},{"key":"1715_CR75","first-page":"218","volume-title":"Empathy and its development","author":"J Strayer","year":"1987","unstructured":"Strayer J (1987) Affective and cognitive perspectives on empathy. In: Eisenberg N, Strayer J (eds) Empathy and its development. Cambridge University Press, Cambridge, pp 218\u2013244"},{"issue":"8","key":"1715_CR76","doi-asserted-by":"publisher","first-page":"678","DOI":"10.1001\/jama.1997.03540320082047","volume":"277","author":"AL Suchman","year":"1997","unstructured":"Suchman AL, Markakis K, Beckman HB, Frankel R (1997) A model of empathic communication in the medical interview. JAMA 277(8):678\u2013682","journal-title":"JAMA"},{"key":"1715_CR77","doi-asserted-by":"publisher","unstructured":"Tianbo J, Graham Y, Jones G, Lyu C, Liu Q (2022) Achieving reliable human assessment of open-domain dialogue systems. In: Proceedings of the 60th annual meeting of the association for computational linguistics. Association for Computational Linguistics, pp 6416\u20136437. https:\/\/doi.org\/10.18653\/v1\/2022.acl-long.445","DOI":"10.18653\/v1\/2022.acl-long.445"},{"key":"1715_CR78","volume-title":"Elementary psychology of the thought processes","author":"E Titchener","year":"1909","unstructured":"Titchener E (1909) Elementary psychology of the thought processes. Macmillan, New York"},{"key":"1715_CR79","doi-asserted-by":"publisher","unstructured":"Urakami J, Moore BA, Sutthithatip S, Park S (2019) Users\u2019 perception of empathic expressions by an advanced intelligent system. In: Proceedings of the 7th international conference on human-agent interaction.  Association for Computing Machinery, pp 11\u201318. https:\/\/doi.org\/10.1145\/3349537.3351895","DOI":"10.1145\/3349537.3351895"},{"key":"1715_CR90","doi-asserted-by":"publisher","unstructured":"van Dijke J, van Nistelrooij I, Bos P, Duyndam J (2020) Towards a relational conceptualization of empathy. Nurs Philos 21(3). https:\/\/doi.org\/10.1111\/nup.12297","DOI":"10.1111\/nup.12297"},{"key":"1715_CR80","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2020.00695","author":"JD van Dongen","year":"2020","unstructured":"van Dongen JD (2020) The empathic brain of psychopaths: from social science to neuroscience in empathy. Front Psychol. https:\/\/doi.org\/10.3389\/fpsyg.2020.00695","journal-title":"Front Psychol"},{"issue":"18","key":"1715_CR81","doi-asserted-by":"publisher","first-page":"871","DOI":"10.1016\/j.cub.2014.06.055","volume":"24","author":"E Viding","year":"2014","unstructured":"Viding E, McCory E, Seara-Cardoso A (2014) Psychopathy. Curr Biol 24(18):871\u2013874. https:\/\/doi.org\/10.1016\/j.cub.2014.06.055","journal-title":"Curr Biol"},{"issue":"1","key":"1715_CR82","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1177\/1754073911421379","volume":"4","author":"H Walter","year":"2012","unstructured":"Walter H (2012) Social cognitive neuroscience of empathy: concepts, circuits, and genes. Emot Rev 4(1):9\u201317. https:\/\/doi.org\/10.1177\/1754073911421379","journal-title":"Emot Rev"},{"issue":"9","key":"1715_CR83","doi-asserted-by":"publisher","first-page":"1385","DOI":"10.1016\/j.pragma.2005.09.008","volume":"38","author":"R Wynn","year":"2006","unstructured":"Wynn R, Wynn M (2006) Empathy as an interactionally achieved phenomenon in psychotherapy: characteristics of some conversational resources. J Pragmat 38(9):1385\u20131397. https:\/\/doi.org\/10.1016\/j.pragma.2005.09.008","journal-title":"J Pragmat"},{"issue":"5","key":"1715_CR84","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1007\/s11920-016-0682-5","volume":"18","author":"B Xiao","year":"2016","unstructured":"Xiao B, Imel ZE, Georgiou P, Atkins DC, Narayanan SS (2016) Computational analysis and simulation of empathic behaviors: a survey of empathy modeling with behavioral signal processing framework. Curr Psychiatry Rep 18(5):49. https:\/\/doi.org\/10.1007\/s11920-016-0682-5","journal-title":"Curr Psychiatry Rep"},{"key":"1715_CR85","doi-asserted-by":"publisher","unstructured":"Yal\u00e7\u0131n \u00d6N (2019) Evaluating empathy in artificial agents. In: 2019 8th International conference on affective computing and intelligent interaction (ACII). IEEE, p 1\u20137. https:\/\/doi.org\/10.1109\/ACII.2019.8925498","DOI":"10.1109\/ACII.2019.8925498"},{"key":"1715_CR86","doi-asserted-by":"publisher","first-page":"2983","DOI":"10.1007\/s10462-019-09753-0","volume":"53","author":"\u00d6N Yal\u00e7\u0131n","year":"2020","unstructured":"Yal\u00e7\u0131n \u00d6N, DiPaola S (2020) Modeling empathy: building a link between affective and cognitive processes. Artif Intell Rev 53:2983\u20133006. https:\/\/doi.org\/10.1007\/s10462-019-09753-0","journal-title":"Artif Intell Rev"},{"issue":"1","key":"1715_CR87","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1162\/coli_a_00368","volume":"46","author":"L Zhou","year":"2020","unstructured":"Zhou L, Gao J, Li D, Shum H-Y (2020) The design and implementation of xiaoice, an empathetic social chatbot. Comput Linguist 46(1):53\u201393. https:\/\/doi.org\/10.1162\/coli_a_00368","journal-title":"Comput Linguist"},{"key":"1715_CR92","doi-asserted-by":"publisher","unstructured":"Zhu LY, Zhang Z, Wang J, Wang H, Wu H, Yang Z (2022) Multi-party empathetic dialogue generation: a new task for dialog systems. In: Proceedings of the 60th annual meeting of the association for computational linguistics, Association for Computational Linguistics, pp 298\u2013307. https:\/\/doi.org\/10.18653\/v1\/2022.acl-long.24","DOI":"10.18653\/v1\/2022.acl-long.24"}],"container-title":["AI &amp; SOCIETY"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-023-01715-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00146-023-01715-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00146-023-01715-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,20]],"date-time":"2024-09-20T04:10:04Z","timestamp":1726805404000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00146-023-01715-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,23]]},"references-count":91,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2024,10]]}},"alternative-id":["1715"],"URL":"https:\/\/doi.org\/10.1007\/s00146-023-01715-z","relation":{},"ISSN":["0951-5666","1435-5655"],"issn-type":[{"value":"0951-5666","type":"print"},{"value":"1435-5655","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,23]]},"assertion":[{"value":"15 September 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 June 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 July 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"On behalf of all authors, the corresponding author states that there is no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}