{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,25]],"date-time":"2026-01-25T05:32:41Z","timestamp":1769319161438,"version":"3.49.0"},"reference-count":81,"publisher":"Walter de Gruyter GmbH","issue":"1","license":[{"start":{"date-parts":[[2021,1,1]],"date-time":"2021-01-01T00:00:00Z","timestamp":1609459200000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,10,16]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>This article explores the rapidly advancing innovation to endow robots with social intelligence capabilities in the form of multilingual and multimodal emotion recognition, and emotion-aware decision-making capabilities, for contextually appropriate robot behaviours and cooperative social human\u2013robot interaction for the healthcare domain. The objective is to enable robots to become trustworthy and versatile social robots capable of having human-friendly and human assistive interactions, utilised to better assist human users\u2019 needs by enabling the robot to sense, adapt, and respond appropriately to their requirements while taking into consideration their wider affective, motivational states, and behaviour. We propose an innovative approach to the difficult research challenge of endowing robots with social intelligence capabilities for human assistive interactions, going beyond the conventional robotic sense-think-act loop. We propose an architecture that addresses a wide range of social cooperation skills and features required for real human\u2013robot social interaction, which includes language and vision analysis, dynamic emotional analysis (long-term affect and mood), semantic mapping to improve the robot\u2019s knowledge of the local context, situational knowledge representation, and emotion-aware decision-making. Fundamental to this architecture is a normative ethical and social framework adapted to the specific challenges of robots engaging with caregivers and care-receivers.<\/jats:p>","DOI":"10.1515\/pjbr-2021-0026","type":"journal-article","created":{"date-parts":[[2021,10,16]],"date-time":"2021-10-16T20:13:32Z","timestamp":1634415212000},"page":"437-453","source":"Crossref","is-referenced-by-count":5,"title":["CASIE \u2013 Computing affect and social intelligence for healthcare in an ethical and trustworthy manner"],"prefix":"10.1515","volume":"12","author":[{"given":"Laurentiu","family":"Vasiliu","sequence":"first","affiliation":[{"name":"Peracton Ltd. , Dublin , Ireland"}]},{"given":"Keith","family":"Cortis","sequence":"additional","affiliation":[{"name":"School of Computing, Dublin City University , Dublin , Ireland"}]},{"given":"Ross","family":"McDermott","sequence":"additional","affiliation":[{"name":"School of Computing, Dublin City University , Dublin , Ireland"}]},{"given":"Aphra","family":"Kerr","sequence":"additional","affiliation":[{"name":"Department of Sociology, Maynooth University , Kildare , Ireland"}]},{"given":"Arne","family":"Peters","sequence":"additional","affiliation":[{"name":"Informatik 6 - Lehrstuhl f\u00fcr Robotik, K\u00fcnstliche Intelligenz und Echtzeitsysteme Fakult\u00e4t f\u00fcr Informatik, Technische Universit\u00e4t M\u00fcnchen , Munich , Germany"}]},{"given":"Marc","family":"Hesse","sequence":"additional","affiliation":[{"name":"Cognitronics & Sensor Systems Group, Center for Cognitive Interaction Technology (CITEC), Universit\u00e4t Bielefeld , Bielefeld , Germany"}]},{"given":"Jens","family":"Hagemeyer","sequence":"additional","affiliation":[{"name":"Cognitronics & Sensor Systems Group, Center for Cognitive Interaction Technology (CITEC), Universit\u00e4t Bielefeld , Bielefeld , Germany"}]},{"given":"Tony","family":"Belpaeme","sequence":"additional","affiliation":[{"name":"IDLab, Department of Electronics and Information Systems, Ghent University , Ghent , Belgium"}]},{"given":"John","family":"McDonald","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Maynooth University , Kildare , Ireland"}]},{"given":"Rudi","family":"Villing","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Maynooth University , Kildare , Ireland"}]},{"given":"Alessandra","family":"Mileo","sequence":"additional","affiliation":[{"name":"School of Computing, Dublin City University , Dublin , Ireland"}]},{"given":"Annalina","family":"Caputo","sequence":"additional","affiliation":[{"name":"School of Computing, Dublin City University , Dublin , Ireland"}]},{"given":"Michael","family":"Scriney","sequence":"additional","affiliation":[{"name":"School of Computing, Dublin City University , Dublin , Ireland"}]},{"given":"Sascha","family":"Griffiths","sequence":"additional","affiliation":[{"name":"NoosWare BV , Amsterdam , The Netherlands"}]},{"given":"Adamantios","family":"Koumpis","sequence":"additional","affiliation":[{"name":"Berner Fachhochschule, Business School, Institute Digital Enabling , Bern , Switzerland"}]},{"given":"Brian","family":"Davis","sequence":"additional","affiliation":[{"name":"School of Computing, Dublin City University , Dublin , Ireland"}]}],"member":"374","published-online":{"date-parts":[[2021,10,16]]},"reference":[{"key":"2022020408211308636_j_pjbr-2021-0026_ref_001","doi-asserted-by":"crossref","unstructured":"C. Murad and C. Munteanu, \u201cI don\u2019t know what you\u2019re talking about, HALexa,\u201d in Proceedings of the 1st International Conference on Conversational User Interfaces \u2013 CUI \u201919, ACM Press, 2019, https:\/\/doi.org\/10.1145\/3342775.3342795.","DOI":"10.1145\/3342775.3342795"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_002","unstructured":"G. Hoffman, \u201cAnki, Jibo, and Kuri: What we can learn from social robots that didn\u2019t make it,\u201d IEEE Spectrum, 2019, http:\/\/spectrum.ieee.org\/automaton\/robotics\/home-robots\/anki-jibo-and-kuri-what-we-can-learn-from-social-robotics-failures."},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_003","doi-asserted-by":"crossref","unstructured":"L. Tian and S. Oviatt, \u201cA taxonomy of social errors in human\u2013robot interaction,\u201d ACM Trans. Hum.-Robot Interact. vol. 10, no. 2, art. 13, 2021, https:\/\/doi.org\/10.1145\/3439720.","DOI":"10.1145\/3439720"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_004","doi-asserted-by":"crossref","unstructured":"R. Plutchik, \u201cA General Psychoevolutionary Theory of Emotion,\u201d in Theories of Emotion, R. Plutchik and H. Kellerman, Eds., Academic Press, New York, 1980, pp. 3\u201333, https:\/\/doi.org\/10.1016\/B978-0-12-558701-3.50007-7.","DOI":"10.1016\/B978-0-12-558701-3.50007-7"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_005","doi-asserted-by":"crossref","unstructured":"M. A. Goodrich and A. C. Schultz, \u201cHuman-robot interaction: A survey,\u201d Foundation Trends\u00ae Hum.-Comp Interact., vol. 1, no. 3, pp. 203\u2013275, 2008, https:\/\/doi.org\/10.1561\/1100000005.","DOI":"10.1561\/1100000005"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_006","doi-asserted-by":"crossref","unstructured":"M. Salem, G. Lakatos, F. Amirabdollahian, and K. Dautenhahn, \u201cWould you trust a (faulty) robot?\u201d in Proceedings of the Tenth Annual ACM\/IEEE International Conference on Human\u2013Robot Interaction, ACM, 2015, pp. 141\u2013148, https:\/\/doi.org\/10.1145\/2696454.2696497.","DOI":"10.1145\/2696454.2696497"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_007","doi-asserted-by":"crossref","unstructured":"K. Darling, \u201c\u2018Who\u2019s Johnny?\u2019 Anthropomorphic framing in human-robot interaction, integration, and policy,\u201d in ROBOT ETHICS 2.0, P. Lin, G. Bekey, K. Abney, R. Jenkins, Eds., Oxford University Press, 2017. Available at SSRN: http:\/\/dx.doi.org\/10.2139\/ssrn.2588669.","DOI":"10.1093\/oso\/9780190652951.003.0012"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_008","doi-asserted-by":"crossref","unstructured":"O. Celiktutan, E. Sariyanidi, and H. Gunes, \u201cComputational Analysis of Affect, Personality, and Engagement in Human\u2013Robot Interactions,\u201d in Computer Vision for Assistive Healthcare, M. Leo and G. M. Farinella, Eds., Academic Press, United Kingdom, 2018, pp. 283\u2013318, https:\/\/doi.org\/10.1016\/B978-0-12-813445-0.00010-1.","DOI":"10.1016\/B978-0-12-813445-0.00010-1"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_009","unstructured":"D. Jurafsky and J. H. Martin, Speech and Language Processing, Prentice Hall: Pearson Education International, 2014."},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_010","doi-asserted-by":"crossref","unstructured":"P. Wiriyathammabhum, D. Summers-Stay, C. Ferm\u00fcller, and Y. Aloimonos, \u201cComputer vision and natural language processing,\u201d ACM Computing Surveys, vol. 49, no. 4, art. 71, 2017, https:\/\/doi.org\/10.1145\/3009906.","DOI":"10.1145\/3009906"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_011","doi-asserted-by":"crossref","unstructured":"D. Nyga and M. Beetz, \u201cCloud-based probabilistic knowledge services for instruction interpretation,\u201d in Robotics Research, Springer Proceedings in Advanced Robotics, vol 3, A. Bicchi and W. Burgard, Eds., Springer, Cham, 2018, pp. 649\u2013664, https:\/\/doi.org\/10.1007\/978-3-319-60916-4_37.","DOI":"10.1007\/978-3-319-60916-4_37"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_012","unstructured":"E. Triantaphyllou, B. Shu, S. N. Sanchez, and T. Ray, \u201cMulti-criteria decision making: an operations research approach,\u201d Encyclopedia Electrical Electron. Eng., vol. 15, no. 1998, pp. 175\u2013186, 1998."},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_013","unstructured":"European Commission Directorate General for Health and Food Safety, \u201cState of health in the EU: Companion Report,\u201d 2019, https:\/\/data.europa.eu\/doi\/10.2875\/71887."},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_014","doi-asserted-by":"crossref","unstructured":"M. Kyrarini, F. Lygerakis, A. Rajavenkatanarayanan, C. Sevastopoulos, H. R. Nambiappan, K. K. Chaitanya, et al., \u201cA survey of robots in healthcare,\u201d Technologies, vol. 9, no. 1, art. 8, 2021, https:\/\/doi.org\/10.3390\/technologies9010008.","DOI":"10.3390\/technologies9010008"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_015","doi-asserted-by":"crossref","unstructured":"T. Belpaeme, P. Baxter, R. Read, R. Wood, H. Cuayahuitl, B. Kiefer, et al., \u201cMultimodal child-robot interaction: Building social bonds,\u201d J. Hum.-Robot Interact., vol. 1, no. 2, pp. 33\u201353, 2013, https:\/\/doi.org\/10.5898\/jhri.1.2.belpaeme.","DOI":"10.5898\/JHRI.1.2.Belpaeme"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_016","doi-asserted-by":"crossref","unstructured":"A. D. Nuovo, F. Broz, N. Wang, T. Belpaeme, A. Cangelosi, R. Jones, et al., \u201cThe multi-modal interface of robot-era multi-robot services tailored for the elderly,\u201d Intell. Serv. Robot., vol. 11, no. 1, pp. 109\u2013126, 2017, https:\/\/doi.org\/10.1007\/s11370-017-0237-6.","DOI":"10.1007\/s11370-017-0237-6"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_017","doi-asserted-by":"crossref","unstructured":"R. Bemelmans, G. J. Gelderblom, P. Jonker, and L. de Witte, \u201cSocially assistive robots in elderly care: A systematic review into effects and effectiveness,\u201d J. Am. Med. Directors Assoc., vol. 13, no. 2, pp. 114\u2013120.e1, 2012, https:\/\/doi.org\/10.1016\/j.jamda.2010.10.002.","DOI":"10.1016\/j.jamda.2010.10.002"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_018","doi-asserted-by":"crossref","unstructured":"R. Q. Stafford, E. Broadbent, C. Jayawardena, U. Unger, I. H. Kuo, A. Igic, et al., \u201cImproved robot attitudes and emotions at a retirement home after meeting a robot,\u201d in 19th International Symposium in Robot and Human Interactive Communication, IEEE, 2010, pp. 82\u201387, https:\/\/doi.org\/10.1109\/roman.2010.5598679.","DOI":"10.1109\/ROMAN.2010.5598679"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_019","doi-asserted-by":"crossref","unstructured":"J. J. Diehl, L. M. Schmitt, M. Villano, and C. R. Crowell, \u201cThe clinical use of robots for individuals with autism spectrum disorders: A critical review,\u201d Res. Autism Spect. Dis., vol. 6, no. 1, pp. 249\u2013262, 2012, https:\/\/doi.org\/10.1016\/j.rasd.2011.05.006.","DOI":"10.1016\/j.rasd.2011.05.006"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_020","doi-asserted-by":"crossref","unstructured":"B. Scassellati, \u201cHow social robots will help us to diagnose, treat, and understand autism,\u201d in Robotics Research, Springer Tracts in Advanced Robotics, vol. 28, S. Thrun, R. Brooks, H. Durrant-Whyte, Eds., Springer, Berlin, Heidelberg, 2007, pp. 552\u2013563, https:\/\/doi.org\/10.1007\/978-3-540-48113-3_47.","DOI":"10.1007\/978-3-540-48113-3_47"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_021","doi-asserted-by":"crossref","unstructured":"S. Thill, C. A. Pop, T. Belpaeme, T. Ziemke, and B. Vanderborght, \u201cRobot-assisted therapy for autism spectrum disorders with (partially) autonomous control: Challenges and outlook,\u201d Paladyn, J. Behav. Robot., vol. 3, no. 4, pp. 209\u2013217, 2012, https:\/\/doi.org\/10.2478\/s13230-013-0107-7.","DOI":"10.2478\/s13230-013-0107-7"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_022","doi-asserted-by":"crossref","unstructured":"T. Turja and A. Oksanen, \u201cRobot acceptance at work: A multilevel analysis based on 27 EU countries,\u201d Int. J. Soc. Robot., vol. 11, no. 4, pp. 679\u2013689, 2019, https:\/\/doi.org\/10.1007\/s12369-019-00526-x.","DOI":"10.1007\/s12369-019-00526-x"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_023","doi-asserted-by":"crossref","unstructured":"L. Hung, C. Liu, E. Woldum, A. Au-Yeung, A. Berndt, C. Wallsworth, et al., \u201cThe benefits of and barriers to using a social robot PARO in care settings: a scoping review,\u201d BMC Geriatrics, vol. 19, art. 232, 2019, https:\/\/doi.org\/10.1186\/s12877-019-1244-6.","DOI":"10.1186\/s12877-019-1244-6"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_024","doi-asserted-by":"crossref","unstructured":"P. Salovey and J. D. Mayer, \u201cEmotional intelligence,\u201d Imaginat. Cognit. Personal., vol. 9, no. 3, pp. 185\u2013211, 1990, https:\/\/doi.org\/10.2190\/dugg-p24e-52wk-6cdg.","DOI":"10.2190\/DUGG-P24E-52WK-6CDG"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_025","doi-asserted-by":"crossref","unstructured":"M. Asada, \u201cTowards artificial empathy,\u201d Int. J. Soc. Robot., vol. 7, pp. 19\u201333, 2015, https:\/\/doi.org\/10.1007\/s12369-014-0253-z.","DOI":"10.1007\/s12369-014-0253-z"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_026","doi-asserted-by":"crossref","unstructured":"M. Chita-Tegmark, J. M. Ackerman, and M. Scheutz, \u201cEffects of assistive robot behavior on impressions of patient psychological attributes: Vignette-based human\u2013robot interaction study,\u201d J. Med. Internet Res., vol. 21, no. 6, art. e13729, 2019, https:\/\/doi.org\/10.2196\/13729.","DOI":"10.2196\/13729"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_027","doi-asserted-by":"crossref","unstructured":"M. Escher, T. V. Perneger, and J.-C. Chevrolet, \u201cNational questionnaire survey on what influences doctors\u2019 decisions about admission to intensive care,\u201d BMJ, vol. 329, no. 7463, art. 425, 2004, https:\/\/doi.org\/10.1136\/bmj.329.7463.425.","DOI":"10.1136\/bmj.329.7463.425"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_028","doi-asserted-by":"crossref","unstructured":"G. Odekerken-Schr\u00f6der, C. Mele, T. Russo-Spena, D. Mahr, and A. Ruggiero, \u201cMitigating loneliness with companion robots in the COVID-19 pandemic and beyond: An integrative framework and research agenda,\u201d J. Serv. Manag., vol. 31, no. 6, pp. 1149\u20131162, 2020, https:\/\/doi.org\/10.1108\/josm-05-2020-0148.","DOI":"10.1108\/JOSM-05-2020-0148"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_029","doi-asserted-by":"crossref","unstructured":"G. D\u2019Onofrio, D. Sancarlo, M. Raciti, M. Burke, A. Teare, T. Kovacic, et al., \u201cMARIO Project: validation and evidence of service robots for older people with dementia,\u201d J. Alzheimer Dis., vol. 68, no. 4, pp. 1587\u20131601, 2019, https:\/\/doi.org\/10.3233\/JAD-181165.","DOI":"10.3233\/JAD-181165"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_030","unstructured":"Microsoft, \u201cArtificial Intelligence in Western Europe: How 277 major European companies benefit from AI,\u201d 2019, https:\/\/info.microsoft.com\/WE-DIGTRNS-CNTNT-FY19-10Oct-09-ArtificialIntelligenceinWesternEurope-MGC0003181_01Registration-ForminBody.html."},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_031","doi-asserted-by":"crossref","unstructured":"G.-Z. Yang, B. J. Nelson, R. R. Murphy, H. Choset, H. Christensen, S. H. Collins, et al., \u201cCombating COVID-19 \u2013 The role of robotics in managing public health and infectious diseases,\u201d Sci. Robot., vol. 5, no. 40, art. eabb5589, 2020, https:\/\/doi.org\/10.1126\/scirobotics.abb5589.","DOI":"10.1126\/scirobotics.abb5589"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_032","unstructured":"World Health Organization, \u201cGlobal strategy on human resources for health: Workforce 2030,\u201d 2020, https:\/\/www.who.int\/publications\/i\/item\/9789241511131."},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_033","doi-asserted-by":"crossref","unstructured":"J.-P. Michel and F. Ecarnot, \u201cThe shortage of skilled workers in Europe: Its impact on geriatric medicine,\u201d Europ. Geriatr. Med., vol. 11, no. 3, pp. 345\u2013347, 2020, https:\/\/doi.org\/10.1007\/s41999-020-00323-0.","DOI":"10.1007\/s41999-020-00323-0"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_034","doi-asserted-by":"crossref","unstructured":"J. Wajcman, \u201cFeminist theories of technology,\u201d Cambridge J. Econom., vol. 34, no. 1, pp. 143\u2013152, 2010, https:\/\/doi.org\/10.1093\/cje\/ben057.","DOI":"10.1093\/cje\/ben057"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_035","doi-asserted-by":"crossref","unstructured":"C. Tannenbaum, R. P. Ellis, F. Eyssel, J. Zou, and L. Schiebinger, \u201cSex and gender analysis improves science and engineering,\u201d Nature, vol. 575, no. 7781, pp. 137\u2013146, 2019, https:\/\/doi.org\/10.1038\/s41586-019-1657-6.","DOI":"10.1038\/s41586-019-1657-6"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_036","doi-asserted-by":"crossref","unstructured":"M. Bergin, J. S. Wells, and S. Owen, \u201cGender awareness, symptom expressions and Irish mental health-care provision,\u201d J. Gender Stud., vol. 25, no. 2, pp. 141\u2013154, 2016, https:\/\/doi.org\/10.1080\/09589236.2014.917950.","DOI":"10.1080\/09589236.2014.917950"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_037","doi-asserted-by":"crossref","unstructured":"T. Stivers, N. J. Enfield, P. Brown, C. Englert, M. Hayashi, T. Heinemann, et al., \u201cUniversals and cultural variation in turn-taking in conversation,\u201d Proc. Nat. Acad. Sci., vol. 106, no. 26, pp. 10587\u201310592, 2009, https:\/\/doi.org\/10.1073\/pnas.0903616106.","DOI":"10.1073\/pnas.0903616106"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_038","doi-asserted-by":"crossref","unstructured":"R. W. Picard, \u201cAffective computing: challenges,\u201d Int. J. Hum.-Comp. Stud., vol. 59, no. 1\u20132, pp. 55\u201364, 2003, https:\/\/doi.org\/10.1016\/s1071-5819(03)00052-1.","DOI":"10.1016\/S1071-5819(03)00052-1"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_039","doi-asserted-by":"crossref","unstructured":"V. Mitra, S. Booker, E. Marchi, D. S. Farrar, U. D. Peitz, B. Cheng, et al., \u201cLeveraging acoustic cues and paralinguistic embeddings to detect expression from voice,\u201d in Proc. Interspeech 2019, 2019, pp. 1651\u20131655, https:\/\/doi.org\/10.21437\/interspeech.2019-2998.","DOI":"10.21437\/Interspeech.2019-2998"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_040","doi-asserted-by":"crossref","unstructured":"B. Weiss, Talker Quality in Human and Machine Interaction, Springer International Publishing, Switzerland, 2020, https:\/\/doi.org\/10.1007\/978-3-030-22769-2.","DOI":"10.1007\/978-3-030-22769-2"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_041","doi-asserted-by":"crossref","unstructured":"D. Maynard, K. Bontcheva, and I. Augenstein, \u201cNatural language processing for the semantic web,\u201d Synthesis Lect. Semant. Web Theor. Technol., vol. 6, no. 2, pp. 1\u2013194, 2016, https:\/\/doi.org\/10.2200\/s00741ed1v01y201611wbe015.","DOI":"10.2200\/S00741ED1V01Y201611WBE015"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_042","doi-asserted-by":"crossref","unstructured":"M. Scheutz, R. Cantrell, and P. Schermerhorn, \u201cToward humanlike task-based dialogue processing for human robot interaction,\u201d AI Magazine, vol. 32, no. 4, pp. 77\u201384, 2011, https:\/\/doi.org\/10.1609\/aimag.v32i4.2381.","DOI":"10.1609\/aimag.v32i4.2381"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_043","doi-asserted-by":"crossref","unstructured":"P. Fung, D. Bertero, Y. Wan, A. Dey, R. H. Y. Chan, F. B. Siddique, et al., \u201cTowards empathetic human\u2013robot interactions,\u201d in Computational Linguistics and Intelligent Text Processing, CICLing 2016, Lecture Notes in Computer Science, vol. 9624, A. Gelbukh, Ed.,  Springer, Cham, 2018, pp. 173\u2013193, https:\/\/doi.org\/10.1007\/978-3-319-75487-1_14.","DOI":"10.1007\/978-3-319-75487-1_14"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_044","unstructured":"Y. Zhang and M. Huang, \u201cOverview of the NTCIR-14 short text generation subtask: emotion generation challenge,\u201d in Proceedings of the 14th NTCIR Conference on Evaluation of Information Access Technologies, June 10\u201313, 2019 Tokyo Japan, 2019, pp. 316\u2013327."},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_045","doi-asserted-by":"crossref","unstructured":"T.-Y. Lin, P. Goyal, R. Girshick, K. He, and P. Dollar, \u201cFocal loss for dense object detection,\u201d IEEE Trans. Pattern Anal. Machine Intell., vol. 42, no. 2, pp. 318\u2013327, 2020, https:\/\/doi.org\/10.1109\/tpami.2018.2858826.","DOI":"10.1109\/TPAMI.2018.2858826"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_046","doi-asserted-by":"crossref","unstructured":"Z. Cao, G. Hidalgo, T. Simon, S.-E. Wei, and Y. Sheikh, \u201cOpenPose: Realtime multi-person 2D pose estimation using part affinity fields,\u201d IEEE Trans. Pattern Anal. Machine Intell., vol. 43, no. 1, pp. 172\u2013186, 2021, https:\/\/doi.org\/10.1109\/tpami.2019.2929257.","DOI":"10.1109\/TPAMI.2019.2929257"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_047","doi-asserted-by":"crossref","unstructured":"M. Berger, A. Tagliasacchi, L. M. Seversky, P. Alliez, G. Guennebaud, J. A. Levine, et al., \u201cA survey of surface reconstruction from point clouds,\u201d Comp. Graph. Forum, vol. 36, no. 1, pp. 301\u2013329, 2016, https:\/\/doi.org\/10.1111\/cgf.12802.","DOI":"10.1111\/cgf.12802"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_048","unstructured":"O. Sorkine and M. Alexa, \u201cAs-rigid-as-possible surface modeling,\u201d in Geometry Processing, A. Belyaev and M. Garland, Eds., 2007, http:\/\/dx.doi.org\/10.2312\/SGP\/SGP07\/109-116."},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_049","doi-asserted-by":"crossref","unstructured":"W. Chang and M. Zwicker, \u201cGlobal registration of dynamic range scans for articulated model reconstruction,\u201d ACM Trans. Graph., vol. 30, no. 3, pp. 1\u201315, 2011.","DOI":"10.1145\/1966394.1966405"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_050","doi-asserted-by":"crossref","unstructured":"R. A. Newcombe, D. Fox, and S. M. Seitz, \u201cDynamicFusion: Reconstruction and tracking of non-rigid scenes in real-time,\u201d in 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, 2015, pp. 343\u2013352, https:\/\/doi.org\/10.1109\/cvpr.2015.7298631.","DOI":"10.1109\/CVPR.2015.7298631"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_051","unstructured":"M. L. Walters, K. Dautenhahn, R. Te Boekhorst, K. L. Koay, D. S. Syrdal, and C. L. Nehaniv, \u201cAn empirical framework for human\u2013robot proxemics,\u201d Procs. of New Frontiers in Human-Robot Interaction: symposium at the AISB09 convention, 2009, pp. 144\u2013149."},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_052","doi-asserted-by":"crossref","unstructured":"A. Coninx, P. Baxter, E. Oleari, S. Bellini, B. Bierman, O. B. Henkemans, et al., \u201cTowards long-term social child-robot interaction: Using multi-activity switching to engage young users,\u201d J. Hum.-Robot Interact., vol. 5, no. 1, pp. 32\u201367, 2016, https:\/\/doi.org\/10.5898\/jhri.5.1.coninx.","DOI":"10.5898\/JHRI.5.1.Coninx"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_053","doi-asserted-by":"crossref","unstructured":"H. Beck, M. Dao-Tran, and T. Eiter, \u201cLARS: A logic-based framework for analytic reasoning over streams,\u201d in SOFSEM 2018: Theory and Practice of Computer Science, Lecture Notes in Computer Science, vol. 10706, Springer, Cham, A. Tjoa, L. Bellatreche, S. Biffl, J. van Leeuwen, J. Wiedermann, Eds., 2018, pp. 87\u201393, https:\/\/doi.org\/10.1007\/978-3-319-73117-9_6.","DOI":"10.1007\/978-3-319-73117-9_6"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_054","doi-asserted-by":"crossref","unstructured":"D. Paulius and Y. Sun, \u201cA survey of knowledge representation in service robotics,\u201d Robot. Autonom. Sys., vol. 118, pp. 13\u201330, 2019, https:\/\/doi.org\/10.1016\/j.robot.2019.03.005.","DOI":"10.1016\/j.robot.2019.03.005"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_055","unstructured":"J. Wang, N. Ntarmos, and P. Triantafillou, \u201cIndexing query graphs to speedup graph query processing,\u201d OpenProceedings.org, 2016, pp. 41\u201352, https:\/\/openproceedings.org\/2016\/conf\/edbt\/paper-30.pdf."},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_056","doi-asserted-by":"crossref","unstructured":"F. Gessert, W. Wingerath, and N. Ritter, \u201cPolyglot persistence in data management,\u201d in Fast and Scalable Cloud Data Management, Springer, Cham, 2020, pp. 149\u2013174, https:\/\/doi.org\/10.1007\/978-3-030-43506-6_7.","DOI":"10.1007\/978-3-030-43506-6_7"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_057","doi-asserted-by":"crossref","unstructured":"H. Rong, T. Ma, M. Tang, and J. Cao, \u201cA novel subgraph K+-isomorphism method in social network based on graph similarity detection,\u201d Soft Comput., vol. 22, no. 8, pp. 2583\u20132601, 2017, https:\/\/doi.org\/10.1007\/s00500-017-2513-y.","DOI":"10.1007\/s00500-017-2513-y"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_058","doi-asserted-by":"crossref","unstructured":"H. Gunes and M. Piccardi, \u201cAutomatic temporal segment detection and affect recognition from face and body display,\u201d in IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), vol. 39, no. 1, pp. 64\u201384, 2009, https:\/\/doi.org\/10.1109\/tsmcb.2008.927269.","DOI":"10.1109\/TSMCB.2008.927269"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_059","doi-asserted-by":"crossref","unstructured":"L.-P. Morency, R. Mihalcea, and P. Doshi, \u201cTowards multimodal sentiment analysis,\u201d in ICMI \u201911: Proceedings of the 13th International Conference on Multimodal Interfaces, ACM Press, 2011, pp. 169\u2013176, https:\/\/doi.org\/10.1145\/2070481.2070509.","DOI":"10.1145\/2070481.2070509"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_060","doi-asserted-by":"crossref","unstructured":"Y. Ma, K. L. Nguyen, F. Z. Xing, and E. Cambria, \u201cA survey on empathetic dialogue systems,\u201d Inform. Fusion, vol. 64, pp. 50\u201370, 2020, https:\/\/doi.org\/10.1016\/j.inffus.2020.06.011.","DOI":"10.1016\/j.inffus.2020.06.011"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_061","unstructured":"R. Skerry-Ryan, E. Battenberg, Y. Xiao, Y. Wang, D. Stanton, J. Shor, et al., \u201cTowards end-to-end prosody transfer for expressive speech synthesis with tacotron,\u201d in International Conference on Machine Learning, PMLR, 2018, pp. 4693\u20134702."},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_062","unstructured":"Y. Wang, D. Stanton, Y. Zhang, R.-S. Ryan, Y. Battenberg, Y. Shor, et al., \u201cStyle tokens: Unsupervised style modeling, control and transfer in end-to-end speech synthesis,\u201d in International Conference on Machine Learning, PMLR, 2018, pp. 5180\u20135189."},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_063","doi-asserted-by":"crossref","unstructured":"G. Hillaire, F. Iniesto, and B. Rienties, \u201cHumanising text-to-speech through emotional expression in online courses,\u201d J. Interact. Media Edu., vol. 2019, no. 1, p. 12, 2019, https:\/\/doi.org\/10.5334\/jime.519.","DOI":"10.5334\/jime.519"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_064","unstructured":"R. Kirby, \u201cSocial robot navigation,\u201d Ph.D. dissertation, The Robotics Institute, Carnegie Mellon University, 2010."},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_065","unstructured":"A. Peters, T. P. Spexard, H. Marc, and W. Petra, \u201cHey robot, get out of my way \u2013 A survey on a spatial and situational movement concept in HRI,\u201d Ambient Intell. Smart Environ., vol. 9, pp. 147\u2013165, 2011, https:\/\/doi.org\/10.3233\/978-1-60750-731-4-147."},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_066","unstructured":"A. Peters, \u201cSpatial coordination-human and robotic communicative whole-body motions in narrow passages,\u201d Ph.D. dissertation, Universitat Bielefeld, 2012, https:\/\/pub.uni-bielefeld.de\/record\/2594360."},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_067","doi-asserted-by":"crossref","unstructured":"C. Lichtenth\u00e4ler, A. Peters, S. Griffiths, and A. Kirsch, \u201cSocial navigation \u2013 identifying robot navigation patterns in a path crossing scenario,\u201d in Social Robotics, ICSR 2013, Lecture Notes in Computer Science, vol. 8239, G. Herrmann, M. J. Pearson, A. Lenz, P. Bremner, A. Spiers, U. Leonards, Eds., Springer, Cham, 2013, pp. 84\u201393, https:\/\/doi.org\/10.1007\/978-3-319-02675-6_9.","DOI":"10.1007\/978-3-319-02675-6_9"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_068","doi-asserted-by":"crossref","unstructured":"C. Lichtenth\u00e4ler, T. Lorenzy, and A. Kirsch, \u201cInfluence of legibility on perceived safety in a virtual human\u2013robot path crossing task,\u201d in 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication, IEEE, 2012, pp. 676\u2013681, https:\/\/doi.org\/10.1109\/roman.2012.6343829.","DOI":"10.1109\/ROMAN.2012.6343829"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_069","doi-asserted-by":"crossref","unstructured":"C. Dondrup, C. Lichtenth\u00e4ler, and M. Hanheide, \u201cHesitation signals in human-robot head-on encounters: a pilot study,\u201d in HRI \u201914: Proceedings of the 2014 ACM\/IEEE International Conference on Human-robot Interaction, ACM, 2014, pp. 154\u2013155, https:\/\/doi.org\/10.1145\/2559636.2559817.","DOI":"10.1145\/2559636.2559817"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_070","doi-asserted-by":"crossref","unstructured":"K. Charalampous, I. Kostavelis, and A. Gasteratos, \u201cRecent trends in social aware robot navigation: A survey,\u201d Robot. Autonom. Syst., vol. 93, pp. 85\u2013104, 2017, https:\/\/doi.org\/10.1016\/j.robot.2017.03.002.","DOI":"10.1016\/j.robot.2017.03.002"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_071","doi-asserted-by":"crossref","unstructured":"Y. Goldberg, \u201cNeural network methods for natural language processing,\u201d Synthes. Lectur. Hum. Lang. Technol., vol. 10, no. 1, pp. 1\u2013309, 2017, https:\/\/doi.org\/10.2200\/s00762ed1v01y201703hlt037.","DOI":"10.2200\/S00762ED1V01Y201703HLT037"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_072","unstructured":"B. Davis, K. Cortis, L. Vasiliu, A. Koumpis, R. McDermott, and S. Handschuh, \u201cSocial sentiment indices powered by, X-Scores,\u201d in the Second International Conference on Big Data, Small Data, Linked Data and Open Data \u2013 ALLDATA 2016, 2016, http:\/\/www.proceedings.com\/29767.html."},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_073","doi-asserted-by":"crossref","unstructured":"T. Gaillat, B. Stearns, G. Sridhar, R. McDermott, M. Zarrouk, and B. Davis, \u201cImplicit and explicit aspect extraction in financial microblogs,\u201d in Proceedings of the First Workshop on Economics and Natural Language Processing, ACL, 2018, pp. 55\u201361, https:\/\/doi.org\/10.18653\/v1\/w18-3108.","DOI":"10.18653\/v1\/W18-3108"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_074","doi-asserted-by":"crossref","unstructured":"J. Li, Y. Rao, F. Jin, H. Chen, and X. Xiang, \u201cMulti-label maximum entropy model for social emotion classification over short text,\u201d Neurocomputing, vol. 210, pp. 247\u2013256, 2016, https:\/\/doi.org\/10.1016\/j.neucom.2016.03.088.","DOI":"10.1016\/j.neucom.2016.03.088"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_075","doi-asserted-by":"crossref","unstructured":"A. Mudinas, D. Zhang, and M. Levene, \u201cCombining lexicon and learning based approaches for concept-level sentiment analysis,\u201d in WISDOM \u201912: Proceedings of the First International Workshop on Issues of Sentiment Discovery and Opinion Mining, ACM Press, 2012, art. 5, pp. 1\u20138, https:\/\/doi.org\/10.1145\/2346676.2346681.","DOI":"10.1145\/2346676.2346681"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_076","doi-asserted-by":"crossref","unstructured":"S. Poria, A. Gelbukh, E. Cambria, A. Hussain, and G.-B. Huang, \u201cEmoSenticSpace: A novel framework for affective common-sense reasoning,\u201d Knowledge-Based Syst., vol. 69, pp. 108\u2013123, 2014, https:\/\/doi.org\/10.1016\/j.knosys.2014.06.011.","DOI":"10.1016\/j.knosys.2014.06.011"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_077","doi-asserted-by":"crossref","unstructured":"A. Gatt and E. Krahmer, \u201cSurvey of the state of the art in natural language generation: Core tasks, applications and evaluation,\u201d J. Artif. Intell. Res., vol. 61, pp. 65\u2013170, 2018.","DOI":"10.1613\/jair.5477"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_078","doi-asserted-by":"crossref","unstructured":"M. Coeckelbergh, \u201cPersonal robots, appearance, and human good: A methodological reflection on roboethics,\u201d Int. J. Soc. Robot., vol. 1, no. 3, pp. 217\u2013221, 2009, https:\/\/doi.org\/10.1007\/s12369-009-0026-2.","DOI":"10.1007\/s12369-009-0026-2"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_079","doi-asserted-by":"crossref","unstructured":"S. Vallor, \u201cCarebots and caregivers: Sustaining the ethical ideal of care in the twenty-first century,\u201d Philos. Technol., vol. 24, art. 251, 2011, https:\/\/doi.org\/10.1007\/s13347-011-0015-x.","DOI":"10.1007\/s13347-011-0015-x"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_080","doi-asserted-by":"crossref","unstructured":"M. Bar, A. Saad, D. Slonim-Atzil, R. Tuval-Mashiach, T. Gour, N. Baron, et al., \u201cPatient \u2013 therapist congruent exchanges engaged with the potential-to-experience is associated with better outcome of psychotherapy,\u201d Psychol. Psychother. Theory Res. Pract., vol. 94, no. S2, pp. 304\u2013320, 2020, https:\/\/doi.org\/10.1111\/papt.12274.","DOI":"10.1111\/papt.12274"},{"key":"2022020408211308636_j_pjbr-2021-0026_ref_081","doi-asserted-by":"crossref","unstructured":"K. Chlasta, K. Wo\u0142k, and I. Krejtz, \u201cAutomated speech-based screening of depression using deep convolutional neural networks,\u201d Proc. Comp. Sci., vol. 164, pp. 618\u2013628, 2019, https:\/\/doi.org\/10.1016\/j.procs.2019.12.228.","DOI":"10.1016\/j.procs.2019.12.228"}],"container-title":["Paladyn, Journal of Behavioral Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/pjbr-2021-0026\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/pjbr-2021-0026\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,2,4]],"date-time":"2022-02-04T08:25:24Z","timestamp":1643963124000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.degruyter.com\/document\/doi\/10.1515\/pjbr-2021-0026\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,1]]},"references-count":81,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,2,10]]},"published-print":{"date-parts":[[2021,2,10]]}},"alternative-id":["10.1515\/pjbr-2021-0026"],"URL":"https:\/\/doi.org\/10.1515\/pjbr-2021-0026","relation":{},"ISSN":["2081-4836"],"issn-type":[{"value":"2081-4836","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,1]]}}}