{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,26]],"date-time":"2026-03-26T17:24:11Z","timestamp":1774545851382,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":29,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,10,9]],"date-time":"2023-10-09T00:00:00Z","timestamp":1696809600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,10,9]]},"DOI":"10.1145\/3610661.3616129","type":"proceedings-article","created":{"date-parts":[[2023,10,9]],"date-time":"2023-10-09T16:51:22Z","timestamp":1696870282000},"page":"353-358","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Emotion Expression Estimates to Measure and Improve Multimodal Social-Affective Interactions"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6370-3622","authenticated-orcid":false,"given":"Jeffrey A.","family":"Brooks","sequence":"first","affiliation":[{"name":"Hume AI, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5071-7091","authenticated-orcid":false,"given":"Vineet","family":"Tiruvadi","sequence":"additional","affiliation":[{"name":"Hume AI, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7003-5650","authenticated-orcid":false,"given":"Alice","family":"Baird","sequence":"additional","affiliation":[{"name":"Hume AI, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9449-5339","authenticated-orcid":false,"given":"Panagiotis","family":"Tzirakis","sequence":"additional","affiliation":[{"name":"Hume AI, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8851-4529","authenticated-orcid":false,"given":"Haoqi","family":"Li","sequence":"additional","affiliation":[{"name":"Hume AI, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2241-5285","authenticated-orcid":false,"given":"Chris","family":"Gagne","sequence":"additional","affiliation":[{"name":"Hume AI, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-0401-8773","authenticated-orcid":false,"given":"Moses","family":"Oh","sequence":"additional","affiliation":[{"name":"Hume AI, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8381-5883","authenticated-orcid":false,"given":"Alan","family":"Cowen","sequence":"additional","affiliation":[{"name":"Hume AI, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,10,9]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"The Hamilton Depression Rating Scale: has the gold standard become a lead weight?American Journal of Psychiatry 161, 12","author":"Bagby R\u00a0Michael","year":"2004","unstructured":"R\u00a0Michael Bagby, Andrew\u00a0G Ryder, Deborah\u00a0R Schuller, and Margarita\u00a0B Marshall. 2004. The Hamilton Depression Rating Scale: has the gold standard become a lead weight?American Journal of Psychiatry 161, 12 (2004), 2163\u20132177."},{"key":"e_1_3_2_1_2_1","volume-title":"The ACII 2022 Affective Vocal Bursts Workshop & Competition. In 2022 10th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW). IEEE, 1\u20135.","author":"Baird Alice","year":"2022","unstructured":"Alice Baird, Panagiotis Tzirakis, Jeffrey\u00a0A Brooks, Chris\u00a0B Gregory, Bj\u00f6rn Schuller, Anton Batliner, Dacher Keltner, and Alan Cowen. 2022. The ACII 2022 Affective Vocal Bursts Workshop & Competition. In 2022 10th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW). IEEE, 1\u20135."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2022-10927"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-022-01310-0"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.2196\/24699"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-022-01489-2"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"crossref","unstructured":"Q. Cao L. Shen W. Xie O.M. Parkhi and A. Zisserman. 2017. VGGFace2: A dataset for recognising faces across pose and age. arXiv (2017).","DOI":"10.1109\/FG.2018.00020"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3551876.3554817"},{"key":"e_1_3_2_1_9_1","volume-title":"Characterizing the therapeutic response to deep brain stimulation for treatment-resistant depression: a single center long-term perspective. Frontiers in integrative neuroscience 9","author":"Crowell L","year":"2015","unstructured":"Andrea\u00a0L Crowell, Steven\u00a0J Garlow, Patricio Riva-Posse, and Helen\u00a0S Mayberg. 2015. Characterizing the therapeutic response to deep brain stimulation for treatment-resistant depression: a single center long-term perspective. Frontiers in integrative neuroscience 9 (2015), 41."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Paul Ekman and W.V. Friesen. 1978. Facial Action Coding System. Consulting Psychologist Press (1978).","DOI":"10.1037\/t27734-000"},{"key":"e_1_3_2_1_11_1","volume-title":"Emotions and feelings in critical and emergency caring situations: A qualitative study. BMC nursing 19","author":"Jim\u00e9nez-Herrera F","year":"2020","unstructured":"Mar\u00eda\u00a0F Jim\u00e9nez-Herrera, Mireia Llaurad\u00f3-Serra, Sagrario Acebedo-Urdiales, Leticia Bazo-Hern\u00e1ndez, Isabel Font-Jim\u00e9nez, and Christer Axelsson. 2020. Emotions and feelings in critical and emergency caring situations: A qualitative study. BMC nursing 19 (2020), 1\u201310."},{"key":"e_1_3_2_1_12_1","volume-title":"Self-report and interview measures of childhood and adolescent depression.Journal of Child Psychology and Psychiatry, and Allied Disciplines 23, 4","author":"Kazdin E","year":"1982","unstructured":"Alane\u00a0E Kazdin and Theodore\u00a0A Petti. 1982. Self-report and interview measures of childhood and adolescent depression.Journal of Child Psychology and Psychiatry, and Allied Disciplines 23, 4 (1982), 437\u2013457."},{"key":"e_1_3_2_1_13_1","volume-title":"Semantic space theory: Data-driven insights into basic emotions. Current Directions in Psychological Science 32, 3","author":"Keltner Dacher","year":"2022","unstructured":"Dacher Keltner, Jeffrey Brooks, and Alan\u00a0S. Cowen. 2022. Semantic space theory: Data-driven insights into basic emotions. Current Directions in Psychological Science 32, 3 (2022)."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.psyneuen.2018.04.028"},{"key":"e_1_3_2_1_15_1","volume-title":"Thirteenth Annual Conference of the International Speech Communication Association","author":"Levow G.-A.","year":"2012","unstructured":"G.-A. Levow and S. Duncan. 2012. Contrasting cues to verbal and non-verbal backchannels in multi-lingual dyadic rapport. Thirteenth Annual Conference of the International Speech Communication Association (2012)."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"crossref","unstructured":"S.R. Livingstone and F.A. Russo. 2018. The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic multimodal set of facial and vocal expressions in North American English. PLoS ONE (2018) e0196391.","DOI":"10.1371\/journal.pone.0196391"},{"key":"e_1_3_2_1_17_1","volume-title":"Measures of emotion: A review. Cognition and emotion 23, 2","author":"Mauss B","year":"2009","unstructured":"Iris\u00a0B Mauss and Michael\u00a0D Robinson. 2009. Measures of emotion: A review. Cognition and emotion 23, 2 (2009), 209\u2013237."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/265013"},{"key":"e_1_3_2_1_19_1","volume-title":"Advancing an Interdisciplinary Science of Conversation: Insights from a Large Multimodal Corpus of Human Speech. ArXiv","author":"Reece Andrew","year":"2022","unstructured":"Andrew Reece, Gus Cooney, Peter Bull, Christine Chung, Bryn Dawson, Casey Fitzpatrick, Tamara Glazer, Dean Knox, Alex Liebscher, and Sebastian Marin. 2022. Advancing an Interdisciplinary Science of Conversation: Insights from a Large Multimodal Corpus of Human Speech. ArXiv (2022)."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"crossref","unstructured":"F. Schroff D. Kalenichenko and J. Philbin. 2015. FaceNet: A Unified Embedding for Face Recognition and Clustering. arXiv (2015).","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2022.102298"},{"key":"e_1_3_2_1_22_1","volume-title":"Brain\u2013machine interfaces from motor to mood. Nature neuroscience 22, 10","author":"Shanechi M","year":"2019","unstructured":"Maryam\u00a0M Shanechi. 2019. Brain\u2013machine interfaces from motor to mood. Nature neuroscience 22, 10 (2019), 1554\u20131564."},{"key":"e_1_3_2_1_23_1","first-page":"e177","article-title":"Indicators for measuring mental health: towards better surveillance","volume":"5","author":"Tannenbaum Cara","year":"2009","unstructured":"Cara Tannenbaum, Joel Lexchin, Robyn Tamblyn, and Sarah Romans. 2009. Indicators for measuring mental health: towards better surveillance. Healthcare Policy 5, 2 (2009), e177.","journal-title":"Healthcare Policy"},{"key":"e_1_3_2_1_24_1","volume-title":"HEAR4HEALTH: A blueprint for making computer audition a staple of modern healthcare. arXiv","author":"Triantafyllopoulos Andreas","year":"2023","unstructured":"Andreas Triantafyllopoulos, Alexander Kathan, Alice Baird, 2023. HEAR4HEALTH: A blueprint for making computer audition a staple of modern healthcare. arXiv (2023)."},{"key":"e_1_3_2_1_25_1","volume-title":"Large-Scale Nonverbal Vocalization Detection Using Transformers. In ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 1\u20135.","author":"Tzirakis Panagiotis","year":"2023","unstructured":"Panagiotis Tzirakis, Alice Baird, Jeffrey Brooks, Christopher Gagne, Lauren Kim, Michael Opara, Christopher Gregory, Jacob Metrick, Garrett Boseck, Vineet Tiruvadi, 2023. Large-Scale Nonverbal Vocalization Detection Using Transformers. In ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 1\u20135."},{"key":"e_1_3_2_1_26_1","volume-title":"Human emotions on the onset of cardiovascular and small vessel related diseases. in vivo 32, 4","author":"Vlachakis Chrisanthy","year":"2018","unstructured":"Chrisanthy Vlachakis, Konstantina Dragoumani, Sofia Raftopoulou, Meropi Mantaiou, Louis Papageorgiou, Spyridon\u00a0Champeris Tsaniras, Vasileios Megalooikonomou, and Dimitrios Vlachakis. 2018. Human emotions on the onset of cardiovascular and small vessel related diseases. in vivo 32, 4 (2018), 859\u2013870."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1097\/YCO.0000000000000122"},{"key":"e_1_3_2_1_28_1","volume-title":"Closing the loop on deep brain stimulation for treatment-resistant depression. Frontiers in neuroscience 12","author":"Widge S","year":"2018","unstructured":"Alik\u00a0S Widge, Donald\u00a0A Malone\u00a0Jr, and Darin\u00a0D Dougherty. 2018. Closing the loop on deep brain stimulation for treatment-resistant depression. Frontiers in neuroscience 12 (2018), 175."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2016.2603342"}],"event":{"name":"ICMI '23: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","location":"Paris France","acronym":"ICMI '23","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["International Cconference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610661.3616129","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3610661.3616129","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T19:32:37Z","timestamp":1755891157000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610661.3616129"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,9]]},"references-count":29,"alternative-id":["10.1145\/3610661.3616129","10.1145\/3610661"],"URL":"https:\/\/doi.org\/10.1145\/3610661.3616129","relation":{},"subject":[],"published":{"date-parts":[[2023,10,9]]},"assertion":[{"value":"2023-10-09","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}