{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T07:59:52Z","timestamp":1776931192466,"version":"3.51.2"},"publisher-location":"New York, NY, USA","reference-count":80,"publisher":"ACM","funder":[{"name":"James F. McDonnell Foundation - Understanding Human Cognition","award":["103771720223937"],"award-info":[{"award-number":["103771720223937"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,10,13]]},"DOI":"10.1145\/3747327.3764904","type":"proceedings-article","created":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:04:34Z","timestamp":1760191474000},"page":"244-259","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Multimodal Fusion with LLMs for Engagement Prediction in Natural Conversation"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-4036-0390","authenticated-orcid":false,"given":"Cheng","family":"Ma","sequence":"first","affiliation":[{"name":"School of Computer Science, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6387-5686","authenticated-orcid":false,"given":"Kevin Hyekang","family":"Joo","sequence":"additional","affiliation":[{"name":"Institute for Creative Technologies, University of Southern California, Los Angeles, California, USA and Thomas Lord Department of Computer Science, University of Southern California, Los Angeles, California, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5221-4092","authenticated-orcid":false,"given":"Alexandria K.","family":"Vail","sequence":"additional","affiliation":[{"name":"The Robotics Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6292-6699","authenticated-orcid":false,"given":"Sunreeta","family":"Bhattacharya","sequence":"additional","affiliation":[{"name":"The Neuroscience Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-1664-9272","authenticated-orcid":false,"given":"\u00c1lvaro","family":"Fern\u00e1ndez Garc\u00eda","sequence":"additional","affiliation":[{"name":"The Robotics Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-6801-253X","authenticated-orcid":false,"given":"Kailana","family":"Baker-Matsuoka","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Stanford University, Stanford, California, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-6549-9418","authenticated-orcid":false,"given":"Sheryl","family":"Mathew","sequence":"additional","affiliation":[{"name":"School of Computer Science, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8732-4977","authenticated-orcid":false,"given":"Lori L.","family":"Holt","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Texas at Austin, Austin, Texas, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7086-8572","authenticated-orcid":false,"given":"Fernando","family":"De La Torre","sequence":"additional","affiliation":[{"name":"The Robotics Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,10,12]]},"reference":[{"key":"e_1_3_3_1_2_2","series-title":"ICML\u201923","first-page":"337","volume-title":"Proceedings of the 40th International Conference on Machine Learning","volume":"202","author":"Aher Gati","year":"2023","unstructured":"Gati Aher, Rosa\u00a0I. Arriaga, and Adam\u00a0Tauman Kalai. 2023. Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studies. In Proceedings of the 40th International Conference on Machine Learning(ICML\u201923, Vol.\u00a0202). Honolulu, Hawaii, USA, 337\u2013371."},{"key":"e_1_3_3_1_3_2","doi-asserted-by":"publisher","unstructured":"Lisa\u00a0P. Argyle Ethan\u00a0C. Busby Nancy Fulda Joshua\u00a0R. Gubler Christopher Rytting and David Wingate. 2023. Out of One Many: Using Language Models to Simulate Human Samples. Political Analysis 31 3 (July 2023) 337\u2013351. 10.1017\/pan.2023.2","DOI":"10.1017\/pan.2023.2"},{"key":"e_1_3_3_1_4_2","doi-asserted-by":"publisher","unstructured":"Meghan\u00a0J. Babcock Vivian\u00a0P. Ta and William Ickes. 2014. Latent Semantic Similarity and Language Style Matching in Initial Dyadic Interactions. Journal of Language and Social Psychology 33 1 (Jan. 2014) 78\u201388. 10.1177\/0261927X13499331","DOI":"10.1177\/0261927X13499331"},{"key":"e_1_3_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2018.00019"},{"key":"e_1_3_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3136755.3136814"},{"key":"e_1_3_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2023-105"},{"key":"e_1_3_3_1_8_2","doi-asserted-by":"publisher","unstructured":"Carlos Busso Murtaza Bulut Chi\u00a0Chun Lee Abe Kazemzadeh Emily Mower Samuel Kim Jeannette\u00a0N. Chang Sungbok Lee and Shrikanth Narayanan. 2008. IEMOCAP: Interactive Emotional Dyadic Motion Capture Database. Language Resources and Evaluation 42 4 (2008). 10.1007\/s10579-008-9076-6","DOI":"10.1007\/s10579-008-9076-6"},{"key":"e_1_3_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3136755.3136780"},{"key":"e_1_3_3_1_10_2","doi-asserted-by":"publisher","unstructured":"Patrick\u00a0C. Carmody Julio\u00a0C. Mateo Drew Bowers and Mike\u00a0J. McCloskey. 2017. Linguistic Coordination as an Unobtrusive Dynamic Indicator of Rapport Prosocial Team Processes and Performance in Team Communication. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 61 1 (Sept. 2017) 140\u2013144. 10.1177\/1541931213601518","DOI":"10.1177\/1541931213601518"},{"key":"e_1_3_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/3279981.3279991"},{"key":"e_1_3_3_1_12_2","doi-asserted-by":"publisher","unstructured":"Oya Celiktutan Efstratios Skordos and Hatice Gunes. 2019. Multimodal Human-Human-Robot Interactions (MHHRI) Dataset for Studying Personality and Engagement. IEEE Transactions on Affective Computing 10 4 (Oct. 2019) 484\u2013497. 10.1109\/TAFFC.2017.2737019","DOI":"10.1109\/TAFFC.2017.2737019"},{"key":"e_1_3_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.acl-long.84"},{"key":"e_1_3_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/3623809.3623931"},{"key":"e_1_3_3_1_15_2","doi-asserted-by":"publisher","unstructured":"Ronen Cuperman and William Ickes. 2009. Big Five Predictors of Behavior and Perceptions in Initial Dyadic Interactions: Personality Similarity Helps Extraverts and Introverts but Hurts \u201cDisagreeables\u201d. Journal of Personality and Social Psychology 97 4 (2009) 667\u2013684. 10.1037\/a0015741","DOI":"10.1037\/a0015741"},{"key":"e_1_3_3_1_16_2","doi-asserted-by":"publisher","unstructured":"Jared\u00a0R. Curhan and Alex Pentland. 2007. Thin Slices of Negotiation: Predicting Outcomes from Conversational Dynamics within the First 5 Minutes. Journal of Applied Psychology 92 3 (2007) 802\u2013811. 10.1037\/0021-9010.92.3.802","DOI":"10.1037\/0021-9010.92.3.802"},{"key":"e_1_3_3_1_17_2","series-title":"(ICML\u201911)","first-page":"929","volume-title":"Proceedings of the 28th International Conference on International Conference on Machine Learning","author":"Cuturi Marco","year":"2011","unstructured":"Marco Cuturi. 2011. Fast global alignment kernels. In Proceedings of the 28th International Conference on International Conference on Machine Learning (Bellevue, Washington, USA) (ICML\u201911). Omnipress, Madison, WI, USA, 929\u2013936."},{"key":"e_1_3_3_1_18_2","doi-asserted-by":"publisher","unstructured":"Dorottya Demszky Diyi Yang David\u00a0S. Yeager Christopher\u00a0J. Bryan Margarett Clapper Susannah Chandhok Johannes\u00a0C. Eichstaedt Cameron Hecht Jeremy Jamieson Meghann Johnson Michaela Jones Danielle Krettek-Cobb Leslie Lai Nirel JonesMitchell Desmond\u00a0C. Ong Carol\u00a0S. Dweck James\u00a0J. Gross and James\u00a0W. Pennebaker. 2023. Using Large Language Models in Psychology. Nature Reviews Psychology 2 11 (Nov. 2023) 688\u2013701. 10.1038\/s44159-023-00241-5","DOI":"10.1038\/s44159-023-00241-5"},{"key":"e_1_3_3_1_19_2","doi-asserted-by":"crossref","unstructured":"Danica Dillion Niket Tandon Yuling Gu and Kurt Gray. 2023. Can AI language models replace human participants? Trends in Cognitive Sciences (2023).","DOI":"10.1016\/j.tics.2023.04.008"},{"key":"e_1_3_3_1_20_2","doi-asserted-by":"publisher","unstructured":"Paul Ekman and Wallace\u00a0V. Friesen. 1978. Facial Action Coding System. 10.1037\/t27734-000","DOI":"10.1037\/t27734-000"},{"key":"e_1_3_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.coling-main.393"},{"key":"e_1_3_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.emnlp-main.552"},{"key":"e_1_3_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.01457"},{"key":"e_1_3_3_1_24_2","volume-title":"Conversational Organization: Interaction Between Speakers and Hearers","author":"Goodwin Charles","year":"1981","unstructured":"Charles Goodwin. 1981. Conversational Organization: Interaction Between Speakers and Hearers. Academic Press, New York."},{"key":"e_1_3_3_1_25_2","doi-asserted-by":"crossref","unstructured":"Calbert Graham and Nathan Roll. 2024. Evaluating OpenAI\u2019s Whisper ASR: Performance analysis across diverse accents and speaker traits. JASA Express Letters 4 2 (2024).","DOI":"10.1121\/10.0024876"},{"key":"e_1_3_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52733.2024.01834"},{"key":"e_1_3_3_1_27_2","doi-asserted-by":"publisher","unstructured":"Marco Guevara Shan Chen Spencer Thomas Tafadzwa\u00a0L. Chaunzwa Idalid Franco Benjamin\u00a0H. Kann Shalini Moningi Jack\u00a0M. Qian Madeleine Goldstein Susan Harper Hugo J. W.\u00a0L. Aerts Paul\u00a0J. Catalano Guergana\u00a0K. Savova Raymond\u00a0H. Mak and Danielle\u00a0S. Bitterman. 2024. Large Language Models to Identify Social Determinants of Health in Electronic Health Records. npj Digital Medicine 7 1 (Jan. 2024) 1\u201314. 10.1038\/s41746-023-00970-0","DOI":"10.1038\/s41746-023-00970-0"},{"key":"e_1_3_3_1_28_2","unstructured":"Jacqueline Harding William D\u2019Alessandro NG Laskowski and Robert Long. 2023. AI language models cannot replace human research participants. Ai & Society (2023) 1\u20133."},{"key":"e_1_3_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2016-846"},{"key":"e_1_3_3_1_30_2","doi-asserted-by":"publisher","unstructured":"Molly\u00a0E. Ireland and James\u00a0W. Pennebaker. 2010. Language Style Matching in Writing: Synchrony in Essays Correspondence and Poetry. Journal of Personality and Social Psychology 99 3 (2010) 549\u2013571. 10.1037\/a0020386","DOI":"10.1037\/a0020386"},{"key":"e_1_3_3_1_31_2","doi-asserted-by":"publisher","unstructured":"Molly\u00a0E. Ireland Richard\u00a0B. Slatcher Paul\u00a0W. Eastwick Lauren\u00a0E. Scissors Eli\u00a0J. Finkel and James\u00a0W. Pennebaker. 2011. Language Style Matching Predicts Relationship Initiation and Stability. Psychological Science 22 1 (Jan. 2011) 39\u201344. 10.1177\/0956797610392928","DOI":"10.1177\/0956797610392928"},{"key":"e_1_3_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3716553.3750822"},{"key":"e_1_3_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3716553.3750818"},{"key":"e_1_3_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlp-main.961"},{"key":"e_1_3_3_1_35_2","doi-asserted-by":"publisher","unstructured":"Elise Karinshak Sunny\u00a0Xun Liu Joon\u00a0Sung Park and Jeffrey\u00a0T. Hancock. 2023. Working With AI to Persuade: Examining a Large Language Model\u2019s Ability to Generate Pro-Vaccination Messages. Proceedings of the ACM on Human-Computer Interaction 7 CSCW1 (April 2023) 116:1\u2013116:29. 10.1145\/3579592","DOI":"10.1145\/3579592"},{"key":"e_1_3_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlp-main.890"},{"key":"e_1_3_3_1_37_2","unstructured":"Bolin Lai Fiona Ryan Wenqi Jia Miao Liu and James\u00a0M Rehg. 2023. Listen to look into the future: Audio-visual egocentric gaze anticipation. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2305.03907 (2023)."},{"key":"e_1_3_3_1_38_2","doi-asserted-by":"publisher","unstructured":"J.\u00a0Richard Landis and Gary\u00a0G. Koch. 1977. The Measurement of Observer Agreement for Categorical Data. Biometrics 33 1 (March 1977) 159\u2013174. 10.2307\/2529310 jstor:2529310","DOI":"10.2307\/2529310"},{"key":"e_1_3_3_1_39_2","doi-asserted-by":"publisher","unstructured":"Camillo Lugaresi Jiuqiang Tang Hadon Nash Chris McClanahan Esha Uboweja Michael Hays Fan Zhang Chuo-Ling Chang Ming\u00a0Guang Yong Juhyun Lee Wan-Teh Chang Wei Hua Manfred Georg and Matthias Grundmann. 2019. MediaPipe: A Framework for Building Perception Pipelines. 10.48550\/arXiv.1906.08172 arxiv:https:\/\/arXiv.org\/abs\/1906.08172\u00a0[cs]","DOI":"10.48550\/arXiv.1906.08172"},{"key":"e_1_3_3_1_40_2","first-page":"139","volume-title":"Handbook of Personality: Theory and Research, 2nd Ed","author":"McCrae Robert\u00a0R.","year":"1999","unstructured":"Robert\u00a0R. McCrae and Paul\u00a0T. Costa\u00a0Jr.1999. A Five-Factor Theory of Personality. In Handbook of Personality: Theory and Research, 2nd Ed. Guilford Press, New York, NY, US, 139\u2013153."},{"key":"e_1_3_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/2851581.2890247"},{"key":"e_1_3_3_1_42_2","doi-asserted-by":"publisher","unstructured":"Gary McKeown Michel Valstar Roddy Cowie Maja Pantic and Marc Schroder. 2012. The SEMAINE Database: Annotated Multimodal Records of Emotionally Colored Conversations between a Person and a Limited Agent. IEEE Transactions on Affective Computing 3 1 (Jan. 2012) 5\u201317. 10.1109\/T-AFFC.2011.20","DOI":"10.1109\/T-AFFC.2011.20"},{"key":"e_1_3_3_1_43_2","unstructured":"Microsoft. [n. d.]. System Message. https:\/\/microsoft.github.io\/Workshop-Interact-with-OpenAI-models\/Part-2-labs\/System-Message\/"},{"key":"e_1_3_3_1_44_2","doi-asserted-by":"publisher","unstructured":"Ron Mokady Amir Hertz and Amit\u00a0H. Bermano. 2021. ClipCap: CLIP Prefix for Image Captioning. 10.48550\/arXiv.2111.09734 arxiv:https:\/\/arXiv.org\/abs\/2111.09734\u00a0[cs]","DOI":"10.48550\/arXiv.2111.09734"},{"key":"e_1_3_3_1_45_2","doi-asserted-by":"publisher","unstructured":"Ali Mollahosseini Behzad Hasani and Mohammad\u00a0H. Mahoor. 2019. AffectNet: A Database for Facial Expression Valence and Arousal Computing in the Wild. IEEE Transactions on Affective Computing 10 1 (Jan. 2019) 18\u201331. 10.1109\/TAFFC.2017.2740923","DOI":"10.1109\/TAFFC.2017.2740923"},{"key":"e_1_3_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/1719970.1719990"},{"key":"e_1_3_3_1_47_2","doi-asserted-by":"crossref","unstructured":"Shushi Namba Wataru Sato and Sakiko Yoshikawa. 2021. Viewpoint robustness of automated facial action unit detection systems. Applied Sciences 11 23 (2021) 11171.","DOI":"10.3390\/app112311171"},{"key":"e_1_3_3_1_48_2","doi-asserted-by":"publisher","unstructured":"Roberto Navigli Simone Conia and Bj\u00f6rn Ross. 2023. Biases in Large Language Models: Origins Inventory and Discussion. Journal of Data and Information Quality 15 2 (June 2023) 10:1\u201310:21. 10.1145\/3597307","DOI":"10.1145\/3597307"},{"key":"e_1_3_3_1_49_2","unstructured":"OpenAI. [n. d.]. Create chat completion. https:\/\/platform.openai.com\/docs\/api-reference\/chat\/create"},{"key":"e_1_3_3_1_50_2","first-page":"27730","volume-title":"Advances in Neural Information Processing Systems (NeurIPS \u201822)","author":"Ouyang Long","year":"2022","unstructured":"Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, John Schulman, Jacob Hilton, Fraser Kelton, Luke Miller, Maddie Simens, Amanda Askell, Peter Welinder, Paul\u00a0F. Christiano, Jan Leike, and Ryan Lowe. 2022. Training Language Models to Follow Instructions with Human Feedback. In Advances in Neural Information Processing Systems (NeurIPS \u201822) , Vol.\u00a035. 27730\u201327744."},{"key":"e_1_3_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3586183.3606763"},{"key":"e_1_3_3_1_52_2","doi-asserted-by":"publisher","unstructured":"Arthur Pellet-Rostaing Roxane Bertrand Auriane Boudin St\u00e9phane Rauzy and Philippe Blache. 2023. A Multimodal Approach for Modeling Engagement in Conversation. Frontiers in Computer Science 5 (March 2023). 10.3389\/fcomp.2023.1062342","DOI":"10.3389\/fcomp.2023.1062342"},{"key":"e_1_3_3_1_53_2","volume-title":"Beyond Red vs. Blue: The Political Typology","author":"Center Pew Research","year":"2021","unstructured":"Pew Research Center. 2021. Beyond Red vs. Blue: The Political Typology. Technical Report. Pew Research Center, Washington, DC, USA."},{"key":"e_1_3_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2023-205"},{"key":"e_1_3_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1050"},{"key":"e_1_3_3_1_56_2","doi-asserted-by":"publisher","unstructured":"David Premack and Guy Woodruff. 1978. Does the Chimpanzee Have a Theory of Mind? Behavioral and Brain Sciences 1 4 (Dec. 1978) 515\u2013526. 10.1017\/S0140525X00076512","DOI":"10.1017\/S0140525X00076512"},{"key":"e_1_3_3_1_57_2","unstructured":"Pupil-Labs. [n. d.]. Recording format. https:\/\/docs.pupil-labs.com\/invisible\/data-collection\/data-format\/"},{"key":"e_1_3_3_1_58_2","series-title":"ICML\u201923","first-page":"28492","volume-title":"Proceedings of the 40th International Conference on Machine Learning","volume":"202","author":"Radford Alec","year":"2023","unstructured":"Alec Radford, Jong\u00a0Wook Kim, Tao Xu, Greg Brockman, Christine McLeavey, and Ilya Sutskever. 2023. Robust Speech Recognition via Large-Scale Weak Supervision. In Proceedings of the 40th International Conference on Machine Learning(ICML\u201923, Vol.\u00a0202). JMLR, Honolulu, Hawaii, USA, 28492\u201328518."},{"key":"e_1_3_3_1_59_2","doi-asserted-by":"publisher","unstructured":"Carolyn Ranti Warren Jones Ami Klin and Sarah Shultz. 2020. Blink Rate Patterns Provide a Reliable Measure of Individual Engagement with Scene Content. Scientific Reports 10 1 (May 2020) 8267. 10.1038\/s41598-020-64999-x","DOI":"10.1038\/s41598-020-64999-x"},{"key":"e_1_3_3_1_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2013.6553805"},{"key":"e_1_3_3_1_61_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.emnlp-main.248"},{"key":"e_1_3_3_1_62_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1454"},{"key":"e_1_3_3_1_63_2","doi-asserted-by":"publisher","unstructured":"Greg Serapio-Garc\u00eda Mustafa Safdari Cl\u00e9ment Crepy Luning Sun Stephen Fitz Peter Romero Marwa Abdulhai Aleksandra Faust and Maja Matari\u0107. 2023. Personality Traits in Large Language Models. 10.48550\/arXiv.2307.00184 arxiv:https:\/\/arXiv.org\/abs\/2307.00184\u00a0[cs]","DOI":"10.48550\/arXiv.2307.00184"},{"key":"e_1_3_3_1_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/3678957.3685752"},{"key":"e_1_3_3_1_65_2","doi-asserted-by":"publisher","unstructured":"Elizabeth\u00a0C. Stade Shannon\u00a0Wiltsey Stirman Lyle\u00a0H. Ungar Cody\u00a0L. Boland H.\u00a0Andrew Schwartz David\u00a0B. Yaden Jo\u00e3o Sedoc Robert\u00a0J. DeRubeis Robb Willer and Johannes\u00a0C. Eichstaedt. 2024. Large Language Models Could Change the Future of Behavioral Healthcare: A Proposal for Responsible Development and Evaluation. npj Mental Health Research 3 1 (April 2024) 1\u201312. 10.1038\/s44184-024-00056-z","DOI":"10.1038\/s44184-024-00056-z"},{"key":"e_1_3_3_1_66_2","doi-asserted-by":"publisher","unstructured":"Yla\u00a0R. Tausczik and James\u00a0W. Pennebaker. 2010. The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods. Journal of Language and Social Psychology 29 1 (March 2010) 24\u201354. 10.1177\/0261927X09351676","DOI":"10.1177\/0261927X09351676"},{"key":"e_1_3_3_1_67_2","doi-asserted-by":"publisher","DOI":"10.1145\/3490100.3516464"},{"key":"e_1_3_3_1_68_2","doi-asserted-by":"publisher","unstructured":"Julian Tejada Raquel Meister\u00a0Ko Freitag Bruno Felipe\u00a0Marques Pinheiro Paloma\u00a0Batista Cardoso Victor Rene\u00a0Andrade Souza and Lucas\u00a0Santos Silva. 2022. Building and Validation of a Set of Facial Expression Images to Detect Emotions: A Transcultural Study. Psychological Research 86 6 (2022) 1996\u20132006. 10.1007\/s00426-021-01605-3","DOI":"10.1007\/s00426-021-01605-3"},{"key":"e_1_3_3_1_69_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01739"},{"key":"e_1_3_3_1_70_2","doi-asserted-by":"publisher","unstructured":"Marc Tonsen Chris\u00a0Kay Baumann and Kai Dierkes. 2020. A High-Level Description and Performance Evaluation of Pupil Invisible. 10.48550\/arXiv.2009.00508 arxiv:https:\/\/arXiv.org\/abs\/2009.00508\u00a0[cs]","DOI":"10.48550\/arXiv.2009.00508"},{"key":"e_1_3_3_1_71_2","doi-asserted-by":"publisher","unstructured":"Lyn\u00a0M. Van\u00a0Swol and Aim\u00e9e\u00a0A. Kane. 2019. Language and Group Processes: An Integrative Interdisciplinary Review. Small Group Research 50 1 (Feb. 2019) 3\u201338. 10.1177\/1046496418785019","DOI":"10.1177\/1046496418785019"},{"key":"e_1_3_3_1_72_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2009.5349466"},{"key":"e_1_3_3_1_73_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-emnlp.243"},{"key":"e_1_3_3_1_74_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.acl-long.511"},{"key":"e_1_3_3_1_75_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.acl-long.548"},{"key":"e_1_3_3_1_76_2","doi-asserted-by":"publisher","DOI":"10.1109\/MMSP55362.2022.9948860"},{"key":"e_1_3_3_1_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/3503161.3548027"},{"key":"e_1_3_3_1_78_2","volume-title":"The Eleventh International Conference on Learning Representations (ICLR \u201822)","author":"Zeng Andy","year":"2022","unstructured":"Andy Zeng, Maria Attarian, Brian Ichter, Krzysztof Choromanski, Adrian Wong, Stefan Welker, Federico Tombari, Aveek Purohit, Michael Ryoo, Vikas Sindhwani, Johnny Lee, Vincent Vanhoucke, and Pete Florence. 2022. Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language. In The Eleventh International Conference on Learning Representations (ICLR \u201822). https:\/\/openreview.net\/forum?id=G2Q2Mh3avow"},{"key":"e_1_3_3_1_79_2","volume-title":"British Machine Vision Conference (BMVC \u201823)","author":"Zhao Zengqun","year":"2023","unstructured":"Zengqun Zhao and Ioannis Patras. 2023. Prompting Visual-Language Models for Dynamic Facial Expression Recognition. In British Machine Vision Conference (BMVC \u201823). https:\/\/papers.bmvc2023.org\/0098.pdf"},{"key":"e_1_3_3_1_80_2","volume-title":"The Twelfth International Conference on Learning Representations (ICLR \u201824)","author":"Zhou Xuhui","year":"2024","unstructured":"Xuhui Zhou, Hao Zhu, Leena Mathur, Ruohong Zhang, Haofei Yu, Zhengyang Qi, Louis-Philippe Morency, Yonatan Bisk, Daniel Fried, Graham Neubig, and Maarten Sap. 2024. SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents. In The Twelfth International Conference on Learning Representations (ICLR \u201824)."},{"key":"e_1_3_3_1_81_2","volume-title":"The Twelfth International Conference on Learning Representations (ICLR \u201823)","author":"Zhu Bin","year":"2024","unstructured":"Bin Zhu, Bin Lin, Munan Ning, Yang Yan, Jiaxi Cui, HongFa Wang, Yatian Pang, Wenhao Jiang, Junwu Zhang, Zongwei Li, Wancai Zhang, Zhifeng Li, Wei Liu, and Li Yuan. 2024. LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment. In The Twelfth International Conference on Learning Representations (ICLR \u201823). https:\/\/openreview.net\/forum?id=QmZKc7UZCy"}],"event":{"name":"ICMI Companion '25: Companion Proceedings of the 27th International Conference on Multimodal Interaction","location":"Canberra Australia","acronym":"ICMI Companion '25","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Companion Proceedings of the 27th International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3747327.3764904","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,16]],"date-time":"2025-12-16T21:08:34Z","timestamp":1765919314000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3747327.3764904"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,12]]},"references-count":80,"alternative-id":["10.1145\/3747327.3764904","10.1145\/3747327"],"URL":"https:\/\/doi.org\/10.1145\/3747327.3764904","relation":{},"subject":[],"published":{"date-parts":[[2025,10,12]]},"assertion":[{"value":"2025-10-12","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}