{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T12:21:12Z","timestamp":1767183672541,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":44,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,10,18]],"date-time":"2021-10-18T00:00:00Z","timestamp":1634515200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,10,18]]},"DOI":"10.1145\/3462244.3481004","type":"proceedings-article","created":{"date-parts":[[2021,10,15]],"date-time":"2021-10-15T14:41:47Z","timestamp":1634308907000},"page":"728-734","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Human-Guided Modality Informativeness for Affective States"],"prefix":"10.1145","author":[{"given":"Torsten","family":"W\u00f6rtwein","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, Language Technologies Institute, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lisa B.","family":"Sheeber","sequence":"additional","affiliation":[{"name":"Oregon Research Institute, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicholas","family":"Allen","sequence":"additional","affiliation":[{"name":"Center for Digital Mental Health, University of Oregon, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeffrey F.","family":"Cohn","sequence":"additional","affiliation":[{"name":"Psychology, University of Pittsburgh, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Louis-Philippe","family":"Morency","sequence":"additional","affiliation":[{"name":"Language Technologies Institute, Carnegie Mellon University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,10,18]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2018.00019"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K18-1030"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2016.2515617"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.adolescence.2009.07.004"},{"volume-title":"The 41st international acm sigir conference on research & development in information retrieval. 225\u2013234.","author":"Chen Zheqian","key":"e_1_3_2_2_5_1","unstructured":"Zheqian Chen , Rongqin Yang , Zhou Zhao , Deng Cai , and Xiaofei He. 2018. Dialogue act recognition via crf-attentive structured network . In The 41st international acm sigir conference on research & development in information retrieval. 225\u2013234. Zheqian Chen, Rongqin Yang, Zhou Zhao, Deng Cai, and Xiaofei He. 2018. Dialogue act recognition via crf-attentive structured network. In The 41st international acm sigir conference on research & development in information retrieval. 225\u2013234."},{"volume-title":"COVAREP\u2014A collaborative voice analysis repository for speech technologies. In 2014 ieee international conference on acoustics, speech and signal processing (icassp)","author":"Degottex Gilles","key":"e_1_3_2_2_6_1","unstructured":"Gilles Degottex , John Kane , Thomas Drugman , Tuomo Raitio , and Stefan Scherer . 2014. COVAREP\u2014A collaborative voice analysis repository for speech technologies. In 2014 ieee international conference on acoustics, speech and signal processing (icassp) . IEEE , 960\u2013964. Gilles Degottex, John Kane, Thomas Drugman, Tuomo Raitio, and Stefan Scherer. 2014. COVAREP\u2014A collaborative voice analysis repository for speech technologies. In 2014 ieee international conference on acoustics, speech and signal processing (icassp). IEEE, 960\u2013964."},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2019.8756623"},{"key":"e_1_3_2_2_8_1","volume-title":"The Geneva minimalistic acoustic parameter set (GeMAPS) for voice research and affective computing","author":"Eyben Florian","year":"2015","unstructured":"Florian Eyben , Klaus\u00a0 R Scherer , Bj\u00f6rn\u00a0 W Schuller , Johan Sundberg , Elisabeth Andr\u00e9 , Carlos Busso , Laurence\u00a0 Y Devillers , Julien Epps , Petri Laukka , Shrikanth\u00a0 S Narayanan , 2015. The Geneva minimalistic acoustic parameter set (GeMAPS) for voice research and affective computing . IEEE transactions on affective computing 7, 2 ( 2015 ), 190\u2013202. Florian Eyben, Klaus\u00a0R Scherer, Bj\u00f6rn\u00a0W Schuller, Johan Sundberg, Elisabeth Andr\u00e9, Carlos Busso, Laurence\u00a0Y Devillers, Julien Epps, Petri Laukka, Shrikanth\u00a0S Narayanan, 2015. The Geneva minimalistic acoustic parameter set (GeMAPS) for voice research and affective computing. IEEE transactions on affective computing 7, 2 (2015), 190\u2013202."},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2013.6637694"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1873951.1874246"},{"key":"e_1_3_2_2_11_1","volume-title":"LIBLINEAR: A library for large linear classification. the Journal of machine Learning research 9","author":"Fan Rong-En","year":"2008","unstructured":"Rong-En Fan , Kai-Wei Chang , Cho-Jui Hsieh , Xiang-Rui Wang , and Chih-Jen Lin . 2008 . LIBLINEAR: A library for large linear classification. the Journal of machine Learning research 9 (2008), 1871\u20131874. Rong-En Fan, Kai-Wei Chang, Cho-Jui Hsieh, Xiang-Rui Wang, and Chih-Jen Lin. 2008. LIBLINEAR: A library for large linear classification. the Journal of machine Learning research 9 (2008), 1871\u20131874."},{"key":"e_1_3_2_2_12_1","volume-title":"The value of a smile: does emotional performance matter more in familiar or unfamiliar exchanges?Journal of Business and Psychology 30, 1","author":"Gabriel S","year":"2015","unstructured":"Allison\u00a0 S Gabriel , Jennifer\u00a0 D Acosta , and Alicia\u00a0 A Grandey . 2015. The value of a smile: does emotional performance matter more in familiar or unfamiliar exchanges?Journal of Business and Psychology 30, 1 ( 2015 ), 37\u201350. Allison\u00a0S Gabriel, Jennifer\u00a0D Acosta, and Alicia\u00a0A Grandey. 2015. The value of a smile: does emotional performance matter more in familiar or unfamiliar exchanges?Journal of Business and Psychology 30, 1 (2015), 37\u201350."},{"key":"e_1_3_2_2_13_1","volume-title":"Nonverbal social withdrawal in depression: Evidence from manual and automatic analyses. Image and vision computing 32, 10","author":"Girard M","year":"2014","unstructured":"Jeffrey\u00a0 M Girard , Jeffrey\u00a0 F Cohn , Mohammad\u00a0 H Mahoor , S\u00a0Mohammad Mavadati , Zakia Hammal , and Dean\u00a0 P Rosenwald . 2014. Nonverbal social withdrawal in depression: Evidence from manual and automatic analyses. Image and vision computing 32, 10 ( 2014 ), 641\u2013647. Jeffrey\u00a0M Girard, Jeffrey\u00a0F Cohn, Mohammad\u00a0H Mahoor, S\u00a0Mohammad Mavadati, Zakia Hammal, and Dean\u00a0P Rosenwald. 2014. Nonverbal social withdrawal in depression: Evidence from manual and automatic analyses. Image and vision computing 32, 10 (2014), 641\u2013647."},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15374424jccp2402_7"},{"key":"e_1_3_2_2_15_1","volume-title":"Adaptive mixtures of local experts. Neural computation 3, 1","author":"Jacobs A","year":"1991","unstructured":"Robert\u00a0 A Jacobs , Michael\u00a0 I Jordan , Steven\u00a0 J Nowlan , and Geoffrey\u00a0 E Hinton . 1991. Adaptive mixtures of local experts. Neural computation 3, 1 ( 1991 ), 79\u201387. Robert\u00a0A Jacobs, Michael\u00a0I Jordan, Steven\u00a0J Nowlan, and Geoffrey\u00a0E Hinton. 1991. Adaptive mixtures of local experts. Neural computation 3, 1 (1991), 79\u201387."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(18)32279-7"},{"key":"e_1_3_2_2_17_1","volume-title":"Kingma and Jimmy Ba","author":"P.","year":"2015","unstructured":"Diederik\u00a0 P. Kingma and Jimmy Ba . 2015 . Adam : A Method for Stochastic Optimization. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, Yoshua Bengio and Yann LeCun (Eds .). Diederik\u00a0P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings, Yoshua Bengio and Yann LeCun (Eds.)."},{"key":"e_1_3_2_2_18_1","unstructured":"Klaus Krippendorff. 2011. Computing Krippendorff\u2019s alpha-reliability. (2011).  Klaus Krippendorff. 2011. Computing Krippendorff\u2019s alpha-reliability. (2011)."},{"key":"e_1_3_2_2_19_1","volume-title":"The discrimination of speech sounds within and across phoneme boundaries.Journal of experimental psychology 54, 5","author":"Liberman M","year":"1957","unstructured":"Alvin\u00a0 M Liberman , Katherine\u00a0Safford Harris , Howard\u00a0 S Hoffman , and Belver\u00a0 C Griffith . 1957. The discrimination of speech sounds within and across phoneme boundaries.Journal of experimental psychology 54, 5 ( 1957 ), 358. Alvin\u00a0M Liberman, Katherine\u00a0Safford Harris, Howard\u00a0S Hoffman, and Belver\u00a0C Griffith. 1957. The discrimination of speech sounds within and across phoneme boundaries.Journal of experimental psychology 54, 5 (1957), 358."},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2015.01340"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"crossref","unstructured":"Michael McAuliffe Michaela Socolof Sarah Mihuc Michael Wagner and Morgan Sonderegger. 2017. Montreal Forced Aligner: Trainable Text-Speech Alignment Using Kaldi.. In Interspeech Vol.\u00a02017. 498\u2013502.  Michael McAuliffe Michaela Socolof Sarah Mihuc Michael Wagner and Morgan Sonderegger. 2017. Montreal Forced Aligner: Trainable Text-Speech Alignment Using Kaldi.. In Interspeech Vol.\u00a02017. 498\u2013502.","DOI":"10.21437\/Interspeech.2017-1386"},{"volume-title":"Silent messages","author":"Mehrabian Albert","key":"e_1_3_2_2_22_1","unstructured":"Albert Mehrabian . 1971. Silent messages . Wadsworth Publishing Company , Belmont, California . Albert Mehrabian. 1971. Silent messages. Wadsworth Publishing Company, Belmont, California."},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2522848.2522857"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1111\/jcpp.13264"},{"key":"e_1_3_2_2_25_1","volume-title":"Manuel Montes-y G\u00f3mez, and Fabio\u00a0A Gonz\u00e1lez","author":"Edison\u00a0Arevalo Ovalle John","year":"2017","unstructured":"John Edison\u00a0Arevalo Ovalle , Thamar Solorio , Manuel Montes-y G\u00f3mez, and Fabio\u00a0A Gonz\u00e1lez . 2017 . Gated Multimodal Units for Information Fusion.. In ICLR (Workshop) . John Edison\u00a0Arevalo Ovalle, Thamar Solorio, Manuel Montes-y G\u00f3mez, and Fabio\u00a0A Gonz\u00e1lez. 2017. Gated Multimodal Units for Information Fusion.. In ICLR (Workshop)."},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2015.2407898"},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.432"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1080\/02664760903046102"},{"volume-title":"Proceedings of the 9th International on Audio\/Visual Emotion Challenge and Workshop. 3\u201312.","author":"Ringeval Fabien","key":"e_1_3_2_2_29_1","unstructured":"Fabien Ringeval , Bj\u00f6rn Schuller , Michel Valstar , Nicholas Cummins , Roddy Cowie , Leili Tavabi , Maximilian Schmitt , Sina Alisamir , Shahin Amiriparian , Eva-Maria Messner , 2019. AVEC 2019 workshop and challenge: state-of-mind, detecting depression with AI, and cross-cultural affect recognition . In Proceedings of the 9th International on Audio\/Visual Emotion Challenge and Workshop. 3\u201312. Fabien Ringeval, Bj\u00f6rn Schuller, Michel Valstar, Nicholas Cummins, Roddy Cowie, Leili Tavabi, Maximilian Schmitt, Sina Alisamir, Shahin Amiriparian, Eva-Maria Messner, 2019. AVEC 2019 workshop and challenge: state-of-mind, detecting depression with AI, and cross-cultural affect recognition. In Proceedings of the 9th International on Audio\/Visual Emotion Challenge and Workshop. 3\u201312."},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300750"},{"key":"e_1_3_2_2_31_1","volume-title":"What are emotions? And how can they be measured?Social science information 44, 4","author":"Scherer R","year":"2005","unstructured":"Klaus\u00a0 R Scherer . 2005. What are emotions? And how can they be measured?Social science information 44, 4 ( 2005 ), 695\u2013729. Klaus\u00a0R Scherer. 2005. What are emotions? And how can they be measured?Social science information 44, 4 (2005), 695\u2013729."},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2011-801"},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1177\/2167702613505531"},{"key":"e_1_3_2_2_34_1","volume-title":"Proceedings of the 2013 conference on empirical methods in natural language processing. 1631\u20131642","author":"Socher Richard","year":"2013","unstructured":"Richard Socher , Alex Perelygin , Jean Wu , Jason Chuang , Christopher\u00a0 D Manning , Andrew\u00a0 Y Ng , and Christopher Potts . 2013 . Recursive deep models for semantic compositionality over a sentiment treebank . In Proceedings of the 2013 conference on empirical methods in natural language processing. 1631\u20131642 . Richard Socher, Alex Perelygin, Jean Wu, Jason Chuang, Christopher\u00a0D Manning, Andrew\u00a0Y Ng, and Christopher Potts. 2013. Recursive deep models for semantic compositionality over a sentiment treebank. In Proceedings of the 2013 conference on empirical methods in natural language processing. 1631\u20131642."},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1177\/0261927X09351676"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2168556.2168570"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1656"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.143"},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2017.107"},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01271"},{"key":"e_1_3_2_2_41_1","volume-title":"5th International Conference on Language Resources and Evaluation (LREC","author":"Wittenburg Peter","year":"2006","unstructured":"Peter Wittenburg , Hennie Brugman , Albert Russel , Alex Klassmann , and Han Sloetjes . 2006 . ELAN: a professional framework for multimodality research . In 5th International Conference on Language Resources and Evaluation (LREC 2006). 1556\u20131559. Peter Wittenburg, Hennie Brugman, Albert Russel, Alex Klassmann, and Han Sloetjes. 2006. ELAN: a professional framework for multimodality research. In 5th International Conference on Language Resources and Evaluation (LREC 2006). 1556\u20131559."},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sigpro.2017.10.019"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1208"},{"key":"e_1_3_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D17-1323"}],"event":{"name":"ICMI '21: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"Montr\u00e9al QC Canada","acronym":"ICMI '21"},"container-title":["Proceedings of the 2021 International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3462244.3481004","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3462244.3481004","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:19:01Z","timestamp":1750191541000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3462244.3481004"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,18]]},"references-count":44,"alternative-id":["10.1145\/3462244.3481004","10.1145\/3462244"],"URL":"https:\/\/doi.org\/10.1145\/3462244.3481004","relation":{},"subject":[],"published":{"date-parts":[[2021,10,18]]},"assertion":[{"value":"2021-10-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}