{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:27:08Z","timestamp":1750220828856,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":37,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,10,14]],"date-time":"2019-10-14T00:00:00Z","timestamp":1571011200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,10,14]]},"DOI":"10.1145\/3340555.3353730","type":"proceedings-article","created":{"date-parts":[[2019,10,17]],"date-time":"2019-10-17T12:49:48Z","timestamp":1571316588000},"page":"85-94","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Multitask Prediction of Exchange-level Annotations for Multimodal Dialogue Systems"],"prefix":"10.1145","author":[{"given":"Yuki","family":"Hirano","sequence":"first","affiliation":[{"name":"Japan Advanced Institute of Science and Technology, Japan"}]},{"given":"Shogo","family":"Okada","sequence":"additional","affiliation":[{"name":"Japan Advanced Institute of Science and Technology, Japan"}]},{"given":"Haruto","family":"Nishimoto","sequence":"additional","affiliation":[{"name":"The Institute of Scientific and Industrial Research Osaka University, Japan"}]},{"given":"Kazunori","family":"Komatani","sequence":"additional","affiliation":[{"name":"Osaka University, Japan"}]}],"member":"320","published-online":{"date-parts":[[2019,10,14]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Proc. International Conference on Language Resources and Evaluation (LREC). European Language Resources Association (ELRA).","author":"Araki Masahiro","year":"2018","unstructured":"Masahiro Araki , Sayaka Tomimasu , Mikio Nakano , Kazunori Komatani , Shogo Okada , Shinya Fujie , and Hiroaki Sugiyama . 2018 . Collection of Multimodal Dialog Data and Analysis of the Result of Annotation of Users\u2019 Interest Level . In Proc. International Conference on Language Resources and Evaluation (LREC). European Language Resources Association (ELRA). Masahiro Araki, Sayaka Tomimasu, Mikio Nakano, Kazunori Komatani, Shogo Okada, Shinya Fujie, and Hiroaki Sugiyama. 2018. Collection of Multimodal Dialog Data and Analysis of the Result of Annotation of Users\u2019 Interest Level. In Proc. International Conference on Language Resources and Evaluation (LREC). European Language Resources Association (ELRA)."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2522848.2522859"},{"volume-title":"Proc. International Conference on Automatic Face and Gesture Recognition (FG). IEEE Computer Society, 59\u201366","author":"Baltrusaitis T.","key":"e_1_3_2_1_3_1","unstructured":"T. Baltrusaitis , A. Zadeh , Y. Lim , and L. Morency . 2018. OpenFace 2.0: Facial Behavior Analysis Toolkit . In Proc. International Conference on Automatic Face and Gesture Recognition (FG). IEEE Computer Society, 59\u201366 . T. Baltrusaitis, A. Zadeh, Y. Lim, and L. Morency. 2018. OpenFace 2.0: Facial Behavior Analysis Toolkit. In Proc. International Conference on Automatic Face and Gesture Recognition (FG). IEEE Computer Society, 59\u201366."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.3115\/1708376.1708411"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-1-55860-307-3.50012-5"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007379606734"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-4310"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Corinna Cortes and Vladimir Vapnik. 1995. Support-Vector Networks. In Machine Learning. 273\u2013297.  Corinna Cortes and Vladimir Vapnik. 1995. Support-Vector Networks. In Machine Learning. 273\u2013297.","DOI":"10.1007\/BF00994018"},{"key":"e_1_3_2_1_9_1","volume-title":"Proc. International Conference on Autonomous Agents and Multi-agent Systems (AAMAS). International Foundation for Autonomous Agents and Multiagent Systems, 1061\u20131068","author":"DeVault David","year":"2014","unstructured":"David DeVault , Ron Artstein , Grace Benn , Teresa Dey , Ed Fast , Alesia Gainer , Kallirroi Georgila , Jon Gratch , Arno Hartholt , Margaux Lhommet , Gale Lucas , Stacy Marsella , Fabrizio Morbini , Angela Nazarian , Stefan Scherer , Giota Stratou , Apar Suri , David Traum , Rachel Wood , Yuyu Xu , Albert Rizzo , and Louis-Philippe Morency . 2014 . SimSensei Kiosk: A Virtual Human Interviewer for Healthcare Decision Support . In Proc. International Conference on Autonomous Agents and Multi-agent Systems (AAMAS). International Foundation for Autonomous Agents and Multiagent Systems, 1061\u20131068 . David DeVault, Ron Artstein, Grace Benn, Teresa Dey, Ed Fast, Alesia Gainer, Kallirroi Georgila, Jon Gratch, Arno Hartholt, Margaux Lhommet, Gale Lucas, Stacy Marsella, Fabrizio Morbini, Angela Nazarian, Stefan Scherer, Giota Stratou, Apar Suri, David Traum, Rachel Wood, Yuyu Xu, Albert Rizzo, and Louis-Philippe Morency. 2014. SimSensei Kiosk: A Virtual Human Interviewer for Healthcare Decision Support. In Proc. International Conference on Autonomous Agents and Multi-agent Systems (AAMAS). International Foundation for Autonomous Agents and Multiagent Systems, 1061\u20131068."},{"key":"e_1_3_2_1_10_1","volume-title":"Proc. International Conference for Learning Representations (ICLR).","author":"Kingma D.","year":"2014","unstructured":"D. Kingma and J. Ba . 2014 . Adam: A method for stochastic optimization . In Proc. International Conference for Learning Representations (ICLR). D.Kingma and J.Ba. 2014. Adam: A method for stochastic optimization. In Proc. International Conference for Learning Representations (ICLR)."},{"volume-title":"The facial action coding system: A technique for the measurement of facial movement","author":"Friesen P","key":"e_1_3_2_1_11_1","unstructured":"Ekman. P and W\u00a0V Friesen . 1978. The facial action coding system: A technique for the measurement of facial movement . Consulting Psychologists Press . Ekman.P and W\u00a0V Friesen. 1978. The facial action coding system: A technique for the measurement of facial movement.Consulting Psychologists Press."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2010.09.020"},{"key":"e_1_3_2_1_13_1","volume-title":"Proc. Spoken Language Understanding for Conversational Systems and Higher Level Linguistic Information for Speech Processing (HLT-NAACL).","author":"Filisko Edward","year":"2004","unstructured":"Edward Filisko and Stephanie Seneff . 2004 . Error detection and recovery in spoken dialogue systems . In Proc. Spoken Language Understanding for Conversational Systems and Higher Level Linguistic Information for Speech Processing (HLT-NAACL). Edward Filisko and Stephanie Seneff. 2004. Error detection and recovery in spoken dialogue systems. In Proc. Spoken Language Understanding for Conversational Systems and Higher Level Linguistic Information for Speech Processing (HLT-NAACL)."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACII.2015.7344688"},{"key":"e_1_3_2_1_15_1","volume-title":"Proc. International Conference on Language Resources and Evaluation (LREC).","author":"Higashinaka Ryuichiro","year":"2016","unstructured":"Ryuichiro Higashinaka , Kotaro Funakoshi , Yuka Kobayashi , and Michimasa Inaba . 2016 . The dialogue breakdown detection challenge: Task description, datasets, and evaluation metrics .. In Proc. International Conference on Language Resources and Evaluation (LREC). Ryuichiro Higashinaka, Kotaro Funakoshi, Yuka Kobayashi, and Michimasa Inaba. 2016. The dialogue breakdown detection challenge: Task description, datasets, and evaluation metrics.. In Proc. International Conference on Language Resources and Evaluation (LREC)."},{"key":"e_1_3_2_1_16_1","volume-title":"The Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC","author":"Hirayama Takatsugu","year":"2011","unstructured":"Takatsugu Hirayama , Yasuyuki Sumi , Tatsuya Kawahara , and Takashi Matsuyama . 2011 . Info-concierge: Proactive multi-modal interaction through mind probing . In The Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2011). Takatsugu Hirayama, Yasuyuki Sumi, Tatsuya Kawahara, and Takashi Matsuyama. 2011. Info-concierge: Proactive multi-modal interaction through mind probing. In The Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2011)."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493432.2493502"},{"key":"e_1_3_2_1_18_1","volume-title":"Proc. International Workshop on Spoken Dialogue Systems (IWSDS).","author":"Inoue Koji","year":"2018","unstructured":"Koji Inoue , Divesh Lala , Katsuya Takanashi , and Tatsuya Kawahara . 2018 . Latent character model for engagement recognition based on multimodal behaviors . In Proc. International Workshop on Spoken Dialogue Systems (IWSDS). Koji Inoue, Divesh Lala, Katsuya Takanashi, and Tatsuya Kawahara. 2018. Latent character model for engagement recognition based on multimodal behaviors. In Proc. International Workshop on Spoken Dialogue Systems (IWSDS)."},{"key":"e_1_3_2_1_19_1","volume-title":"Proc. International Workshop on Spoken Dialogue Systems (IWSDS).","author":"Komatani Kazunori","year":"2019","unstructured":"Kazunori Komatani , Shogo Okada , Haruto Nishimoto , Masahiro Araki , and Mikio Nakano . 2019 . Multimodal Dialogue Data Collection and Analysis of Annotation Disagreement . In Proc. International Workshop on Spoken Dialogue Systems (IWSDS). Kazunori Komatani, Shogo Okada, Haruto Nishimoto, Masahiro Araki, and Mikio Nakano. 2019. Multimodal Dialogue Data Collection and Analysis of Annotation Disagreement. In Proc. International Workshop on Spoken Dialogue Systems (IWSDS)."},{"key":"e_1_3_2_1_20_1","unstructured":"Krippendorff.K. 2011. Computing Krippendorff\u2019s Alpha-Reliability.  Krippendorff.K. 2011. Computing Krippendorff\u2019s Alpha-Reliability."},{"key":"e_1_3_2_1_21_1","volume-title":"Proc. Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics, 230\u2013237","author":"Kudo Taku","year":"2004","unstructured":"Taku Kudo , Kaoru Yamamoto , and Yuji Matsumoto . 2004 . Applying Conditional Random Fields to Japanese Morphological Analysis . In Proc. Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics, 230\u2013237 . Taku Kudo, Kaoru Yamamoto, and Yuji Matsumoto. 2004. Applying Conditional Random Fields to Japanese Morphological Analysis. In Proc. Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics, 230\u2013237."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242969.3242994"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"volume-title":"Proc. International Conference on Intelligent User Interfaces (IUI). ACM, 139\u2013148","author":"I.","key":"e_1_3_2_1_24_1","unstructured":"Yukiko\u00a0 I. Nakano and Ryo Ishii. 2010. Estimating User\u2019s Engagement from Eye-gaze Behaviors in Human-agent Conversations . In Proc. International Conference on Intelligent User Interfaces (IUI). ACM, 139\u2013148 . Yukiko\u00a0I. Nakano and Ryo Ishii. 2010. Estimating User\u2019s Engagement from Eye-gaze Behaviors in Human-agent Conversations. In Proc. International Conference on Intelligent User Interfaces (IUI). ACM, 139\u2013148."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242969.3243029"},{"key":"e_1_3_2_1_26_1","volume-title":"Proc. Annual Meeting of the Association for Computational Linguistics. 973\u2013982","author":"P\u00e9rez-Rosas Ver\u00f3nica","year":"2013","unstructured":"Ver\u00f3nica P\u00e9rez-Rosas , Rada Mihalcea , and Louis-Philippe Morency . 2013 . Utterance-level multimodal sentiment analysis . In Proc. Annual Meeting of the Association for Computational Linguistics. 973\u2013982 . Ver\u00f3nica P\u00e9rez-Rosas, Rada Mihalcea, and Louis-Philippe Morency. 2013. Utterance-level multimodal sentiment analysis. In Proc. Annual Meeting of the Association for Computational Linguistics. 973\u2013982."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2015.06.015"},{"key":"e_1_3_2_1_28_1","volume-title":"The INTERSPEECH 2009 emotion challenge. In Proc. Annual Conference of the International Speech Communication Association (INTERSPEECH). ISCA, 312\u2013315","author":"Schuller Bj\u00f6rn","year":"2009","unstructured":"Bj\u00f6rn Schuller , Stefan Steidl , and Anton Batliner . 2009 . The INTERSPEECH 2009 emotion challenge. In Proc. Annual Conference of the International Speech Communication Association (INTERSPEECH). ISCA, 312\u2013315 . Bj\u00f6rn Schuller, Stefan Steidl, and Anton Batliner. 2009. The INTERSPEECH 2009 emotion challenge. In Proc. Annual Conference of the International Speech Communication Association (INTERSPEECH). ISCA, 312\u2013315."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2014.05.005"},{"key":"e_1_3_2_1_31_1","first-page":"1","article-title":"Dropout: A Simple Way to Prevent Neural Networks from Overfitting","volume":"15","author":"Srivastava Nitish","year":"2014","unstructured":"Nitish Srivastava , Geoffrey Hinton , Alex Krizhevsky , Ilya Sutskever , and Ruslan Salakhutdinov . 2014 . Dropout: A Simple Way to Prevent Neural Networks from Overfitting . J. Mach. Learn. Res. 15 , 1 (Jan. 2014), 1929\u20131958. Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: A Simple Way to Prevent Neural Networks from Overfitting. J. Mach. Learn. Res. 15, 1 (Jan. 2014), 1929\u20131958.","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2016.2614300"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/JTEHM.2017.2752152"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0182151"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242969.3242970"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3011263.3011269"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242969.3242976"},{"key":"e_1_3_2_1_38_1","volume-title":"A survey of affect recognition methods: Audio, visual, and spontaneous expressions","author":"Zeng Zhihong","year":"2009","unstructured":"Zhihong Zeng , Maja Pantic , Glenn\u00a0 I Roisman , and Thomas\u00a0 S Huang . 2009. A survey of affect recognition methods: Audio, visual, and spontaneous expressions . IEEE transactions on pattern analysis and machine intelligence 31, 1( 2009 ), 39\u201358. Zhihong Zeng, Maja Pantic, Glenn\u00a0I Roisman, and Thomas\u00a0S Huang. 2009. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE transactions on pattern analysis and machine intelligence 31, 1(2009), 39\u201358."}],"event":{"name":"ICMI '19: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","acronym":"ICMI '19","location":"Suzhou China"},"container-title":["2019 International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3340555.3353730","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3340555.3353730","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:13:28Z","timestamp":1750202008000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3340555.3353730"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,14]]},"references-count":37,"alternative-id":["10.1145\/3340555.3353730","10.1145\/3340555"],"URL":"https:\/\/doi.org\/10.1145\/3340555.3353730","relation":{},"subject":[],"published":{"date-parts":[[2019,10,14]]},"assertion":[{"value":"2019-10-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}