{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,29]],"date-time":"2025-11-29T07:59:55Z","timestamp":1764403195663,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":33,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,11,7]],"date-time":"2022-11-07T00:00:00Z","timestamp":1667779200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,11,7]]},"DOI":"10.1145\/3536221.3556576","type":"proceedings-article","created":{"date-parts":[[2022,11,4]],"date-time":"2022-11-04T15:54:14Z","timestamp":1667577254000},"page":"349-358","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Transformer-Based Physiological Feature Learning for Multimodal Analysis of Self-Reported Sentiment"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3241-4470","authenticated-orcid":false,"given":"Shun","family":"Katada","sequence":"first","affiliation":[{"name":"Japan Advanced Institute of Science and Technology, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9260-0403","authenticated-orcid":false,"given":"Shogo","family":"Okada","sequence":"additional","affiliation":[{"name":"Japan Advanced Institute of Science and Technology, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6052-600X","authenticated-orcid":false,"given":"Kazunori","family":"Komatani","sequence":"additional","affiliation":[{"name":"The Institute of Scientific and Industrial Research (SANKEN), Osaka University, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,11,7]]},"reference":[{"key":"#cr-split#-e_1_3_2_1_1_1.1","unstructured":"Jimmy\u00a0Lei Ba Jamie\u00a0Ryan Kiros and Geoffrey\u00a0E. Hinton. 2016. Layer Normalization. https:\/\/doi.org\/10.48550\/ARXIV.1607.06450 10.48550\/ARXIV.1607.06450"},{"key":"#cr-split#-e_1_3_2_1_1_1.2","unstructured":"Jimmy\u00a0Lei Ba Jamie\u00a0Ryan Kiros and Geoffrey\u00a0E. Hinton. 2016. Layer Normalization. https:\/\/doi.org\/10.48550\/ARXIV.1607.06450"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2018.2798607"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2018.00019"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2020.3037496"},{"volume-title":"Handbook of psychophysiology","author":"Darson E","key":"e_1_3_2_1_5_1","unstructured":"Michael\u00a0 E Darson , Anne Schell , and Diane\u00a0 L Filion . 2007. The electrodermal system . In Handbook of psychophysiology . Cambridge University Press , New York, NY, USA , 159\u2013182. Michael\u00a0E Darson, Anne Schell, and Diane\u00a0L Filion. 2007. The electrodermal system. In Handbook of psychophysiology. Cambridge University Press, New York, NY, USA, 159\u2013182."},{"key":"e_1_3_2_1_6_1","first-page":"19","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","volume":"1","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding . In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171\u20134186. https:\/\/doi.org\/10. 18653\/v1\/N 19 - 1423 10.18653\/v1 Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171\u20134186. https:\/\/doi.org\/10.18653\/v1\/N19-1423"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1207"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394171.3413678"},{"key":"e_1_3_2_1_9_1","volume-title":"Deep Residual Learning for Image Recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society","author":"He Kaiming","year":"2016","unstructured":"Kaiming He , Xiangyu Zhang , Shaoqing Ren , and Jian Sun . 2016 . Deep Residual Learning for Image Recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society , Los Alamitos, CA, USA, 770\u2013778. https:\/\/doi.org\/10.1109\/CVPR. 2016.90 10.1109\/CVPR.2016.90 Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep Residual Learning for Image Recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society, Los Alamitos, CA, USA, 770\u2013778. https:\/\/doi.org\/10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_3_2_1_11_1","volume-title":"Proceedings of the 2020 International Conference on Multimodal Interaction. Association for Computing Machinery","author":"Katada Shun","year":"2020","unstructured":"Shun Katada , Shogo Okada , Yuki Hirano , and Kazunori Komatani . 2020 . Is She Truly Enjoying the Conversation? Analysis of Physiological Signals toward Adaptive Dialogue Systems . In Proceedings of the 2020 International Conference on Multimodal Interaction. Association for Computing Machinery , New York, NY, USA, 315\u2013323. https:\/\/doi.org\/10.1145\/3382507.34 18844 10.1145\/3382507.3418844 Shun Katada, Shogo Okada, Yuki Hirano, and Kazunori Komatani. 2020. Is She Truly Enjoying the Conversation? Analysis of Physiological Signals toward Adaptive Dialogue Systems. In Proceedings of the 2020 International Conference on Multimodal Interaction. Association for Computing Machinery, New York, NY, USA, 315\u2013323. https:\/\/doi.org\/10.1145\/3382507.3418844"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2022.3155604"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.26"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2011.15"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACII52823.2021.9597447"},{"key":"e_1_3_2_1_16_1","unstructured":"Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy Mike Lewis Luke Zettlemoyer and Veselin Stoyanov. 2019. RoBERTa: A robustly optimized bert pretraining approach.  Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy Mike Lewis Luke Zettlemoyer and Veselin Stoyanov. 2019. RoBERTa: A robustly optimized bert pretraining approach."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/196"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/0160-2896(93)90010-3"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2018.2884461"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.954607"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2019.8852318"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.214"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2013.6553805"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2009-103"},{"key":"e_1_3_2_1_25_1","volume-title":"Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics","author":"Socher Richard","year":"2013","unstructured":"Richard Socher , Alex Perelygin , Jean Wu , Jason Chuang , Christopher\u00a0 D. Manning , Andrew Ng , and Christopher Potts . 2013 . Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank . In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics , Seattle, Washington, USA, 1631\u20131642. https:\/\/aclanthology.org\/D13-1170 Richard Socher, Alex Perelygin, Jean Wu, Jason Chuang, Christopher\u00a0D. Manning, Andrew Ng, and Christopher Potts. 2013. Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Seattle, Washington, USA, 1631\u20131642. https:\/\/aclanthology.org\/D13-1170"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2011.25"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1656"},{"volume-title":"Advances in neural information processing systems. Curran Associates","author":"Vaswani Ashish","key":"e_1_3_2_1_28_1","unstructured":"Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan\u00a0 N Gomez , \u0141ukasz Kaiser , and Illia Polosukhin . 2017. Attention is all you need . In Advances in neural information processing systems. Curran Associates , Inc., Red Hook, NY, USA , 5998\u20136008. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan\u00a0N Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. Curran Associates, Inc., Red Hook, NY, USA, 5998\u20136008."},{"key":"#cr-split#-e_1_3_2_1_29_1.1","doi-asserted-by":"crossref","unstructured":"Yansen Wang Ying Shen Zhun Liu Paul\u00a0Pu Liang Amir Zadeh and Louis-Philippe Morency. 2019. Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviors. In Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence and Thirty-First Innovative Applications of Artificial Intelligence Conference and Ninth AAAI Symposium on Educational Advances in Artificial Intelligence (Honolulu Hawaii USA) (AAAI'19\/IAAI'19\/EAAI'19). AAAI Press Palo Alto CA USA Article 886 8\u00a0pages. https:\/\/doi.org\/10.1609\/aaai.v33i01.33017216 10.1609\/aaai.v33i01.33017216","DOI":"10.1609\/aaai.v33i01.33017216"},{"key":"#cr-split#-e_1_3_2_1_29_1.2","doi-asserted-by":"crossref","unstructured":"Yansen Wang Ying Shen Zhun Liu Paul\u00a0Pu Liang Amir Zadeh and Louis-Philippe Morency. 2019. Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviors. In Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence and Thirty-First Innovative Applications of Artificial Intelligence Conference and Ninth AAAI Symposium on Educational Advances in Artificial Intelligence (Honolulu Hawaii USA) (AAAI'19\/IAAI'19\/EAAI'19). AAAI Press Palo Alto CA USA Article 886 8\u00a0pages. https:\/\/doi.org\/10.1609\/aaai.v33i01.33017216","DOI":"10.1609\/aaai.v33i01.33017216"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-019-09794-5"},{"key":"e_1_3_2_1_31_1","volume-title":"Proceedings of IJCAI 2017 Workshop on Artificial Intelligence in Affective Computing(Proceedings of Machine Learning Research, Vol.\u00a066)","author":"Yates Heath","year":"2017","unstructured":"Heath Yates , Brent Chamberlain , Greg Norman , and William\u00a0 H. Hsu . 2017 . Arousal Detection for Biometric Data in Built Environments using Machine Learning . In Proceedings of IJCAI 2017 Workshop on Artificial Intelligence in Affective Computing(Proceedings of Machine Learning Research, Vol.\u00a066) , Neil Lawrence and Mark Reid (Eds.). PMLR, Cambridge, MA, USA, 58\u201372. https:\/\/proceedings.mlr.press\/v66\/yates17a.html Heath Yates, Brent Chamberlain, Greg Norman, and William\u00a0H. Hsu. 2017. Arousal Detection for Biometric Data in Built Environments using Machine Learning. In Proceedings of IJCAI 2017 Workshop on Artificial Intelligence in Affective Computing(Proceedings of Machine Learning Research, Vol.\u00a066), Neil Lawrence and Mark Reid (Eds.). PMLR, Cambridge, MA, USA, 58\u201372. https:\/\/proceedings.mlr.press\/v66\/yates17a.html"}],"event":{"name":"ICMI '22: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"Bengaluru India","acronym":"ICMI '22"},"container-title":["Proceedings of the 2022 International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3536221.3556576","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3536221.3556576","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:48:52Z","timestamp":1750182532000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3536221.3556576"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,7]]},"references-count":33,"alternative-id":["10.1145\/3536221.3556576","10.1145\/3536221"],"URL":"https:\/\/doi.org\/10.1145\/3536221.3556576","relation":{},"subject":[],"published":{"date-parts":[[2022,11,7]]},"assertion":[{"value":"2022-11-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}