{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T21:24:15Z","timestamp":1774646655258,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":28,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,10,21]],"date-time":"2020-10-21T00:00:00Z","timestamp":1603238400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000183","name":"Army Research Office","doi-asserted-by":"publisher","award":["W911NF-20-2-0053"],"award-info":[{"award-number":["W911NF-20-2-0053"]}],"id":[{"id":"10.13039\/100000183","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003475","name":"Hasler Stiftung","doi-asserted-by":"publisher","award":["15034"],"award-info":[{"award-number":["15034"]}],"id":[{"id":"10.13039\/501100003475","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,10,21]]},"DOI":"10.1145\/3382507.3418867","type":"proceedings-article","created":{"date-parts":[[2020,10,22]],"date-time":"2020-10-22T10:04:34Z","timestamp":1603361074000},"page":"655-659","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["Multimodal Gated Information Fusion for Emotion Recognition from EEG Signals and Facial Behaviors"],"prefix":"10.1145","author":[{"given":"Soheil","family":"Rayatdoost","sequence":"first","affiliation":[{"name":"University of Geneva, Geneva, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Rudrauf","sequence":"additional","affiliation":[{"name":"University of Geneva, Geneva, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohammad","family":"Soleymani","sequence":"additional","affiliation":[{"name":"University of Southern California, Los Angeles, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,10,22]]},"reference":[{"key":"e_1_3_2_2_1_1","unstructured":"J. Arevalo Th. Solorio M. Montes-y-G\u00f3mez and F. A. Gonz\u00e1lez. 2017. Gated Multimodal Units for Information Fusion. arXiv e-prints Article arXiv:1702.01992 (Feb. 2017) arXiv:1702.01992 pages. arXiv:stat.ML\/1702.01992  J. Arevalo Th. Solorio M. Montes-y-G\u00f3mez and F. A. Gonz\u00e1lez. 2017. Gated Multimodal Units for Information Fusion. arXiv e-prints Article arXiv:1702.01992 (Feb. 2017) arXiv:1702.01992 pages. arXiv:stat.ML\/1702.01992"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2016.7477553"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2018.2798607"},{"key":"e_1_3_2_2_4_1","volume-title":"4th International Conference on Learning Representations (ICLR).","author":"Bashivan P.","unstructured":"P. Bashivan , I. Rish , M. Yeasin , and N. Codella . 2016. Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networks . In 4th International Conference on Learning Representations (ICLR). P. Bashivan, I. Rish, M. Yeasin, and N. Codella. 2016. Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networks. In 4th International Conference on Learning Representations (ICLR)."},{"key":"e_1_3_2_2_5_1","volume-title":"Proceedings of the 19th ACM International Conference on Multimodal Interaction - ICMI 2017. ACM Press. https:\/\/doi.org\/10","author":"Chen M.","unstructured":"M. Chen , S. Wang , P. Pu Liang , T. Baltru\u0161aitis , A. Zadeh , and LP. Morency . 2017. Multimodal sentiment analysis with word-level fusion and reinforcement learning . In Proceedings of the 19th ACM International Conference on Multimodal Interaction - ICMI 2017. ACM Press. https:\/\/doi.org\/10 .1145\/3136755.3136801 10.1145\/3136755.3136801 M. Chen, S. Wang, P. Pu Liang, T. Baltru\u0161aitis, A. Zadeh, and LP. Morency. 2017. Multimodal sentiment analysis with word-level fusion and reinforcement learning. In Proceedings of the 19th ACM International Conference on Multimodal Interaction - ICMI 2017. ACM Press. https:\/\/doi.org\/10.1145\/3136755.3136801"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"crossref","unstructured":"S. K. D'mello and J. Kory. 2015. A Review and Meta-Analysis of Multimodal Affect Detection Systems. ACM Comput. Surv. 47 3 Article 43 (Feb. 2015) 36 pages.  S. K. D'mello and J. Kory. 2015. A Review and Meta-Analysis of Multimodal Affect Detection Systems. ACM Comput. Surv. 47 3 Article 43 (Feb. 2015) 36 pages.","DOI":"10.1145\/2682899"},{"key":"e_1_3_2_2_7_1","volume-title":"Friesen","author":"Ekman Paul","year":"1978","unstructured":"Paul Ekman and Wallace V . Friesen . 1978 . Facial action coding system: a technique for the measurement of facial movement. Consulting Psychologists Press . Paul Ekman and Wallace V. Friesen. 1978. Facial action coding system: a technique for the measurement of facial movement. Consulting Psychologists Press."},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1388-2457(03)00093-2"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_3_2_2_10_1","volume-title":"Computer Vision -- ACCV","author":"Jaekyum","year":"2018","unstructured":"Jaekyum K., Junho K., Yecheol K., Jaehyung Ch ., Youngbae H., and Jun Won Ch. 2019. Robust Deep Multi-modal Learning Based on Gated Information Fusion Network . In Computer Vision -- ACCV 2018 , C.V. Jawahar, Hongdong Li , Greg Mori, and Konrad Schindler (Eds.). Springer International Publishing , Cham, 90--106. Jaekyum K., Junho K., Yecheol K., Jaehyung Ch., Youngbae H., and Jun Won Ch. 2019. Robust Deep Multi-modal Learning Based on Gated Information Fusion Network. In Computer Vision -- ACCV 2018, C.V. Jawahar, Hongdong Li, Greg Mori, and Konrad Schindler (Eds.). Springer International Publishing, Cham, 90--106."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12193-009-0025-5"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2012.10.002"},{"key":"e_1_3_2_2_13_1","first-page":"63","article-title":"Observations: SAM: The self-assessment manikin: An efficient cross-cultural measurement of emotional response","volume":"35","author":"Morris J.D.","year":"1995","unstructured":"J.D. Morris . 1995 . Observations: SAM: The self-assessment manikin: An efficient cross-cultural measurement of emotional response . Journal of Advertising Research 35 , 6 (1995), 63 -- 68 . J.D. Morris. 1995. Observations: SAM: The self-assessment manikin: An efficient cross-cultural measurement of emotional response. Journal of Advertising Research 35, 6 (1995), 63--68.","journal-title":"Journal of Advertising Research"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1080\/2326263X.2014.912881"},{"key":"e_1_3_2_2_15_1","volume-title":"Expression-Guided EEG Representation Learning for Emotion Recognition. In ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 3222--3226","author":"Rayatdoost S.","unstructured":"S. Rayatdoost , D. Rudrauf , and M. Soleymani . 2020 . Expression-Guided EEG Representation Learning for Emotion Recognition. In ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 3222--3226 . S. Rayatdoost, D. Rudrauf, and M. Soleymani. 2020. Expression-Guided EEG Representation Learning for Emotion Recognition. In ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 3222--3226."},{"key":"e_1_3_2_2_16_1","volume-title":"CROSS-CORPUS EEG-BASED EMOTION RECOGNITION. In 2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP). 1--6. https:\/\/doi.org\/10","author":"Rayatdoost S.","year":"2018","unstructured":"S. Rayatdoost and M. Soleymani . 2018 . CROSS-CORPUS EEG-BASED EMOTION RECOGNITION. In 2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP). 1--6. https:\/\/doi.org\/10 .1109\/MLSP. 2018 .8517037 10.1109\/MLSP.2018.8517037 S. Rayatdoost and M. Soleymani. 2018. CROSS-CORPUS EEG-BASED EMOTION RECOGNITION. In 2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP). 1--6. https:\/\/doi.org\/10.1109\/MLSP.2018.8517037"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-019-52891-2"},{"key":"#cr-split#-e_1_3_2_2_18_1.1","unstructured":"S. Siddharth T. Jung and T. J. Sejnowski. 2019. Utilizing Deep Learning Towards Multi-modal Bio-sensing and Vision-based Affective Computing. IEEE Transactions on Affective Computing (2019) 1--1. https:\/\/doi.org\/10.1109\/TAFFC.2019. 10.1109\/TAFFC.2019"},{"key":"#cr-split#-e_1_3_2_2_18_1.2","unstructured":"S. Siddharth T. Jung and T. J. Sejnowski. 2019. Utilizing Deep Learning Towards Multi-modal Bio-sensing and Vision-based Affective Computing. IEEE Transactions on Affective Computing (2019) 1--1. https:\/\/doi.org\/10.1109\/TAFFC.2019."},{"key":"e_1_3_2_2_19_1","unstructured":"K. Simonyan and A. Zisserman. 2014. Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv:cs.CV\/1409.1556  K. Simonyan and A. Zisserman. 2014. Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv:cs.CV\/1409.1556"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2015.2436926"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2011.25"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-AFFC.2011.37"},{"key":"#cr-split#-e_1_3_2_2_23_1.1","doi-asserted-by":"crossref","unstructured":"T. Song W. Zheng P. Song and Z. Cui. 2018. EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks. IEEE Transactions on Affective Computing (2018) 1--1. https:\/\/doi.org\/10.1109\/TAFFC.2018.2817622 10.1109\/TAFFC.2018.2817622","DOI":"10.1109\/TAFFC.2018.2817622"},{"key":"#cr-split#-e_1_3_2_2_23_1.2","doi-asserted-by":"crossref","unstructured":"T. Song W. Zheng P. Song and Z. Cui. 2018. EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks. IEEE Transactions on Affective Computing (2018) 1--1. https:\/\/doi.org\/10.1109\/TAFFC.2018.2817622","DOI":"10.1109\/TAFFC.2018.2817622"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.538"},{"key":"e_1_3_2_2_25_1","volume-title":"Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics","author":"Zadeh A.","year":"1865","unstructured":"A. Zadeh , M. Chen , S. Poria , E. Cambria , and LP. Morency . 2017. Tensor Fusion Network for Multimodal Sentiment Analysis . In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics , Copenhagen, Denmark, 1103--1114. https: \/\/doi.org\/10. 1865 3\/v1\/D17--1115 10.18653\/v1 A. Zadeh, M. Chen, S. Poria, E. Cambria, and LP. Morency. 2017. Tensor Fusion Network for Multimodal Sentiment Analysis. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Copenhagen, Denmark, 1103--1114. https: \/\/doi.org\/10.18653\/v1\/D17--1115"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/NER.2019.8717055"}],"event":{"name":"ICMI '20: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","location":"Virtual Event Netherlands","acronym":"ICMI '20","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2020 International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3382507.3418867","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3382507.3418867","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3382507.3418867","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:02:48Z","timestamp":1750197768000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3382507.3418867"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,21]]},"references-count":28,"alternative-id":["10.1145\/3382507.3418867","10.1145\/3382507"],"URL":"https:\/\/doi.org\/10.1145\/3382507.3418867","relation":{},"subject":[],"published":{"date-parts":[[2020,10,21]]},"assertion":[{"value":"2020-10-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}