{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T04:05:47Z","timestamp":1754107547924,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":20,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,10,21]],"date-time":"2020-10-21T00:00:00Z","timestamp":1603238400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Bundesministerium f\u00fcr Verkehr und Digitale Infrastruktur","award":["19F2105F"],"award-info":[{"award-number":["19F2105F"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,10,21]]},"DOI":"10.1145\/3382507.3420053","type":"proceedings-article","created":{"date-parts":[[2020,10,22]],"date-time":"2020-10-22T10:04:35Z","timestamp":1603361075000},"page":"883-885","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Modeling Socio-Emotional and Cognitive Processes from Multimodal Data in the Wild"],"prefix":"10.1145","author":[{"given":"Dennis","family":"K\u00fcster","sequence":"first","affiliation":[{"name":"University of Bremen, Bremen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Felix","family":"Putze","sequence":"additional","affiliation":[{"name":"University of Bremen, Bremen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Patr\u00edcia","family":"Alves-Oliveira","sequence":"additional","affiliation":[{"name":"University of Washington, Washington, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maike","family":"Paetzel","sequence":"additional","affiliation":[{"name":"Uppsala University, Uppsala, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tanja","family":"Schultz","sequence":"additional","affiliation":[{"name":"University of Bremen, Bremen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,10,22]]},"reference":[{"key":"e_1_3_2_1_1_1","series-title":"In 2016 AAAI Fall Symposium Series","volume-title":"Psychological science in hri: Striving for a more integrated field of research","author":"Alves-Oliveira Patr\u00edcia","unstructured":"Patr\u00edcia Alves-Oliveira , Dennis K\u00fcster , Arvid Kappas , and Ana Paiva . 2016. Psychological science in hri: Striving for a more integrated field of research . In 2016 AAAI Fall Symposium Series . Patr\u00edcia Alves-Oliveira, Dennis K\u00fcster, Arvid Kappas, and Ana Paiva. 2016. Psychological science in hri: Striving for a more integrated field of research. In 2016 AAAI Fall Symposium Series ."},{"key":"e_1_3_2_1_2_1","volume-title":"Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20)","author":"Anguiozar Nerea Urrestilla","year":"2020","unstructured":"Nerea Urrestilla Anguiozar and David St-Onge . 2020 . Measuring cognitive load: heart-rate variability (HRV) and pupillometry assessment . In Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20) , October 25 --29 , 2020, Virtual event, Netherlands. Association for Computing Machinery, New York, NY, USA. Nerea Urrestilla Anguiozar and David St-Onge. 2020. Measuring cognitive load: heart-rate variability (HRV) and pupillometry assessment. In Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20), October 25--29, 2020, Virtual event, Netherlands. Association for Computing Machinery, New York, NY, USA."},{"key":"e_1_3_2_1_3_1","first-page":"33","article-title":"Multimodal Child-Robot Interaction","volume":"1","author":"Belpaeme Tony","year":"2013","unstructured":"Tony Belpaeme , Paul E Baxter , Robin Read , Rachel Wood , Heriberto Cuay\u00e1huitl , Bernd Kiefer , Stefania Racioppa , Ivana Kruijff-Korbayov\u00e1 , Georgios Athanasopoulos , Valentin Enescu , Rosemarijn Looije , Mark Neerincx , Yiannis Demiris , Raquel Ros-Espinoza , Aryel Beck , Lola Ca\u00f1amero , Antione Hiolle , Matthew Lewis , Ilaria Baroni , Marco Nalin , Piero Cosi , Giulio Paci , Fabio Tesser , Giacomo Sommavilla , and Remi Humbert . 2013 . Multimodal Child-Robot Interaction : Building Social Bonds. , Vol. 1 , 2 (2013), 33 -- 53 . https:\/\/doi.org\/10.5898\/JHRI.1.2.Belpaeme 10.5898\/JHRI.1.2.Belpaeme Tony Belpaeme, Paul E Baxter, Robin Read, Rachel Wood, Heriberto Cuay\u00e1huitl, Bernd Kiefer, Stefania Racioppa, Ivana Kruijff-Korbayov\u00e1, Georgios Athanasopoulos, Valentin Enescu, Rosemarijn Looije, Mark Neerincx, Yiannis Demiris, Raquel Ros-Espinoza, Aryel Beck, Lola Ca\u00f1amero, Antione Hiolle, Matthew Lewis, Ilaria Baroni, Marco Nalin, Piero Cosi, Giulio Paci, Fabio Tesser, Giacomo Sommavilla, and Remi Humbert. 2013. Multimodal Child-Robot Interaction: Building Social Bonds., Vol. 1, 2 (2013), 33--53. https:\/\/doi.org\/10.5898\/JHRI.1.2.Belpaeme","journal-title":"Building Social Bonds."},{"volume-title":"Principles of psychophysiology: Physical, social, and inferential elements","author":"Cacioppo John T","key":"e_1_3_2_1_4_1","unstructured":"John T Cacioppo and Louis G Tassinary . 1990. Principles of psychophysiology: Physical, social, and inferential elements . Cambridge University Press . John T Cacioppo and Louis G Tassinary. 1990. Principles of psychophysiology: Physical, social, and inferential elements. Cambridge University Press."},{"key":"e_1_3_2_1_5_1","volume-title":"Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20)","author":"Chatterjee Sromona","year":"2020","unstructured":"Sromona Chatterjee , Kevin Scheck , Dennis K\u00fcster , Felix Putze , Harish Moturu , Johannes Schering , Jorge Marx G\u00f3mez , and Tanja Schultz . 2020 . SmartHelm: Towards Multimodal Detection of Attention in an Outdoor Augmented Reality Biking Scenario . In Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20) , October 25 --29 , 2020, Virtual event, Netherlands. Association for Computing Machinery, New York, NY, USA. Sromona Chatterjee, Kevin Scheck, Dennis K\u00fcster, Felix Putze, Harish Moturu, Johannes Schering, Jorge Marx G\u00f3mez, and Tanja Schultz. 2020. SmartHelm: Towards Multimodal Detection of Attention in an Outdoor Augmented Reality Biking Scenario. In Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20), October 25--29, 2020, Virtual event, Netherlands. Association for Computing Machinery, New York, NY, USA."},{"volume-title":"Social Robotics,, Arvin Agah, John-John Cabibihan, Ayanna M. Howard, Miguel A. Salichs, and Hongsheng He (Eds.).","author":"Foster Mary Ellen","key":"e_1_3_2_1_6_1","unstructured":"Mary Ellen Foster , Rachid Alami , Olli Gestranius , Oliver Lemon , Marketta Niemel\u00e4 , Jean-Marc Odobez , and Amit Kumar Pandey . 2016. The MuMMER Project: Engaging Human-Robot Interaction in Real-World Public Spaces . In Social Robotics,, Arvin Agah, John-John Cabibihan, Ayanna M. Howard, Miguel A. Salichs, and Hongsheng He (Eds.). Vol. 9979 . Springer International Publishing , 753--763. https:\/\/doi.org\/10.1007\/978--3--319--47437--3_74 Series Title : Lecture Notes in Computer Science. 10.1007\/978--3--319--47437--3_74 Mary Ellen Foster, Rachid Alami, Olli Gestranius, Oliver Lemon, Marketta Niemel\u00e4, Jean-Marc Odobez, and Amit Kumar Pandey. 2016. The MuMMER Project: Engaging Human-Robot Interaction in Real-World Public Spaces. In Social Robotics,, Arvin Agah, John-John Cabibihan, Ayanna M. Howard, Miguel A. Salichs, and Hongsheng He (Eds.). Vol. 9979. Springer International Publishing, 753--763. https:\/\/doi.org\/10.1007\/978--3--319--47437--3_74 Series Title: Lecture Notes in Computer Science."},{"key":"e_1_3_2_1_7_1","volume-title":"Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20)","author":"Gumuslu Elif","year":"2020","unstructured":"Elif Gumuslu , Duygun Erol Barkana , and Hatice Kose . 2020 . Emotion Recognition using EEG and Physiological Data for Robot-Assisted Rehabilitation Systems . In Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20) , October 25 --29 , 2020, Virtual event, Netherlands. Association for Computing Machinery, New York, NY, USA. Elif Gumuslu, Duygun Erol Barkana, and Hatice Kose. 2020. Emotion Recognition using EEG and Physiological Data for Robot-Assisted Rehabilitation Systems. In Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20), October 25--29, 2020, Virtual event, Netherlands. Association for Computing Machinery, New York, NY, USA."},{"key":"e_1_3_2_1_8_1","volume-title":"Patricia Alves-Oliveira, Sofia Serholt, Helen Hastie, Lee J. Corrigan, Wolmet Barendregt, Arvid Kappas, Ana Paiva, and Ginevra Castellano.","author":"Jones Aidan","year":"2015","unstructured":"Aidan Jones , Dennis K\u00fcster , Christina Anne Basedow , Patricia Alves-Oliveira, Sofia Serholt, Helen Hastie, Lee J. Corrigan, Wolmet Barendregt, Arvid Kappas, Ana Paiva, and Ginevra Castellano. 2015 . Empathic Robotic Tutors for Personalised Learning: A Multidisciplinary Approach. In Social Robotics,, Adriana Tapus, Elisabeth Andr\u00e9, Jean-Claude Martin, Fran\u00e7ois Ferland, and Mehdi Ammi (Eds.). Vol. 9388 . Springer International Publishing , 285--295. https:\/\/doi.org\/10.1007\/978--3--319--25554--5_29 Series Title : Lecture Notes in Computer Science. 10.1007\/978--3--319--25554--5_29 Aidan Jones, Dennis K\u00fcster, Christina Anne Basedow, Patricia Alves-Oliveira, Sofia Serholt, Helen Hastie, Lee J. Corrigan, Wolmet Barendregt, Arvid Kappas, Ana Paiva, and Ginevra Castellano. 2015. Empathic Robotic Tutors for Personalised Learning: A Multidisciplinary Approach. In Social Robotics,, Adriana Tapus, Elisabeth Andr\u00e9, Jean-Claude Martin, Fran\u00e7ois Ferland, and Mehdi Ammi (Eds.). Vol. 9388. Springer International Publishing, 285--295. https:\/\/doi.org\/10.1007\/978--3--319--25554--5_29 Series Title: Lecture Notes in Computer Science."},{"key":"e_1_3_2_1_9_1","volume-title":"Proceedings of the International Conference on Physiological Computing Systems","author":"K\u00fcster Dennis","year":"2014","unstructured":"Dennis K\u00fcster and Arvid Kappas . 2014 . What Could a Body Tell a Social Robot that It Does Not Know? :. In Proceedings of the International Conference on Physiological Computing Systems ( Lisbon, Portugal). SCITEPRESS - Science and and Technology Publications, 358--367. https:\/\/doi.org\/10.5220\/0004892503580367 10.5220\/0004892503580367 Dennis K\u00fcster and Arvid Kappas. 2014. What Could a Body Tell a Social Robot that It Does Not Know?:. In Proceedings of the International Conference on Physiological Computing Systems (Lisbon, Portugal). SCITEPRESS - Science and and Technology Publications, 358--367. https:\/\/doi.org\/10.5220\/0004892503580367"},{"key":"e_1_3_2_1_10_1","volume-title":"Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20)","author":"L\u00e9chapp\u00e9 Aur\u00e9lien","year":"2020","unstructured":"Aur\u00e9lien L\u00e9chapp\u00e9 , Mathieu Chollet , and Caroline Cao Cao . 2020 . Assessment of situation awareness during robotic-assisted surgery using multimodal data . In Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20) , October 25 --29 , 2020, Virtual event, Netherlands. Association for Computing Machinery, New York, NY, USA. Aur\u00e9lien L\u00e9chapp\u00e9, Mathieu Chollet, and Caroline Cao Cao. 2020. Assessment of situation awareness during robotic-assisted surgery using multimodal data. In Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20), October 25--29, 2020, Virtual event, Netherlands. Association for Computing Machinery, New York, NY, USA."},{"volume-title":"When Positive Perception of the Robot Has No Effect on Learning (29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN),2020 ). IEEE.","author":"Nasir Jauwairia","key":"e_1_3_2_1_11_1","unstructured":"Jauwairia Nasir , Utku Norman , Barbara Bruno , and Pierre Dillenbourg . [n.d.]. When Positive Perception of the Robot Has No Effect on Learning (29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN),2020 ). IEEE. Jauwairia Nasir, Utku Norman, Barbara Bruno, and Pierre Dillenbourg. [n.d.]. When Positive Perception of the Robot Has No Effect on Learning (29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN),2020 ). IEEE."},{"key":"e_1_3_2_1_12_1","volume-title":"22","author":"Nasir Jauwairia","year":"2020","unstructured":"Jauwairia Nasir , Utku Norman , Barbara Bruno , and Pierre Dillenbourg . 2020. You Tell , I do, and We Swap until we Connect All the Gold Mines! Educational Technology ( 2020 ), 22 . Jauwairia Nasir, Utku Norman, Barbara Bruno, and Pierre Dillenbourg. 2020. You Tell, I do, and We Swap until we Connect All the Gold Mines! Educational Technology (2020), 22."},{"key":"e_1_3_2_1_13_1","volume-title":"Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20)","author":"Parthasarathy Srinivas","year":"2020","unstructured":"Srinivas Parthasarathy and Shiva Sundaram . 2020 . Training Strategies to Handle Missing Modalities for Audio-Visual Expression Recognition . In Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20) , October 25 --29 , 2020, Virtual event, Netherlands. Association for Computing Machinery, New York, NY, USA. Srinivas Parthasarathy and Shiva Sundaram. 2020. Training Strategies to Handle Missing Modalities for Audio-Visual Expression Recognition. In Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20), October 25--29, 2020, Virtual event, Netherlands. Association for Computing Machinery, New York, NY, USA."},{"key":"e_1_3_2_1_14_1","volume-title":"Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20)","author":"Putze Felix","year":"2020","unstructured":"Felix Putze , Merlin Burri , Lisa-Marie Vortmann , and Tanja Schultz . 2020 . Model-based Prediction of Exogenous and Endogenous Attention Shifts During an Everyday Activity . In Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20) , October 25 --29 , 2020, Virtual event, Netherlands. Association for Computing Machinery, New York, NY, USA. Felix Putze, Merlin Burri, Lisa-Marie Vortmann, and Tanja Schultz. 2020. Model-based Prediction of Exogenous and Endogenous Attention Shifts During an Everyday Activity. In Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20), October 25--29, 2020, Virtual event, Netherlands. Association for Computing Machinery, New York, NY, USA."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242969.3265861"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242969.3243000"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.2478\/s13230-013-0107-7"},{"key":"e_1_3_2_1_18_1","volume-title":"Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20)","author":"Tozadore Daniel C","year":"2020","unstructured":"Daniel C Tozadore and Roseli Romero . 2020 . Multimodal Fuzzy Assessment for Robot Behavioral Adaptation in Educational Children-Robot Interaction . In Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20) , October 25 --29 , 2020, Virtual event, Netherlands. Association for Computing Machinery, New York, NY, USA. Daniel C Tozadore and Roseli Romero. 2020. Multimodal Fuzzy Assessment for Robot Behavioral Adaptation in Educational Children-Robot Interaction. In Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI '20), October 25--29, 2020, Virtual event, Netherlands. Association for Computing Machinery, New York, NY, USA."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2019.00348"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3334480.3382889"}],"event":{"name":"ICMI '20: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"Virtual Event Netherlands","acronym":"ICMI '20"},"container-title":["Proceedings of the 2020 International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3382507.3420053","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3382507.3420053","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:02:49Z","timestamp":1750197769000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3382507.3420053"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,21]]},"references-count":20,"alternative-id":["10.1145\/3382507.3420053","10.1145\/3382507"],"URL":"https:\/\/doi.org\/10.1145\/3382507.3420053","relation":{},"subject":[],"published":{"date-parts":[[2020,10,21]]},"assertion":[{"value":"2020-10-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}