{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T00:35:58Z","timestamp":1776299758971,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":50,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,10,21]],"date-time":"2020-10-21T00:00:00Z","timestamp":1603238400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,10,21]]},"DOI":"10.1145\/3382507.3418890","type":"proceedings-article","created":{"date-parts":[[2020,10,22]],"date-time":"2020-10-22T10:04:34Z","timestamp":1603361074000},"page":"107-116","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":23,"title":["Early Prediction of Visitor Engagement in Science Museums with Multimodal Learning Analytics"],"prefix":"10.1145","author":[{"given":"Andrew","family":"Emerson","sequence":"first","affiliation":[{"name":"North Carolina State University, Raleigh, NC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nathan","family":"Henderson","sequence":"additional","affiliation":[{"name":"North Carolina State University, Raleigh, NC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jonathan","family":"Rowe","sequence":"additional","affiliation":[{"name":"North Carolina State University, Raleigh, NC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wookhee","family":"Min","sequence":"additional","affiliation":[{"name":"North Carolina State University, Raleigh, NC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Seung","family":"Lee","sequence":"additional","affiliation":[{"name":"North Carolina State University, Raleigh, NC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James","family":"Minogue","sequence":"additional","affiliation":[{"name":"North Carolina State University, Raleigh, NC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James","family":"Lester","sequence":"additional","affiliation":[{"name":"North Carolina State University, Raleigh, NC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,10,22]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376277"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300534"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2013.05.062"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2016.7477553"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.18608\/jla.2016.32.11"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702231"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818346.2820739"},{"key":"e_1_3_2_2_8_1","volume-title":"Proceedings of the 25th International Joint Conference on Artificial Intelligence. 4125--4129","author":"Bosch Nigel","year":"2016","unstructured":"Nigel Bosch , Sidney K. D'Mello , Ryan S. Baker , Jaclyn Ocumpaugh , Valerie Shute , Matthew Ventura , Lubin Wang , and Weinan Zhao . 2016 . Detecting student emotions in computer-enabled classrooms . In Proceedings of the 25th International Joint Conference on Artificial Intelligence. 4125--4129 . Nigel Bosch, Sidney K. D'Mello, Ryan S. Baker, Jaclyn Ocumpaugh, Valerie Shute, Matthew Ventura, Lubin Wang, and Weinan Zhao. 2016. Detecting student emotions in computer-enabled classrooms. In Proceedings of the 25th International Joint Conference on Artificial Intelligence. 4125--4129."},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3136755.3136780"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242969.3264986"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-010-9074-4"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818346.2830602"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40593-017-0152-1"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242969.3264993"},{"key":"e_1_3_2_2_15_1","volume-title":"Uttal","author":"Diamond Judy","year":"2016","unstructured":"Judy Diamond , Michael Horn , and David H . Uttal . 2016 . Practical evaluation guide: Tools for museums and other informal educational settings. Rowman & Littlefield . Judy Diamond, Michael Horn, and David H. Uttal. 2016. Practical evaluation guide: Tools for museums and other informal educational settings. Rowman & Littlefield."},{"key":"e_1_3_2_2_16_1","article-title":"Automatic detection of social behavior of museum visitor pairs","volume":"4","author":"Dim Eyal","year":"2014","unstructured":"Eyal Dim and Tsvi Kuflik . 2014 . Automatic detection of social behavior of museum visitor pairs . ACM Transactions on Interactive Intelligent Systems (TiiS) 4 , 4 (2014). 1--30. Eyal Dim and Tsvi Kuflik. 2014. Automatic detection of social behavior of museum visitor pairs. ACM Transactions on Interactive Intelligent Systems (TiiS) 4, 4 (2014). 1--30.","journal-title":"ACM Transactions on Interactive Intelligent Systems (TiiS)"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2666633.2666641"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3340555.3353748"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-52237-7_14"},{"key":"e_1_3_2_2_20_1","volume-title":"Dierking","author":"Falk John H.","year":"2018","unstructured":"John H. Falk and Lynn D . Dierking . 2018 . Learning from museums. Rowman & Littlefield . John H. Falk and Lynn D. Dierking. 2018. Learning from museums. Rowman & Littlefield."},{"key":"e_1_3_2_2_21_1","volume-title":"Proceedings of the 25th International Florida Artificial Intelligence Research Society Conference. 438--443","author":"Grafsgaard Joseph","year":"2012","unstructured":"Joseph Grafsgaard , Kristy Boyer , Eric Wiebe , and James Lester . 2012 . Analyzing posture and affect in task-oriented tutoring . In Proceedings of the 25th International Florida Artificial Intelligence Research Society Conference. 438--443 . Joseph Grafsgaard, Kristy Boyer, Eric Wiebe, and James Lester. 2012. Analyzing posture and affect in task-oriented tutoring. In Proceedings of the 25th International Florida Artificial Intelligence Research Society Conference. 438--443."},{"key":"e_1_3_2_2_22_1","volume-title":"Learner engagement in blended learning environments: A conceptual framework. Online Learning 23, 2","author":"Halverson Lisa","year":"2019","unstructured":"Lisa Halverson and Charles Graham . 2019. Learner engagement in blended learning environments: A conceptual framework. Online Learning 23, 2 ( 2019 ). 145--178. Lisa Halverson and Charles Graham. 2019. Learner engagement in blended learning environments: A conceptual framework. Online Learning 23, 2 (2019). 145--178."},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-52237-7_19"},{"key":"e_1_3_2_2_24_1","volume-title":"Learning science in informal environments: People, places, and pursuits. Museums and Social Issues 4, 1","author":"Hein George","year":"2009","unstructured":"George Hein . 2009. Learning science in informal environments: People, places, and pursuits. Museums and Social Issues 4, 1 ( 2009 ). 113--124. George Hein. 2009. Learning science in informal environments: People, places, and pursuits. Museums and Social Issues 4, 1 (2009). 113--124."},{"key":"e_1_3_2_2_25_1","volume-title":"Proceedings of the 12th International Conference on Educational Data Mining. 323--329","author":"Huang Karina","year":"2019","unstructured":"Karina Huang , Tonya Bryant , and Bertrand Schneider . 2019 . Identifying collaborative learning states using unsupervised machine learning on eyetracking, physiological and motion sensor data . In Proceedings of the 12th International Conference on Educational Data Mining. 323--329 . Karina Huang, Tonya Bryant, and Bertrand Schneider. 2019. Identifying collaborative learning states using unsupervised machine learning on eyetracking, physiological and motion sensor data. In Proceedings of the 12th International Conference on Educational Data Mining. 323--329."},{"key":"e_1_3_2_2_26_1","article-title":"Flexible interventions to increase family engagement at natural history museum dioramas. Curator","volume":"59","author":"Knutson Karen","year":"2016","unstructured":"Karen Knutson , Mandela Lyon , Kevin Crowley , and Lauren Giarratani . 2016 . Flexible interventions to increase family engagement at natural history museum dioramas. Curator : The Museum Journal 59 , 4 (2016). 339--352. Karen Knutson, Mandela Lyon, Kevin Crowley, and Lauren Giarratani. 2016. Flexible interventions to increase family engagement at natural history museum dioramas. Curator: The Museum Journal 59, 4 (2016). 339--352.","journal-title":"The Museum Journal"},{"key":"e_1_3_2_2_27_1","volume-title":"Proceedings of the Annual Conference of Museums and the Web. 113--124","author":"Kuflik Tsvi","year":"2013","unstructured":"Tsvi Kuflik and Eyal Dim . 2013 . Early detection of pairs of visitors by using a museum triage . In Proceedings of the Annual Conference of Museums and the Web. 113--124 . Tsvi Kuflik and Eyal Dim. 2013. Early detection of pairs of visitors by using a museum triage. In Proceedings of the Annual Conference of Museums and the Web. 113--124."},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-21869-9_22"},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3325480.3325505"},{"key":"e_1_3_2_2_30_1","volume-title":"Proceedings of the 12th Annual AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment. 197203","author":"Min Wookhee","year":"2016","unstructured":"Wookhee Min , Alok Baikadi , Bradford Mott , Jonathan Rowe , Barry Liu , Eun Young Ha , and James Lester . 2016 . A generalized multidimensional evaluation framework for player goal recognition . In Proceedings of the 12th Annual AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment. 197203 . Wookhee Min, Alok Baikadi, Bradford Mott, Jonathan Rowe, Barry Liu, Eun Young Ha, and James Lester. 2016. A generalized multidimensional evaluation framework for player goal recognition. In Proceedings of the 12th Annual AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment. 197203."},{"key":"e_1_3_2_2_31_1","volume-title":"Proceedings of the 13th Artificial Intelligence and Interactive Digital Entertainment Conference. 80--86","author":"Min Wookhee","year":"2017","unstructured":"Wookhee Min , Bradford Mott , Jonathan Rowe , Robert Taylor , Eric Wiebe , Kristy Boyer , and James Lester . 2017 . Multimodal goal recognition in open-world digital games . In Proceedings of the 13th Artificial Intelligence and Interactive Digital Entertainment Conference. 80--86 . Wookhee Min, Bradford Mott, Jonathan Rowe, Robert Taylor, Eric Wiebe, Kristy Boyer, and James Lester. 2017. Multimodal goal recognition in open-world digital games. In Proceedings of the 13th Artificial Intelligence and Interactive Digital Entertainment Conference. 80--86."},{"key":"e_1_3_2_2_32_1","article-title":"Automated detection of engagement using video-based estimation of facial expressions and heart rate","volume":"8","author":"Monkaresi Hamed","year":"2016","unstructured":"Hamed Monkaresi , Nigel Bosch , Rafael Calvo , and Sidney D'Mello . 2016 . Automated detection of engagement using video-based estimation of facial expressions and heart rate . IEEE Trans. on Affect. Comp. 8 , 1 (2016). 15--28. Hamed Monkaresi, Nigel Bosch, Rafael Calvo, and Sidney D'Mello. 2016. Automated detection of engagement using video-based estimation of facial expressions and heart rate. IEEE Trans. on Affect. Comp. 8, 1 (2016). 15--28.","journal-title":"IEEE Trans. on Affect. Comp."},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.18608\/hla17.011"},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242969.3243010"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"crossref","unstructured":"Sharon Oviatt Joseph Grafsgaard Lei Chen and Xavier Ochoa. 2018. Multimodal learning analytics: Assessing learners' mental state during the process of learning. The Handbook of Multimodal-Multisensor Interfaces: Signal Processing Architectures and Detection of Emotion and Cognition 2 (2018). 331374.  Sharon Oviatt Joseph Grafsgaard Lei Chen and Xavier Ochoa. 2018. Multimodal learning analytics: Assessing learners' mental state during the process of learning. The Handbook of Multimodal-Multisensor Interfaces: Signal Processing Architectures and Detection of Emotion and Cognition 2 (2018). 331374.","DOI":"10.1145\/3107990.3108003"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2883851.2883927"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2460296.2460351"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2567574.2567581"},{"key":"e_1_3_2_2_39_1","volume-title":"Well","author":"Rayner Keith","year":"2007","unstructured":"Keith Rayner , Xingshan Li , Carrick C. Williams , Kyle R. Cave , and Arnold D . Well . 2007 . Eye movements during information processing tasks: Individual differences and cultural effects. Vision Research 47, 21 (2007). 2714--2726. Keith Rayner, Xingshan Li, Carrick C. Williams, Kyle R. Cave, and Arnold D. Well. 2007. Eye movements during information processing tasks: Individual differences and cultural effects. Vision Research 47, 21 (2007). 2714--2726."},{"key":"e_1_3_2_2_40_1","volume-title":"Proceedings of the 11th International Conference on Educational Data Mining. 333339","author":"Reilly Joseph","year":"2018","unstructured":"Joseph Reilly , Milan Ravenell , and Bertrand Schneider . 2018 . Exploring collaboration using motion sensors and multi-modal learning analytics . In Proceedings of the 11th International Conference on Educational Data Mining. 333339 . Joseph Reilly, Milan Ravenell, and Bertrand Schneider. 2018. Exploring collaboration using motion sensors and multi-modal learning analytics. In Proceedings of the 11th International Conference on Educational Data Mining. 333339."},{"key":"e_1_3_2_2_41_1","article-title":"Play in the museum: Design and development of a game-based learning exhibit for informal science education","volume":"9","author":"Rowe Jonathan P.","year":"2017","unstructured":"Jonathan P. Rowe , Eleni V. Lobene , Bradford W. Mott , and James C. Lester . 2017 . Play in the museum: Design and development of a game-based learning exhibit for informal science education . International Journal of Gaming and ComputerMediated Simulations 9 , 3 (2017). 96--113. Jonathan P. Rowe, Eleni V. Lobene, Bradford W. Mott, and James C. Lester. 2017. Play in the museum: Design and development of a game-based learning exhibit for informal science education. International Journal of Gaming and ComputerMediated Simulations 9, 3 (2017). 96--113.","journal-title":"International Journal of Gaming and ComputerMediated Simulations"},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3079628.3079686"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1111\/bjet.12854"},{"key":"e_1_3_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3375462.3375498"},{"key":"e_1_3_2_2_45_1","doi-asserted-by":"crossref","unstructured":"Michelle Taub Robert Sawyer Andy Smith Jonathan Rowe Roger Azevedo and James Lester. 2020. The agency effect: The impact of student agency on learning emotions and problem-solving behaviors in a game-based learning environment. Computers & Education 147 (2020).  Michelle Taub Robert Sawyer Andy Smith Jonathan Rowe Roger Azevedo and James Lester. 2020. The agency effect: The impact of student agency on learning emotions and problem-solving behaviors in a game-based learning environment. Computers & Education 147 (2020).","DOI":"10.1016\/j.compedu.2019.103781"},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242969.3264984"},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2014.2316163"},{"key":"e_1_3_2_2_48_1","volume-title":"Proceedings of the 14th Artificial Intelligence and Interactive Digital Entertainment Conference. 243249","author":"Wiggins Joseph","year":"2018","unstructured":"Joseph Wiggins , Mayank Kulkarni , Wookhee Min , Bradford Mott , Kristy Boyer , Eric Wiebe , and James Lester . 2018 . Affect-based early prediction of player mental demand and engagement for educational games . In Proceedings of the 14th Artificial Intelligence and Interactive Digital Entertainment Conference. 243249 . Joseph Wiggins, Mayank Kulkarni, Wookhee Min, Bradford Mott, Kristy Boyer, Eric Wiebe, and James Lester. 2018. Affect-based early prediction of player mental demand and engagement for educational games. In Proceedings of the 14th Artificial Intelligence and Interactive Digital Entertainment Conference. 243249."},{"key":"e_1_3_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818346.2820737"},{"key":"e_1_3_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1111\/jcal.12247"}],"event":{"name":"ICMI '20: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION","location":"Virtual Event Netherlands","acronym":"ICMI '20","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2020 International Conference on Multimodal Interaction"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3382507.3418890","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3382507.3418890","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:02:49Z","timestamp":1750197769000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3382507.3418890"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,21]]},"references-count":50,"alternative-id":["10.1145\/3382507.3418890","10.1145\/3382507"],"URL":"https:\/\/doi.org\/10.1145\/3382507.3418890","relation":{},"subject":[],"published":{"date-parts":[[2020,10,21]]},"assertion":[{"value":"2020-10-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}