{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T05:13:34Z","timestamp":1755839614696,"version":"3.44.0"},"reference-count":69,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2024,10,4]],"date-time":"2024-10-04T00:00:00Z","timestamp":1728000000000},"content-version":"vor","delay-in-days":372,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["Grant No. 2119589"],"award-info":[{"award-number":["Grant No. 2119589"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"name":"AI Research Institutes program by the National Science Foundation and the","award":["Award # 2229873"],"award-info":[{"award-number":["Award # 2229873"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2023,9,28]]},"abstract":"<jats:p>Learners' awareness of their own affective states (emotions) can improve their meta-cognition, which is a critical skill of being aware of and controlling one's cognitive, motivational, and affect, and adjusting their learning strategies and behaviors accordingly. To investigate the effect of peers' affects on learners' meta-cognition, we proposed two types of cues that aggregated peers' affects that were recognized via facial expression recognition:Locative cues (displaying the spikes of peers' emotions along a video timeline) andTemporal cues (showing the positivities of peers' emotions at different segments of a video). We conducted a between-subject experiment with 42 college students through the use of think-aloud protocols, interviews, and surveys. Our results showed that the two types of cues improved participants' meta-cognition differently. For example, interacting with theTemporal cues triggered the participants to compare their own affective responses with their peers and reflect more on why and how they had different emotions with the same video content. While the participants perceived the benefits of using AI-generated peers' cues to improve their awareness of their own learning affects, they also sought more explanations from their peers to understand the AI-generated results. Our findings not only provide novel design implications for promoting learners' meta-cognition with privacy-preserved social cues of peers' learning affects, but also suggest an expanded design framework for Explainable AI (XAI).<\/jats:p>","DOI":"10.1145\/3610079","type":"journal-article","created":{"date-parts":[[2023,10,4]],"date-time":"2023-10-04T15:54:10Z","timestamp":1696434850000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["MirrorUs: Mirroring Peers' Affective Cues to Promote Learner's Meta-Cognition in Video-based Learning"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0640-6883","authenticated-orcid":false,"given":"Si","family":"Chen","sequence":"first","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Champaign, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-3385-871X","authenticated-orcid":false,"given":"Jason","family":"Situ","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Urbana, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1535-1714","authenticated-orcid":false,"given":"Haocong","family":"Cheng","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Champaign, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-2251-6458","authenticated-orcid":false,"given":"Desir\u00e9e","family":"Kirst","sequence":"additional","affiliation":[{"name":"Gallaudet University, Washington, DC, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0399-8032","authenticated-orcid":false,"given":"Yun","family":"Huang","sequence":"additional","affiliation":[{"name":"University of Illinois at Urbana-Champaign, Champaign, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,10,4]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/HealthCom.2016.7749447"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.3389\/frai.2021.723447"},{"volume-title":"Informational environments","author":"Azevedo Roger","key":"e_1_2_1_3_1","unstructured":"Roger Azevedo, Michelle Taub, Nicholas V Mudrick, Garrett C Millar, Amanda E Bradbury, and Megan J Price. 2017. Using data visualizations to foster emotion regulation during self-regulated learning with advanced learning technologies. In Informational environments. Springer, 225--247."},{"key":"e_1_2_1_4_1","volume-title":"Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements. Psychological science in the public interest","author":"Barrett Lisa Feldman","year":"2019","unstructured":"Lisa Feldman Barrett, Ralph Adolphs, Stacy Marsella, Aleix M Martinez, and Seth D Pollak. 2019. Emotional expressions reconsidered: Challenges to inferring emotion from human facial movements. Psychological science in the public interest, Vol. 20, 1 (2019), 1--68."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3569475"},{"key":"e_1_2_1_6_1","volume-title":"Effects of emotional valence and arousal on the voice perception network. Social cognitive and affective neuroscience","author":"Bestelmeyer Patricia EG","year":"2017","unstructured":"Patricia EG Bestelmeyer, Sonja A Kotz, and Pascal Belin. 2017. Effects of emotional valence and arousal on the voice perception network. Social cognitive and affective neuroscience, Vol. 12, 8 (2017), 1351--1358."},{"key":"e_1_2_1_7_1","volume-title":"Exploring collaborative caption editing to augment video-based learning. Educational technology research and development","author":"Bhavya Bhavya","year":"2022","unstructured":"Bhavya Bhavya, Si Chen, Zhilin Zhang, Wenting Li, Chengxiang Zhai, Lawrence Angrave, and Yun Huang. 2022. Exploring collaborative caption editing to augment video-based learning. Educational technology research and development, Vol. 70, 5 (2022), 1755--1779."},{"key":"e_1_2_1_8_1","volume-title":"Using thematic analysis in psychology. Qualitative research in psychology","author":"Braun Virginia","year":"2006","unstructured":"Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology, Vol. 3, 2 (2006), 77--101."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1080\/13562517.2019.1698540"},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the ACM on Human-Computer Interaction","volume":"5","author":"Zana Bucc","year":"2021","unstructured":"Zana Bucc inca, Maja Barbara Malaya, and Krzysztof Z Gajos. 2021. To trust or to think: cognitive forcing functions can reduce overreliance on AI in AI-assisted decision-making. Proceedings of the ACM on Human-Computer Interaction, Vol. 5, CSCW1 (2021), 1--21."},{"volume-title":"New perspectives on affect and learning technologies","author":"Calvo Rafael A","key":"e_1_2_1_11_1","unstructured":"Rafael A Calvo and Sidney K D'Mello. 2011. New perspectives on affect and learning technologies. Vol. 3. Springer Science & Business Media."},{"key":"e_1_2_1_12_1","unstructured":"Stephane Champely. 2021. R package \"pwr\". http:\/\/cran.r-project.org\/web\/packages\/pwr\/ R package version 1.3."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11409-012-9086-z"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3563657.3595980"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3532106.3533500"},{"key":"e_1_2_1_16_1","volume-title":"Metacognition: New Research Developments (01","author":"Chiu Ming","year":"2009","unstructured":"Ming Chiu and S.W. Kuo. 2009. Social metacognition in groups: Benefits, difficulties, learning, and teaching. Metacognition: New Research Developments (01 2009), 117--136."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3154862.3154881"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2021.103503"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sbspro.2015.04.410"},{"volume-title":"Multitask Emotion Recognition with Incomplete Labels. In 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020)","author":"Deng Didan","key":"e_1_2_1_20_1","unstructured":"Didan Deng, Zhaokang Chen, and Bertram E Shi. [n.d.]. Multitask Emotion Recognition with Incomplete Labels. In 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020)(FG). IEEE Computer Society, 828--835."},{"key":"e_1_2_1_21_1","first-page":"197","article-title":"Towards systems that care: a conceptual framework based on motivation, metacognition and affect","volume":"20","author":"Boulay Benedict Du","year":"2010","unstructured":"Benedict Du Boulay, Katerina Avramides, Rosemary Luckin, Erika Mart'inez-Mir\u00f3n, Genaro Rebolledo M\u00e9ndez, and Amanda Carr. 2010. Towards systems that care: a conceptual framework based on motivation, metacognition and affect. International Journal of Artificial Intelligence in Education, Vol. 20, 3 (2010), 197--229.","journal-title":"International Journal of Artificial Intelligence in Education"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1177\/1754073917696583"},{"key":"e_1_2_1_23_1","volume-title":"Metacognition and affect: What can metacognitive experiences tell us about the learning process? Educational research review","author":"Efklides Anastasia","year":"2006","unstructured":"Anastasia Efklides. 2006. Metacognition and affect: What can metacognitive experiences tell us about the learning process? Educational research review, Vol. 1, 1 (2006), 3--14."},{"volume-title":"Motivation and affect in self-regulated learning: does metacognition play a role? In Handbook of self-regulation of learning and performance","author":"Efklides Anastasia","key":"e_1_2_1_24_1","unstructured":"Anastasia Efklides, Bennett L Schwartz, and Victoria Brown. 2017. Motivation and affect in self-regulated learning: does metacognition play a role? In Handbook of self-regulation of learning and performance. Routledge, 64--82."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445188"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2020.102411"},{"key":"e_1_2_1_27_1","volume-title":"DARMA: Software for dual axis rating and media annotation. Behavior research methods","author":"Girard Jeffrey M","year":"2018","unstructured":"Jeffrey M Girard and Aidan G C Wright. 2018. DARMA: Software for dual axis rating and media annotation. Behavior research methods, Vol. 50, 3 (2018), 902--909."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3512925"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW54120.2021.00423"},{"key":"e_1_2_1_30_1","volume-title":"Facilitating collaborative knowledge building. Cognition and instruction","author":"Hmelo-Silver Cindy E","year":"2008","unstructured":"Cindy E Hmelo-Silver and Howard S Barrows. 2008. Facilitating collaborative knowledge building. Cognition and instruction, Vol. 26, 1 (2008), 48--94."},{"key":"e_1_2_1_31_1","volume-title":"Olga C Santos, Mercedes T Rodrigo, Mutlu Cukurova, Ig Ibert Bittencourt, et al.","author":"Holmes Wayne","year":"2021","unstructured":"Wayne Holmes, Kaska Porayska-Pomsta, Ken Holstein, Emma Sutherland, Toby Baker, Simon Buckingham Shum, Olga C Santos, Mercedes T Rodrigo, Mutlu Cukurova, Ig Ibert Bittencourt, et al. 2021. Ethics of AI in education: Towards a community-wide framework. International Journal of Artificial Intelligence in Education (2021), 1--23."},{"key":"e_1_2_1_32_1","volume-title":"2013 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 1--6.","author":"Hsu Lun-Kai","year":"2013","unstructured":"Lun-Kai Hsu, Wen-Sheng Tseng, Li-Wei Kang, and Yu-Chiang Frank Wang. 2013. Seeing through the expression: Bridging the gap between expression and emotion recognition. In 2013 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 1--6."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-21869-9_19"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2020.104031"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517453"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.caeai.2022.100074"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379503.3403553"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3214273"},{"key":"e_1_2_1_39_1","volume-title":"Workshop on Artificial Intelligence in Education (AI-ED 2001","author":"Kort Barry","year":"2001","unstructured":"Barry Kort, Rob Reilly, and Rosalind W Picard. 2001. External representation of learning process and domain knowledge: Affective state as a determinate of its structure and function. In Workshop on Artificial Intelligence in Education (AI-ED 2001), San Antonio,(May 2001). 64--69."},{"volume-title":"Computer Graphics Forum","author":"Kucher Kostiantyn","key":"e_1_2_1_40_1","unstructured":"Kostiantyn Kucher, Carita Paradis, and Andreas Kerren. 2018. The state of the art in sentiment visualization. In Computer Graphics Forum, Vol. 37. Wiley Online Library, 71--96."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445294"},{"key":"e_1_2_1_42_1","volume-title":"Cognitive engagement in self-regulated learning: An integrative model. European Journal of Psychology of Education","author":"Li Shan","year":"2021","unstructured":"Shan Li and Susanne P Lajoie. 2021. Cognitive engagement in self-regulated learning: An integrative model. European Journal of Psychology of Education (2021), 1--20."},{"key":"e_1_2_1_43_1","volume-title":"Human-centered explainable ai (xai): From algorithms to user experiences. arXiv preprint arXiv:2110.10790","author":"Vera Liao Q","year":"2021","unstructured":"Q Vera Liao and Kush R Varshney. 2021. Human-centered explainable ai (xai): From algorithms to user experiences. arXiv preprint arXiv:2110.10790 (2021)."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517482"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292147.3293450"},{"key":"e_1_2_1_46_1","volume-title":"What is metacognition? Phi delta kappan","author":"Martinez Michael E","year":"2006","unstructured":"Michael E Martinez. 2006. What is metacognition? Phi delta kappan, Vol. 87, 9 (2006), 696--699."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445235"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10639-020-10229-w"},{"key":"e_1_2_1_49_1","volume-title":"A review of self-regulated learning: Six models and four directions for research. Frontiers in psychology","author":"Panadero Ernesto","year":"2017","unstructured":"Ernesto Panadero. 2017. A review of self-regulated learning: Six models and four directions for research. Frontiers in psychology, Vol. 8 (2017), 422."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445324"},{"key":"e_1_2_1_51_1","volume-title":"The use of AI in education: Practicalities and ethical considerations. London Review of Education","author":"Reiss Michael J","year":"2021","unstructured":"Michael J Reiss. 2021. The use of AI in education: Practicalities and ethical considerations. London Review of Education (2021)."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1093\/deafed\/enh009"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3476049"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0077714"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1093\/deafed\/enac037"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445615"},{"key":"e_1_2_1_57_1","volume-title":"AIP Conference Proceedings","volume":"2481","author":"Sharma Tanya","year":"2022","unstructured":"Tanya Sharma, Manoj Diwakar, and Chandrakala Arya. 2022. A systematic review on emotion recognition by using machine learning approaches. In AIP Conference Proceedings, Vol. 2481. AIP Publishing LLC, 020045."},{"key":"e_1_2_1_58_1","first-page":"1423","article-title":"A Review of Human Emotion Recognition","volume":"1","author":"Vaidya Kanchan S","year":"2022","unstructured":"Kanchan S Vaidya, Pradeep M Patil, and Mukil Alagirisamy. 2022. A Review of Human Emotion Recognition. Specialusis Ugdymas, Vol. 1, 43 (2022), 1423--1451.","journal-title":"Specialusis Ugdymas"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICME.2005.1521463"},{"volume-title":"A Review of Automatic Detection of Learner States in Four Typical Learning Scenarios","author":"Wang Guanfeng","key":"e_1_2_1_60_1","unstructured":"Guanfeng Wang, Chen Gong, and Shuxia Wang. 2022. A Review of Automatic Detection of Learner States in Four Typical Learning Scenarios. In Adaptive Instructional Systems, Robert A. Sottilare and Jessica Schwarz (Eds.). Springer International Publishing, Cham, 53--72."},{"key":"e_1_2_1_61_1","volume-title":"A short form of the metacognitions questionnaire: properties of the MCQ-30. Behaviour research and therapy","author":"Wells Adrian","year":"2004","unstructured":"Adrian Wells and Sam Cartwright-Hatton. 2004. A short form of the metacognitions questionnaire: properties of the MCQ-30. Behaviour research and therapy, Vol. 42, 4 (2004), 385--396."},{"key":"e_1_2_1_62_1","first-page":"3","article-title":"Social mirrors and shared experiential worlds","volume":"8","author":"Whitehead Charles","year":"2001","unstructured":"Charles Whitehead. 2001. Social mirrors and shared experiential worlds. Journal of consciousness studies, Vol. 8, 4 (2001), 3--36.","journal-title":"Journal of consciousness studies"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3329485"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3148330.3148344"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2014.106"},{"key":"e_1_2_1_66_1","first-page":"n3","article-title":"Creating a High Impact Learning Environment for Engineering Technology Students","volume":"6","author":"Zhan Wei","year":"2018","unstructured":"Wei Zhan, Jyhwen Wang, Manoj Vanajakumari, and Michael D Johnson. 2018. Creating a High Impact Learning Environment for Engineering Technology Students. Advances in Engineering Education, Vol. 6, 3 (2018), n3.","journal-title":"Advances in Engineering Education"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3090097"},{"key":"e_1_2_1_68_1","volume-title":"Self-regulated learning and academic achievement: An overview. Educational psychologist","author":"Zimmerman Barry J","year":"1990","unstructured":"Barry J Zimmerman. 1990. Self-regulated learning and academic achievement: An overview. Educational psychologist, Vol. 25, 1 (1990), 3--17."},{"key":"e_1_2_1_69_1","volume-title":"From cognitive modeling to self-regulation: A social cognitive career path. Educational psychologist","author":"Zimmerman Barry J","year":"2013","unstructured":"Barry J Zimmerman. 2013. From cognitive modeling to self-regulation: A social cognitive career path. Educational psychologist, Vol. 48, 3 (2013), 135--147."}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610079","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3610079","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3610079","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T04:19:04Z","timestamp":1755749944000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610079"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,28]]},"references-count":69,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2023,9,28]]}},"alternative-id":["10.1145\/3610079"],"URL":"https:\/\/doi.org\/10.1145\/3610079","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2023,9,28]]},"assertion":[{"value":"2023-10-04","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}