{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T21:35:13Z","timestamp":1776116113553,"version":"3.50.1"},"reference-count":96,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2020,9,4]],"date-time":"2020-09-04T00:00:00Z","timestamp":1599177600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2020,9,4]]},"abstract":"<jats:p>The study of student engagement has attracted growing interests to address problems such as low academic performance, disaffection, and high dropout rates. Existing approaches to measuring student engagement typically rely on survey-based instruments. While effective, those approaches are time-consuming and labour-intensive. Meanwhile, both the response rate and quality of the survey are usually poor. As an alternative, in this paper, we investigate whether we can infer and predict engagement at multiple dimensions, just using sensors. We hypothesize that multidimensional student engagement level can be translated into physiological responses and activity changes during the class, and also be affected by the environmental changes. Therefore, we aim to explore the following questions: Can we measure the multiple dimensions of high school student's learning engagement including emotional, behavioural and cognitive engagement with sensing data in the wild? Can we derive the activity, physiological, and environmental factors contributing to the different dimensions of student learning engagement? If yes, which sensors are the most useful in differentiating each dimension of the engagement? Then, we conduct an in-situ study in a high school from 23 students and 6 teachers in 144 classes over 11 courses for 4 weeks. We present the n-Gage, a student engagement sensing system using a combination of sensors from wearables and environments to automatically detect student in-class multidimensional learning engagement. Extensive experiment results show that n-Gage can accurately predict multidimensional student engagement in real-world scenarios with an average mean absolute error (MAE) of 0.788 and root mean square error (RMSE) of 0.975 using all the sensors. We also show a set of interesting findings of how different factors (e.g., combinations of sensors, school subjects, CO2 level) affect each dimension of the student learning engagement.<\/jats:p>","DOI":"10.1145\/3411813","type":"journal-article","created":{"date-parts":[[2020,9,4]],"date-time":"2020-09-04T21:39:45Z","timestamp":1599255585000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":47,"title":["n-Gage"],"prefix":"10.1145","volume":"4","author":[{"given":"Nan","family":"Gao","sequence":"first","affiliation":[{"name":"RMIT University, Melbourne, Australia"}]},{"given":"Wei","family":"Shao","sequence":"additional","affiliation":[{"name":"RMIT University, Melbourne, Australia"}]},{"given":"Mohammad Saiedur","family":"Rahaman","sequence":"additional","affiliation":[{"name":"RMIT University, Melbourne, Australia"}]},{"given":"Flora D.","family":"Salim","sequence":"additional","affiliation":[{"name":"RMIT University, Melbourne, Australia"}]}],"member":"320","published-online":{"date-parts":[[2020,9,4]]},"reference":[{"key":"e_1_2_2_1_1","first-page":"71","article-title":"EduSense: Practical classroom sensing at Scale","volume":"3","author":"Dohyun Kim Karan Ahuja","year":"2019","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_2_2_1","volume-title":"GSR and HRV: Its Application in Clinical Diagnosis. In 16th IEEE Symposium Computer-Based Medical Systems, 2003. Proceedings. IEEE, 279--283","author":"Ahuja Nutan D","year":"2003"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.4324\/9780203880340"},{"key":"e_1_2_2_4_1","volume-title":"Heart Rate Variability as an Index of Regulated Emotional Responding. Review of general psychology 10, 3","author":"Appelhans Bradley M","year":"2006"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsp.2006.04.002"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027385.3029434"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2011.178"},{"key":"e_1_2_2_8_1","volume-title":"Noise reduction in speech processing","author":"Benesty Jacob"},{"key":"e_1_2_2_9_1","volume-title":"EEG Correlates of Task Engagement and Mental Workload in Vigilance, Learning, and Memory Tasks. Aviation, space, and environmental medicine 78, 5","author":"Berka Chris","year":"2007"},{"key":"e_1_2_2_10_1","volume-title":"Developing the Theory of Formative Assessment. Educational Assessment, Evaluation and Accountability (formerly: Journal of Personnel Evaluation in Education) 21, 1","author":"Black Paul","year":"2009"},{"key":"e_1_2_2_11_1","volume-title":"Automated Physiological-based Detection of Mind Wandering During Learning. In International Conference on Intelligent Tutoring Systems. Springer, 55--60","author":"Blanchard Nathaniel","year":"2014"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-1126-0"},{"key":"e_1_2_2_13_1","volume-title":"Gamification and student motivation. Interactive learning environments 24, 6","author":"Buckley Patrick","year":"2016"},{"key":"e_1_2_2_14_1","volume-title":"Handbook of Psychophysiology","author":"Cacioppo John T"},{"key":"e_1_2_2_15_1","unstructured":"A John Camm Marek Malik J Thomas Bigger G\u00fcnter Breithardt Sergio Cerutti Richard J Cohen Philippe Coumel Ernest L Fallen Harold L Kennedy RE Kleiger etal 1996. Heart Rate Variability: Standards of Measurement physiological interpretation and clinical use. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. (1996).  A John Camm Marek Malik J Thomas Bigger G\u00fcnter Breithardt Sergio Cerutti Richard J Cohen Philippe Coumel Ernest L Fallen Harold L Kennedy RE Kleiger et al. 1996. Heart Rate Variability: Standards of Measurement physiological interpretation and clinical use. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. (1996)."},{"key":"e_1_2_2_16_1","volume-title":"SENSORS","author":"Canento Filipe","year":"2011"},{"key":"e_1_2_2_17_1","volume-title":"Ensuring Fair and Reliable Measures of Effective Teaching: Culminating Findings from the MET Project's Three-year Study. MET Project Research Paper","author":"Cantrell Steven","year":"2013"},{"key":"e_1_2_2_18_1","volume-title":"Root Mean Square Error (RMSE) or Mean Absolute Error (MAE)?-Arguments Against Avoiding RMSE in the Literature. Geoscientific model development 7, 3","author":"Chai Tianfeng","year":"2014"},{"key":"e_1_2_2_19_1","volume-title":"Yeon Hee Ryu, and Ji-Eun Park.","author":"Choi Kwang-Ho","year":"2017"},{"key":"e_1_2_2_20_1","volume-title":"Margaret Beale Spencer, and J Lawrence Aber","author":"Connell James Patrick","year":"1994"},{"key":"e_1_2_2_21_1","volume-title":"The Role of Cognitive Engagement in Classroom Learning and Motivation. Educational psychologist 18, 2","author":"Corno Lyn","year":"1983"},{"key":"e_1_2_2_22_1","volume-title":"Engaging Schools: Fostering High School Students' Motivation to Learn","author":"National Research Council et al.","year":"2003"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1177\/107385840200800209"},{"key":"e_1_2_2_24_1","volume-title":"EdMedia+ Innovate Learning","author":"Cronk Marguerite"},{"key":"e_1_2_2_25_1","volume-title":"Thermal Comfort in Naturally Ventilated Buildings: Revisions to ASHRAE Standard 55. Energy and buildings 34, 6","author":"De Dear Richard J","year":"2002"},{"key":"e_1_2_2_26_1","unstructured":"Shohreh Deldari Jonathan Liono Flora D Salim and Daniel V Smith. 2019. Inferring Work Routines and Behavior Deviations with Life-logging Sensor Data. (2019).  Shohreh Deldari Jonathan Liono Flora D Salim and Daniel V Smith. 2019. Inferring Work Routines and Behavior Deviations with Life-logging Sensor Data. (2019)."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3264913"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2656.2008.01390.x"},{"key":"e_1_2_2_29_1","doi-asserted-by":"crossref","unstructured":"Rebecca Eynon. 2015. The Quantified Self for Learning: Critical Questions for Education.  Rebecca Eynon. 2015. The Quantified Self for Learning: Critical Questions for Education.","DOI":"10.1080\/17439884.2015.1100797"},{"key":"e_1_2_2_30_1","volume-title":"Predicting Individual Thermal Comfort Using Machine Learning Algorithms. In 2015 IEEE International Conference on Automation Science and Engineering (CASE). IEEE, 708--713","author":"Farhan Asma Ahmad","year":"2015"},{"key":"e_1_2_2_31_1","volume-title":"Withdrawing from School. Review of educational research 59, 2","author":"Finn Jeremy D","year":"1989"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1086\/461853"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.82.2.221"},{"key":"e_1_2_2_34_1","volume-title":"School Engagement: Potential of the Concept, State of the Evidence. Review of educational research 74, 1","author":"Fredricks Jennifer A","year":"2004"},{"key":"e_1_2_2_35_1","volume-title":"Handbook of research on student engagement","author":"Fredricks Jennifer A"},{"key":"e_1_2_2_36_1","volume-title":"The Elements of Statistical Learning","author":"Friedman Jerome"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0205828"},{"key":"e_1_2_2_38_1","volume-title":"Jun Zhai, Klaus David, and Flora D Salim.","author":"Gao Nan","year":"2020"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2019.2913751"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.4108\/icst.mobihealth.2014.257418"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3314400"},{"key":"e_1_2_2_42_1","first-page":"797","article-title":"cvxEDA: A Convex Optimization Approach to Electrodermal Activity Processing","volume":"63","author":"Greco Alberto","year":"2015","journal-title":"IEEE Transactions on Biomedical Engineering"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1002\/tl.20287"},{"key":"e_1_2_2_44_1","volume-title":"The Power of Feedback. Review of educational research 77, 1","author":"Hattie John","year":"2007"},{"key":"e_1_2_2_45_1","volume-title":"Association Between Substandard Classroom Ventilation Rates and Students' Academic Achievement. Indoor air 21, 2","author":"Haverinen-Shaughnessy Ulla","year":"2011"},{"key":"e_1_2_2_46_1","volume-title":"Skin Temperature Reveals the Intensity of Acute Stress. Physiology & behavior 152","author":"Herborn Katherine A","year":"2015"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632048.2636065"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-019-09228-5"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3191745"},{"key":"e_1_2_2_50_1","volume-title":"Shichao Liu, and Jacob Whitehill.","author":"Jiang Han","year":"2019"},{"key":"e_1_2_2_51_1","unstructured":"Kane. 2020. What are Safe Levels of CO and CO2 in Rooms? https:\/\/www.kane.co.uk\/knowledge-centre\/what-are-safe-levels-of-co-and-co2-in-rooms Accessed 2020-07-08.  Kane. 2020. What are Safe Levels of CO and CO2 in Rooms? https:\/\/www.kane.co.uk\/knowledge-centre\/what-are-safe-levels-of-co-and-co2-in-rooms Accessed 2020-07-08."},{"key":"e_1_2_2_52_1","volume-title":"Lightgbm: A Highly Efficient Gradient Boosting Decision Tree. In Advances in Neural Information Processing Systems. 3146--3154.","author":"Ke Guolin","year":"2017"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359260"},{"key":"e_1_2_2_54_1","volume-title":"Ardeshir Mahdavi, Mohammad Saiedur Rahaman, Flora D Salim, et al.","author":"Kj\u00e6rgaard Mikkel B","year":"2020"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979210"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0056935"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1093\/poq\/nfn050"},{"key":"e_1_2_2_58_1","volume-title":"Student Engagement in Instructional Activity: Patterns in the Elementary, Middle, and High school years. American educational research journal 37, 1","author":"Marks Helen M","year":"2000"},{"key":"e_1_2_2_59_1","volume-title":"What is Student Engagement and Why is it Important. Retrieved May 4","author":"Martin Jonathan","year":"2016"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.5408\/13-111.1"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.17077\/drivingassessment.1451"},{"key":"e_1_2_2_62_1","volume-title":"Assessing Autonomic Nervous System Activity. Methods in social neuroscience","author":"Mendes Wendy Berry","year":"2009"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2016.2515084"},{"key":"e_1_2_2_64_1","doi-asserted-by":"crossref","unstructured":"KA Moore and L Lippman. 2005. Conceptualizing and Measuring Indicators of positive Development: What do Children Need to Flourish.  KA Moore and L Lippman. 2005. Conceptualizing and Measuring Indicators of positive Development: What do Children Need to Flourish.","DOI":"10.1007\/b100487"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351233"},{"key":"e_1_2_2_66_1","volume-title":"Python: A Guide for data scientists. \" O'Reilly Media","author":"M\u00fcller Andreas C","year":"2016"},{"key":"e_1_2_2_67_1","volume-title":"Cognitive Behavior Evaluation Based on Physiological Parameters Among Young Healthy Subjects with Yoga as Intervention. Computational and mathematical methods in medicine 2015","author":"Nagendra H","year":"2015"},{"key":"e_1_2_2_68_1","volume-title":"Sensitivity and Diagnosticity of the 0.1-Hz component of Heart Rate Variability as an Indicator of Mental Workload. Human factors 45, 4","author":"Nickel Peter","year":"2003"},{"key":"e_1_2_2_69_1","unstructured":"World Health Organization et al. 2007. Housing Energy and Thermal Comfort. A review of 10 (2007).  World Health Organization et al. 2007. Housing Energy and Thermal Comfort. A review of 10 (2007)."},{"key":"e_1_2_2_70_1","volume-title":"Applications of Regression Techniques","author":"Pal Manoranjan"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1177\/1088868316628405"},{"key":"e_1_2_2_72_1","volume-title":"8th AIVC Conference \"Ventilating healthy low-energy buildings\"","author":"Pawel Wargocki","year":"2017"},{"key":"e_1_2_2_73_1","volume-title":"Galvanic Skin Response and the Polygraph. BIOPAC Systems","author":"Pflanzer Richard","year":"2013"},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-0663.82.1.33"},{"key":"e_1_2_2_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979047"},{"key":"e_1_2_2_76_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2020.2996219"},{"key":"e_1_2_2_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/2330601.2330631"},{"key":"e_1_2_2_78_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmcj.2017.01.003"},{"key":"e_1_2_2_79_1","volume-title":"The Association Between Electrodermal Activity (EDA), Depression and Suicidal Behaviour: A Systematic Review and Narrative Synthesis. BMC psychiatry 18, 1","author":"Sarchiapone Marco","year":"2018"},{"key":"e_1_2_2_80_1","volume-title":"Is CO2 an Indoor Pollutant? Direct Effects of Low-to-moderate CO2 Cncentrations on Human Decision-making Performance. Environmental health perspectives 120, 12","author":"Satish Usha","year":"2012"},{"key":"e_1_2_2_81_1","volume-title":"Linear Regression Analysis","author":"Seber George AF"},{"key":"e_1_2_2_82_1","first-page":"1","article-title":"Dynamic Time Warping Algorithm Review. Information and Computer Science Department University of Hawaii at Manoa Honolulu","volume":"855","author":"Senin Pavel","year":"2008","journal-title":"USA"},{"key":"e_1_2_2_83_1","volume-title":"An Overview of Heart Rate Variability Metrics and Norms. Frontiers in public health 5","author":"Shaffer Fred","year":"2017"},{"key":"e_1_2_2_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/3347146.3359079"},{"key":"e_1_2_2_85_1","volume-title":"Applications of flow in human development and education","author":"Shernoff David J"},{"key":"e_1_2_2_86_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0012840"},{"key":"e_1_2_2_87_1","doi-asserted-by":"publisher","DOI":"10.1177\/0013164408323233"},{"key":"e_1_2_2_88_1","volume-title":"Development of achievement motivation","author":"Stipek Deborah"},{"key":"e_1_2_2_89_1","doi-asserted-by":"publisher","DOI":"10.1187\/cbe.13-06-0115"},{"key":"e_1_2_2_90_1","volume-title":"HeartPy: A Novel Heart Rate Algorithm for the Analysis of Noisy Signals. Transportation research part F: traffic psychology and behaviour 66","author":"van Gent Paul","year":"2019"},{"key":"e_1_2_2_91_1","doi-asserted-by":"publisher","DOI":"10.1111\/tops.12320"},{"key":"e_1_2_2_92_1","unstructured":"Chen Wang and Pablo Cesar. 2015. Physiological Measurement on Students' Engagement in a Distributed Learning Environment. In PhyCS. 149--156.  Chen Wang and Pablo Cesar. 2015. Physiological Measurement on Students' Engagement in a Distributed Learning Environment. In PhyCS. 149--156."},{"key":"e_1_2_2_93_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632048.2632054"},{"key":"e_1_2_2_94_1","doi-asserted-by":"publisher","DOI":"10.1145\/3264951"},{"key":"e_1_2_2_95_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267242.3267263"},{"key":"e_1_2_2_96_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ecolmodel.2007.10.005"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411813","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3411813","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:48Z","timestamp":1750195488000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411813"}},"subtitle":["Predicting in-class Emotional, Behavioural and Cognitive Engagement in the Wild"],"short-title":[],"issued":{"date-parts":[[2020,9,4]]},"references-count":96,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,9,4]]}},"alternative-id":["10.1145\/3411813"],"URL":"https:\/\/doi.org\/10.1145\/3411813","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,4]]},"assertion":[{"value":"2020-09-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}