{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:08:46Z","timestamp":1760144926184,"version":"build-2065373602"},"reference-count":29,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2024,6,3]],"date-time":"2024-06-03T00:00:00Z","timestamp":1717372800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62277029","20YJC880100","2022010801010274","CCNU22JC011","22YJC880061"],"award-info":[{"award-number":["62277029","20YJC880100","2022010801010274","CCNU22JC011","22YJC880061"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Humanities and Social Sciences of China MOE (Ministry of Education)","award":["62277029","20YJC880100","2022010801010274","CCNU22JC011","22YJC880061"],"award-info":[{"award-number":["62277029","20YJC880100","2022010801010274","CCNU22JC011","22YJC880061"]}]},{"name":"Knowledge Innovation Program of Wuhan -Basic Research","award":["62277029","20YJC880100","2022010801010274","CCNU22JC011","22YJC880061"],"award-info":[{"award-number":["62277029","20YJC880100","2022010801010274","CCNU22JC011","22YJC880061"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["62277029","20YJC880100","2022010801010274","CCNU22JC011","22YJC880061"],"award-info":[{"award-number":["62277029","20YJC880100","2022010801010274","CCNU22JC011","22YJC880061"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Humanities and Social Sciences Youth Foundation, Ministry of Education of the People\u2019s Republic of China","award":["62277029","20YJC880100","2022010801010274","CCNU22JC011","22YJC880061"],"award-info":[{"award-number":["62277029","20YJC880100","2022010801010274","CCNU22JC011","22YJC880061"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Cognitive engagement involves mental and physical involvement, with observable behaviors as indicators. Automatically measuring cognitive engagement can offer valuable insights for instructors. However, object occlusion, inter-class similarity, and intra-class variance make designing an effective detection method challenging. To deal with these problems, we propose the Object-Enhanced\u2013You Only Look Once version 8 nano (OE-YOLOv8n) model. This model employs the YOLOv8n framework with an improved Inner Minimum Point Distance Intersection over Union (IMPDIoU) Loss to detect cognitive engagement. To evaluate the proposed methodology, we construct a real-world Students\u2019 Cognitive Engagement (SCE) dataset. Extensive experiments on the self-built dataset show the superior performance of the proposed model, which improves the detection performance of the five distinct classes with a precision of 92.5%.<\/jats:p>","DOI":"10.3390\/s24113609","type":"journal-article","created":{"date-parts":[[2024,6,3]],"date-time":"2024-06-03T10:06:01Z","timestamp":1717409161000},"page":"3609","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Occlusion Robust Cognitive Engagement Detection in Real-World Classroom"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2730-033X","authenticated-orcid":false,"given":"Guangrun","family":"Xiao","sequence":"first","affiliation":[{"name":"School of Mechanical Engineering, Hubei University of Arts and Science, Xiangyang 441053, China"},{"name":"Hubei Key Laboratory of Digital Education, Central China Normal University, Wuhan 430079, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2912-5694","authenticated-orcid":false,"given":"Qi","family":"Xu","sequence":"additional","affiliation":[{"name":"Hubei Key Laboratory of Digital Education, Central China Normal University, Wuhan 430079, China"},{"name":"Faculty of Artificial Intelligence in Education, Central China Normal University, Wuhan 430079, China"}]},{"given":"Yantao","family":"Wei","sequence":"additional","affiliation":[{"name":"Hubei Key Laboratory of Digital Education, Central China Normal University, Wuhan 430079, China"},{"name":"Faculty of Artificial Intelligence in Education, Central China Normal University, Wuhan 430079, China"}]},{"given":"Huang","family":"Yao","sequence":"additional","affiliation":[{"name":"Faculty of Artificial Intelligence in Education, Central China Normal University, Wuhan 430079, China"}]},{"given":"Qingtang","family":"Liu","sequence":"additional","affiliation":[{"name":"Hubei Key Laboratory of Digital Education, Central China Normal University, Wuhan 430079, China"},{"name":"Faculty of Artificial Intelligence in Education, Central China Normal University, Wuhan 430079, China"}]}],"member":"1968","published-online":{"date-parts":[[2024,6,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1007\/s11218-007-9024-0","article-title":"Classroom discourse and the distribution of student engagement","volume":"10","author":"Kelly","year":"2007","journal-title":"Soc. Psychol. Educ."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1007\/s10648-019-09514-z","article-title":"Attentive or not? Toward a machine learning approach to assessing students\u2019 visible engagement in classroom instruction","volume":"33","author":"Goldberg","year":"2021","journal-title":"Educ. Psychol. Rev."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1080\/00461520.2014.965823","article-title":"The ICAP framework: Linking cognitive engagement to active learning outcomes","volume":"49","author":"Chi","year":"2014","journal-title":"Educ. Psychol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"59","DOI":"10.3102\/00346543074001059","article-title":"School engagement: Potential of the concept, state of the evidence","volume":"74","author":"Fredricks","year":"2004","journal-title":"Rev. Educ. Res."},{"key":"ref_5","unstructured":"Olney, A.M., Risko, E.F., D\u2019Mello, S.K., and Graesser, A.C. (2015). Attention in Educational Contexts: The Role of the Learning Task in Guiding Attention, MIT Press. Grantee Submission."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1111\/bjet.13048","article-title":"Learning by explaining to oneself and a peer enhances learners\u2019 theta and alpha oscillations while watching video lectures","volume":"52","author":"Pi","year":"2021","journal-title":"Br. J. Educ. Technol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1111\/bjet.12572","article-title":"Students\u2019 insights on the use of video lectures in online classes","volume":"50","author":"Scagnoli","year":"2019","journal-title":"Br. J. Educ. Technol."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Chen, H., Zhou, G., and Jiang, H. (2023). Student Behavior Detection in the Classroom Based on Improved YOLOv8. Sensors, 23.","DOI":"10.3390\/s23208385"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"136063","DOI":"10.1109\/ACCESS.2023.3337435","article-title":"ICAPD Framework and simAM-YOLOv8n for Student Cognitive Engagement Detection in Classroom","volume":"11","author":"Xu","year":"2023","journal-title":"IEEE Access"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"104482","DOI":"10.1016\/j.cognition.2020.104482","article-title":"Validity of attention self-reports in younger and older adults","volume":"206","author":"Arnicane","year":"2021","journal-title":"Cognition"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1146\/annurev-psych-010814-015331","article-title":"The science of mind wandering: Empirically navigating the stream of consciousness","volume":"66","author":"Smallwood","year":"2015","journal-title":"Annu. Rev. Psychol."},{"key":"ref_12","unstructured":"Guhan, P., Agarwal, M., Awasthi, N., Reeves, G., Manocha, D., and Bera, A. (2020). ABC-Net: Semi-supervised multimodal GAN-based engagement detection using an affective, behavioral and cognitive model. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"104114","DOI":"10.1016\/j.compedu.2020.104114","article-title":"Automated detection of cognitive engagement to inform the art of staying engaged in problem-solving","volume":"163","author":"Li","year":"2021","journal-title":"Comput. Educ."},{"key":"ref_14","unstructured":"Salam, H., Celiktutan, O., Gunes, H., and Chetouani, M. (2023). IEEE Transactions on Affective Computing, IEEE."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"D\u2019Mello, S. (2017). Handbook of Learning Analytics, Society for Learning Analytics Research (SoLAR).","DOI":"10.18608\/hla17.010"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"104461","DOI":"10.1016\/j.compedu.2022.104461","article-title":"Automated detection of emotional and cognitive engagement in MOOC discussions to predict learning achievement","volume":"181","author":"Liu","year":"2022","journal-title":"Comput. Educ."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ringeval, F., Sonderegger, A., Sauer, J., and Lalanne, D. (2013, January 22\u201326). Introducing the RECOLA multimodal corpus of remote collaborative and affective interactions. Proceedings of the 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), Shanghai, China.","DOI":"10.1109\/FG.2013.6553805"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Chen, H., and Guan, J. (2022). Teacher\u2013student behavior recognition in classroom teaching based on improved YOLO-v4 and Internet of Things technology. Electronics, 11.","DOI":"10.3390\/electronics11233998"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-019-0197-0","article-title":"A survey on image data augmentation for deep learning","volume":"6","author":"Shorten","year":"2019","journal-title":"J. Big Data"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Miko\u0142ajczyk, A., and Grochowski, M. (2018, January 9\u201312). Data augmentation for improving deep learning in image classification problem. Proceedings of the 2018 International Interdisciplinary PhD Workshop (IIPhDW), Swinoujscie, Poland.","DOI":"10.1109\/IIPHDW.2018.8388338"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1613\/jair.953","article-title":"SMOTE: Synthetic minority over-sampling technique","volume":"16","author":"Chawla","year":"2002","journal-title":"J. Artif. Intell. Res."},{"key":"ref_23","unstructured":"DeVries, T., and Taylor, G.W. (2017). Improved regularization of convolutional neural networks with cutout. arXiv."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"119268","DOI":"10.1016\/j.ins.2023.119268","article-title":"Improvement Accuracy in Deep Learning: An Increasing Neurons Distance Approach with the Penalty Term of Loss Function","volume":"644","author":"Hu","year":"2023","journal-title":"Inf. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., and Savarese, S. (2019, January 15\u201320). Generalized intersection over union: A metric and a loss for bounding box regression. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00075"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zheng, Z., Wang, P., Liu, W., Li, J., Ye, R., and Ren, D. (2020, January 7\u201312). Distance-IoU loss: Faster and better learning for bounding box regression. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i07.6999"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/j.neucom.2022.07.042","article-title":"Focal and efficient IOU loss for accurate bounding box regression","volume":"506","author":"Zhang","year":"2022","journal-title":"Neurocomputing"},{"key":"ref_28","unstructured":"Siliang, M., and Yong, X. (2023). MPDIoU: A loss for efficient and accurate bounding box regression. arXiv."},{"key":"ref_29","unstructured":"Zhang, H., Xu, C., and Zhang, S. (2023). Inner-IoU: More Effective Intersection over Union Loss with Auxiliary Bounding Box. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/11\/3609\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:53:03Z","timestamp":1760107983000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/11\/3609"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,3]]},"references-count":29,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["s24113609"],"URL":"https:\/\/doi.org\/10.3390\/s24113609","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2024,6,3]]}}}