{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T06:23:49Z","timestamp":1792131829721,"version":"4.4.0"},"reference-count":44,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,9,26]],"date-time":"2023-09-26T00:00:00Z","timestamp":1695686400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurorobot."],"abstract":"<jats:p>Human behavior recognition plays a crucial role in the field of smart education. It offers a nuanced understanding of teaching and learning dynamics by revealing the behaviors of both teachers and students. In this study, to address the exigencies of teaching behavior analysis in smart education, we first constructed a teaching behavior analysis dataset called EuClass. EuClass contains 13 types of teacher\/student behavior categories and provides multi-view, multi-scale video data for the research and practical applications of teacher\/student behavior recognition. We also provide a teaching behavior analysis network containing an attention-based network and an intra-class differential representation learning module. The attention mechanism uses a two-level attention module encompassing spatial and channel dimensions. The intra-class differential representation learning module utilized a unified loss function to reduce the distance between features. Experiments conducted on the EuClass dataset and a widely used action\/gesture recognition dataset, IsoGD, demonstrate the effectiveness of our method in comparison to current state-of-the-art methods, with the recognition accuracy increased by 1\u20132% on average.<\/jats:p>","DOI":"10.3389\/fnbot.2023.1276208","type":"journal-article","created":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T02:49:35Z","timestamp":1695782975000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Multi-view and multi-scale behavior recognition algorithm based on attention mechanism"],"prefix":"10.3389","volume":"17","author":[{"given":"Di","family":"Zhang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chen","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fa","family":"Tan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Beibei","family":"Qian","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xuan","family":"He","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Susan","family":"Lei","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2023,9,26]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"6299","DOI":"10.1109\/CVPR.2017.502","article-title":"Quo vadis, action recognition? A new model and the kinetics dataset","volume":"2017","author":"Carreira","year":"2017","journal-title":"Proc. IEEE Conf. Comp. Vision Pattern Recog."},{"key":"B2","doi-asserted-by":"publisher","first-page":"2405","DOI":"10.3390\/s22062405","article-title":"Multi-scale attention 3D convolutional network for multimodal gesture recognition","volume":"22","author":"Chen","year":"2022","journal-title":"Sensors."},{"key":"B3","doi-asserted-by":"publisher","first-page":"13728","DOI":"10.1109\/CVPR46437.2021.01352","article-title":"\u201cRepVGG: making VGG-style ConvNets great again 2021,\u201d","author":"Ding","year":"2021","journal-title":"IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)"},{"key":"B4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3131343","article-title":"unified framework for multi-modal isolated gesture recognition","volume":"14","author":"Duan","year":"2018","journal-title":"ACM Trans. Multim. Comput. Commun. Appl."},{"key":"B5","author":"Fan","year":"2023","journal-title":"SCB-dataset: a dataset for detecting student classroom behavior. Comput. Vision Pattern Recog."},{"key":"B6","first-page":"206","article-title":"\u201cLearning behavior analysis in classroom based on deep learning 2019,\u201d","author":"Fu","year":"2019","journal-title":"Tenth International Conference on Intelligent Control and Information Processing (ICICIP)"},{"key":"B7","first-page":"4230","article-title":"\u201cSelf-supervised learning of visual features through embedding images into text topic spaces,\u201d","author":"Gomez","year":"2017","journal-title":"IEEE Conference on Computer Vision and Pattern Recognition IEEE Computer Society"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1155\/2022\/5736407","article-title":"Analysis of art classroom teaching behavior based on intelligent image recognition","author":"Gu","year":"2022","journal-title":"Mobile Inform. Syst"},{"key":"B9","doi-asserted-by":"publisher","first-page":"3525266","DOI":"10.1155\/2022\/3525266","article-title":"System analysis of the learning behavior recognition system for students in a law classroom: based on the improved SSD behavior recognition algorithm","volume":"2022","author":"Guo","year":"2022","journal-title":"Sci. Program"},{"key":"B10","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4614-7138-7","volume-title":"An Introduction to Statistical Learning","author":"James","year":"2013"},{"key":"B11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2021\/6336773","article-title":"Convolutional neural network (CNN) based approach for the recognition and evaluation of classroom teaching behavior","volume":"2021","author":"Li","year":"2021","journal-title":"Sci. Program"},{"key":"B12","article-title":"\u201cLearning robust representations with information bottleneck and memory network for RGB-D-based gesture recognition,\u201d","author":"Li","year":"","journal-title":"IEEE International Conference on Computer Vision"},{"key":"B13","first-page":"3276","article-title":"\u201cLAP-Net:level-aware progressive network for image dehazing,\u201d","volume-title":"2019 IEEE\/CVF International Conference on Computer Vision (ICCV)","author":"Li","year":""},{"key":"B14","doi-asserted-by":"publisher","first-page":"875","DOI":"10.1007\/s00138-018-0996-x","article-title":"A spatiotemporal attention-based ResC3D model for large-scale gesture recognition","volume":"30","author":"Li","year":"","journal-title":"Mach. Vis. Appl."},{"key":"B15","doi-asserted-by":"publisher","first-page":"2956","DOI":"10.1109\/TCSVT.2017.2749509","article-title":"Large-scale gesture recognition with a fusion of RGB-D data based on saliency theory and C3D model","volume":"28","author":"Li","year":"2018","journal-title":"IEEE Trans. Circ. Syst. Video Technol."},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2023.3295811","article-title":"\u201cSeeking a hierarchical prototype for multimodal gesture recognition,\u201d","author":"Li","year":"","journal-title":"IEEE Trans. Neural Netw. Learn. Syst"},{"key":"B17","first-page":"52","article-title":"\u201cLarge-scale isolated gesture recognition using a refined fused model based on masked res-c3d network and skeleton lstm,\u201d","author":"Lin","year":"2018","journal-title":"IEEE International Conference on Automatic Face and Gesture Recognition"},{"key":"B18","doi-asserted-by":"publisher","first-page":"314","DOI":"10.3390\/s21165314","article-title":"Student behavior recognition system for the classroom environment based on skeleton pose estimation and person detection","volume":"21","author":"Lin","year":"2021","journal-title":"Sensors"},{"key":"B19","doi-asserted-by":"publisher","first-page":"3047","DOI":"10.1109\/ICCVW.2017.360","article-title":"Multimodal gesture recognition based on the resc3d network","volume":"2017","author":"Miao","year":"2017","journal-title":"Proc. IEEE Int. Conf. Comp. Vision Workshops"},{"key":"B20","doi-asserted-by":"publisher","first-page":"820","DOI":"10.1016\/j.future.2021.06.045","article-title":"Human action recognition using attention based LSTM network with dilated CNN features","volume":"125","author":"Muhammad","year":"2021","journal-title":"Future Gen. Comp. Syst."},{"key":"B21","first-page":"2006","article-title":"\u201cLearning 3D action models from a few 2D videos for view invariant action recognition,\u201d","author":"Natarajan","year":"2010","journal-title":"San Francisco, USA, Proc. of the IEEE Conference on Computer Vision and Pattern Recognition"},{"key":"B22","author":"Qian","year":"2021","journal-title":"Enhancing Self-supervised Video Representation Learning via Multi-level Feature Optimization"},{"key":"B23","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1007\/s11263-010-0384-0","article-title":"Human action segmentation and recognition using discriminative semi-Markov models","volume":"93","author":"Shi","year":"2011","journal-title":"Int. J. Comput. Vis."},{"key":"B24","doi-asserted-by":"publisher","first-page":"108339","DOI":"10.1016\/j.nanoen.2023.108339","article-title":"Self-powered difunctional sensors based on sliding contact-electrification and tribovoltaic effects for pneumatic monitoring and controlling","volume":"110","author":"Shi","year":"","journal-title":"Nano Energy"},{"key":"B25","doi-asserted-by":"publisher","first-page":"110001","DOI":"10.1016\/j.ymssp.2022.110001","article-title":"Center-based transfer feature learning with classifier adaptation for surface defect recognition","volume":"188","author":"Shi","year":"","journal-title":"Mech. Syst. Signal Proces"},{"key":"B26","doi-asserted-by":"publisher","first-page":"8335","DOI":"10.1007\/s00521-020-05587-y","article-title":"Student class behavior dataset: a video dataset for recognizing, detecting, and captioning students' behaviors in classroom scenes","volume":"33","author":"Sun","year":"2021","journal-title":"Neural Comput. Applic."},{"key":"B27","doi-asserted-by":"publisher","first-page":"6790","DOI":"10.3390\/app12136790","article-title":"Classroom behavior detection based on improved YOLOv5 algorithm combining multi-scale feature fusion and attention mechanism","volume":"12","author":"Tang","year":"2022","journal-title":"Appl. Sci."},{"key":"B28","doi-asserted-by":"publisher","first-page":"2023552","DOI":"10.3934\/mbe.2023552","article-title":"Arc fault detection using artificial intelligence: challenges and benefits","volume":"20","author":"Tian","year":"2023","journal-title":"Math. Biosci. Eng"},{"key":"B29","doi-asserted-by":"publisher","first-page":"4232","DOI":"10.3390\/s22114232","article-title":"A fuzzy similarity-based approach to classify numerically simulated and experimentally detected carbon fiber-reinforced polymer plate defects","volume":"22","author":"Versaci","year":"2022","journal-title":"Sensors"},{"key":"B30","doi-asserted-by":"publisher","first-page":"2648","DOI":"10.1109\/TMM.2021.3086758","article-title":"LAGA-Net: local-and-global attention network for skeleton based action recognition","volume":"24","author":"Xia","year":"2022","journal-title":"IEEE Trans. Multimed."},{"key":"B31","doi-asserted-by":"publisher","first-page":"38","DOI":"10.18280\/ts.380109","article-title":"Abnormal behavior recognition in classroom pose estimation of college students based on spatiotemporal representation learning","volume":"1","author":"Xie","year":"2021","journal-title":"Traitement du Signal Signal Image Parole."},{"key":"B32","doi-asserted-by":"publisher","first-page":"107433","DOI":"10.1016\/j.asoc.2021.107433","article-title":"Video salient object detection using dual-stream spatiotemporal attention","volume":"108","author":"Xu","year":"2021","journal-title":"Appl. Soft. Comput"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298789","article-title":"A discriminative CNN video representation for event detection","author":"Xu","year":"2014","journal-title":"arXiv preprint"},{"key":"B34","doi-asserted-by":"publisher","first-page":"107218","DOI":"10.1016\/j.knosys.2021.107218","article-title":"Adaptive crossover operator-based multi-objective binary genetic algorithm for feature selection in classification","volume":"3","author":"Xue","year":"2021","journal-title":"Knowledge-Based Syst."},{"key":"B35","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1109\/CVPR.1992.223161","article-title":"Recognizing human action in time-sequential images using hidden markov model","volume":"1992","author":"Yamato","year":"1992","journal-title":"Comp. Vision Pattern Recog"},{"key":"B36","first-page":"84","article-title":"\u201cGlobal and local spatial-attention network for isolated gesture recognition,\u201d","volume-title":"Biometric Recognition. CCBR 2019. Lecture Notes in Computer Science","author":"Yuan","year":"2019"},{"key":"B37","article-title":"Attention in convolutional LSTM for gesture, recognition","author":"Zhang","year":"2018","journal-title":"Adv. Neural Inform. Process. Syst"},{"key":"B38","doi-asserted-by":"crossref","first-page":"3120","DOI":"10.1109\/ICCVW.2017.369","article-title":"\u201cLearning spatiotemporal features using 3DCNN and convolutional LSTM for gesture recognition\/\/2017,\u201d","volume-title":"IEEE International Conference on Computer Vision Workshops (ICCVW).","author":"Zhang","year":"2017"},{"key":"B39","article-title":"\u201cClassroom behavior recognition based on improved yolov3 2020,\u201d","volume-title":"International Conference on Artificial Intelligence and Education (ICAIE)","author":"Zhang","year":"2020"},{"key":"B40","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10489-021-02329-y","article-title":"A simple teacher behavior recognition method for massive teaching videos based on teacher set","volume":"51","author":"Zhao","year":"2021","journal-title":"Appl. Intellig"},{"key":"B41","doi-asserted-by":"publisher","first-page":"110040","DOI":"10.1016\/j.asoc.2023.110040","article-title":"EGNN Graph structure learning based on evolutionary computation helps more in graph neural networks","volume":"135","author":"Zhaowei","year":"2023","journal-title":"Appl. Soft. Comp. J"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i4.16471","article-title":"Regional attention with architecture-rebuilt 3D network for RGB-D gesture recognition","author":"Zhou","year":"2021","journal-title":"arXiv."},{"key":"B43","doi-asserted-by":"publisher","first-page":"1323","DOI":"10.1109\/TNNLS.2019.2919764","article-title":"Redundancy and attention in convolutional LSTM for gesture recognition","volume":"31","author":"Zhu","year":"2019","journal-title":"IEEE Trans. Neural. Netw. Learn. Syst."},{"key":"B44","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1016\/j.procs.2018.08.069","article-title":"Edge detection in MRI brain tumor images based on fuzzy C-means clustering","volume":"126","author":"Zotin","year":"2018","journal-title":"Proc. Comp. Sci"}],"container-title":["Frontiers in Neurorobotics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2023.1276208\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T02:49:41Z","timestamp":1695782981000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2023.1276208\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,26]]},"references-count":44,"alternative-id":["10.3389\/fnbot.2023.1276208"],"URL":"https:\/\/doi.org\/10.3389\/fnbot.2023.1276208","relation":{},"ISSN":["1662-5218"],"issn-type":[{"value":"1662-5218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,26]]},"article-number":"1276208"}}