{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T18:28:30Z","timestamp":1773512910141,"version":"3.50.1"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,7,26]],"date-time":"2022-07-26T00:00:00Z","timestamp":1658793600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,7,26]],"date-time":"2022-07-26T00:00:00Z","timestamp":1658793600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100014718","name":"Innovative Research Group Project of the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61972282"],"award-info":[{"award-number":["61972282"]}],"id":[{"id":"10.13039\/100014718","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2023,2]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Timely feedback of students\u2019 listening status is crucial for teaching work. However, it is often difficult for teachers to pay attention to all students at the same time. By leveraging surveillance cameras in the classroom, we are able to assist the teaching work. However, the existing methods either lack the protection of students\u2019 privacy, or they have to reduce the accuracy of success, because they are concerned about the leakage of students\u2019 privacy. We propose federated semi-supervised class assistance system to evaluate the listening status of students in the classroom. Rather than training the semi-supervised model in a centralized manner, we train a semi-supervised model in a federated manner among various monitors while preserving students\u2019 privacy. We also formulate a new loss function according to the difference between the pre-trained initial model and the expected model to restrict the training process of the unlabeled data. By applying the pseudo-label assignment method on the unlabeled data, the class monitors are able to recognize the student class behavior. In addition, simulation and real-world experimental results demonstrate that the performance of the proposed system outperforms that of the baseline models.<\/jats:p>","DOI":"10.1007\/s40747-022-00796-5","type":"journal-article","created":{"date-parts":[[2022,7,26]],"date-time":"2022-07-26T07:02:48Z","timestamp":1658818968000},"page":"597-608","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["A privacy-preserving student status monitoring system"],"prefix":"10.1007","volume":"9","author":[{"given":"Haopeng","family":"Wu","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3445-8637","authenticated-orcid":false,"given":"Zhiying","family":"Lu","sequence":"additional","affiliation":[]},{"given":"Jianfeng","family":"Zhang","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,7,26]]},"reference":[{"key":"796_CR1","first-page":"1","volume":"20","author":"H Khaled","year":"2021","unstructured":"Khaled H, Abu-Elnasr O, Elmougy S, Tolba A (2021) Intelligent system for human activity recognition in IoT environment. Compl Intell Syst 20:1\u201312","journal-title":"Compl Intell Syst"},{"key":"796_CR2","doi-asserted-by":"crossref","unstructured":"Pu Y, Wang C, Wu W (2020) A deep reinforcement learning framework for instructional sequencing. In: 2020 IEEE international conference on big data (Big Data), pp 5201\u20135208. IEEE","DOI":"10.1109\/BigData50022.2020.9378463"},{"key":"796_CR3","doi-asserted-by":"crossref","unstructured":"Min W, Frankosky MH, Mott BW, Rowe JP, Wiebe E, Boyer KE, Lester JC (2015) Deepstealth: leveraging deep learning models for stealth assessment in game-based learning environments. In: International conference on artificial intelligence in education. Springer, pp 277\u2013286","DOI":"10.1007\/978-3-319-19773-9_28"},{"key":"796_CR4","first-page":"1889","volume-title":"Advanced materials research","author":"Y Yu","year":"2014","unstructured":"Yu Y, Wang JH (2014) The study on the key technologies in multiple agent-based intelligent tutoring system. Advanced materials research, vol 846. Trans Tech Publ, New York, pp 1889\u20131892"},{"issue":"1","key":"796_CR5","first-page":"2641","volume":"28","author":"C Zhang","year":"2017","unstructured":"Zhang C (2017) Research on teaching evaluation system based on data mining. Agro Food Indu Hi-Tech 28(1):2641\u20132645","journal-title":"Agro Food Indu Hi-Tech"},{"key":"796_CR6","doi-asserted-by":"publisher","first-page":"3152676","DOI":"10.1007\/978-3-319-57959-7","volume-title":"The EU general data protection regulation (GDPR). A practical guide","author":"P Voigt","year":"2017","unstructured":"Voigt P, Von dem Bussche A (2017) The EU general data protection regulation (GDPR). A practical guide, vol 10, 1st edn. Springer, Cham, p 3152676","edition":"1"},{"key":"796_CR7","doi-asserted-by":"crossref","unstructured":"Wu Z, Wang Z, Wang Z, Jin H (2018) Towards privacy-preserving visual recognition via adversarial training: a pilot study. In: Proceedings of the European conference on computer vision (ECCV), pp 606\u2013624","DOI":"10.1007\/978-3-030-01270-0_37"},{"key":"796_CR8","doi-asserted-by":"crossref","unstructured":"Butler DJ, Huang J, Roesner F, Cakmak M (2015) The privacy-utility tradeoff for remotely teleoperated robots. In: Proceedings of the tenth annual ACM\/IEEE international conference on human-robot interaction, pp 27\u201334","DOI":"10.1145\/2696454.2696484"},{"key":"796_CR9","doi-asserted-by":"crossref","unstructured":"Dai J, Saghafi B, Wu J, Konrad J, Ishwar P (2015) Towards privacy-preserving recognition of human activities. In: 2015 IEEE international conference on image processing (ICIP). IEEE, pp 4238\u20134242","DOI":"10.1109\/ICIP.2015.7351605"},{"key":"796_CR10","doi-asserted-by":"crossref","unstructured":"Ryoo MS, Rothrock B, Fleming C, Yang HJ (2017) Privacy-preserving human activity recognition from extreme low resolution. In: Thirty-first AAAI conference on artificial intelligence","DOI":"10.1609\/aaai.v31i1.11233"},{"key":"796_CR11","doi-asserted-by":"crossref","unstructured":"Tu L (2019) Analysis and prediction method of student behavior mining based on campus big data. In: International conference on advanced hybrid information processing. Springer, pp 363\u2013371","DOI":"10.1007\/978-3-030-36405-2_36"},{"key":"796_CR12","first-page":"1","volume":"20","author":"C Zhao","year":"2021","unstructured":"Zhao C, Keyak JH, Tang J, Kaneko TS, Khosla S, Amin S, Atkinson EJ, Zhao L-J, Serou MJ, Zhang C et al (2021) St-v-net: incorporating shape prior into convolutional neural networks for proximal femur segmentation. Complex Intell Syst 20:1\u201312","journal-title":"Complex Intell Syst"},{"key":"796_CR13","volume-title":"Handbook of research on machine learning applications and trends: algorithms, methods, and techniques: algorithms, methods, and techniques","author":"ES Olivas","year":"2009","unstructured":"Olivas ES, Guerrero JDM, Martinez-Sober M, Magdalena-Benedito JR, Serrano L (2009) Handbook of research on machine learning applications and trends: algorithms, methods, and techniques: algorithms, methods, and techniques. IGI Global, Pennsylvania"},{"issue":"1","key":"796_CR14","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1109\/TAFFC.2014.2316163","volume":"5","author":"J Whitehill","year":"2014","unstructured":"Whitehill J, Serpell Z, Lin Y-C, Foster A, Movellan JR (2014) The faces of engagement: automatic recognition of student engagement from facial expressions. IEEE Trans Affect Comput 5(1):86\u201398","journal-title":"IEEE Trans Affect Comput"},{"key":"796_CR15","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2019.103797","volume":"148","author":"G Tongu\u00e7","year":"2020","unstructured":"Tongu\u00e7 G, Ozkara BO (2020) Automatic recognition of student emotions from facial expressions during a lecture. Comput Educ 148:103797","journal-title":"Comput Educ"},{"key":"796_CR16","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1016\/j.neucom.2019.07.039","volume":"363","author":"Y Li","year":"2019","unstructured":"Li Y, Wang Y, Li D (2019) Privacy-preserving lightweight face recognition. Neurocomputing 363:212\u2013222","journal-title":"Neurocomputing"},{"issue":"5","key":"796_CR17","doi-asserted-by":"publisher","first-page":"2545","DOI":"10.1109\/TIP.2017.2675341","volume":"26","author":"Y Gao","year":"2017","unstructured":"Gao Y, Ma J, Yuille AL (2017) Semi-supervised sparse representation based classification for face recognition with insufficient labeled samples. IEEE Trans Image Process 26(5):2545\u20132560","journal-title":"IEEE Trans Image Process"},{"key":"796_CR18","doi-asserted-by":"crossref","unstructured":"Zheng Z, Zheng L, Yang Y (2017) Unlabeled samples generated by gan improve the person re-identification baseline in vitro, 3754\u20133762","DOI":"10.1109\/ICCV.2017.405"},{"issue":"3","key":"796_CR19","doi-asserted-by":"publisher","first-page":"292","DOI":"10.3390\/electronics8030292","volume":"8","author":"MZ Alom","year":"2019","unstructured":"Alom MZ, Taha TM, Yakopcic C, Westberg S, Sidike P, Nasrin MS, Hasan M, Van Essen BC, Awwal AA, Asari VK (2019) A state-of-the-art survey on deep learning theory and architectures. Electronics 8(3):292","journal-title":"Electronics"},{"key":"796_CR20","doi-asserted-by":"crossref","unstructured":"Li Q, Han Z, Wu X-M (2018) Deeper insights into graph convolutional networks for semi-supervised learning. In: Thirty-second AAAI conference on artificial intelligence","DOI":"10.1609\/aaai.v32i1.11604"},{"key":"796_CR21","doi-asserted-by":"crossref","unstructured":"Nie F, Cai G, Li X (2017) Multi-view clustering and semi-supervised classification with adaptive neighbours. In: Thirty-first AAAI conference on artificial intelligence","DOI":"10.1609\/aaai.v31i1.10909"},{"issue":"4","key":"796_CR22","doi-asserted-by":"publisher","first-page":"1428","DOI":"10.3390\/app11041428","volume":"11","author":"H Wu","year":"2021","unstructured":"Wu H, Lu Z, Zhang J, Li X, Zhao M, Ding X (2021) Facial expression recognition based on multi-features cooperative deep convolutional network. Appl Sci 11(4):1428","journal-title":"Appl Sci"},{"issue":"8","key":"796_CR23","doi-asserted-by":"publisher","first-page":"1979","DOI":"10.1109\/TPAMI.2018.2858821","volume":"41","author":"T Miyato","year":"2018","unstructured":"Miyato T, Maeda S-I, Koyama M, Ishii S (2018) Virtual adversarial training: a regularization method for supervised and semi-supervised learning. IEEE Trans Pattern Anal Mach Intell 41(8):1979\u20131993","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"796_CR24","unstructured":"McMahan B, Moore E, Ramage D, Hampson S, y Arcas BA (2017) Communication-efficient learning of deep networks from decentralized data. In: Artificial intelligence and statistics, pp 1273\u20131282 PMLR"},{"issue":"6","key":"796_CR25","doi-asserted-by":"publisher","first-page":"1205","DOI":"10.1109\/JSAC.2019.2904348","volume":"37","author":"S Wang","year":"2019","unstructured":"Wang S, Tuor T, Salonidis T, Leung KK, Makaya C, He T, Chan K (2019) Adaptive federated learning in resource constrained edge computing systems. IEEE J Sel Areas Commun 37(6):1205\u20131221","journal-title":"IEEE J Sel Areas Commun"},{"issue":"9","key":"796_CR26","doi-asserted-by":"publisher","first-page":"3400","DOI":"10.1109\/TNNLS.2019.2944481","volume":"31","author":"F Sattler","year":"2019","unstructured":"Sattler F, Wiedemann S, M\u00fcller K-R, Samek W (2019) Robust and communication-efficient federated learning from non-iid data. IEEE Trans Neural Netw Learn Syst 31(9):3400\u20133413","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"796_CR27","doi-asserted-by":"crossref","unstructured":"Hara K, Kataoka H, Satoh Y (2018) Can spatiotemporal 3d cnns retrace the history of 2d cnns and imagenet? In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 6546\u20136555","DOI":"10.1109\/CVPR.2018.00685"},{"key":"796_CR28","unstructured":"Laine S, Aila T (2016) Temporal ensembling for semi-supervised learning. arXiv:1610.02242 (arXiv preprint)"},{"key":"796_CR29","first-page":"1163","volume":"29","author":"M Sajjadi","year":"2016","unstructured":"Sajjadi M, Javanmardi M, Tasdizen T (2016) Regularization with stochastic transformations and perturbations for deep semi-supervised learning. Adv Neural Inf Process Syst 29:1163\u20131171","journal-title":"Adv Neural Inf Process Syst"},{"key":"796_CR30","unstructured":"Berthelot D, Carlini N, Goodfellow I, Papernot N, Oliver A, Raffel C (2019) Mixmatch: a holistic approach to semi-supervised learning. arXiv:1905.02249 (arXiv preprint)"},{"key":"796_CR31","doi-asserted-by":"crossref","unstructured":"Abuduweili A, Li X, Shi H, Xu C-Z, Dou D (2021) Adaptive consistency regularization for semi-supervised transfer learning. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 6923\u20136932","DOI":"10.1109\/CVPR46437.2021.00685"},{"key":"796_CR32","doi-asserted-by":"crossref","unstructured":"Borgwardt KM, Gretton A, Rasch MJ, Kriegel H-P, Sch\u00f6lkopf B, Smola AJ (2006) Integrating structured biological data by kernel maximum mean discrepancy. Bioinformatics 22(14):49\u201357","DOI":"10.1093\/bioinformatics\/btl242"},{"key":"796_CR33","doi-asserted-by":"crossref","unstructured":"Cao X, Jia J, Gong NZ (2021) Provably secure federated learning against malicious clients. In: Proceedings of the AAAI conference on artificial intelligence, vol 35, pp 6885\u20136893","DOI":"10.1609\/aaai.v35i8.16849"},{"key":"796_CR34","unstructured":"Haq S, Jackson PJ, Edge J (2008) Audio-visual feature selection and reduction for emotion classification. In: Proceedings of international conference on auditory-visual speech processing (AVSP\u201908), Tangalooma, Australia"},{"key":"796_CR35","unstructured":"Haq S, Jackson PJ, Edge J (2009) Speaker-dependent audio-visual emotion recognition. In: AVSP, pp 53\u201358"},{"key":"796_CR36","volume-title":"Machine audition: principles, algorithms and systems: principles, algorithms and systems","author":"W Wang","year":"2010","unstructured":"Wang W (2010) Machine audition: principles, algorithms and systems: principles, algorithms and systems. IGI Global, Pennsylvania"},{"key":"796_CR37","unstructured":"Loshchilov I, Hutter F (2016) Sgdr: Stochastic gradient descent with warm restarts. arXiv:1608.03983 (arXiv preprint)"},{"key":"796_CR38","unstructured":"Lee D-H (2013) Pseudo-label: The simple and efficient semi-supervised learning method for deep neural networks. In: Workshop on challenges in representation learning, ICML, vol 3, p 896"},{"key":"796_CR39","unstructured":"Tarvainen A, Valpola H (2017) Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results. arXiv:1703.01780 (arXiv preprint)"},{"key":"796_CR40","unstructured":"Hong Y (1994) College teachers are analyzed according to the \u201cclass hour ratio\u201d. Teacher Training Research (Z1), 2"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-022-00796-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-022-00796-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-022-00796-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,22]],"date-time":"2023-02-22T18:56:54Z","timestamp":1677092214000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-022-00796-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,26]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,2]]}},"alternative-id":["796"],"URL":"https:\/\/doi.org\/10.1007\/s40747-022-00796-5","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"value":"2199-4536","type":"print"},{"value":"2198-6053","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,26]]},"assertion":[{"value":"3 November 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 May 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 July 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"We declare that we have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}