{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T15:57:18Z","timestamp":1780588638257,"version":"3.54.1"},"reference-count":19,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2022,12,6]],"date-time":"2022-12-06T00:00:00Z","timestamp":1670284800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["2020R1A4A1017775"],"award-info":[{"award-number":["2020R1A4A1017775"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Facial emotion recognition (FER) systems are imperative in recent advanced artificial intelligence (AI) applications to realize better human\u2013computer interactions. Most deep learning-based FER systems have issues with low accuracy and high resource requirements, especially when deployed on edge devices with limited computing resources and memory. To tackle these problems, a lightweight FER system, called Light-FER, is proposed in this paper, which is obtained from the Xception model through model compression. First, pruning is performed during the network training to remove the less important connections within the architecture of Xception. Second, the model is quantized to half-precision format, which could significantly reduce its memory consumption. Third, different deep learning compilers performing several advanced optimization techniques are benchmarked to further accelerate the inference speed of the FER system. Lastly, to experimentally demonstrate the objectives of the proposed system on edge devices, Light-FER is deployed on NVIDIA Jetson Nano.<\/jats:p>","DOI":"10.3390\/s22239524","type":"journal-article","created":{"date-parts":[[2022,12,6]],"date-time":"2022-12-06T02:55:39Z","timestamp":1670295339000},"page":"9524","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Light-FER: A Lightweight Facial Emotion Recognition System on Edge Devices"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8751-7229","authenticated-orcid":false,"given":"Alexander M.","family":"Pascual","sequence":"first","affiliation":[{"name":"Department of Aeronautics, Mechanical and Electronic Convergence Engineering, Kumoh National Institute of Technology, Gumi 39177, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Erick C.","family":"Valverde","sequence":"additional","affiliation":[{"name":"Department of Aeronautics, Mechanical and Electronic Convergence Engineering, Kumoh National Institute of Technology, Gumi 39177, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeong-in","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Aeronautics, Mechanical and Electronic Convergence Engineering, Kumoh National Institute of Technology, Gumi 39177, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9313-6860","authenticated-orcid":false,"given":"Jin-Woo","family":"Jeong","sequence":"additional","affiliation":[{"name":"Department of Data Science, Seoul National University of Science and Technology, Seoul 01811, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8871-1979","authenticated-orcid":false,"given":"Yuchul","family":"Jung","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Kumoh National Institute of Technology, Gumi 39177, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0599-289X","authenticated-orcid":false,"given":"Sang-Ho","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, Kumoh National Institute of Technology, Gumi 39177, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2533-3496","authenticated-orcid":false,"given":"Wansu","family":"Lim","sequence":"additional","affiliation":[{"name":"Department of Aeronautics, Mechanical and Electronic Convergence Engineering, Kumoh National Institute of Technology, Gumi 39177, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2626","DOI":"10.3389\/fpsyg.2019.02626","article-title":"Development and validation of the yonsei face database (yface db)","volume":"10","author":"Chung","year":"2019","journal-title":"Front. Psychol."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ranjan, R., and Sahana, B.C. (2019, January 10\u201312). An efficient facial feature extraction method based supervised classification model for human facial emotion identification. Proceedings of the ISSPIT, Ajman, United Arab Emirates.","DOI":"10.1109\/ISSPIT47144.2019.9001839"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Pranav, E., Kamal, S., Chandran, C.S., and Supriya, M. (2020, January 6\u20137). Facial emotion recognition using deep convolutional neural network. Proceedings of the ICACCS, Coimbatore, India.","DOI":"10.1109\/ICACCS48705.2020.9074302"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ozdemir, M.A., Elagoz, B., Soy, A.A., and Akan, A. (2020, January 19\u201320). Deep learning based facial emotion recognition system. Proceedings of the TIPTEKNO, Antalya, Turkey.","DOI":"10.1109\/TIPTEKNO50054.2020.9299256"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TIM.2020.3031835","article-title":"Facial Expression Recognition Using Local Gravitational Force Descriptor-Based Deep Convolution Neural Networks","volume":"70","author":"Mohan","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"9125","DOI":"10.1007\/s00521-020-05676-y","article-title":"FER-net: Facial expression recognition using deep neural net","volume":"33","author":"Mohan","year":"2021","journal-title":"Neural Comput. Appl."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2058","DOI":"10.1109\/TAFFC.2022.3208309","article-title":"FLEPNet: Feature Level Ensemble Parallel Network for Facial Expression Recognition","volume":"13","author":"Karnati","year":"2022","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1499","DOI":"10.1109\/LSP.2016.2603342","article-title":"Joint face detection and alignment using multitask cascaded convolutional networks","volume":"23","author":"Zhang","year":"2016","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Kowalski, M., Naruniec, J., and Trzcinski, T. (2017, January 21\u201326). Deep alignment network: A convolutional neural network for robust face alignment. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.254"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Liu, Y., Xu, Z., Ding, L., Jia, J., and Wu, X. (2021, January 16\u201318). Automatic assessment of facial paralysis based on facial landmarks. Proceedings of the 2021 IEEE 2nd International Conference on Pattern Recognition and Machine Learning (PRML), Chengdu, China.","DOI":"10.1109\/PRML52754.2021.9520746"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Yang, H., Gui, S., Zhu, Y., and Liu, J. (2020, January 13\u201319). Automatic neural network compression by sparsity-quantization joint learning: A constrained optimization-based approach. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00225"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"568","DOI":"10.1109\/TPAMI.2018.2886192","article-title":"Deep Neural Network Compression by In-Parallel Pruning-Quantization","volume":"42","author":"Tung","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Cai, Y., Li, H., Yuan, G., Niu, W., Li, Y., Tang, X., Ren, B., and Wang, Y. (2020). Yolobile: Real-Time Object Detection on Mobile Devices Via Compression-Compilation Co-Design. arXiv.","DOI":"10.1609\/aaai.v35i2.16179"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"5573","DOI":"10.1109\/ACCESS.2020.3046715","article-title":"A lightweight convolutional neural network for realtime facial expression detection","volume":"9","author":"Zhou","year":"2020","journal-title":"IEEE Access"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zeng, G., Zhou, J., Jia, X., Xie, W., and Shen, L. (2018, January 15\u201319). Hand-crafted feature guided deep learning for facial expression recognition. Proceedings of the 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), Xi\u2019an, China.","DOI":"10.1109\/FG.2018.00068"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wang, H., and Hou, S. (2020, January 17\u201319). Facial expression recognition based on the fusion of cnn and sift features. Proceedings of the 2020 IEEE 10th International Conference on Electronics Information and Emergency Communication (ICEIEC), Beijing, China.","DOI":"10.1109\/ICEIEC49280.2020.9152361"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Mollahosseini, A., Chan, D., and Mahoor, M.H. (2016, January 7\u201310). Going deeper in facial expression recognition using deep neural networks. Proceedings of the 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Placid, NY, USA.","DOI":"10.1109\/WACV.2016.7477450"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Liu, K., Zhang, M., and Pan, Z. (2016, January 28\u201330). Facial expression recognition with cnn ensemble. Proceedings of the 2016 International Conference on Cyberworlds (CW), Chongqing, China.","DOI":"10.1109\/CW.2016.34"},{"key":"ref_19","unstructured":"Fang, Y. (2021, January 18\u201320). Research on face recognition algorithm based on convolutional nerve. Proceedings of the International Conference on Artificial Intelligence and Industrial Technology Applications (AIITA), Nanchang, China."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/23\/9524\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:34:47Z","timestamp":1760146487000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/23\/9524"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,6]]},"references-count":19,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["s22239524"],"URL":"https:\/\/doi.org\/10.3390\/s22239524","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,6]]}}}