{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T16:10:03Z","timestamp":1778083803606,"version":"3.51.4"},"reference-count":46,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2023,3,7]],"date-time":"2023-03-07T00:00:00Z","timestamp":1678147200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Science and Technology, Taiwan","award":["MOST 111-2221-E-008-089-MY3"],"award-info":[{"award-number":["MOST 111-2221-E-008-089-MY3"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>With the outbreak of COVID-19, epidemic prevention has become a way to prevent the spread of epidemics. Many public places, such as hospitals, schools, and office places, require disinfection and temperature measurement. To implement epidemic prevention systems and reduce the risk of infection, it is a recent trend to measure body temperature through non-contact sensing systems with thermal imaging cameras. Compared to fingerprints and irises, face recognition is accurate and does not require close contact, which significantly reduces the risk of infection. However, masks block most facial features, resulting in the low accuracy of face recognition systems. This work combines masked face recognition with a thermal imaging camera for use as an automated attendance system. It can record body temperature and recognize the person at the same time. Through the designed UI system, we can search the attendance information of each person. We not only provide the design method based on convolutional neural networks (CNNs), but also provide the complete embedded system as a real demonstration and achieve a 94.1% accuracy rate of masked face recognition in the real world. With the face recognition system combined with a thermal imaging camera, the purpose of screening body temperature when checking in at work can be achieved.<\/jats:p>","DOI":"10.3390\/s23062901","type":"journal-article","created":{"date-parts":[[2023,3,8]],"date-time":"2023-03-08T02:08:14Z","timestamp":1678241294000},"page":"2901","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Joint Masked Face Recognition and Temperature Measurement System Using Convolutional Neural Networks"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7524-0621","authenticated-orcid":false,"given":"Tsung-Han","family":"Tsai","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, National Central University, No.300, Jung-Da Rd., Taoyuan City 320317, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ji-Xiu","family":"Lu","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Central University, No.300, Jung-Da Rd., Taoyuan City 320317, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuan-Yu","family":"Chou","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Central University, No.300, Jung-Da Rd., Taoyuan City 320317, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chieng-Yang","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Central University, No.300, Jung-Da Rd., Taoyuan City 320317, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zainal, N.I., Sidek, K.A., Gunawan, T.S., Manser, H., and Kartiwi, M. (2014, January 17\u201318). Design and development of portable classroom attendance system based on Arduino and fingerprint biometric. Proceedings of the 5th International Conference on Information and Communication Technology for the Muslim World (ICT4M), Kuching, Malaysia.","DOI":"10.1109\/ICT4M.2014.7020601"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Lukas, S., Mitra, A.R., Desanti, R.I., and Krisnadi, D. (2016, January 19\u201321). Student attendance system in classroom using face recognition technique. Proceedings of the 2016 International Conference on Information and Communication Technology Convergence (ICTC), Jeju, Republic of Korea.","DOI":"10.1109\/ICTC.2016.7763360"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Bhattacharya, S., Nainala, G.S., Das, P., and Routray, A. (2018, January 9\u201313). Smart attendance monitoring system (SAMS): A face recognition based attendance system for classroom environment. Proceedings of the 2018 IEEE 18th International Conference on Advanced Learning Technologies (ICALT), Mumbai, India.","DOI":"10.1109\/ICALT.2018.00090"},{"key":"ref_4","first-page":"1097","article-title":"Imagenet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Liu, W., Wen, Y., Yu, Z., Li, M., Raj, B., and Song, L. (2017, January 21\u201326). SphereFace: Deep Hypersphere Embedding for Face Recognition. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.713"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wang, H., Wang, Y., Zhou, Z., Ji, X., Gong, D., Zhou, J., Li, Z., and Liu, W. (2018, January 18\u201323). CosFace: Large Margin Cosine Loss for Deep Face Recognition. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00552"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully Convolutional Networks for Semantic Segmentation. Proceedings of the Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Noh, H., Hong, S., and Han, B. (2015, January 7\u201313). Learning Deconvolution Network for Semantic Segmentation. Proceedings of the Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.178"},{"key":"ref_9","unstructured":"Sun, Y., Wang, X., and Tang, X. (2014). Deep Learning Face Representation by Joint Identification-Verification. arXiv."},{"key":"ref_10","unstructured":"Sun, Y., Liang, D., Wang, X., and Tang, X. (2015). DeepID3: Face Recognition with Very Deep Neural Networks. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Ngan, M.L., Grother, P.J., and Hanaoka, K.K. (2020). Ongoing Face Recognition Vendor Test (FRVT) Part 6A: Face Recognition Accuracy with Masks Using Pre-COVID-19 Algorithms, National Institute of Standards and Technology. NIST Interagency\/Internal Report (NISTIR).","DOI":"10.6028\/NIST.IR.8331"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Alzu\u2019bi, A., Albalas, F., AL-Hadhrami, T., Younis, L.B., and Bashayreh, A. (2021). Masked face recognition using deep learning: A review. Electronics, 10.","DOI":"10.3390\/electronics10212666"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Cao, Q., Shen, L., Xie, W., Parkhi, O.M., and Zisserman, A. (2018, January 15\u201319). VGGFace2: A Dataset for Recognising Faces across Pose and Age. Proceedings of the 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), Xi\u2019an, China.","DOI":"10.1109\/FG.2018.00020"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7\u201312). FaceNet: A unified embedding for face recognition and clustering. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"ref_15","unstructured":"Huang, G.B., Ramesh, M., Berg, T., and Miller, E.L. (2007). Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments, TR of University of Massachusetts."},{"key":"ref_16","unstructured":"Anwar, A., and Raychowdhury, A. (2020). Masked Face Recognition for Secure Authentication. arXiv."},{"key":"ref_17","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of Oriented Gradients for Human Detection. Proceedings of the IEEE Conference Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lowe, D.G. (1999, January 20\u201325). Object Recognition from Local Scale-Invariant Features. Proceedings of the International Conference on Computer Vision, Kerkyra, Corfu, Greece.","DOI":"10.1109\/ICCV.1999.790410"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/34.982883","article-title":"Detecting faces in images: A survey","volume":"24","author":"Yang","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_20","unstructured":"Zhang, Z., and Zhang, C. (2010). A Survey of Recent Advances in Face Detection, Microsoft. Microsoft Research Technical Report."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Li, H., Lin, Z., Shen, X., Brandt, J., and Hua, G. (2015, January 7\u201312). A Convolutional Neural Network Cascade for Face Detection. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299170"},{"key":"ref_22","unstructured":"(2018, April 09). FDDB:Main. Available online: http:\/\/vis-www.cs.umass.edu\/fddb\/index.html."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2013, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast R-CNN. Proceedings of the International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE Conference Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016, January 11\u201314). SSD: Single shot multibox detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_28","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21\u201326). Feature pyramid networks for object detection. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_30","unstructured":"Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wang, C.-Y., Liao, H.-Y.M., Wu, Y.-H., Chen, P.-Y., Hsieh, J.-W., and Yeh, I.-H. (2020, January 14\u201319). CSPNet: A new backbone that can enhance learning capability of CNN. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00203"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1904","DOI":"10.1109\/TPAMI.2015.2389824","article-title":"Spatial pyramid pooling in deep convolutional networks for visual recognition","volume":"37","author":"He","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Liu, S., Qi, L., Qin, H., Shi, J., and Jia, J. (2018, January 18\u201323). Path aggregation network for instance segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00913"},{"key":"ref_34","unstructured":"Qi, D., Tan, W., Yao, Q., and Liu, J. (2021). YOLO5Face: Why Reinventing a Face Detector. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhang, S., Zhu, X., Lei, Z., Shi, H., Wang, X., and Li, S.Z. (2017, January 22\u201329). S^3FD: Single Shot Scale-invariant Face Detector. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.30"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Najibi, M., Samangouei, P., Chellappa, R., and Davis, L.S. (2017, January 22\u201329). SSH: Single Stage Headless Face Detector. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.522"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Li, J., Wang, Y., Wang, C., Tai, Y., Qian, J., Yang, J., Wang, C., Li, J., and Huang, F. (2019, January 15\u201320). DSFD: Dual Shot Face Detector. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00520"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Taigman, Y., Yang, M., and Ranzato, M.A. (2014, January 23\u201328). Deepface: Closing the gap to human-level performance in face verification. Proceedings of the CVPR IEEE Conference, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.220"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Wen, Y., Zhang, K., Li, Z., and Qiao, Y. (2016, January 11\u201314). A discriminative feature learning approach for deep face recognition. Proceedings of the 14th European Conference, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46478-7_31"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Masi, I., Wu, Y., Hassner, T., and Natarajan, P. (2018\u20131, January 29). Deep face recognition: A survey. Proceedings of the 31st SIBGRAPI conference on Graphics, Patterns and Images (SIBGRAPI), Parana, Brazil.","DOI":"10.1109\/SIBGRAPI.2018.00067"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Deng, J., Guo, J., Xue, N., and Zafeiriou, S. (2019, January 15\u201320). Arcface: Additive angular margin loss for deep face recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00482"},{"key":"ref_42","unstructured":"Wang, Z., Wang, G., Huang, B., Xiong, Z., Hong, Q., Wu, H., Yi, P., Jiang, K., Wang, N., and Pei, Y. (2020). Masked face recognition dataset and application. arXiv."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Huang, B., Wang, Z., Wang, G., Jiang, K., Zeng, K., Han, Z., Tian, X., and Yang, Y. (2021, January 6\u201311). When Face Recognition Meets Occlusion: A New Benchmark. Proceedings of the ICASSP 2021\u20132021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada.","DOI":"10.1109\/ICASSP39728.2021.9413893"},{"key":"ref_44","unstructured":"Viola, P., and Jones, M. (2001, January 8\u201314). Rapid Object Detection using a Boosted Cascade of Simple Features. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA."},{"key":"ref_45","unstructured":"Yi, D., Lei, Z., Liao, S., and Li, S.Z. (2014). Learning Face Representation from Scratch. arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1499","DOI":"10.1109\/LSP.2016.2603342","article-title":"Joint face detection and alignment using multitask cascaded convolutional networks","volume":"23","author":"Zhang","year":"2016","journal-title":"IEEE Signal Process. Lett."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/6\/2901\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:50:06Z","timestamp":1760122206000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/6\/2901"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,7]]},"references-count":46,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["s23062901"],"URL":"https:\/\/doi.org\/10.3390\/s23062901","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,7]]}}}