{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,12]],"date-time":"2025-11-12T06:28:53Z","timestamp":1762928933712,"version":"build-2065373602"},"reference-count":45,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,31]],"date-time":"2021-12-31T00:00:00Z","timestamp":1640908800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"P2020 - COVID19","award":["70289"],"award-info":[{"award-number":["70289"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>COVID-19 was responsible for devastating social, economic, and political effects all over the world. Although the health authorities imposed restrictions provided relief and assisted with trying to return society to normal life, it is imperative to monitor people\u2019s behavior and risk factors to keep virus transmission levels as low as possible. This article focuses on the application of deep learning algorithms to detect the presence of masks on people in public spaces (using RGB cameras), as well as the detection of the caruncle in the human eye area to make an accurate measurement of body temperature (using thermal cameras). For this task, synthetic data generation techniques were used to create hybrid datasets from public ones to train state-of-the-art algorithms, such as YOLOv5 object detector and a keypoint detector based on Resnet-50. For RGB mask detection, YOLOv5 achieved an average precision of 82.4%. For thermal masks, glasses, and caruncle detection, YOLOv5 and keypoint detector achieved an average precision of 96.65% and 78.7%, respectively. Moreover, RGB and thermal datasets were made publicly available.<\/jats:p>","DOI":"10.3390\/s22010298","type":"journal-article","created":{"date-parts":[[2022,1,9]],"date-time":"2022-01-09T23:08:26Z","timestamp":1641769706000},"page":"298","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["AI Based Monitoring of Different Risk Levels in COVID-19 Context"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9601-3874","authenticated-orcid":false,"given":"C\u00e9sar","family":"Melo","sequence":"first","affiliation":[{"name":"Engineering School, University of Minho, 4800-058 Guimar\u00e3es, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4595-3828","authenticated-orcid":false,"given":"Sandra","family":"Dixe","sequence":"additional","affiliation":[{"name":"Algoritmi Center, University of Minho, 4800-058 Guimar\u00e3es, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6703-3278","authenticated-orcid":false,"given":"Jaime C.","family":"Fonseca","sequence":"additional","affiliation":[{"name":"Algoritmi Center, University of Minho, 4800-058 Guimar\u00e3es, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2148-9146","authenticated-orcid":false,"given":"Ant\u00f3nio H. J.","family":"Moreira","sequence":"additional","affiliation":[{"name":"2Ai, IPCA, School of Technology, 4750-810 Barcelos, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5880-033X","authenticated-orcid":false,"given":"Jo\u00e3o","family":"Borges","sequence":"additional","affiliation":[{"name":"Algoritmi Center, University of Minho, 4800-058 Guimar\u00e3es, Portugal"},{"name":"Polytechnic Institute of C\u00e1vado and Ave, 4750-810 Barcelos, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,31]]},"reference":[{"key":"ref_1","unstructured":"Cheng, K.K., Lam, T.H., and Leung, C.C. (2020). Wearing face masks in the community during the COVID-19 pandemic: Altruism and solidarity. Lancet."},{"key":"ref_2","unstructured":"Melo, C., Dixe, S., Fonseca, J.C., Moreira, A., and Borges, J. (2021, November 01). MoLa RGB CovSurv. Mendeley Data. V1. Available online: https:\/\/data.mendeley.com\/datasets\/vzf939jbxy\/1."},{"key":"ref_3","unstructured":"Melo, C., Dixe, S., Fonseca, J.C., Moreira, A., and Borges, J. (2021, November 01). MoLa IR CovSurv. Mendeley Data. V1. Available online: https:\/\/data.mendeley.com\/datasets\/rgg6b7tx4s\/1."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast r-CNN. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_6","unstructured":"Cortes, C., Lawrence, N.D., Lee, D.D., Sugiyama, M., and Garnett, R. (2016). Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems 28, Curran Associates, Inc."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Redmon, J., and Farhadi, A. (2017, January 21\u201326). Yolo9000: Better, faster, stronger. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.690"},{"key":"ref_9","unstructured":"Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv."},{"key":"ref_10","unstructured":"Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M. (2020). YOLOv4: Optimal Speed and Accuracy of object detection. arXiv."},{"key":"ref_11","unstructured":"(2021, November 20). Ultralytics. Github. Available online: https:\/\/github.com\/ultralytics\/yolov5."},{"key":"ref_12","unstructured":"Jiang, M., Fan, X., and Yan, H. (2020). Retinafacemask: A face mask detector. arXiv."},{"key":"ref_13","unstructured":"(2021, September 03). Fighting against COVID-19: A Novel Deep Learning Model Based on YOLO-v2 with ResNet-50 for Medical Face Mask Detection|Elsevier Enhanced Reader. Available online: https:\/\/reader.elsevier.com\/reader\/sd\/pii\/S2210670720308179?token=8284B3488945F354C37E05EC1ADCE9089934FFC31EB0CC7F23948563EEABE22945396983446BBF80DD07EE1AD21127E9&originRegion=eu-west-1&originCreation=20210923103724."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Nagrath, P., Jain, R., Madan, A., Arora, R., Kataria, P., and Hemanth, J. (2021). SSDMNV2: A real time DNN-based face mask detection system using single shot multibox detector and MobileNetV2. Sustain. Cities Soc., 66.","DOI":"10.1016\/j.scs.2020.102692"},{"key":"ref_15","unstructured":"Viola, P., and Jones, M. (2001, January 8\u201314). Rapid object detection using a boosted cascade of simple features. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, H., Lin, Z., Shen, X., Brandt, J., and Hua, G. (2015, January 7\u201312). A convolutional neural network cascade for face detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299170"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Sun, Y., Wang, X., and Tang, X. (2013, January 23\u201328). Deep convolutional network cascade for facial point detection. Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.446"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Haavisto, M., Kaarna, A., and Lensu, L. (2015, January 11\u201314). Deep learning for facial keypoints detection. Proceedings of the 10th International Conference on Computer Vision Theory and Applications, Berlin, Germany.","DOI":"10.5220\/0005272202890296"},{"key":"ref_19","unstructured":"Longpre, S., and Sohmshetty, A. (2021, September 03). Facial Keypoint Detection. Available online: https:\/\/www.semanticscholar.org\/paper\/Facial-Keypoint-Detection-Longpre-Sohmshetty\/8a1ed5e23231e86216c9bdd62419c3b05f1e0b4d."},{"key":"ref_20","unstructured":"Agarwal, N., Krohn-Grimberghe, A., and Vyas, R. (2017). Facial key points detection using deep convolutional neural network\u2014Naimishnet. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yang, D., Yurtsever, E., Renganathan, V., Redmill, K.A., and \u00d6zg\u00fcner, \u00dc. (2021). A Vision-Based Social Distancing and Critical Density Detection System for COVID-19. Sensors, 21.","DOI":"10.3390\/s21134608"},{"key":"ref_22","first-page":"954","article-title":"2019 Novel Coronavirus Disease (COVID-19): Detection and Diagnosis System Using IoT Based Smart Glasses","volume":"29","author":"Mohammed","year":"2020","journal-title":"Int. J. Adv. Sci. Technol."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Hassan, A., Shahin, I., and Alsabek, M.B. (2020, January 3\u20135). COVID-19 Detection System using Recurrent Neural Networks. Proceedings of the 2020 International Conference on Communications, Computing, Cybersecurity, and Informatics (CCCI), Sharjah, United Arab Emirates.","DOI":"10.1109\/CCCI49893.2020.9256562"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Belkacem, A.N., Ouhbi, S., Lakas, A., Benkhelifa, E., and Chen, C. (2021). End-to-End AI-Based Point-of-Care Diagnosis System for Classifying Respiratory Illnesses and Early Detection of COVID-19: A Theoretical Framework. Front. Med., 8.","DOI":"10.3389\/fmed.2021.585578"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Rahman, M.M., Manik, M.M.H., Islam, M.M., Mahmud, S., and Kim, J.-H. (2020, January 9\u201312). An Automated System to Limit COVID-19 Using Facial Mask Detection in Smart City Network. Proceedings of the 2020 IEEE International IOT, Electronics and Mechatronics Conference (IEMTRONICS), Vancouver, BC, Canada.","DOI":"10.1109\/IEMTRONICS51293.2020.9216386"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Teboulbi, S., Messaoud, S., Hajjaji, M.A., and Mtibaa, A. (2021). Real-Time Implementation ofAI-Based Face Mask Detection and Social Distancing Measuring System for COVID-19 Prevention. Sci. Program., 2021.","DOI":"10.1155\/2021\/8340779"},{"key":"ref_27","unstructured":"(2021, June 01). dlib \u00b7 PyPI. Available online: https:\/\/pypi.org\/project\/dlib\/."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Liu, Z., Luo, P., Wang, X., and Tang, X. (2015, January 7\u201313). Deep learning face attributes in the wild. Proceedings of the International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.425"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C.L., and Doll\u00e1r, P. (2014, January 6\u201312). Microsoft coco: Common objects in context. Proceedings of the 13th European Conference, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Le, V., Brandt, J., Lin, Z., Bourdev, L., and Huang, T.S. (2012, January 7\u201313). Interactive facial feature localization. Proceedings of the 12th European Conference on Computer Vision, Florence, Italy.","DOI":"10.1007\/978-3-642-33712-3_49"},{"key":"ref_31","unstructured":"Nordstr\u00f8m, M.M., Larsen, M., Sierakowski, J., and Stegmann, M.B. (2021, June 15). The Imm Face Database an Annotated Dataset of 240 Face Images. Available online: http:\/\/www.imm.dtu.dk\/~aam\/aamexplorer\/."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Yang, S., Luo, P., Loy, C.C., and Tang, X. (2016, January 27\u201330). Wider face: A face detection benchmark. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.596"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Gallagher, A., and Chen, T. (2009, January 20\u201325). Understanding images of groups of people. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPRW.2009.5206828"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Chen, S., Liu, Y., Gao, X., and Han, Z. (2018, January 11\u201312). Mobilefacenets: Efficient cnns for accurate real-time faceverification on mobile devices. Proceedings of the 3th Chinese Conference, CCBR 2018, Urumqi, China.","DOI":"10.1007\/978-3-319-97909-0_46"},{"key":"ref_35","first-page":"7","article-title":"Temperature gradient analysis by thermography used in optometry","volume":"6","author":"Rizescu","year":"2019","journal-title":"Int. J. Mechatronics Appl. Mech."},{"key":"ref_36","unstructured":"(2021, May 13). FLIR ADK Thermal Vision Automotive Development Kit|Teledyne FLIR. Available online: https:\/\/www.flir.eu\/products\/adk\/."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Dhamecha, T.I., Nigam, A., Singh, R., and Vatsa, M. (2013, January 4\u20137). Disguise detection and face recognition in visible and thermal spectrums. Proceedings of the 2013 International Conference on Biometrics (ICB), Madrid, Spain.","DOI":"10.1109\/ICB.2013.6613019"},{"key":"ref_38","unstructured":"Ghiass, R.S., Bendada, H., and Maldague, X. (2018, January 25\u201329). Universit\u00e9 laval face motion and time-lapse video database (ul-fmtv). Proceedings of the 14th International Conference on Quantitative Infrared Thermography 2018, Berlin, Germany."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Ibrahim, A., Gaber, T., Horiuchi, T., Snasel, V., and Hassanien, A.E. (2015, January 28\u201330). Human thermal face extraction based on superpixel technique. Proceedings of the The 1st International Conference on Advanced Intelligent System and Informatics (AISI2015), Beni Suef, Egypt.","DOI":"10.1007\/978-3-319-26690-9_15"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1007\/s11263-006-6655-0","article-title":"Multiscale fusion of visible and thermal ir images for illumination-invariant face recognition","volume":"71","author":"Kong","year":"2007","journal-title":"Int. J. Comput. Vis."},{"key":"ref_41","unstructured":"V7Labs (2021, June 25). V7\u2014Ai Data Platform for Ml Teams. Available online: https:\/\/www.v7labs.com\/."},{"key":"ref_42","unstructured":"MMPose Contributors (2021, September 20). Openmmlab Pose Estimation Toolbox and Benchmark. Available online: https:\/\/github.com\/open-mmlab\/mmpose."},{"key":"ref_43","unstructured":"(2021, September 13). Face Mask Detection|Kaggle. Available online: https:\/\/www.kaggle.com\/andrewmvd\/face-mask-detection."},{"key":"ref_44","unstructured":"(2021, September 01). Face Mask Detection Dataset|Kaggle. Available online: https:\/\/www.kaggle.com\/wobotintelligence\/face-mask-detection-dataset."},{"key":"ref_45","unstructured":"(2021, November 20). Model Face Mask Detection. Available online: https:\/\/github.com\/AIZOOTech\/FaceMaskDetection."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/1\/298\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:56:56Z","timestamp":1760169416000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/1\/298"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,31]]},"references-count":45,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["s22010298"],"URL":"https:\/\/doi.org\/10.3390\/s22010298","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,12,31]]}}}