{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T19:49:35Z","timestamp":1777060175481,"version":"3.51.4"},"reference-count":62,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2020,8,11]],"date-time":"2020-08-11T00:00:00Z","timestamp":1597104000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"The European Commission under the 4NSEEK project","award":["821966"],"award-info":[{"award-number":["821966"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Face recognition is a valuable forensic tool for criminal investigators since it certainly helps in identifying individuals in scenarios of criminal activity like fugitives or child sexual abuse. It is, however, a very challenging task as it must be able to handle low-quality images of real world settings and fulfill real time requirements. Deep learning approaches for face detection have proven to be very successful but they require large computation power and processing time. In this work, we evaluate the speed\u2013accuracy tradeoff of three popular deep-learning-based face detectors on the WIDER Face and UFDD data sets in several CPUs and GPUs. We also develop a regression model capable to estimate the performance, both in terms of processing time and accuracy. We expect this to become a very useful tool for the end user in forensic laboratories in order to estimate the performance for different face detection options. Experimental results showed that the best speed\u2013accuracy tradeoff is achieved with images resized to 50% of the original size in GPUs and images resized to 25% of the original size in CPUs. Moreover, performance can be estimated using multiple linear regression models with a Mean Absolute Error (MAE) of 0.113, which is very promising for the forensic field.<\/jats:p>","DOI":"10.3390\/s20164491","type":"journal-article","created":{"date-parts":[[2020,8,11]],"date-time":"2020-08-11T09:28:57Z","timestamp":1597138137000},"page":"4491","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["Assessment and Estimation of Face Detection Performance Based on Deep Learning for Forensic Applications"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7745-8111","authenticated-orcid":false,"given":"Deisy","family":"Chaves","sequence":"first","affiliation":[{"name":"Department of Electrical, Systems and Automation, Universidad de Le\u00f3n, 24007 Le\u00f3n, Spain"},{"name":"Researcher at INCIBE (Spanish National Cybersecurity Institute), 24005 Le\u00f3n, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1202-5232","authenticated-orcid":false,"given":"Eduardo","family":"Fidalgo","sequence":"additional","affiliation":[{"name":"Department of Electrical, Systems and Automation, Universidad de Le\u00f3n, 24007 Le\u00f3n, Spain"},{"name":"Researcher at INCIBE (Spanish National Cybersecurity Institute), 24005 Le\u00f3n, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2081-774X","authenticated-orcid":false,"given":"Enrique","family":"Alegre","sequence":"additional","affiliation":[{"name":"Department of Electrical, Systems and Automation, Universidad de Le\u00f3n, 24007 Le\u00f3n, Spain"},{"name":"Researcher at INCIBE (Spanish National Cybersecurity Institute), 24005 Le\u00f3n, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4164-5887","authenticated-orcid":false,"given":"Roc\u00edo","family":"Alaiz-Rodr\u00edguez","sequence":"additional","affiliation":[{"name":"Department of Electrical, Systems and Automation, Universidad de Le\u00f3n, 24007 Le\u00f3n, Spain"},{"name":"Researcher at INCIBE (Spanish National Cybersecurity Institute), 24005 Le\u00f3n, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7665-6418","authenticated-orcid":false,"given":"Francisco","family":"J\u00e1\u00f1ez-Martino","sequence":"additional","affiliation":[{"name":"Department of Electrical, Systems and Automation, Universidad de Le\u00f3n, 24007 Le\u00f3n, Spain"},{"name":"Researcher at INCIBE (Spanish National Cybersecurity Institute), 24005 Le\u00f3n, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6552-2596","authenticated-orcid":false,"given":"George","family":"Azzopardi","sequence":"additional","affiliation":[{"name":"Bernoulli Institute for Mathematics, Computer Science and Artificial Intelligence, University of Groningen, 9747 AG Groningen, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,8,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Anda, F., Lillis, D., Kanta, A., Becker, B.A., Bou-Harb, E., Le-Khac, N.A., and Scanlon, M. (2019, January 26\u201329). Improving Borderline Adulthood Facial Age Estimation Through Ensemble Learning. Proceedings of the 14th International Conference on Availability, Reliability and Security (ARES \u201919), Canterbury, UK.","DOI":"10.1145\/3339252.3341491"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1111\/j.1740-9713.2019.01252.x","article-title":"Machine learning in forensic applications","volume":"16","author":"Carriquiry","year":"2019","journal-title":"Significance"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Rughani, P.H., and Bhatt, P. (2017). Machine learning forensics: a new branch of digital forensics. Int. J. Adv. Res. Comput. Sci., 8.","DOI":"10.26483\/ijarcs.v8i8.4613"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Nixon, M., and Aguado, A. (2019). Feature Extraction and Image Processing for Computer Vision, Academic Press.","DOI":"10.1016\/B978-0-12-814976-8.00003-8"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Gangwar, A., Fidalgo, E., Alegre, E., and Gonz\u00e1lez-Castro, V. (2017, January 13\u201315). Pornography and Child Sexual Abuse Detection in Image and Video: A Comparative Evaluation. Proceedings of the 8th International Conference on Imaging for Crime Detection and Prevention (ICDP), Madrid, Spain.","DOI":"10.1049\/ic.2017.0046"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Saikia, S., Fidalgo, E., Alegre, E., and Fern\u00e1ndez-Robles, L. (2017, January 11\u201315). Object Detection for Crime Scene Evidence Analysis Using Deep Learning. Proceedings of the Image Analysis and Processing (ICIAP), Catania, Italy.","DOI":"10.1007\/978-3-319-68548-9_2"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"231","DOI":"10.4995\/riai.2018.10229","article-title":"A Systematic Review on Object Localisation Methods in Images","volume":"15","author":"Chaves","year":"2018","journal-title":"Rev. Iberoam. Autom\u00e1tica Inf. Ind."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Saikia, S., Fidalgo, E., Alegre, E., and Fern\u00e1ndez-Robles, L. (2017, January 6\u20138). Query Based Object Retrieval Using Neural Codes. Proceedings of the International Joint Conference SOCO\u201917-CISIS\u201917-ICEUTE\u201917, Le\u00f3n, Spain.","DOI":"10.1007\/978-3-319-67180-2_50"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"84003","DOI":"10.1109\/ACCESS.2019.2924733","article-title":"A Survey of Deep Learning Solutions for Multimedia Visual Content Analysis","volume":"7","author":"Nadeem","year":"2019","journal-title":"IEEE Access"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7\u201312). Facenet: A unified embedding for face recognition and clustering. Proceedings of the IEEE conference on computer vision and pattern recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"ref_11","first-page":"344","article-title":"Boosting child abuse victim identification in Forensic Tools with hashing techniques","volume":"1","author":"Biswas","year":"2019","journal-title":"V Jorn. Nac. Investig. Ciberseguridad"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Garc\u00eda-Olalla, O., Alegre, E., Fern\u00e1ndez-Robles, L., Fidalgo, E., and Saikia, S. (2018). Textile Retrieval Based on Image Content from CDC and Webcam Cameras in Indoor Environments. Sensors, 18.","DOI":"10.3390\/s18051329"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1016\/j.procs.2018.10.427","article-title":"Techniques and Challenges of Face Recognition: A Critical Review","volume":"143","author":"Singh","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cviu.2015.03.015","article-title":"A survey on face detection in the wild: Past, present and future","volume":"138","author":"Zafeiriou","year":"2015","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhou, Y., Liu, D., and Huang, T. (2018, January 15\u201319). Survey of face detection on low-quality images. Proceedings of the 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), Xi\u2019an, China.","DOI":"10.1109\/FG.2018.00121"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"927","DOI":"10.1007\/s10462-018-9650-2","article-title":"Face detection techniques: A review","volume":"52","author":"Kumar","year":"2019","journal-title":"Artif. Intel. Rev."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/B:VISI.0000013087.49260.fb","article-title":"Robust real-time face detection","volume":"57","author":"Viola","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Van Gool, L. (2006, January 7\u201313). Surf: Speeded up robust features. Proceedings of the European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_19","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2037","DOI":"10.1109\/TPAMI.2006.244","article-title":"Face description with local binary patterns: Application to face recognition","volume":"28","author":"Ahonen","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","unstructured":"Zhu, X., and Ramanan, D. (2012, January 16\u201321). Face detection, pose estimation, and landmark localization in the wild. Proceedings of the 2012 IEEE conference on computer vision and pattern recognition, Providence, RI, USA."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhang, K., Zhang, Z., Li, Z., and Qiao, Y. (2016). Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks. IEEE Signal Process Lett.","DOI":"10.1109\/LSP.2016.2603342"},{"key":"ref_23","unstructured":"Zhang, J., Wu, X., Zhu, J., and Hoi, S.C.H. (2017). Feature Agglomeration Networks for Single Stage Face Detection. arXiv, Available online: https:\/\/arxiv.org\/abs\/1712.00721."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhang, S., Zhu, X., Lei, Z., Shi, H., Wang, X., and Li, S.Z. (2017, January 22\u201329). S3FD: Single Shot Scale-Invariant Face Detector. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.30"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Tang, X., Du, D.K., He, Z., and Liu, J. (2018, January 8\u201314). PyramidBox: A Context-assisted Single Shot Face Detector. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01240-3_49"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Li, J., Wang, Y., Wang, C., Tai, Y., Qian, J., Yang, J., Wang, C., Li, J., and Huang, F. (2019, January 15\u201321). DSFD: Dual Shot Face Detector. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00520"},{"key":"ref_27","unstructured":"Zhang, F., Fan, X., Ai, G., Song, J., Qin, Y., and Wu, J. (2019). Accurate Face Detection for High Performance. arXiv, Available online: https:\/\/arxiv.org\/abs\/1905.01585."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Jain, V., Chaudhary, G., Cengiz Taplamacioglu, M., and Agarwal, M.S. (2020). Facial Recognition Using Deep Learning. Advances in Data Sciences, Security and Applications, Springer.","DOI":"10.1007\/978-981-15-0372-6"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Srujan Raju, K., Senkerik, R., Prasad Lanka, S., and Rajagopal, V. (2020). A Survey on Face Recognition Using Convolutional Neural Network. Data Engineering and Communication Technology, Springer.","DOI":"10.1007\/978-981-15-1097-7"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1080\/13682199.2017.1358528","article-title":"3D face detection based on salient features extraction and skin colour detection using data mining","volume":"65","author":"Sayed","year":"2017","journal-title":"Imaging Sci. J."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Abbasnejad, I., Sridharan, S., Nguyen, D., Denman, S., Fookes, C., and Lucey, S. (2017, January 22\u201329). Using Synthetic Data to Improve Facial Expression Analysis with 3D Convolutional Networks. Proceedings of the 2017 IEEE International Conference on Computer Vision Workshops (ICCVW), Venice, Italy.","DOI":"10.1109\/ICCVW.2017.189"},{"key":"ref_32","unstructured":"Chellappa, R., and Theodoridis, S. (2018). Chapter 6\u2014Face detection with a 3D model. Academic Press Library in Signal Processing, Volume 6, Academic Press."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Carlotta Olivetti, E., Violante, M., Vezzetti, E., Marcolin, F., and Eynard, B. (2020). Engagement Evaluation in a Virtual Learning Environment via Facial Expression Recognition and Self-Reports: A Preliminary Approach. Appl. Sci., 10.","DOI":"10.3390\/app10010314"},{"key":"ref_34","unstructured":"Chaves, D., Fidalgo, E., Alegre, E., and Blanco, P. (2019, January 5\u20137). Improving Speed-Accuracy Trade-off in Face Detectors for Forensic Tools by Image Resizing. Proceedings of the V Jornadas Nacionales de Investigaci\u00f3n en Ciberseguridad (JNIC-2019), C\u00e1ceres, Spain."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Chaves, D., Fidalgo, E., Alegre, E., J\u00e1\u00f1ez-Martino, F., and Velasco-Mata, J. (2019, January 16\u201318). CPU vs GPU performance of deep learning based face detectors using resized images in forensic applications. Proceedings of the 9th International Conference on Imaging for Crime Detection and Prevention (ICDP-2019), London, UK.","DOI":"10.1049\/cp.2019.1174"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Yang, S., Luo, P., Loy, C.C., and Tang, X. (2016, January 27\u201330). WIDER FACE: A Face Detection Benchmark. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.596"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Nada, H., Sindagi, V.A., Zhang, H., and Patel, V.M. (2018, January 22\u201325). Pushing the Limits of Unconstrained Face Detection: a Challenge Dataset and Baseline Results. Proceedings of the IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS), Redondo Beach, CA, USA.","DOI":"10.1109\/BTAS.2018.8698561"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","article-title":"The Pascal Visual Object Classes (VOC) Challenge","volume":"88","author":"Everingham","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1049\/iet-bmt.2017.0083","article-title":"Strengths and weaknesses of deep learning models for face recognition against image degradations","volume":"7","author":"Grm","year":"2017","journal-title":"Iet Biometrics"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1007\/s40012-016-0149-1","article-title":"Unconstrained face detection: a deep learning and machine learning combined approach","volume":"5","author":"Sawat","year":"2017","journal-title":"CSI Trans. ICT"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Masi, I., Wu, Y., Hassner, T., and Natarajan, P. (November, January 29). Deep face recognition: A survey. Proceedings of the 2018 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Parana, Brazil.","DOI":"10.1109\/SIBGRAPI.2018.00067"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/j.neucom.2018.03.030","article-title":"Face detection using deep learning: An improved faster RCNN approach","volume":"299","author":"Sun","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Jain, V., Patnaik, S., Vl\u0103dicescu, F.P., and Sethi, I.K. (2020). Face Detection Based on YOLOv3. Recent Trends in Intelligent Computing, Communication and Devices, Springer.","DOI":"10.1007\/978-981-13-9406-5"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1016\/j.neucom.2020.01.023","article-title":"Systematic evaluation of deep face recognition methods","volume":"388","author":"You","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Wang, M., and Deng, W. (2020). Deep face recognition with clustering based domain adaptation. Neurocomputing.","DOI":"10.1016\/j.neucom.2020.02.005"},{"key":"ref_46","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Lin, T., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017, January 22\u201329). Focal Loss for Dense Object Detection. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Zitnick, C.L., and Doll\u00e1r, P. (2014, January 6\u201312). Edge boxes: Locating object proposals from edges. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_26"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1016\/j.neucom.2019.07.064","article-title":"Faceboxes: A CPU real-time and accurate unconstrained face detector","volume":"364","author":"Zhang","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Shi, S., Wang, Q., Xu, P., and Chu, X. (2016, January 16\u201318). Benchmarking State-of-the-Art Deep Learning Software Tools. Proceedings of the 7th International Conference on Cloud Computing and Big Data, Macau, China.","DOI":"10.1109\/CCBD.2016.029"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Nardelli, R., Dall, Z., and Skevoulis, S. (2020, January 14\u201315). Comparing TensorFlow Deep Learning Performance and Experiences Using CPUs via Local PCs and Cloud Solutions. Proceedings of the Advances in Information and Communication (FICC 2019), San Francisco, CA, USA.","DOI":"10.1007\/978-3-030-12385-7_10"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Demirovi\u0107, D., Skeji\u0107, E., and \u0160erifovi\u0107-Trbali\u0107, A. (2018, January 20\u201322). Performance of Some Image Processing Algorithms in Tensorflow. Proceedings of the 2018 25th International Conference on Systems, Signals and Image Processing (IWSSIP), Maribor, Slovenia.","DOI":"10.1109\/IWSSIP.2018.8439714"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.image.2018.01.008","article-title":"Eye landmarks detection via two-level cascaded CNNs with multi-task learning","volume":"63","author":"Huang","year":"2018","journal-title":"Signal Process. Image Commun."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1016\/j.image.2016.04.004","article-title":"FaceHunter: A multi-task convolutional neural network based face detector","volume":"47","author":"Wang","year":"2016","journal-title":"Signal Process. Image Commun."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1109\/TPAMI.2017.2781233","article-title":"HyperFace: A Deep Multi-Task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition","volume":"41","author":"Ranjan","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Fang, Z., Ren, J., Marshall, S., Zhao, H., Wang, Z., Huang, K., and Xiao, B. (2020). Triple loss for hard face detection. Neurocomputing.","DOI":"10.1016\/j.neucom.2020.02.060"},{"key":"ref_57","unstructured":"Li, Z., Tang, X., Han, J., Liu, J., and He, R. (2019). PyramidBox++: High Performance Detector for Finding Tiny Face. arXiv, Available online: https:\/\/arxiv.org\/abs\/1904.00386."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Deng, J., Guo, J., Zhou, Y., Yu, J., Kotsia, I., and Zafeiriou, S. (2019). RetinaFace: Single-stage Dense Face Localisation in the Wild. arXiv, Available online: https:\/\/arxiv.org\/abs\/1905.00641.","DOI":"10.1109\/CVPR42600.2020.00525"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 11\u201314). SSD: Single Shot MultiBox Detector. Proceedings of the Computer Vision\u2013ECCV 2016, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_60","first-page":"37","article-title":"Evaluation: from Precision, Recall and F-measure to ROC, Informedness, Markedness and Correlation","volume":"2","author":"Powers","year":"2011","journal-title":"J. Mach. Learn. Technol."},{"key":"ref_61","first-page":"045","article-title":"A New Typology Design of Performance Metrics to Measure Errors in Machine Learning Regression Algorithms","volume":"14","author":"Botchkarev","year":"2019","journal-title":"Interdiscip. J. Inf. Knowl. Manag."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"McCullagh, P., and Nelder, J. (2018). Generalized Linear Models, CRC Press. [2nd ed.].","DOI":"10.1201\/9780203753736"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/16\/4491\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:59:11Z","timestamp":1760176751000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/16\/4491"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,11]]},"references-count":62,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2020,8]]}},"alternative-id":["s20164491"],"URL":"https:\/\/doi.org\/10.3390\/s20164491","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,11]]}}}