{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:12:15Z","timestamp":1760130735544,"version":"build-2065373602"},"reference-count":40,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2023,8,8]],"date-time":"2023-08-08T00:00:00Z","timestamp":1691452800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Korea Agency for Technology and Standards","award":["K_G012002234001","K_G012002236201"],"award-info":[{"award-number":["K_G012002234001","K_G012002236201"]}]},{"name":"Gachon University","award":["K_G012002234001","K_G012002236201"],"award-info":[{"award-number":["K_G012002234001","K_G012002236201"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Over the past several years, many children have died from suffocation due to being left inside a closed vehicle on a sunny day. Various vehicle manufacturers have proposed a variety of technologies to locate an unattended child in a vehicle, including pressure sensors, passive infrared motion sensors, temperature sensors, and microwave sensors. However, these methods have not yet reliably located forgotten children in the vehicle. Recently, visual-based methods have taken the attention of manufacturers after the emergence of deep learning technology. However, the existing methods focus only on the forgotten child and neglect a forgotten pet. Furthermore, their systems only detect the presence of a child in the car with or without their parents. Therefore, this research introduces a visual-based framework to reduce hyperthermia deaths in enclosed vehicles. This visual-based system detects objects inside a vehicle; if the child or pet are without an adult, a notification is sent to the parents. First, a dataset is constructed for vehicle interiors containing children, pets, and adults. The proposed dataset is collected from different online sources, considering varying illumination, skin color, pet type, clothes, and car brands for guaranteed model robustness. Second, blurring, sharpening, brightness, contrast, noise, perspective transform, and fog effect augmentation algorithms are applied to these images to increase the training data. The augmented images are annotated with three classes: child, pet, and adult. This research concentrates on fine-tuning different state-of-the-art real-time detection models to detect objects inside the vehicle: NanoDet, YOLOv6_1, YOLOv6_3, and YOLO7. The simulation results demonstrate that YOLOv6_1 presents significant values with 96% recall, 95% precision, and 95% F1.<\/jats:p>","DOI":"10.3390\/s23167025","type":"journal-article","created":{"date-parts":[[2023,8,8]],"date-time":"2023-08-08T12:45:53Z","timestamp":1691498753000},"page":"7025","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Visual-Based Children and Pet Rescue from Suffocation and Incidence of Hyperthermia Death in Enclosed Vehicles"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3647-1993","authenticated-orcid":false,"given":"Mona M.","family":"Moussa","sequence":"first","affiliation":[{"name":"Computer and Systems Department, Electronics Research Institute (ERI), Cairo 11843, Egypt"}]},{"given":"Rasha","family":"Shoitan","sequence":"additional","affiliation":[{"name":"Computer and Systems Department, Electronics Research Institute (ERI), Cairo 11843, Egypt"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0184-7599","authenticated-orcid":false,"given":"Young-Im","family":"Cho","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Gachon University, 1342 Seongnam-daero, Sujeong-gu, Seongnam 13415, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7351-625X","authenticated-orcid":false,"given":"Mohamed S.","family":"Abdallah","sequence":"additional","affiliation":[{"name":"Informatics Department, Electronics Research Institute (ERI), Cairo 11843, Egypt"},{"name":"AI Laboratory, DeltaX Co., Ltd., 3F, 24 Namdaemun-ro 9-gil, Jung-gu, Seoul 04522, Republic of Korea"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Poon, Y.-S., Lin, C.-C., Liu, Y.-H., and Fan, C.-P. (2022, January 7\u20139). YOLO-Based Deep Learning Design for In-Cabin Monitoring System with Fisheye-Lens Camera. Proceedings of the 2022 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA.","DOI":"10.1109\/ICCE53296.2022.9730235"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Miwata, M., Tsuneyoshi, M., Ikeda, M., and Barolli, L. (2022). Performance Evaluation of an AI-Based Safety Driving Support System for Detecting Distracted Driving, Springer International Publishing.","DOI":"10.1007\/978-3-031-08819-3_2"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Othman, W., Kashevnik, A., Ali, A., and Shilov, N. (2022). DriverMVT: In-Cabin Dataset for Driver Monitoring Including Video and Vehicle Telemetry Information. Data, 7.","DOI":"10.3390\/data7050062"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"4125865","DOI":"10.1155\/2019\/4125865","article-title":"Driver Distraction Identification with an Ensemble of Convolutional Neural Networks","volume":"2019","author":"Eraqi","year":"2019","journal-title":"J. Adv. Transp."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Khan, S.S., Shen, Z., Sun, H., Patel, A., and Abedi, A. (June, January 31). Modified Supervised Contrastive Learning for Detecting Anomalous Driving Behaviours. Proceedings of the 2022 19th Conference on Robots and Vision (CRV), Toronto, ON, Canada.","DOI":"10.1109\/CRV55824.2022.00011"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Mishra, A., Lee, S., Kim, D., and Kim, S. (2022). In-Cabin Monitoring System for Autonomous Vehicles. Sensors, 22.","DOI":"10.3390\/s22124360"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Kumar, V., and Sharma, S. (2022). Ranjeet Driver Drowsiness Detection Using Modified Deep Learning Architecture. Evol. Intell., 1\u201310.","DOI":"10.1007\/s12065-022-00743-w"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"12036","DOI":"10.1088\/1742-6596\/1235\/1\/012036","article-title":"Vision Based Eye Closeness Classification for Driver\u2019s Distraction and Drowsiness Using PERCLOS and Support Vector Machines: Comparative Study between RGB and Grayscale Images","volume":"1235","author":"Ibrahim","year":"2019","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_9","unstructured":"Yusri, M.F., Mangat, P., and Wasenm\u00fcller, O. (2021). Detection of Driver Drowsiness by Calculating the Speed of Eye Blinking. arXiv."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Jahan, I., Uddin, K.M.A., Murad, S.A., Miah, M.S.U., Khan, T.Z., Masud, M., Aljahdali, S., and Bairagi, A.K. (2023). 4D: A Real-Time Driver Drowsiness Detector Using Deep Learning. Electronics, 12.","DOI":"10.3390\/electronics12010235"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zhu, T., Zhang, C., Wu, T., Ouyang, Z., Li, H., Na, X., Liang, J., and Li, W. (2022). Research on a Real-Time Driver Fatigue Detection Algorithm Based on Facial Video Sequences. Appl. Sci., 12.","DOI":"10.3390\/app12042224"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wang, F., Wang, H., and Fu, R. (2018). Real-Time ECG-Based Detection of Fatigue Driving Using Sample Entropy. Entropy, 20.","DOI":"10.3390\/e20030196"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3089","DOI":"10.1109\/TITS.2020.2979527","article-title":"Vision-Based Fatigue Driving Recognition Method Integrating Heart Rate and Facial Features","volume":"22","author":"Du","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"012056","DOI":"10.1088\/1757-899X\/429\/1\/012056","article-title":"Development of an Automatic Vehicular Heatstroke Detection System","volume":"429","author":"Goh","year":"2018","journal-title":"IOP Conf. Ser. Mater. Sci. Eng."},{"key":"ref_15","first-page":"1653","article-title":"Child in Car Alarm System Using Various Sensors","volume":"9","author":"Hashim","year":"2014","journal-title":"ARPN J. Eng. Appl. Sci."},{"key":"ref_16","unstructured":"Hallberg, H., and Wessberg, V. (2018). Detection of Child-like Objects inside Vehicles Using Deep Learning. [Master\u2019s Thesis, Chalmers University of Technology]."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hu, Y. (2021, January 15\u201317). Solving Pediatric Vehicular Heatstroke with Efficient Multi-Cascaded Convolutional Networks. Proceedings of the 2021 IEEE International Conference on Consumer Electronics and Computer Engineering (ICCECE), Guangzhou, China.","DOI":"10.1109\/ICCECE51280.2021.9342313"},{"key":"ref_18","unstructured":"Sunil, M., Vallimaharajan, G., and Udhayanan, C. (2022, January 4\u20135). Child Safety Monitor in Cars Using Machine Learning. Proceedings of the 2022 International Conference on Advanced Computing Technologies and Applications (ICACTA), Coimbatore, India."},{"key":"ref_19","unstructured":"Rudd, R., Prasad, A., Weston, D., and Wietholter, K. (2015). Functional Assessment of Unattended Child Reminder Systems, National Highway Traffic Safety Administration."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"01008","DOI":"10.1051\/matecconf\/20179001008","article-title":"Development of Comprehensive Unattended Child Warning and Feedback System in Vehicle","volume":"90","author":"Sulaiman","year":"2016","journal-title":"MATEC Web Conf."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Shi, D., Lu, J., Wang, J., Li, L., Liu, K., and Pan, M. (2020, January 7\u201311). No One Left Behind: Avoid Hot Car Deaths via WiFi Detection. Proceedings of the ICC 2020\u20132020 IEEE International Conference on Communications (ICC), Dublin, Ireland.","DOI":"10.1109\/ICC40277.2020.9148648"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Chen, Y., Luo, Y., Ma, J., Qi, A., Huang, R., De Paulis, F., and Qi, Y. (2023). Non-Contact In-Vehicle Occupant Monitoring System Based on Point Clouds from FMCW Radar. Technologies, 11.","DOI":"10.3390\/technologies11020039"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Stekas, N., and Van Den Heuvel, D. (2016, January 23\u201327). Face Recognition Using Local Binary Patterns Histograms (LBPH) on an FPGA-Based System on Chip (SoC). Proceedings of the 30th IEEE International Parallel & Distributed Processing Symposium, Lyon, France.","DOI":"10.1109\/IPDPSW.2016.67"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","first-page":"2980","article-title":"Mask R-CNN","volume":"2017","author":"He","year":"2017","journal-title":"Proc. IEEE Int. Conf. Comput. Vis."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"102007","DOI":"10.1016\/j.aei.2023.102007","article-title":"DenseSPH-YOLOv5: An Automated Damage Detection Model Based on DenseNet and Swin-Transformer Prediction Head-Enabled YOLOv5 with Attention Mechanism","volume":"56","author":"Roy","year":"2023","journal-title":"Adv. Eng. Inform."},{"key":"ref_27","unstructured":"Li, C., Li, L., Geng, Y., Jiang, H., Cheng, M., Zhang, B., Ke, Z., Xu, X., and Chu, X. (2023). YOLOv6 v3.0: A Full-Scale Reloading. arXiv."},{"key":"ref_28","unstructured":"Li, C., Li, L., Jiang, H., Weng, K., Geng, Y., Li, L., Ke, Z., Li, Q., Cheng, M., and Nie, W. (2022). YOLOv6: A Single-Stage Object Detection Framework for Industrial Applications. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wang, C.-Y., Bochkovskiy, A., and Liao, H.-Y.M. (2022). YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors. arXiv.","DOI":"10.1109\/UV56588.2022.10185474"},{"key":"ref_30","unstructured":"Jocher, G., Stoken, A., Borovec, J., Chaurasia, A., Changyu, L., Hogan, A., Hajek, J., Diaconu, L., Kwon, Y., and Defretin, Y. (2023, August 01). Ultralytics\/yolov5: v5. 0-YOLOv5-P6 1280 Models, AWS, Supervisely and YouTube Integrations. Zenodo. Available online: https:\/\/zenodo.org\/record\/4679653."},{"key":"ref_31","first-page":"398","article-title":"SSD: Single Shot MultiBox Detector Wei","volume":"1","author":"Liu","year":"2016","journal-title":"ECCV"},{"key":"ref_32","unstructured":"(2023, May 29). RangiLyu NanoDet-Plus: Super Fast and High Accuracy Lightweight Anchor-Free Object Detection Model. Available online: https:\/\/github.com\/RangiLyu\/nanodet."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ding, X., Zhang, X., Ma, N., Han, J., Ding, G., and Sun, J. (2021, January 20\u201325). RepVgg: Making VGG-Style ConvNets Great Again. Proceedings of the 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01352"},{"key":"ref_34","unstructured":"Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021). YOLOX: Exceeding YOLO Series in 2021. arXiv, 2107.08430."},{"key":"ref_35","unstructured":"Gevorgyan, Z. (2022). SIoU Loss: More Powerful Learning for Bounding Box Regression. arXiv, 2205.12740."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., and Savarese, S. (2019, January 15\u201320). Generalized Intersection over Union: A Metric and a Loss for Bounding Box Regression. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00075"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Dai, Y., Gieseke, F., Oehmcke, S., Wu, Y., and Barnard, K. (2021, January 3\u20137). Attentional Feature Fusion. Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.","DOI":"10.1109\/WACV48630.2021.00360"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Li, X., Wang, W., Hu, X., Li, J., Tang, J., and Yang, J. (2021, January 20\u201325). Generalized Focal Loss V2: Learning Reliable Localization Quality Estimation for Dense Object Detection. Proceedings of the 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01146"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1263","DOI":"10.1109\/LRA.2019.2894858","article-title":"Focal Loss in 3D Object Detection","volume":"4","author":"Yun","year":"2019","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_40","unstructured":"Sun, D. (2023, June 10). Ybat\u2014YOLO BBox Annotation Tool. Available online: https:\/\/github.com\/drainingsun\/ybat."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/16\/7025\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:28:02Z","timestamp":1760128082000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/16\/7025"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,8]]},"references-count":40,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["s23167025"],"URL":"https:\/\/doi.org\/10.3390\/s23167025","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,8,8]]}}}