{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,22]],"date-time":"2026-01-22T10:20:05Z","timestamp":1769077205855,"version":"3.49.0"},"reference-count":56,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2025,7,23]],"date-time":"2025-07-23T00:00:00Z","timestamp":1753228800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Romanian Ministry of Research, Innovation, and Digitalization","award":["13N\/2023 (PN 23 38 05 01)"],"award-info":[{"award-number":["13N\/2023 (PN 23 38 05 01)"]}]},{"name":"MDPI","award":["13N\/2023 (PN 23 38 05 01)"],"award-info":[{"award-number":["13N\/2023 (PN 23 38 05 01)"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>In the context of global demographic aging, falls among the elderly remain a major public health concern, often leading to injury, hospitalization, and loss of autonomy. This study proposes a real-time fall detection system that combines a modern computer vision model, YOLOv11 with integrated pose estimation, and an Artificial Intelligence (AI)-based voice assistant designed to reduce false alarms and improve intervention efficiency and reliability. The system continuously monitors human posture via video input, detects fall events based on body dynamics and keypoint analysis, and initiates a voice-based interaction to assess the user\u2019s condition. Depending on the user\u2019s verbal response or the absence thereof, the system determines whether to trigger an emergency alert to caregivers or family members. All processing, including speech recognition and response generation, is performed locally to preserve user privacy and ensure low-latency performance. The approach is designed to support independent living for older adults. Evaluation of 200 simulated video sequences acquired by the development team demonstrated high precision and recall, along with a decrease in false positives when incorporating voice-based confirmation. In addition, the system was also evaluated on an external dataset to assess its robustness. Our results highlight the system\u2019s reliability and scalability for real-world in-home elderly monitoring applications.<\/jats:p>","DOI":"10.3390\/fi17080324","type":"journal-article","created":{"date-parts":[[2025,7,23]],"date-time":"2025-07-23T14:22:44Z","timestamp":1753280564000},"page":"324","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Real-Time Fall Monitoring for Seniors via YOLO and Voice Interaction"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-5647-1928","authenticated-orcid":false,"given":"Eugenia","family":"T\u00eerziu","sequence":"first","affiliation":[{"name":"National Institute for Research and Development in Informatics, 011455 Bucharest, Romania"},{"name":"Doctoral School of Computer Science, Information Technology and Systems Engineering, National University of Science and Technology Politehnica Bucharest, 060042 Bucharest, Romania"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-5926-1333","authenticated-orcid":false,"given":"Ana-Mihaela","family":"Vasilevschi","sequence":"additional","affiliation":[{"name":"National Institute for Research and Development in Informatics, 011455 Bucharest, Romania"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4016-8313","authenticated-orcid":false,"given":"Adriana","family":"Alexandru","sequence":"additional","affiliation":[{"name":"National Institute for Research and Development in Informatics, 011455 Bucharest, Romania"},{"name":"Faculty of Electrical Engineering, Electronics and Information Technology, Valahia University of T\u00e2rgovi\u0219te, 130004 T\u00e2rgovi\u0219te, Romania"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8492-2277","authenticated-orcid":false,"given":"Eleonora","family":"Tudora","sequence":"additional","affiliation":[{"name":"National Institute for Research and Development in Informatics, 011455 Bucharest, Romania"}]}],"member":"1968","published-online":{"date-parts":[[2025,7,23]]},"reference":[{"key":"ref_1","unstructured":"UN Department of Economic and Social Affairs (2025, April 25). Improving the Visibility of Older People in Global Statistics, Available online: https:\/\/blog.ons.gov.uk\/2024\/10\/01\/improving-the-visibility-of-older-people-in-global-statistics\/#:~:text=The%20UN%20Department%20of%20Economic."},{"key":"ref_2","unstructured":"World Health Organization (2025, April 25). Falls. Available online: https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/falls."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Amir, N.I., Dziyauddin, R.A., Mohamed, N., Ismail, N.S., Kaidi, H.M., Ahmad, N., and Izhar, M.A. (TechRxiv, 2024). Fall Detection System Using Wearable Sensor Devices and Machine Learning: A Review, TechRxiv, submitted.","DOI":"10.36227\/techrxiv.171084921.16728034\/v1"},{"key":"ref_4","unstructured":"Tohidypour, H.R., Shojaei-Hashemi, A., Nasiopoulos, P., and Pourazad, M.T. (July, January 29). A Deep Learning Based Human Fall Detection Solution. Proceedings of the 15th International Conference on PErvasive Technologies Related to Assistive Environments (PETRA \u201922), Corfu, Greece."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Kang, S., Hu, Z., Liu, L., Zhang, K., and Cao, Z. (2025). Object Detection YOLO Algorithms and Their Industrial Applications: Overview and Comparative Analysis. Electronics, 14.","DOI":"10.3390\/electronics14061104"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"T\u00eerziu, E., Vasilevschi, A.-M., Alexandru, A., and Tudora, E. (2024). Enhanced Fall Detection Using YOLOv7-W6-Pose for Real-Time Elderly Monitoring. Future Internet, 16.","DOI":"10.3390\/fi16120472"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Ma, M., and Hu, X. (2025). A Deep Learning and Edge Computing Integrated Approach for Fall Behavior Detection in Buildings. J. Saf. Sci. Resil., 100218.","DOI":"10.1016\/j.jnlssr.2025.100218"},{"key":"ref_8","unstructured":"Ultralytics (2025, April 25). YOLOv11 vs YOLOv7. Available online: https:\/\/docs.ultralytics.com\/compare\/yolo11-vs-yolov7\/."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Karar, M.E., Shehata, H.I., and Reyad, O. (2022). A Survey of IoT-Based Fall Detection for Aiding Elderly Care: Sensors, Methods, Challenges and Future Trends. Appl. Sci., 12.","DOI":"10.3390\/app12073276"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wang, X., Ellul, J., and Azzopardi, G. (2020). Elderly Fall Detection Systems: A Literature Survey. Front. Robot. AI, 7.","DOI":"10.3389\/frobt.2020.00071"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2735","DOI":"10.1007\/s12652-021-03248-z","article-title":"Sensor-Based Fall Detection Systems: A Review","volume":"13","author":"Nooruddin","year":"2022","journal-title":"J. Ambient Intell. Hum. Comput."},{"key":"ref_12","first-page":"125","article-title":"Optimal Threshold Selection for Acceleration-Based Fall Detection","volume":"Volume 66","author":"Maglaveras","year":"2018","journal-title":"Precision Medicine Powered by pHealth and Connected Health, Proceedings of IFMBE, Thessaloniki, Greece, 18\u201321 November 2017"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"105002","DOI":"10.1088\/1361-6579\/aae0eb","article-title":"Threshold-Based Fall Detection Using a Hybrid of Tri-Axial Accelerometer and Gyroscope","volume":"39","author":"Wang","year":"2018","journal-title":"Physiol. Meas."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"35","DOI":"10.51316\/jst.174.ssad.2024.34.2.5","article-title":"Development of a Smart Wearable Device for Fall and Slip Detection and Warning for the Elderly People","volume":"34","author":"Nguyen","year":"2024","journal-title":"JST Smart Syst. Devices"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"6889","DOI":"10.1109\/JSEN.2020.2976554","article-title":"Sensor Technologies for Fall Detection Systems: A Review","volume":"20","author":"Singh","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ezugwu, A.E., Ho, Y.S., Egwuche, O.S., Ekundayo, O.S., Van Der Merwe, A., Saha, A.K., and Pal, J. (2024). Classical Machine Learning: Seventy Years of Algorithmic Learning Evolution. arXiv.","DOI":"10.3724\/2096-7004.di.2024.0051"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Yotov, O., and Aleksieva-Petrova, A. (2024). Data-Driven Prediction Model for Analysis of Sensor Data. Electronics, 13.","DOI":"10.3390\/electronics13101799"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1849","DOI":"10.1109\/JSEN.2020.3018335","article-title":"FallAllD: An Open Dataset of Human Falls and Activities of Daily Living for Classical and Deep Learning Applications","volume":"21","author":"Saleh","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4110246","DOI":"10.1155\/2022\/4110246","article-title":"Pedestrian Fall Event Detection in Complex Scenes Based on Attention-Guided Neural Network","volume":"2022","author":"Geng","year":"2022","journal-title":"Math. Probl. Eng."},{"key":"ref_20","unstructured":"Khalili, S., Mohammadzade, H., and Ahmadi, M.M. (2022). Elderly Fall Detection Using CCTV Cameras Under Partial Occlusion of the Subjects Body. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"8982","DOI":"10.1007\/s10489-024-05645-1","article-title":"Deep learning for computer vision based activity recognition and fall detection of the elderly: A systematic review","volume":"54","year":"2024","journal-title":"Appl. Intell."},{"key":"ref_22","unstructured":"Shukla, P.K., Vijayvargiya, A., and Kumar, R. (2020, January 21\u201322). Human activity recognition using accelerometer and gyroscope data from smartphones. Proceedings of the 2020 International Conference on Emerging Trends in Communication, Control and Computing (ICONC3), Lakshmangarh, India."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"103178","DOI":"10.1016\/j.aei.2025.103178","article-title":"A hybrid CNN-LSTM model for involuntary fall detection using wrist-worn sensors","volume":"65","author":"Hu","year":"2025","journal-title":"Adv. Eng. Inform."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e2100","DOI":"10.7717\/peerj-cs.2100","article-title":"Recognition of sports and daily activities through deep learning and convolutional block attention","volume":"10","author":"Mekruksavanich","year":"2024","journal-title":"PeerJ Comput. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Xia, M., Que, S., Liu, N., Wang, Q., and Li, T. (2025). Motion Pattern Recognition via CNN-LSTM-Attention Model Using Array-Based Wi-Fi CSI Sensors in GNSS-Denied Areas. Electronics, 14.","DOI":"10.3390\/electronics14081594"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"107937","DOI":"10.1016\/j.engappai.2024.107937","article-title":"Transformer-based fall detection in videos","volume":"132","year":"2024","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1994","DOI":"10.1109\/JBHI.2019.2958879","article-title":"Deep learning for fall risk assessment with inertial sensors: Utilizing domain knowledge in spatio-temporal gait parameters","volume":"24","author":"Tunca","year":"2019","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"966","DOI":"10.3390\/make3040048","article-title":"Analysis of Explainers of Black Box Deep Neural Networks for Computer Vision: A Survey","volume":"3","author":"Buhrmester","year":"2021","journal-title":"Mach. Learn. Knowl. Extr."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"11804","DOI":"10.1007\/s10489-024-05747-w","article-title":"A comprehensive review of model compression techniques in machine learning","volume":"54","author":"Dantas","year":"2024","journal-title":"Appl. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Islam, M.M., Nooruddin, S., and Karray, F. (2022, January 9\u201312). Multimodal Human Activity Recognition for Smart Healthcare Applications. Proceedings of the 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Prague, Czech Republic.","DOI":"10.1109\/SMC53654.2022.9945513"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Shin, J., Miah, A.S.M., Egawa, R., Hassan, N., Hirooka, K., and Tomioka, Y. (2025). Multimodal Fall Detection Using Spatial\u2013Temporal Attention and Bi-LSTM-Based Feature Fusion. Future Internet, 17.","DOI":"10.20944\/preprints202503.2247.v1"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Liu, L., Sun, Y., Li, Y., and Liu, Y. (2025). A hybrid human fall detection method based on modified YOLOv8s and AlphaPose. Sci. Rep., 15.","DOI":"10.1038\/s41598-025-86429-6"},{"key":"ref_33","first-page":"215","article-title":"Visual Context-Aware Person Fall Detection","volume":"Volume 411","author":"Czarnowski","year":"2025","journal-title":"Intelligent Decision Technologies, Proceedings of the KESIDT 2024, Rome, Italy, 17\u201319 June 2024"},{"key":"ref_34","unstructured":"(2025, June 29). Azure Kinect DK. Available online: https:\/\/azure.microsoft.com\/en-us\/products\/kinect-dk."},{"key":"ref_35","unstructured":"De Coster, M., Rushe, E., Holmes, R., Ventresque, A., and Dambre, J. (2023). Towards the extraction of robust sign embeddings for low resource sign language recognition. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"103407","DOI":"10.1016\/j.jvcir.2021.103407","article-title":"Fall detection using body geometry and human pose estimation in video sequences","volume":"82","author":"Beddiar","year":"2022","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_37","unstructured":"Mali, V., and Jaiswal, S. (2025). Pose-Based Fall Detection System: Efficient Monitoring on Standard CPUs. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Sultana, A., Deb, K., Dhar, P.K., and Koshiba, T. (2021). Classification of Indoor Human Fall Events Using Deep Learning. Entropy, 23.","DOI":"10.3390\/e23030328"},{"key":"ref_39","unstructured":"(2025, June 29). ResNet\u2014Residual Neural Network. Available online: https:\/\/viso.ai\/deep-learning\/resnet-residual-neural-network\/."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1109\/JBHI.2018.2808281","article-title":"Deep Learning for Fall Detection: Three-Dimensional CNN Combined with LSTM on Video Kinematic Data","volume":"23","author":"Lu","year":"2019","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Yang, J., He, Y., Zhu, J., Lv, Z., and Jin, W. (2024). Fall Detection Method for Infrared Videos Based on Spatial-Temporal Graph Convolutional Network. Sensors, 24.","DOI":"10.3390\/s24144647"},{"key":"ref_42","first-page":"107984","article-title":"Yolov10: Real-time end-to-end object detection","volume":"37","author":"Wang","year":"2024","journal-title":"Adv. Neural Inf. Process Syst."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Maji, D., Nagori, S., Mathew, M., and Poddar, D. (2022, January 19\u201324). Yolo-pose: Enhancing yolo for multi person pose estimation using object keypoint similarity loss. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, New Orleans, LA, USA.","DOI":"10.1109\/CVPRW56347.2022.00297"},{"key":"ref_44","unstructured":"Jagan Mohan, R.N.V., Sekhar, V.C., and Gupta, V.M.N.S.S.V.K.R. (2024). A Study of YOLO (You Only Look Once) to YOLOv8. Algorithms in Advanced Artificial Intelligence, CRC Press."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"e36553","DOI":"10.2196\/36553","article-title":"Ambient Assisted Living: Scoping Review of Artificial Intelligence Models, Domains, Technology, and Concerns","volume":"24","author":"Jovanovic","year":"2022","journal-title":"J. Med. Internet Res."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"e115","DOI":"10.1016\/S2589-7500(20)30275-2","article-title":"Ethical Issues in Using Ambient Intelligence in Health-Care Settings","volume":"3","author":"Luo","year":"2021","journal-title":"Lancet Digit. Health"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Gupta, A., Sawhney, S., and Ahmed, S. (2024). CareTaker.ai\u2014A Smart Health-Monitoring and Caretaker-Assistant System for Elder Healthcare. Eng. Proc., 78.","DOI":"10.3390\/engproc2024078007"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Ullah, R., Asghar, I., Akbar, S., Evans, G., Vermaak, J., Alblwi, A., and Bamaqa, A. (2025). Vision-Based Activity Recognition for Unobtrusive Monitoring of the Elderly in Care Settings. Technologies, 13.","DOI":"10.3390\/technologies13050184"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Cao, X., Zhang, H., Zhou, B., Wang, D., Cui, C., and Bai, X. (2024). Factors Influencing Older Adults\u2019 Acceptance of Voice Assistants. Front. Psychol., 15.","DOI":"10.3389\/fpsyg.2024.1376207"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1186\/s41512-025-00190-y","article-title":"A Scoping Review of Machine Learning Models to Predict Risk of Falls in Elders, Without Using Sensor Data","volume":"9","author":"Capodici","year":"2025","journal-title":"Diagn. Progn. Res."},{"key":"ref_51","unstructured":"(2025, June 29). Fall Detection and Prevention for the Elderly: A Review of Trends and Challenges. Available online: https:\/\/www.academia.edu\/51232799."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Wang, Y., and Deng, T. (2024). Enhancing Elderly Care: Efficient and Reliable Real-Time Fall Detection Algorithm. Digit. Health, 10.","DOI":"10.1177\/20552076241233690"},{"key":"ref_53","unstructured":"(2025, April 25). Le2i Fall Dataset. Available online: https:\/\/www.kaggle.com\/datasets\/tuyenldvn\/falldataset-imvia."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Chamle, M., Gunale, K.G., and Warhade, K.K. (2016, January 26\u201327). Automated unusual event detection in video surveillance. Proceedings of the International Conference on Inventive Computation Technologies (ICICT), Coimbatore, India.","DOI":"10.1109\/INVENTIVE.2016.7824826"},{"key":"ref_55","first-page":"5","article-title":"Human Fall Detection Using Von Mises Distribution and Motion Vectors of Interest Points","volume":"82","author":"Alaoui","year":"2017","journal-title":"Assoc. Comput. Mach."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Poonsri, A., and Chiracharit, W. (2018, January 7\u20139). Improvement of fall detection using consecutive-frame voting. Proceedings of the International Workshop on Advanced Image Technology (IWAIT), Chiang Mai, Thailand.","DOI":"10.1109\/IWAIT.2018.8369696"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/17\/8\/324\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:14:39Z","timestamp":1760033679000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/17\/8\/324"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,23]]},"references-count":56,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2025,8]]}},"alternative-id":["fi17080324"],"URL":"https:\/\/doi.org\/10.3390\/fi17080324","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,23]]}}}