{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:23:53Z","timestamp":1760145833982,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2024,9,8]],"date-time":"2024-09-08T00:00:00Z","timestamp":1725753600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Taiwan Ministry of Science and Technology","award":["MOST 110-2221-E-224-041-MY3"],"award-info":[{"award-number":["MOST 110-2221-E-224-041-MY3"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Fatigued driving is a problem that every driver will face, and traffic accidents caused by drowsy driving often occur involuntarily. If there is a fatigue detection and warning system, it is generally believed that the occurrence of some incidents can be reduced. However, everyone\u2019s driving habits and methods may differ, so it is not easy to establish a suitable general detection system. If a customized intelligent fatigue detection system can be established, it may reduce unfortunate accidents. With its potential to mitigate unfortunate accidents, this study offers hope for a safer driving environment. Thus, on the one hand, this research hopes to integrate the information obtained from three different sensing devices (eye movement, finger pressure, and plantar pressure), which are chosen for their ability to provide comprehensive and reliable data on a driver\u2019s physical and mental state. On the other hand, it uses an autonomous learning architecture to integrate these three data types to build a customized fatigued driving detection system. This study used a system that simulated a car driving environment and then invited subjects to conduct tests on fixed driving routes. First, we demonstrated that the system established in this study could be used to learn and classify different driving clips. Then, we showed that it was possible to judge whether the driver was fatigued through a series of driving behaviors, such as lane drifting, sudden braking, and irregular acceleration, rather than a single momentary behavior. Finally, we tested the hypothesized situation in which drivers were experiencing three cases of different distractions. The results show that the entire system can establish a personal driving system through autonomous learning behavior and further detect whether fatigued driving abnormalities occur.<\/jats:p>","DOI":"10.3390\/a17090402","type":"journal-article","created":{"date-parts":[[2024,9,9]],"date-time":"2024-09-09T04:15:01Z","timestamp":1725855301000},"page":"402","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Integrating Eye Movement, Finger Pressure, and Foot Pressure Information to Build an Intelligent Driving Fatigue Detection System"],"prefix":"10.3390","volume":"17","author":[{"given":"Jong-Chen","family":"Chen","sequence":"first","affiliation":[{"name":"Information Management Department, National Yunlin University of Science and Technology, Douliu 640, Taiwan"}]},{"given":"Yin-Zhen","family":"Chen","sequence":"additional","affiliation":[{"name":"Information Management Department, National Yunlin University of Science and Technology, Douliu 640, Taiwan"}]}],"member":"1968","published-online":{"date-parts":[[2024,9,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2339","DOI":"10.1109\/TITS.2018.2868499","article-title":"Driver Fatigue Detection Systems: A Review","volume":"20","author":"Sikander","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1177\/03611981221096118","article-title":"Evolution of driver fatigue detection techniques\u2014A review from 2007 to 2021","volume":"2676","author":"Kamti","year":"2022","journal-title":"Transp. Res. Record."},{"key":"ref_3","first-page":"3214","article-title":"Multimodal features for detection of driver stress and Fatigue: Review","volume":"22","author":"Hesko","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3017","DOI":"10.1109\/TITS.2015.2462084","article-title":"Driver behavior analysis for safe driving: A survey","volume":"16","author":"Kaplan","year":"2015","journal-title":"IEEE Trans. Intell. Transp. Systems."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Abbas, Q., and Alsheddy, A. (2020). Driver fatigue detection systems using multi-sensors, smartphone, and cloud-based computing platforms: A comparative analysis. Sensors, 21.","DOI":"10.3390\/s21010056"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1016\/j.eswa.2016.06.042","article-title":"Dynamic driver fatigue detection using hidden Markov model in actual driving conditions","volume":"63","author":"Fu","year":"2016","journal-title":"Expert Syst. Appl."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1109\/JSEN.2015.2475638","article-title":"Smart watch-based driver vigilance indicator with kernel-fuzzy-C-Means-Wavelet method","volume":"16","author":"Lee","year":"2016","journal-title":"IEEE Sens. J."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/j.apergo.2018.06.006","article-title":"Mental workload is reflected in driver behavior, physiology, eye movements, and prefrontal cortex activation","volume":"73","author":"Foy","year":"2018","journal-title":"Appl. Ergon."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1016\/j.cogr.2022.01.003","article-title":"Eye fatigue estimation using blink detection based on eye aspect ratio mapping","volume":"2","author":"Kuwahara","year":"2022","journal-title":"Cogn. Robot."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"46389","DOI":"10.1109\/ACCESS.2019.2909035","article-title":"Feature extraction and simulation of EEG Signals during exercise-induced Fatigue","volume":"7","author":"Yang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1438","DOI":"10.1109\/TII.2016.2573259","article-title":"An accurate ECG-based transportation safety drowsiness detection scheme","volume":"12","author":"Chui","year":"2016","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1016\/j.jbmt.2006.12.005","article-title":"EMG-based analysis of change in muscle activity during simulated driving","volume":"11","author":"Balasubramanian","year":"2007","journal-title":"J. Bodyw. Mov. Ther."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"5956","DOI":"10.1109\/JSEN.2023.3239029","article-title":"Fatigue working detection based on facial multi-feature fusion","volume":"23","author":"Yi","year":"2023","journal-title":"IEEE Sens. J."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1650010:1","DOI":"10.1142\/S0218001416500105","article-title":"Video-based classification of driving behavior using a hierarchical classification system with multiple features","volume":"30","author":"Yan","year":"2016","journal-title":"Int. J. Pattern Recognit. Artif. Intel."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Xiao, W., Liu, H., Ma, Z., Chen, W., Sun, C., and Shi, B. (2022). Fatigued driving recognition method based on multi-scale facial landmark detector. Electronics, 11.","DOI":"10.3390\/electronics11244103"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"7157","DOI":"10.1109\/TPAMI.2022.3222784","article-title":"AlphaPose: Whole-body regional multi-person pose estimation and tracking in real-Time","volume":"45","author":"Fang","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"12491","DOI":"10.1109\/ACCESS.2020.2963960","article-title":"Real-time driver fatigue detection system based on multi-task ConNN","volume":"8","author":"Becerikli","year":"2020","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"117568","DOI":"10.1016\/j.eswa.2022.117568","article-title":"Automatic driver cognitive fatigue detection based on upper body posture variations","volume":"203","author":"Ansari","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Chen, J., Yan, M., Zhu, F., Xu, J., Li, H.L., and Sun, X. (2022). Fatigued driving detection method based on combination of BP neural network and time cumulative effect. Sensors, 22.","DOI":"10.3390\/s22134717"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"12361","DOI":"10.1007\/s00521-021-06856-0","article-title":"The road rage detection algorithm is based on fatigued driving and facial feature point location","volume":"34","author":"Shulei","year":"2022","journal-title":"Neural Comput. Appl."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.neucom.2012.02.041","article-title":"Eye-based vigilance estimation using extreme learning machines","volume":"102","author":"Shi","year":"2013","journal-title":"Neurocomputing"},{"key":"ref_22","unstructured":"D\u2019orazio, T., Leo, M., and Distante, A. (2004, January 14\u201317). Eye detection in face images for a driver vigilance system. Proceedings of the IEEE Intelligent Vehicles Symposium, Parma, Italy."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2419","DOI":"10.1007\/s00371-023-02927-6","article-title":"A multi-feature fusion algorithm for driver fatigue detection based on a lightweight convolutional neural network","volume":"40","author":"Cheng","year":"2024","journal-title":"Visual Comput."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhou, C., Zhao, Y., Liu, S., Zhao, Y., Li, X., and Cheng, C. (June, January 31). Research on driver facial fatigue detection based on Yolov8 model. Proceedings of the 5th International Conference on Information Science, Parallel and Distributed Systems (ISPDS 2024), Guangzhou, China.","DOI":"10.36227\/techrxiv.171822194.49730312\/v1"},{"key":"ref_25","first-page":"68","article-title":"Hand position on steering wheel during fatigue and sleepiness case: Driving simulator","volume":"53","author":"Soulmana","year":"2021","journal-title":"Adv. Transp. Stud."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/j.jsr.2005.11.003","article-title":"Vigilance monitoring for operator safety: A simulation study on highway driving","volume":"37","author":"Desai","year":"2006","journal-title":"J. Saf. Res."},{"key":"ref_27","unstructured":"Chieh, T.C., Mustafa, M.M., Hussain, A., Zahedi, E., and Majlis, B. (2003, January 25\u201326). Driver fatigue detection using steering grip force. Proceedings of the IEEE Student Conference on Research and Development, Putrajaya, Malaysia."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Eskandarian, A., and Mortazavi, A. (2007, January 13\u201315). Evaluation of a smart algorithm for commercial vehicle driver drowsiness detection. Proceedings of the 2007 IEEE Intelligent Vehicles Symposium, Istanbul, Turkey.","DOI":"10.1109\/IVS.2007.4290173"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"071008","DOI":"10.1115\/1.4029718","article-title":"A study of the continuous optimization problem using a wood robot controlled by a biologically motivated system","volume":"137","author":"Chen","year":"2015","journal-title":"J. Dyn. Syst. Meas. Control."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Chen, J.-C. (2023). Bridging the finger-action gap between hand patients and healthy people in daily life with a biomimetic System. Biomimetics, 8.","DOI":"10.3390\/biomimetics8010076"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Chen, J.-C. (2022). Using artificial neuro-molecular system in robotic arm motion control\u2014Taking simulation of rehabilitation as an example. Sensors, 22.","DOI":"10.3390\/s22072584"},{"key":"ref_32","unstructured":"Conrad, M. (1983). Adaptability, the Significance of Variability from Molecule to Ecosystem, Plenum Press."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1261\/rna.079004.121","article-title":"Weak multivalent biomolecular interactions: A strength versus numbers tug of war with implications for phase partitioning","volume":"28","author":"Darzacq","year":"2022","journal-title":"RNA"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/17\/9\/402\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:51:32Z","timestamp":1760111492000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/17\/9\/402"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,8]]},"references-count":33,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["a17090402"],"URL":"https:\/\/doi.org\/10.3390\/a17090402","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2024,9,8]]}}}