{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,17]],"date-time":"2025-12-17T09:12:58Z","timestamp":1765962778892,"version":"3.48.0"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2025,10,27]],"date-time":"2025-10-27T00:00:00Z","timestamp":1761523200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,10,27]],"date-time":"2025-10-27T00:00:00Z","timestamp":1761523200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Key Research and Development Program of Heilongjiang Province","award":["JD22A014"],"award-info":[{"award-number":["JD22A014"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Hum-Cent Intell Syst"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Traditional fatigue monitoring methods often suffer from in-sufficient real-time performance and low accuracy. To address these limitations, this study proposes a novel facial feature-based approach for driver fatigue monitoring and prediction, aiming to enhance both detection accuracy and real-time responsiveness. Eye features are one of the key indicators for assessing driver fatigue. This research first introduces a new quantitative metric based on eye features to improve the stability and robustness of fatigue characterization. Subsequently, a pre-trained facial keypoint detection model is employed to extract dynamic eye and mouth features, constructing a novel fatigue index that dy-namically reflects real-time changes in facial behavior for more accurate fatigue state assessment. To further improve prediction accuracy, a lightweight CNN-BiLSTM-Attention hybrid model is designed. This model integrates spatial features extracted by convolutional neural networks (CNN) with temporal dependencies captured by a bidirectional long short-term memory (BiLSTM) network, while an attention mechanism is introduced to optimize fatigue-level prediction capabilities. To validate the proposed method, experiments were conducted with six drivers, each lasting no less than 20 min. The results demonstrate that the new fatigue index and prediction model can accurately capture dynamic changes in driver fatigue levels with low prediction error rates. Finally, we also verified the effectiveness of the fatigue index through validation in a public dataset.<\/jats:p>","DOI":"10.1007\/s44230-025-00113-6","type":"journal-article","created":{"date-parts":[[2025,10,27]],"date-time":"2025-10-27T16:16:51Z","timestamp":1761581811000},"page":"545-558","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Driver Fatigue Prediction Method Based on BiLSTM and Novel Comprehensive Fatigue Index"],"prefix":"10.1007","volume":"5","author":[{"given":"Jingliang","family":"Lv","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7813-5218","authenticated-orcid":false,"given":"Yulong","family":"Pei","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,10,27]]},"reference":[{"issue":"3","key":"113_CR1","doi-asserted-by":"publisher","first-page":"666","DOI":"10.1109\/TITS.2017.2706978","volume":"19","author":"CM Martinez","year":"2017","unstructured":"Martinez CM, Heucke M, Wang FY, et al. Driving style recognition for intelligent vehicle control and advanced driver assistance: a survey. IEEE Trans Intell Transp Syst. 2017;19(3):666\u201376.","journal-title":"IEEE Trans Intell Transp Syst"},{"key":"113_CR2","doi-asserted-by":"publisher","DOI":"10.1017\/aer.2024.122","author":"AC Russo","year":"2024","unstructured":"Russo AC, Junior MMC, Villani E. Eye-tracking analysis to assess the mental load of unmanned aerial system operators: systematic review and future directions. Aeronaut J. 2024. https:\/\/doi.org\/10.1017\/aer.2024.122.","journal-title":"Aeronaut J"},{"issue":"7290","key":"113_CR3","doi-asserted-by":"publisher","first-page":"829","DOI":"10.1136\/bmj.322.7290.829","volume":"322","author":"P Philip","year":"2001","unstructured":"Philip P, Vervialle F, Le Breton P, et al. Fatigue, alcohol, and serious road crashes in France: factorial study of national data. BMJ. 2001;322(7290):829\u201330.","journal-title":"BMJ"},{"issue":"3","key":"113_CR4","doi-asserted-by":"publisher","first-page":"499","DOI":"10.1109\/TIV.2022.3154426","volume":"7","author":"S Ansari","year":"2022","unstructured":"Ansari S, Naghdy F, Du H. Human-machine shared driving: challenges and future directions[J]. IEEE Trans Intell Veh. 2022;7(3):499\u2013519.","journal-title":"IEEE Trans Intell Veh"},{"key":"113_CR5","doi-asserted-by":"crossref","unstructured":"Wadhwa A, Roy S S. Driver drowsiness detection using heart rate and behavior methods: a study. Data Analyt Biomed Eng Healthcare, 2021: 163\u2013177.","DOI":"10.1016\/B978-0-12-819314-3.00011-2"},{"issue":"5","key":"113_CR6","doi-asserted-by":"publisher","first-page":"479","DOI":"10.7307\/ptt.v29i5.2244","volume":"29","author":"L Wang","year":"2017","unstructured":"Wang L, Wang H, Jiang X. A new method to detect driver fatigue based on EMG and ECG collected by portable non-contact sensors. Promet-Traffic Transp. 2017;29(5):479\u201388.","journal-title":"Promet-Traffic Transp"},{"issue":"2","key":"113_CR7","first-page":"398","volume":"35","author":"W Fei","year":"2014","unstructured":"Fei W, Shaonan W, Xihui W. Driving fatigue detection based on EEG recognition combined with manipulation features. J Chinese Instr. 2014;35(2):398\u2013404.","journal-title":"J Chinese Instr"},{"key":"113_CR8","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2022.117568","volume":"203","author":"S Ansari","year":"2022","unstructured":"Ansari S, Du H, Naghdy F, et al. Automatic driver cognitive fatigue detection based on upper body posture variations. Expert Syst Appl. 2022;203:117568.","journal-title":"Expert Syst Appl"},{"key":"113_CR9","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2020.113778","volume":"162","author":"S Arefnezhad","year":"2020","unstructured":"Arefnezhad S, Samiee S, Eichberger A, et al. Applying deep neural networks for multi-level classification of driver drowsiness using vehicle-based measures. Expert Syst Appl. 2020;162:113778.","journal-title":"Expert Syst Appl"},{"issue":"17","key":"113_CR10","doi-asserted-by":"publisher","first-page":"8674","DOI":"10.3390\/app12178674","volume":"12","author":"BT Dong","year":"2022","unstructured":"Dong BT, Lin HY, Chang CC. Driver fatigue and distracted driving detection using random forest and convolutional neural network. Appl Sci. 2022;12(17):8674.","journal-title":"Appl Sci"},{"issue":"4","key":"113_CR11","doi-asserted-by":"publisher","first-page":"2224","DOI":"10.3390\/app12042224","volume":"12","author":"T Zhu","year":"2022","unstructured":"Zhu T, Zhang C, Wu T, et al. Research on a real-time driver fatigue detection algorithm based on facial video sequences. Appl Sci. 2022;12(4):2224.","journal-title":"Appl Sci"},{"issue":"3","key":"113_CR12","doi-asserted-by":"publisher","first-page":"545","DOI":"10.1109\/TITS.2016.2582900","volume":"18","author":"B Mandal","year":"2016","unstructured":"Mandal B, Li L, Wang GS, et al. Towards detection of bus driver fatigue based on robust visual analysis of eye state. IEEE Trans Intell Transp Syst. 2016;18(3):545\u201357.","journal-title":"IEEE Trans Intell Transp Syst"},{"key":"113_CR13","doi-asserted-by":"crossref","unstructured":"Dwivedi K, Biswaranjan K, Sethi A. Drowsy driver detection using representation learning[C]\/\/2014 IEEE international advance computing conference (IACC). IEEE, 2014: 995\u2013999.","DOI":"10.1109\/IAdCC.2014.6779459"},{"key":"113_CR14","doi-asserted-by":"crossref","unstructured":"Rahman A, Sirshar M, Khan A. Real time drowsiness detection using eye blink monitoring[C]\/\/2015 National software engineering conference (NSEC). IEEE, 2015: 1\u20137.","DOI":"10.1109\/NSEC.2015.7396336"},{"key":"113_CR15","doi-asserted-by":"crossref","unstructured":"Punitha A, Geetha M K, Sivaprakash A. Driver fatigue monitoring system based on eye state analysis[C]\/\/2014 International Conference on Circuits, Power and Computing Technologies [ICCPCT-2014]. IEEE, 2014: 1405\u20131408.","DOI":"10.1109\/ICCPCT.2014.7055020"},{"key":"113_CR16","doi-asserted-by":"publisher","first-page":"25495","DOI":"10.1007\/s11042-021-10930-z","volume":"80","author":"Z Cui","year":"2021","unstructured":"Cui Z, Sun HM, Yin RN, et al. Real-time detection method of driver fatigue state based on deep learning of face video. Multimedia Tools Appl. 2021;80:25495\u2013515.","journal-title":"Multimedia Tools Appl"},{"issue":"8","key":"113_CR17","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997;9(8):1735\u201380.","journal-title":"Neural Comput"},{"key":"113_CR18","doi-asserted-by":"publisher","DOI":"10.1016\/j.epsr.2022.109065","volume":"216","author":"PN Thanh","year":"2023","unstructured":"Thanh PN, Cho MY. Online leakage current classification using convolutional neural network long short-term memory for high voltage insulators on web-based service. Electr Power Syst Res. 2023;216:109065.","journal-title":"Electr Power Syst Res"},{"key":"113_CR19","doi-asserted-by":"publisher","DOI":"10.1016\/j.physd.2019.132306","volume":"404","author":"A Sherstinsky","year":"2020","unstructured":"Sherstinsky A. Fundamentals of recurrent neural network (RNN) and long short-term memory (LSTM) network. Physica D Nonlinear Phenom. 2020;404:132306.","journal-title":"Physica D Nonlinear Phenom"},{"key":"113_CR20","doi-asserted-by":"publisher","first-page":"188","DOI":"10.1016\/j.future.2020.03.019","volume":"109","author":"X Chen","year":"2020","unstructured":"Chen X, He J, Wu X, et al. Sleep staging by bidirectional long short-term memory convolution neural network. Future Gener Comput Syst. 2020;109:188\u201396.","journal-title":"Future Gener Comput Syst"},{"key":"113_CR21","doi-asserted-by":"publisher","first-page":"124253","DOI":"10.1109\/ACCESS.2021.3110288","volume":"9","author":"Y Xiang","year":"2021","unstructured":"Xiang Y, Tang T, et al. Fast crdnn: towards on site training of mobile construction machines. IEEE Access. 2021;9:124253\u201367.","journal-title":"IEEE Access"},{"key":"113_CR22","doi-asserted-by":"publisher","DOI":"10.1088\/2631-8695\/ad937b","author":"SP Soman","year":"2024","unstructured":"Soman SP, Senthil Kumar G, Nuthalapati S, et al. Internet of things assisted deep learning enabled driver drowsiness monitoring and alert system using CNN-LSTM framework. Eng Res Express. 2024. https:\/\/doi.org\/10.1088\/2631-8695\/ad937b.","journal-title":"Eng Res Express"},{"issue":"2","key":"113_CR23","doi-asserted-by":"publisher","first-page":"576","DOI":"10.1049\/ipr2.12373","volume":"16","author":"MZ Liu","year":"2022","unstructured":"Liu MZ, Xu X, Hu J, et al. Real time detection of driver fatigue based on CNN-LSTM. IET Image Process. 2022;16(2):576\u201395.","journal-title":"IET Image Process"},{"issue":"13","key":"113_CR24","doi-asserted-by":"publisher","DOI":"10.3390\/electronics12132884","volume":"12","author":"FF Wei","year":"2023","unstructured":"Wei FF, Chi T, Chen X. A multi-feature fusion and situation awareness-based method for fatigue driving level determination. Electronics. 2023;12(13):2884.","journal-title":"Electronics"},{"key":"113_CR25","doi-asserted-by":"crossref","unstructured":"Abtahi S, Omidyeganeh M, Shirmohammadi S, Hariri B. YawDD: Yawning Detection Dataset. In Proceedings of the ACM MMSys 2014, Singapore, 2014;19\u201321.","DOI":"10.1145\/2557642.2563678"},{"issue":"12","key":"113_CR26","doi-asserted-by":"publisher","first-page":"3711","DOI":"10.3390\/s25123711","volume":"25","author":"SH Al-Gburi","year":"2025","unstructured":"Al-Gburi SH, Al-Sammak KA, Marghescu I, et al. Effres-drowsynet: a novel hybrid deep learning model combining EfficientNetB0 and ResNet50 for driver drowsiness detection. Sensors. 2025;25(12):3711.","journal-title":"Sensors"},{"key":"113_CR27","volume":"2021","author":"L Chen","year":"2021","unstructured":"Chen L, Xin GJ, Liu YL, et al. Driver fatigue detection based on facial key points and LSTM. Secur Commun Networks. 2021;2021:5383573.","journal-title":"Secur Commun Networks"},{"issue":"12","key":"113_CR28","doi-asserted-by":"publisher","first-page":"13821","DOI":"10.1109\/TCYB.2021.3110813","volume":"52","author":"J Bai","year":"2022","unstructured":"Bai J, Yu W, Xiao Z, et al. Two-stream spatial-temporal graph convolutional networks for driver drowsiness detection. IEEE Trans Cybern. 2022;52(12):13821\u201333.","journal-title":"IEEE Trans Cybern"}],"container-title":["Human-Centric Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44230-025-00113-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44230-025-00113-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44230-025-00113-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,17]],"date-time":"2025-12-17T09:08:58Z","timestamp":1765962538000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44230-025-00113-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,27]]},"references-count":28,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["113"],"URL":"https:\/\/doi.org\/10.1007\/s44230-025-00113-6","relation":{},"ISSN":["2667-1336"],"issn-type":[{"type":"electronic","value":"2667-1336"}],"subject":[],"published":{"date-parts":[[2025,10,27]]},"assertion":[{"value":"4 July 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 September 2025","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 October 2025","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 October 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflicts of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Institutional Review Board Statement: The study was conducted in accordance with the Declaration of Helsinki, and approved by the Scientific Ethics Committee of Northeast Forestry University (protocol code 2024\u2013093 and January 7, 2024).","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Informed consent was obtained from all subjects involved in the study. Written informed consent has been obtained from the patients to publish this paper.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}]}}