{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T15:44:54Z","timestamp":1780674294963,"version":"3.54.1"},"reference-count":25,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2024,1,19]],"date-time":"2024-01-19T00:00:00Z","timestamp":1705622400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["62173133"],"award-info":[{"award-number":["62173133"]}]},{"name":"National Natural Science Foundation of China","award":["61971182"],"award-info":[{"award-number":["61971182"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Fatigue driving is a serious threat to road safety, which is why accurately identifying fatigue driving behavior and warning drivers in time are of great significance in improving traffic safety. However, accurately recognizing fatigue driving is still challenging due to large intra-class variations in facial expression, continuity of behaviors, and illumination conditions. A fatigue driving recognition method based on feature parameter images and a residual Swin Transformer is proposed in this paper. First, the face region is detected through spatial pyramid pooling and a multi-scale feature output module. Then, a multi-scale facial landmark detector is used to locate 23 key points on the face. The aspect ratios of the eyes and mouth are calculated based on the coordinates of these key points, and a feature parameter matrix for fatigue driving recognition is obtained. Finally, the feature parameter matrix is converted into an image, and the residual Swin Transformer network is presented to recognize fatigue driving. Experimental results on the HNUFD dataset show that the proposed method achieves an accuracy of 96.512%, thus outperforming state-of-the-art methods.<\/jats:p>","DOI":"10.3390\/s24020636","type":"journal-article","created":{"date-parts":[[2024,1,19]],"date-time":"2024-01-19T03:33:41Z","timestamp":1705635221000},"page":"636","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["FPIRST: Fatigue Driving Recognition Method Based on Feature Parameter Images and a Residual Swin Transformer"],"prefix":"10.3390","volume":"24","author":[{"given":"Weichu","family":"Xiao","sequence":"first","affiliation":[{"name":"College of Electrical and Information Engineering, Hunan University, Changsha 410082, China"},{"name":"College of Information and Electronic Engineering, Hunan City University, Yiyang 413046, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongli","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Electrical and Information Engineering, Hunan University, Changsha 410082, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ziji","family":"Ma","sequence":"additional","affiliation":[{"name":"College of Electrical and Information Engineering, Hunan University, Changsha 410082, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weihong","family":"Chen","sequence":"additional","affiliation":[{"name":"College of Information Technology and Management, Hunan University of Finance and Economics, Changsha 410205, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jie","family":"Hou","sequence":"additional","affiliation":[{"name":"College of Electrical and Information Engineering, Hunan University, Changsha 410082, China"},{"name":"College of Information and Electronic Engineering, Hunan City University, Yiyang 413046, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,1,19]]},"reference":[{"key":"ref_1","unstructured":"Liu, C., and Subramanian, R. (2009). Factors Related to Fatal Single-Vehicle Run-Off-Road Crashes, URC Enterprises. Report HS-811 232."},{"key":"ref_2","first-page":"104","article-title":"Relationship between fatigue driving and traffic accident","volume":"10","author":"Li","year":"2010","journal-title":"J. Traffic transp. Eng."},{"key":"ref_3","first-page":"394","article-title":"Fatigue driving detection method based on eye movement feature","volume":"39","author":"Niu","year":"2015","journal-title":"J. Harbin Eng. Univ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"19999","DOI":"10.1109\/TITS.2022.3189346","article-title":"A systematic survey of driving fatigue monitoring","volume":"23","author":"Zhang","year":"2022","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1499","DOI":"10.1109\/LSP.2016.2603342","article-title":"Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks","volume":"23","author":"Zhang","year":"2016","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Xiao, W., Liu, H., Ma, Z., Chen, W., Sun, C., and Shi, B. (2022). Fatigue Driving Recognition Method Based on Multi-Scale Facial Landmark Detector. Electronics, 11.","DOI":"10.3390\/electronics11244103"},{"key":"ref_7","unstructured":"Guo, X., Li, S., Yu, J., Zhang, J., Ma, J., Ma, L., Liu, W., and Ling, H. (2019, January 16\u201320). PFLD: A Practical Facial Landmark Detector. Proceedings of the IEEE Conference Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Puspasari, M.A., Iridiastadi, H., Sutalaksana, I.Z., and Sjafruddin, A. (2018, January 21\u201324). Fatigue Classification of Ocular Indicators using Support Vector Machine. Proceedings of the International Conference on Intelligent Informatics and Biomedical Science (ICIIBMS), Bangkok, Thailand.","DOI":"10.1109\/ICIIBMS.2018.8549999"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"5383573","DOI":"10.1155\/2021\/5383573","article-title":"Driver fatigue detection based on facial key points and LSTM","volume":"2021","author":"Chen","year":"2021","journal-title":"Secur. Commun. Netw."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4755","DOI":"10.1109\/TCSVT.2019.2958188","article-title":"Driver Drowsiness Recognition via 3D Conditional GAN and Two-Level Attention Bi-LSTM","volume":"30","author":"Hu","year":"2020","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2339","DOI":"10.1109\/TITS.2018.2868499","article-title":"Driver Fatigue Detection Systems: A Review","volume":"20","author":"Sikander","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhang, N., Zhang, H., and Huang, J. (2019, January 2\u20134). Driver Fatigue State Detection Based on Facial Key Points. Proceedings of the of the 6th International Conference on Information Systems (ICSAI), Shanghai, China.","DOI":"10.1109\/ICSAI48974.2019.9010478"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Qin, X., Yang, P., Shen, Y., Li, M., Hu, J., and Yun, J. (2020, January 13\u201316). Classification of driving fatigue based on EEG signals. Proceedings of the International Symposium on Computer, Consumer and Control (IS3C), Taichung City, Taiwan.","DOI":"10.1109\/IS3C50286.2020.00138"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"12745","DOI":"10.1109\/TCYB.2021.3088519","article-title":"Multiview learning with robust double-sided twin SVM","volume":"52","author":"Ye","year":"2022","journal-title":"IEEE Trans. Cybern."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1109\/TNNLS.2020.3027588","article-title":"Learning Robust Discriminant Subspace Based on Joint L2,p- and L2,s-Norm Distance Metrics","volume":"33","author":"Fu","year":"2022","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"706","DOI":"10.1016\/j.comcom.2020.07.015","article-title":"Deep reinforcement learning-based resource allocation strategy for energy harvesting-powered cognitive machine-to-machine networks","volume":"160","author":"Xu","year":"2020","journal-title":"Comput. Commun."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Chen, L., Li, S., Bai, Q., Yang, J., Jiang, S., and Miao, Y. (2021). Review of image classification algorithms based on convolutional neural networks. Remote Sens., 13.","DOI":"10.3390\/rs13224712"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"Lecun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_20","unstructured":"Simonyan, K., and Zisserman, A. (, January 7\u20139). Very deep convolutional networks for large-scale image recognition. Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., and Sermanet, P. (2015, January 8\u201310). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognitio (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_22","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA."},{"key":"ref_23","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., and Unterthiner, T. (2021, January 3\u20137). An image is worth 16x16 words: Transformers for image recognition at scale. Proceedings of the International Conference on Learning Representations(ICLR), Virtual Event."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11\u201317). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1166","DOI":"10.1016\/j.jfranklin.2022.12.016","article-title":"BiRSwinT: Bilinear full-scale residual swin-transformer for fine-grained driver behavior recognition","volume":"360","author":"Yang","year":"2023","journal-title":"J. Frankl. Inst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/2\/636\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:45:48Z","timestamp":1760103948000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/2\/636"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,19]]},"references-count":25,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2024,1]]}},"alternative-id":["s24020636"],"URL":"https:\/\/doi.org\/10.3390\/s24020636","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,19]]}}}