{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T07:05:34Z","timestamp":1776755134900,"version":"3.51.2"},"reference-count":35,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2020,2,29]],"date-time":"2020-02-29T00:00:00Z","timestamp":1582934400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["51775178"],"award-info":[{"award-number":["51775178"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this study, a novel classification method for a driver\u2019s cognitive stress level was proposed, whereby the interbeat intervals extracted from an electrocardiogram (ECG) signal were transferred to pictures, and a convolution neural network (CNN) was used to train the pictures to classify a driver\u2019s cognitive stress level. First, we defined three levels of tasks and collected the ECG signal of the driver at different cognitive stress levels by designing and performing a driving simulation experiment. We extracted the interbeat intervals and converted them to pictures according to the number of consecutive interbeat intervals in each picture. Second, the CNN model was used to train the data set to recognize the cognitive stress levels. Classification accuracies of 100%, 91.6% and 92.8% were obtained for the training set, validation set and test set, respectively, and were compared with those the BP neural network. Last, we discussed the influence of the number of interbeat intervals in each picture on the performance of the proposed classification method. The results showed that the performance initially improved with an increase in the number of interbeat intervals. A downward trend was observed when the number exceeded 40, and when the number was 40, the model performed best with the highest accuracy (98.79%) and a relatively low relative standard deviation (0.019).<\/jats:p>","DOI":"10.3390\/s20051340","type":"journal-article","created":{"date-parts":[[2020,3,3]],"date-time":"2020-03-03T03:13:28Z","timestamp":1583205208000},"page":"1340","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["A Novel Classification Method for a Driver\u2019s Cognitive Stress Level by Transferring Interbeat Intervals of the ECG Signal to Pictures"],"prefix":"10.3390","volume":"20","author":[{"given":"Jing","family":"Huang","sequence":"first","affiliation":[{"name":"Research Centre of Vehicle and Traffic Safety, State Key Laboratory of Advanced Design and Manufacturing for Vehicle Body, Hunan University, Changsha 410082, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiong","family":"Luo","sequence":"additional","affiliation":[{"name":"Research Centre of Vehicle and Traffic Safety, State Key Laboratory of Advanced Design and Manufacturing for Vehicle Body, Hunan University, Changsha 410082, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaoyan","family":"Peng","sequence":"additional","affiliation":[{"name":"Research Centre of Vehicle and Traffic Safety, State Key Laboratory of Advanced Design and Manufacturing for Vehicle Body, Hunan University, Changsha 410082, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,2,29]]},"reference":[{"key":"ref_1","unstructured":"National Center for Statistics and Analysis (2018). Distracted Driving 2016."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"577","DOI":"10.3758\/s13423-013-0541-x","article-title":"Modeling simple driving tasks with a one-boundary diffusion model","volume":"21","author":"Ratcliff","year":"2014","journal-title":"Psychon. Bull. Rev."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1001","DOI":"10.1177\/0018720813480177","article-title":"The impact of eye movements and cognitive workload on lateral position variability in driving","volume":"55","author":"Cooper","year":"2013","journal-title":"Hum. Factors"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"454","DOI":"10.1177\/0018720812437274","article-title":"A field study on the impact of variations in short-term memory demands on drivers\u2019 visual attention and driving performance across three age groups","volume":"54","author":"Reimer","year":"2012","journal-title":"Hum. Factors"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1177\/0018720815619074","article-title":"SPIDER: A framework for understanding driver distraction","volume":"58","author":"Strayer","year":"2016","journal-title":"Hum. Factors"},{"key":"ref_6","unstructured":"National Center for Statistics and Analysis (2017). Distracted Driving 2015."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/j.aap.2015.02.021","article-title":"Identification of common features of vehicle motion under drowsy\/distracted driving: A case study in Wuhan, China","volume":"81","author":"Chen","year":"2015","journal-title":"Accid. Anal. Prev."},{"key":"ref_8","unstructured":"Abouelnaga, Y., Eraqi, H.M., and Moustafa, M.N. (2017). Real-time distracted driver posture classification. arXiv, Available online: https:\/\/arxiv.org\/abs\/1706.09498."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1462","DOI":"10.1109\/TITS.2013.2262098","article-title":"Visual analysis of eye state and head pose for driver alertness monitoring","volume":"14","author":"Mbouna","year":"2013","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_10","unstructured":"Craye, C., and Karray, F. (2015). Driver distraction detection and recognition using RGB-D sensor. arXiv, Available online: https:\/\/arxiv.org\/abs\/1502.00250."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1016\/j.apergo.2016.09.013","article-title":"Classification of a Driver\u2019s cognitive workload levels using artificial neural network on ECG signals","volume":"59","author":"Tjolleng","year":"2017","journal-title":"Appl. Ergon."},{"key":"ref_12","unstructured":"Guardiola, S., Girb\u00e9s, V., Armesto, L., Dols, J., and Tornero, J. (2020, February 28). Physiological Signal Analysis for Driver Stress Detection. Available online: https:\/\/www.researchgate.net\/publication\/320244776_PHYSIOLOGICAL_SIGNAL_ANALYSIS_FOR_DRDRIV_STRESS_DETECTION."},{"key":"ref_13","first-page":"503","article-title":"Acclimatizing to automation: Driver workload and stress during partially automated car following in real traffic","volume":"65","author":"Heikoop","year":"2019","journal-title":"Transp. Res."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1016\/j.bspc.2015.02.012","article-title":"Acute mental stress assessment via short term HRV analysis in healthy adults: A systematic review with meta-analysis","volume":"18","author":"Castaldo","year":"2015","journal-title":"Biomed. Signal. Process. Control."},{"key":"ref_15","first-page":"797","article-title":"Can cECG be an unobtrusive surrogate to determine cognitive state of driver?","volume":"58","author":"Balasubramanian","year":"2018","journal-title":"Transp. Res."},{"key":"ref_16","first-page":"218","article-title":"Deep in thought while driving: An EEG study on drivers\u2019 cognitive distraction","volume":"26","author":"Almahasneh","year":"2014","journal-title":"Transp. Res."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"715","DOI":"10.1109\/JBHI.2016.2532354","article-title":"Driver fatigue classification with independent component by entropy rate bound minimization analysis in an EEG-based system","volume":"21","author":"Chai","year":"2016","journal-title":"IEEE J. Biomed. Health Inf."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"105296","DOI":"10.1016\/j.aap.2019.105296","article-title":"Comparison among driving state prediction models for car-following condition based on EEG and driving features","volume":"133","author":"Yang","year":"2019","journal-title":"Accid. Anal. Prev."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Di Flumeri, G., Borghini, G., Aric\u00f2, P., Colosimo, A., Pozzi, S., Bonelli, S., Golfetti, A., Kong, W., and Babiloni, F. (2015, January 7\u20138). On the use of cognitive neurometric indexes in aeronautic and air traffic management environments. Proceedings of the International Workshop on Symbiotic Interaction, Berlin, Germany.","DOI":"10.1007\/978-3-319-24917-9_5"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"509","DOI":"10.3389\/fnhum.2018.00509","article-title":"EEG-based mental workload neurometric to evaluate the impact of different traffic and road conditions in real driving settings","volume":"12","author":"Borghini","year":"2018","journal-title":"Front. Hum. Neurosci."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Di Flumeri, G., Borghini, G., Aric\u00f2, P., Sciaraffa, N., Lanzi, P., Pozzi, S., Vignali, V., Lantieri, C., Bichicchi, A., and Simone, A. (2019). EEG-based mental workload assessment during real driving: A taxonomic tool for neuroergonomics in highly automated environments. Neuroergonomics, Academic Press.","DOI":"10.1016\/B978-0-12-811926-6.00020-8"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"740","DOI":"10.1016\/j.bspc.2013.06.014","article-title":"A comparative evaluation of neural network classifiers for stress level analysis of automotive drivers using physiological signals","volume":"8","author":"Singh","year":"2013","journal-title":"Biomed. Signal. Process. Control."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"909","DOI":"10.1080\/18756891.2013.864478","article-title":"Assessment of driver stress from physiological signals collected under real-time semi-urban driving scenarios","volume":"7","author":"Singh","year":"2014","journal-title":"Int. J. Comput. Intell. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Rajendra, V. (2018). Characterization and Identification of Distraction During Naturalistic Driving Using Wearable Non-Intrusive Physiological Measure of Galvanic Skin Responses. [Master\u2019s Thesis, University of Michigan-Dearborn].","DOI":"10.1109\/BSN.2017.7936031"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1835","DOI":"10.1109\/TITS.2016.2617881","article-title":"Wearable glove-type driver stress detection using a motion sensor","volume":"18","author":"Lee","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhang, Y.F., Gao, X.Y., Zhu, J.Y., Zheng, W.L., and Lu, B.L. (2015, January 22\u201324). A novel approach to driving fatigue detection using forehead EOG. Proceedings of the 2015 7th International IEEE\/EMBS Conference on Neural Engineering (NER), Piscataway, NJ, USA.","DOI":"10.1109\/NER.2015.7146721"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"026017","DOI":"10.1088\/1741-2552\/aa5a98","article-title":"A multimodal approach to estimating vigilance using EEG and forehead EOG","volume":"14","author":"Zheng","year":"2017","journal-title":"J. Neural Eng."},{"key":"ref_28","unstructured":"Cafasso, A., and Karlsson, S. (2017). Automatic Detection of Saccadic Eye Movements Using EOG for Analysing Effects of Cognitive Distraction during Driving. [Master\u2019s Thesis, Chalmers University of Technology]."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_30","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1016\/j.patcog.2017.10.013","article-title":"Recent advances in convolutional neural networks","volume":"77","author":"Gu","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kasakawa, S., Yamanishi, T., Takahashi, T., Ueno, K., Kikuchi, M., and Nishimura, H. (2016). Approaches of phase lag index to EEG signals in Alzheimer\u2019s disease from complex network analysis. Innovation in Medicine and Healthcare 2015, Springer, Cham.","DOI":"10.1007\/978-3-319-23024-5_42"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"103","DOI":"10.3389\/fnins.2017.00103","article-title":"Improving EEG-based driver fatigue classification using sparse-deep belief networks","volume":"11","author":"Chai","year":"2017","journal-title":"Front. Neurosci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2755","DOI":"10.1109\/TNNLS.2018.2886414","article-title":"EEG-based spatio\u2013temporal convolutional neural network for driver fatigue evaluation","volume":"30","author":"Gao","year":"2019","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1109\/TBME.1985.325532","article-title":"A real-time QRS detection algorithm","volume":"32","author":"Pan","year":"1985","journal-title":"IEEE Trans. Biomed. Eng."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/5\/1340\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:02:53Z","timestamp":1760173373000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/5\/1340"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,29]]},"references-count":35,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2020,3]]}},"alternative-id":["s20051340"],"URL":"https:\/\/doi.org\/10.3390\/s20051340","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,29]]}}}