{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T10:27:26Z","timestamp":1777631246530,"version":"3.51.4"},"reference-count":35,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2023,8,24]],"date-time":"2023-08-24T00:00:00Z","timestamp":1692835200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006769","name":"Russian Science Foundation","doi-asserted-by":"publisher","award":["8-71-10065"],"award-info":[{"award-number":["8-71-10065"]}],"id":[{"id":"10.13039\/501100006769","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006769","name":"Russian Science Foundation","doi-asserted-by":"publisher","award":["FFZF-2022-0005"],"award-info":[{"award-number":["FFZF-2022-0005"]}],"id":[{"id":"10.13039\/501100006769","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Russian State Research","award":["8-71-10065"],"award-info":[{"award-number":["8-71-10065"]}]},{"name":"Russian State Research","award":["FFZF-2022-0005"],"award-info":[{"award-number":["FFZF-2022-0005"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Driving behaviour analysis has drawn much attention in recent years due to the dramatic increase in the number of traffic accidents and casualties, and based on many studies, there is a relationship between the driving environment or behaviour and the driver\u2019s state. To the best of our knowledge, these studies mostly investigate relationships between one vital sign and the driving circumstances either inside or outside the cabin. Hence, our paper provides an analysis of the correlation between the driver state (vital signs, eye state, and head pose) and both the vehicle maneuver actions (caused by the driver) and external events (carried out by other vehicles or pedestrians), including the proximity to other vehicles. Our methodology employs several models developed in our previous work to estimate respiratory rate, heart rate, blood pressure, oxygen saturation, head pose, eye state from in-cabin videos, and the distance to the nearest vehicle from out-cabin videos. Additionally, new models have been developed using Convolutional Neural Network (CNN) and Bidirectional Long Short-Term Memory (BiLSTM) to classify the external events from out-cabin videos, as well as a Decision Tree classifier to detect the driver\u2019s maneuver using accelerometer and gyroscope sensor data. The dataset used includes synchronized in-cabin\/out-cabin videos and sensor data, allowing for the estimation of the driver state, proximity to other vehicles and detection of external events, and driver maneuvers. Therefore, the correlation matrix was calculated between all variables to be analysed. The results indicate that there is a weak correlation connecting both the maneuver action and the overtaking external event on one side and the heart rate and the blood pressure (systolic and diastolic) on the other side. In addition, the findings suggest a correlation between the yaw angle of the head and the overtaking event and a negative correlation between the systolic blood pressure and the distance to the nearest vehicle. Our findings align with our initial hypotheses, particularly concerning the impact of performing a maneuver or experiencing a cautious event, such as overtaking, on heart rate and blood pressure due to the agitation and tension resulting from such events. These results can be the key to implementing a sophisticated safety system aimed at maintaining the driver\u2019s stable state when aggressive external events or maneuvers occur.<\/jats:p>","DOI":"10.3390\/s23177387","type":"journal-article","created":{"date-parts":[[2023,8,24]],"date-time":"2023-08-24T10:47:08Z","timestamp":1692874028000},"page":"7387","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["A Machine Learning-Based Correlation Analysis between Driver Behaviour and Vital Signs: Approach and Case Study"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8581-1333","authenticated-orcid":false,"given":"Walaa","family":"Othman","sequence":"first","affiliation":[{"name":"Saint Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS), 199178 St. Petersburg, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8568-7440","authenticated-orcid":false,"given":"Batol","family":"Hamoud","sequence":"additional","affiliation":[{"name":"Saint Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS), 199178 St. Petersburg, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6503-1447","authenticated-orcid":false,"given":"Alexey","family":"Kashevnik","sequence":"additional","affiliation":[{"name":"Saint Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS), 199178 St. Petersburg, Russia"},{"name":"Institute of Mathematics and Information Technologies, Perozavodsk State University (PetrSU), 185035 Petrozavodsk, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9264-9127","authenticated-orcid":false,"given":"Nikolay","family":"Shilov","sequence":"additional","affiliation":[{"name":"Saint Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS), 199178 St. Petersburg, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ammar","family":"Ali","sequence":"additional","affiliation":[{"name":"Information Technology and Programming Faculty, ITMO University, 191002 St. Petersburg, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Fisa, R., Musukuma, M., Sampa, M., Musonda, P., and Young, T. (2022). Effects of interventions for preventing road traffic crashes: An overview of systematic reviews. BMC Public Health, 22.","DOI":"10.1186\/s12889-021-12253-y"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1007\/s11036-017-0833-x","article-title":"On the Correlation Between Heart Rate and Driving Style in Real Driving Scenarios","volume":"23","author":"Meseguer","year":"2018","journal-title":"Mob. Netw. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1177\/014107680309601001","article-title":"How to Reduce the Toll of Road Traffic Accidents","volume":"96","author":"Charlton","year":"2003","journal-title":"J. R. Soc. Med."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1019","DOI":"10.1016\/j.apergo.2008.06.010","article-title":"Driving with a congestion assistant; mental workload and acceptance","volume":"40","author":"Brookhuis","year":"2009","journal-title":"Appl. Ergon."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"525","DOI":"10.3389\/fnhum.2018.00525","article-title":"Respiration and Heart Rate Modulation Due to Competing Cognitive Tasks While Driving","volume":"12","author":"Fort","year":"2019","journal-title":"Front. Hum. Neurosci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1366","DOI":"10.1111\/jch.13102","article-title":"Traffic congestion and blood pressure elevation: A comparative cross-sectional study in Lebanon","volume":"19","author":"Hosni","year":"2017","journal-title":"J. Clin. Hypertens."},{"key":"ref_7","unstructured":"O\u2019Shea, K., and Nash, R. (2015). An Introduction to Convolutional Neural Networks. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1162\/tacl_a_00104","article-title":"Named Entity Recognition with Bidirectional LSTM-CNNs","volume":"4","author":"Chiu","year":"2016","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Othman, W., and Kashevnik, A. (2022, January 24\u201326). Video-Based Real-Time Heart Rate Detection for Drivers Inside the Cabin Using a Smartphone. Proceedings of the 2022 IEEE International Conference on Internet of Things and Intelligence Systems (IoTaIS), Bali, Indonesia.","DOI":"10.1109\/IoTaIS56727.2022.9975941"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Hamoud, B., Kashevnik, A., Othman, W., and Shilov, N. (2023). Neural Network Model Combination for Video-Based Blood Pressure Estimation: New Approach and Evaluation. Sensors, 23.","DOI":"10.3390\/s23041753"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Arai, K. (2023). Intelligent Systems and Applications, Springer.","DOI":"10.1007\/978-3-031-16072-1"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Hamoud, B., Othman, W., Kashevnik, A., and Shilov, N. (2023, January 24\u201326). Contact-Less Oxygen Saturation Detection Based on Face Analisys: An Approach and Case Study. Proceedings of the 33rd Conference of Open Innovations Association (FRUCT), Zilina, Slovakia.","DOI":"10.23919\/FRUCT58615.2023.10143059"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1007\/978-3-030-63128-4_18","article-title":"Human head angle detection based on image analysis","volume":"Volume 1","author":"Kashevnik","year":"2021","journal-title":"Proceedings of the Future Technologies Conference (FTC) 2020"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1016\/j.procs.2014.07.009","article-title":"A Study on Human Activity Recognition Using Accelerometer Data from Smartphones","volume":"34","author":"Bayat","year":"2014","journal-title":"Procedia Comput. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"20843","DOI":"10.3390\/s141120843","article-title":"Using Smart Phone Sensors to Detect Transportation Modes","volume":"14","author":"Xia","year":"2014","journal-title":"Sensors"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Woo, C., and Kulic, D. (2016, January 19\u201322). Manoeuvre segmentation using smartphone sensors. Proceedings of the 2016 IEEE Intelligent Vehicles Symposium (IV), Gothenburg, Sweden.","DOI":"10.1109\/IVS.2016.7535444"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"\u017dylius, G., Vaitkus, V., and Lengvenis, P. (2014, January 2\u20135). Driving Style Classification using Long-Term Accelerometer Information. Proceedings of the 19th International Conference on Methods and Models in Automation and Robotics (MMAR), Miedzyzdroje, Poland.","DOI":"10.1109\/MMAR.2014.6957429"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Cervantes-Villanueva, J., Carrillo-Zapata, D., Terroso-Saenz, F., Valdes-Vela, M., and Skarmeta, A. (2016). Vehicle Maneuver Detection with Accelerometer-Based Classification. Sensors, 16.","DOI":"10.3390\/s16101618"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"113240","DOI":"10.1016\/j.eswa.2020.113240","article-title":"Driver Behavior Detection and Classification Using Deep Convolutional Neural Networks","volume":"149","author":"Shahverdy","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_20","first-page":"231","article-title":"Evolving cloud-based system for the recognition of drivers\u2019 actions","volume":"99","author":"Andonovski","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"6599","DOI":"10.1109\/TITS.2021.3065900","article-title":"One Step Further Towards Real-Time Driving Maneuver Recognition Using Phone Sensors","volume":"22","author":"Ramah","year":"2021","journal-title":"Trans. Intell. Transp. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Guo, J., Zhu, X., Yang, Y., Yang, F., Lei, Z., and Li, S.Z. (2020, January 23\u201328). Towards Fast, Accurate and Stable 3D Dense Face Alignment. Proceedings of the ECCV 2020: Computer Vision\u2014ECCV 2020, Glasgow, UK.","DOI":"10.1007\/978-3-030-58529-7_10"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2427","DOI":"10.1109\/TITS.2019.2918328","article-title":"Methodology and Mobile Application for Driver Behavior Analysis and Accident Prevention","volume":"21","author":"Kashevnik","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhang, S., Zhu, X., Lei, Z., Shi, H., Wang, X., and Li, S.Z. (2017, January 1\u20134). Faceboxes: A CPU Real-time Face Detector with High Accuracy. Proceedings of the IEEE International Joint Conference on Biometrics (IJCB), Denver, CO, USA.","DOI":"10.1109\/BTAS.2017.8272675"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Kashevnik, A., and Ali, A. (2023). Lightweight 2D Map Construction of Vehicle Environments Using a Semi-Supervised Depth Estimation Approach. Eng. Proc., 33.","DOI":"10.3390\/engproc2023033028"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kashevnik, A., and Ali, A. (2023, January 24\u201326). Vehicle Offline Localization Based on Computer Vision: An Approach Based on Image Matching Retrieval Algorithms and Implementation. Proceedings of the 33rd Conference of Open Innovations Association (FRUCT), Zilina, Slovakia.","DOI":"10.23919\/FRUCT58615.2023.10143057"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Chandra, R., Wang, X., Mahajan, M., Kala, R., Palugulla, R., Naidu, C., Jain, A., and Manocha, D. (June, January 29). METEOR: A Dense, Heterogeneous, and Unstructured Traffic Dataset With Rare Behaviors. Proceedings of the 2023 IEEE International Conference on Robotics and Automation (ICRA), London, UK.","DOI":"10.1109\/ICRA48891.2023.10161281"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Othman, W., Kashevnik, A., Ali, A., and Shilov, N. (2022). DriverMVT: In-Cabin Dataset for Driver Monitoring including Video and Vehicle Telemetry Information. Data, 7.","DOI":"10.3390\/data7050062"},{"key":"ref_29","unstructured":"J\u00fanior, J.d.S.F. (2023, August 21). Driver Behavior Dataset. Available online: https:\/\/github.com\/jair-jr\/driverBehaviorDataset."},{"key":"ref_30","unstructured":"(2023, August 21). XGBoost Developers. Available online: https:\/\/xgboost.readthedocs.io\/en\/stable."},{"key":"ref_31","unstructured":"(2023, August 21). Scikit Learn, Sklearn DecisionTreeClassifier. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.tree.DecisionTreeClassifier.html."},{"key":"ref_32","unstructured":"Koehrsen, W. (2023, August 21). Random Forest in Python. Available online: https:\/\/towardsdatascience.com\/random-forest-in-python-24d0893d51c0."},{"key":"ref_33","unstructured":"(2023, August 21). Scikit-Learn Developers, sklearn.svm.SVC. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.svm.SVC.html."},{"key":"ref_34","unstructured":"(2023, August 21). Scikit-Learn Developers, sklearn.linear_model. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.linear_model.SGDClassifier.html."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"012019","DOI":"10.1088\/1742-6596\/954\/1\/012019","article-title":"Analysis of Student Satisfaction Toward Quality of Service Facility","volume":"954","author":"Napitupulu","year":"2018","journal-title":"J. Phys. Conf. Ser."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/17\/7387\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:38:18Z","timestamp":1760128698000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/17\/7387"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,24]]},"references-count":35,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["s23177387"],"URL":"https:\/\/doi.org\/10.3390\/s23177387","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,24]]}}}