{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:15:32Z","timestamp":1760238932971,"version":"build-2065373602"},"reference-count":52,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2020,9,5]],"date-time":"2020-09-05T00:00:00Z","timestamp":1599264000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002261","name":"Russian Foundation for Basic Research","doi-asserted-by":"publisher","award":["19-29-06099"],"award-info":[{"award-number":["19-29-06099"]}],"id":[{"id":"10.13039\/501100002261","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Russian State Research","award":["0073-2019-0005"],"award-info":[{"award-number":["0073-2019-0005"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper presents an analysis of modern research related to potential threats in a vehicle cabin, which is based on situation monitoring during vehicle control and the interaction of the driver with intelligent transportation systems (ITS). In the modern world, such systems enable the detection of potentially dangerous situations on the road, reducing accident probability. However, at the same time, such systems increase vulnerabilities in vehicles and can be sources of different threats. In this paper, we consider the primary information flows between the driver, vehicle, and infrastructure in modern ITS, and identify possible threats related to these entities. We define threat classes related to vehicle control and discuss which of them can be detected by smartphone sensors. We present a case study that supports our findings and shows the main use cases for threat identification using smartphone sensors: Drowsiness, distraction, unfastened belt, eating, drinking, and smartphone use.<\/jats:p>","DOI":"10.3390\/s20185049","type":"journal-article","created":{"date-parts":[[2020,9,6]],"date-time":"2020-09-06T23:12:49Z","timestamp":1599433969000},"page":"5049","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["In-Vehicle Situation Monitoring for Potential Threats Detection Based on Smartphone Sensors"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6503-1447","authenticated-orcid":false,"given":"Alexey","family":"Kashevnik","sequence":"first","affiliation":[{"name":"St. Petersburg Federal Research Center, Russian Academy of Sciences (SPC RAS), St. Petersburg Institute for Informatics and Automation of the Russian Academy of Sciences, St. Petersburg 199178, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrew","family":"Ponomarev","sequence":"additional","affiliation":[{"name":"St. Petersburg Federal Research Center, Russian Academy of Sciences (SPC RAS), St. Petersburg Institute for Informatics and Automation of the Russian Academy of Sciences, St. Petersburg 199178, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9264-9127","authenticated-orcid":false,"given":"Nikolay","family":"Shilov","sequence":"additional","affiliation":[{"name":"St. Petersburg Federal Research Center, Russian Academy of Sciences (SPC RAS), St. Petersburg Institute for Informatics and Automation of the Russian Academy of Sciences, St. Petersburg 199178, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7056-6972","authenticated-orcid":false,"given":"Andrey","family":"Chechulin","sequence":"additional","affiliation":[{"name":"St. Petersburg Federal Research Center, Russian Academy of Sciences (SPC RAS), St. Petersburg Institute for Informatics and Automation of the Russian Academy of Sciences, St. Petersburg 199178, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"576","DOI":"10.1016\/j.trf.2018.05.032","article-title":"Learning about advanced driver assistance systems\u2013The case of ACC and FCW in a sample of Czech drivers","volume":"65","year":"2019","journal-title":"Transp. Res. Part F Traffic Psychol. Behav."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zhang, H., and Lu, X. (2020). Vehicle communication network in intelligent transportation system based on internet of things. Comput. Commun.","DOI":"10.1016\/j.comcom.2020.03.041"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"101843","DOI":"10.1016\/j.artmed.2020.101843","article-title":"Fuzzy support vector machine-based personalizing method to address the inter-subject variance problem of physiological signals in a driver monitoring system","volume":"105","author":"Choi","year":"2020","journal-title":"Artif. Intell. Med."},{"key":"ref_4","unstructured":"Pfleeger, C.P., Pfleeger, S.L., and Margulies, J. (2015). Security in Computing, Pearson. [5th ed.]."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Kashevnik, A., Ponomarev, A., and Krasov, A. (2020, January 20\u201324). Human-Computer Threats Classification in Intelligent Transportation Systems. Proceedings of the Conference of Open Innovation Association, FRUCT 2020, Yaroslavl, Russia.","DOI":"10.23919\/FRUCT48808.2020.9087528"},{"key":"ref_6","unstructured":"Kelarestaghi, K.B., Foruhandeh, M., Heaslip, K., and Gerdes, R. (2019). Intelligent Transportation System Security: Impact-Oriented Risk Assessment of In-Vehicle Networks. IEEE Intell. Transp. Syst. Mag."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Ming, L., Zhao, G., Huang, M., Kuang, X., Li, H., and Zhang, M. (2018, January 8\u201310). Security analysis of intelligent transportation systems based on simulation data. Proceedings of the 2018 1st International Conference on Data Intelligence and Security, ICDIS 2018, South Padre Island, TX, USA.","DOI":"10.1109\/ICDIS.2018.00037"},{"key":"ref_8","unstructured":"Huq, N., Vosseler, R., and Swimmer, M. (2017). Cyberattacks Against Intelligent Transportation Systems Assessing Future Threats to ITS, Trend Micro."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Maple, C., Bradbury, M., Le, A.T., and Ghirardello, K. (2019). A connected and autonomous vehicle reference architecture for attack surface analysis. Appl. Sci. (Switz.), 9.","DOI":"10.3390\/app9235101"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Macher, G., Messnarz, R., Armengaud, E., Riel, A., Brenner, E., and Kreiner, C. (2017, January 4\u20136). Integrated Safety and Security Development in the Automotive Domain. Proceedings of the WCX\u2122 17: SAE World Congress Experience, Detroit, MI, USA. SAE Technical Paper.","DOI":"10.4271\/2017-01-1661"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"91","DOI":"10.4271\/11-01-02-0005","article-title":"Enhancement of Automotive Penetration Testing with Threat Analyses Results","volume":"1","author":"Braun","year":"2018","journal-title":"SAE Int. J. Transp. Cybersecur. Priv."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Bialas, A. (2019). Vulnerability Assessment of Sensor Systems. Sensors, 19.","DOI":"10.3390\/s19112518"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2898","DOI":"10.1109\/TITS.2017.2665968","article-title":"Cyber Threats Facing Autonomous and Connected Vehicles: Future Challenges","volume":"18","author":"Parkinson","year":"2017","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_14","first-page":"552","article-title":"Review of the Security Issues in Vehicular Ad Hoc Networks (VANET)","volume":"8","author":"Sari","year":"2015","journal-title":"Int. J. Commun. Netw. Syst. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"380","DOI":"10.3390\/electronics4030380","article-title":"Security of Cooperative Intelligent Transport Systems: Standards, Threats Analysis and Cryptographic Countermeasures","volume":"4","author":"Hamida","year":"2015","journal-title":"Electronics"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1016\/j.adhoc.2018.10.002","article-title":"A taxonomy and survey of cyber-physical intrusion detection approaches for vehicles","volume":"84","author":"Loukas","year":"2019","journal-title":"Ad Hoc Netw."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Humayed, A., and Luo, B. (2015). Cyber-physical security for smart cars. Proceedings of the ACM\/IEEE Sixth International Conference on Cyber-Physical Systems\u2014ICCPS \u201815, ACM Press.","DOI":"10.1145\/2735960.2735992"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Resch, B. (2013). People as Sensors and Collective Sensing-Contextual Observations Complementing Geo-Sensor Network Measurements. Progress in Location-Based Services. Lecture Notes in Geoinformation and Cartography, Springer.","DOI":"10.1007\/978-3-642-34203-5_22"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Rozhdestvenskiy, D., and Bouchner, P. (2017, January 25\u201326). Human machine interface for future cars. Proceedings of the 2017 Smart City Symposium Prague (SCSP), Prague, Czech Republic. Changes needed.","DOI":"10.1109\/SCSP.2017.7973863"},{"key":"ref_20","unstructured":"AAA Foundation for Traffic Safety (2018). 2017 Traffic Safety Culture Index, AAA Foundation for Traffic Safety."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Lohani, M., Payne, B.R., and Strayer, D.L. (2019). A Review of Psychophysiological Measures to Assess Cognitive States in Real-World Driving. Front. Hum. Neurosci., 13.","DOI":"10.3389\/fnhum.2019.00057"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1051","DOI":"10.1007\/s12239-019-0099-3","article-title":"Methods to Detect and Reduce Driver Stress: A Review","volume":"20","author":"Chung","year":"2019","journal-title":"Int. J. Automot. Technol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.inffus.2015.08.001","article-title":"Situation awareness within the context of connected cars: A comprehensive review and recent trends","volume":"29","author":"Golestan","year":"2016","journal-title":"Inf. Fusion"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Kashevnik, A., Lashkov, I., and Teslya, N. (2019, January 19\u201322). Driver intelligent support system in internet of transportation things: Smartphone-based approach. Proceedings of the 2019 14th Annual Conference System of Systems Engineering, SoSE 2019, Anchorage, AK, USA.","DOI":"10.1109\/SYSOSE.2019.8753839"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"105317","DOI":"10.1016\/j.aap.2019.105317","article-title":"Comparison between elderly and young drivers\u2019 performances on a driving simulator and self-assessment of their driving attitudes and mastery","volume":"135","author":"Marquez","year":"2020","journal-title":"Accid. Anal. Prev."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/j.trf.2017.06.004","article-title":"How to define the accident risk level of car drivers by combining objective and subjective measures of driving style","volume":"49","author":"Eboli","year":"2017","journal-title":"Transp. Res. Part. F Traffic Psychol. Behav."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1139","DOI":"10.1080\/00140138408963596","article-title":"A conceptualization of driving behaviour as threat avoidance","volume":"27","author":"Fuller","year":"1984","journal-title":"Ergonomics"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"17013","DOI":"10.3390\/s150717013","article-title":"Contextual Sensing: Integrating Contextual Information with Human and Technical Geo-Sensor Information for Smart Cities","volume":"15","author":"Sagl","year":"2015","journal-title":"Sensors"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ferreira, J., Carvalho, E., Ferreira, B.V., De Souza, C., Suhara, Y., Pentland, A., and Pessin, G. (2017). Driver behavior profiling: An investigation with different smartphone sensors and machine learning. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0174959"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Yang, L., Dong, K., Dmitruk, A.J., Brighton, J., and Zhao, Y. (2019). A Dual-Cameras-Based Driver Gaze Mapping System With an Application on Non-Driving Activities Monitoring. IEEE Trans. Intell. Transp. Syst.","DOI":"10.1109\/TITS.2019.2939676"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/j.aap.2017.11.038","article-title":"Detection and prediction of driver drowsiness using artificial neural network models","volume":"126","author":"Bourdin","year":"2019","journal-title":"Accid. Anal. Prev."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kashevnik, A., Lashkov, I., and Gurtov, A. (2019). Methodology and Mobile Application for Driver Behavior Analysis and Accident Prevention. IEEE Trans. Intell. Transp. Syst.","DOI":"10.1109\/TITS.2019.2918328"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"6701","DOI":"10.1109\/JSEN.2020.2975382","article-title":"Cloud-Based Driver Monitoring System Using a Smartphone","volume":"20","author":"Kashevnik","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"583","DOI":"10.15622\/sp.2019.18.3.582-613","article-title":"Context-based rider assistant system for two wheeled self-balancing vehicles","volume":"18","author":"Jeyeon","year":"2019","journal-title":"SPIIRAS Proc."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Redweik, P., Catita, C., Henriques, F., and Rodrigues, A. (2019). Solar Glare Vulnerability Analysis of Urban Road Networks\u2014A Methodology. Energies, 12.","DOI":"10.3390\/en12244779"},{"key":"ref_36","unstructured":"Nassi, D., Ben-Netanel, R., Elovici, Y., and Nassi, B. (2019). MobilBye: Attacking ADAS with Camera Spoofing. arXiv."},{"key":"ref_37","unstructured":"Nassi, B., Nassi, D., Ben-Netanel, R., Mirsky, Y., Drokin, O., and Elovici, Y. (2020, September 03). Phantom of the ADAS: Phantom Attacks on Driver-Assistance Systems. Available online: https:\/\/eprint.iacr.org\/2020\/085."},{"key":"ref_38","unstructured":"Barnard, Y., Risser, R., and Krems, J. (2011). The Safety of Intelligent Driver Support. Systems: Design, Evaluation and Social Perspectives, CRC Press. [1st ed.]."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Narayanan, S.N., Khanna, K., Panigrahi, B.K., and Joshi, A. (2019). Security in Smart Cyber-Physical Systems: A Case Study on Smart Grids and Smart Cars. Smart Cities Cybersecurity and Privacy, Elsevier.","DOI":"10.1016\/B978-0-12-815032-0.00011-1"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Kashevnik, A., Ali, A., Lashkov, I., and Shilov, N. (2020, January 20\u201324). Seat Belt Fastness Detection Based on Image Analysis from Vehicle In-abin Camera. Proceedings of the 2020 26th Conference of Open Innovations Association (FRUCT), Yaroslavl, Russia.","DOI":"10.23919\/FRUCT48808.2020.9087474"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Hatoyama, K., Nishioka, M., Kitajima, M., Nakahira, K., and Sano, K. (2019, January 9\u201312). Perception of Time in Traffic Congestion and Drivers\u2019 Stress. Proceedings of the International Conference on Transportation and Development 2019, Alexandria, VA, USA.","DOI":"10.1061\/9780784482575.017"},{"key":"ref_42","unstructured":"Zhang, Y., Antonsson, E.K., and Grote, K. (2006, January 17\u201320). A new threat assessment measure for collision avoidance systems. Proceedings of the 2006 IEEE Intelligent Transportation Systems Conference, Toronto, ON, Canada."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1109\/TITS.2007.909241","article-title":"Statistical Threat Assessment for General Road Scenes Using Monte Carlo Sampling","volume":"9","author":"Eidehall","year":"2008","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"602","DOI":"10.1109\/TSMCA.2006.871646","article-title":"Preliminary study of behavioral and safety effects of driver dependence on a warning system in a driving simulator","volume":"36","author":"Yamada","year":"2006","journal-title":"IEEE Trans. Syst. Man Cybern. Part A Syst. Hum."},{"key":"ref_45","first-page":"297","article-title":"Driver Drowsiness Measurement Technologies: Current Research, Market Solutions, and Challenges","volume":"18","author":"Doudou","year":"2020","journal-title":"Int. J. Intell. Transp. Syst. Res."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1007\/s11036-011-0304-8","article-title":"WreckWatch: Automatic Traffic Accident Detection and Notification with Smartphones","volume":"16","author":"White","year":"2011","journal-title":"Mob. Netw. Appl."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Le, T.H.N., Zheng, Y., Zhu, C., Luu, K., and Savvides, M. (July, January 26). Multiple Scale Faster-RCNN Approach to Driver\u2019s Cell-Phone Usage and Hands on Steering Wheel Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Las Vegas, NV, USA.","DOI":"10.1109\/CVPRW.2016.13"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"852","DOI":"10.1016\/j.scitotenv.2016.04.076","article-title":"Smartphone-based noise mapping: Integrating sound level meter app data into the strategic noise mapping process","volume":"562","author":"Murphy","year":"2016","journal-title":"Sci. Total Environ."},{"key":"ref_49","unstructured":"Bishop, R. (2005). Intelligent Vehicle Technology and Trends, Artech House."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1294","DOI":"10.1080\/00140130500252990","article-title":"Driver behaviour with adaptive cruise control","volume":"48","author":"Stanton","year":"2005","journal-title":"Ergonomics"},{"key":"ref_51","unstructured":"BBC (2019). Tesla Model 3: Autopilot Engaged during Fatal Crash, BBC."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Zhang, S., Zhu, X., Lei, Z., Shi, H., Wang, X., and Li, S.Z. (2017, January 1\u20134). FaceBoxes: A CPU Real-time Face Detector with High Accuracy. Proceedings of the IEEE International Joint Conference on Biometrics, IJCB 2017, Denver, CO, USA.","DOI":"10.1109\/BTAS.2017.8272675"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/18\/5049\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:07:10Z","timestamp":1760177230000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/18\/5049"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,5]]},"references-count":52,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["s20185049"],"URL":"https:\/\/doi.org\/10.3390\/s20185049","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,9,5]]}}}