{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T22:52:34Z","timestamp":1780527154670,"version":"3.54.1"},"reference-count":34,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2020,9,11]],"date-time":"2020-09-11T00:00:00Z","timestamp":1599782400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100014188","name":"Ministry of Science and ICT, South Korea","doi-asserted-by":"publisher","award":["CISS-2011-0031863"],"award-info":[{"award-number":["CISS-2011-0031863"]}],"id":[{"id":"10.13039\/501100014188","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Advances in vehicle technology have resulted in the development of vehicles equipped with sensors to acquire standardized information such as engine speed and vehicle speed from the in-vehicle controller area network (CAN) system. However, there are challenges in acquiring proprietary information from CAN frames, such as the brake pedal and steering wheel operation, which are essential for driver behavior analysis. Such information extraction requires electronic control unit identifier analysis and accompanying data interpretation. In this paper, we present a system for the automatic extraction of proprietary in-vehicle information using sensor data correlated with the desired information. First, the proposed system estimates the vehicle\u2019s driving status through threshold-, random forest-, and long short-term memory-based techniques using inertial measurement unit and global positioning system values. Then, the system segments in-vehicle CAN frames using the estimation and evaluates each segment with our scoring method to select suitable candidates by examining the similarity between each candidate and its estimation through the suggested distance matching technique. We conduct comprehensive experiments of the proposed system using real vehicles in an urban environment. Performance evaluation shows that the estimation accuracy of the driving condition is 84.20%, and the extraction accuracy of the in-vehicle information is 82.31%, which implies that the presented approaches are quite feasible for automatic extraction of proprietary in-vehicle information.<\/jats:p>","DOI":"10.3390\/s20185197","type":"journal-article","created":{"date-parts":[[2020,9,13]],"date-time":"2020-09-13T21:11:32Z","timestamp":1600031492000},"page":"5197","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Sensor-Based Extraction Approaches of In-Vehicle Information for Driver Behavior Analysis"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2945-1054","authenticated-orcid":false,"given":"Beomjun","family":"Kim","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Pusan National University, Busan 46241, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yunju","family":"Baek","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Pusan National University, Busan 46241, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1109\/MNET.2018.1700364","article-title":"Enabling Collaborative Edge Computing for Software Defined Vehicular Networks","volume":"32","author":"Wang","year":"2018","journal-title":"IEEE Netw."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"6046","DOI":"10.1109\/JIOT.2019.2958097","article-title":"Smart Collaborative Tracking for Ubiquitous Power IoT in Edge-Cloud Interplay Domain","volume":"7","author":"Song","year":"2019","journal-title":"IEEE Internet Things J."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"71012","DOI":"10.1109\/ACCESS.2018.2881722","article-title":"A Driving Fingerprint Map Method of Driving Characteristic Representation for Driver Identification","volume":"6","author":"Cai","year":"2018","journal-title":"IEEE Access"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Yadawadkar, S., Mayer, B., Lokegaonkar, S., Islam, M.R., Ramakrishnan, N., Song, M., and Mollenhauer, M. (2018, January 10\u201313). Identifying Distracted and Drowsy Drivers Using Naturalistic Driving Data. Proceedings of the 2018 IEEE International Conference on Big Data (Big Data), Seattle, WA, USA.","DOI":"10.1109\/BigData.2018.8622612"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ramanishka, V., Chen, Y.-T., Misu, T., and Saenko, K. (2018, January 18\u201322). Toward Driving Scene Understanding: A Dataset for Learning Driver Behavior and Causal Reasoning. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00803"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/TIV.2017.2708600","article-title":"Lane-Change Detection from Steering Signal Using Spectral Segmentation and Learning-Based Classification","volume":"2","author":"Zheng","year":"2017","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Leonhardt, V., and Wanielik, G. (2017, January 10\u201313). Feature evaluation for lane change prediction based on driving situation and driver behavior. Proceedings of the 2017 20th International Conference on Information Fusion (Fusion), Xi\u2019an, China.","DOI":"10.23919\/ICIF.2017.8009848"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Ferreira, J., Carvalho, E., Ferreira, B.V., de Souza, C., Suhara, Y., Pentland, A., and Pessin, G. (2017). Driver behavior profiling: An investigation with different smartphone sensors and machine learning. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0174959"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/j.jsr.2019.12.021","article-title":"A critical overview of driver recording tools","volume":"72","author":"Ziakopoulos","year":"2020","journal-title":"J. Saf. Res."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1205","DOI":"10.1007\/s12239-019-0113-9","article-title":"Development of Three Driver State Detection Models from Driving Information Using Vehicle Simulator; Normal, Drowsy and Drunk Driving","volume":"20","author":"Lee","year":"2019","journal-title":"Int. J. Automot. Technol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/j.trd.2018.07.007","article-title":"Drowsiness monitoring based on steering wheel status","volume":"66","author":"Chai","year":"2019","journal-title":"Transp. Res. D Transp. Environ."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"6391","DOI":"10.1109\/TVT.2019.2917025","article-title":"Virtual-to-Real Knowledge Transfer for Driving Behavior Recognition: Framework and a Case Study","volume":"68","author":"Lu","year":"2019","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3558","DOI":"10.1109\/TITS.2018.2878736","article-title":"Enhancing In-Vehicle Driving Assistance Information Under Connected Vehicle Environment","volume":"20","author":"Park","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1109\/TITS.2016.2605163","article-title":"Tracking and Behavior Reasoning of Moving Vehicles Based on Roadway Geometry Constraints","volume":"18","author":"Jo","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/j.apergo.2015.03.017","article-title":"Multi-parameter prediction of drivers\u2019 lane-changing behaviour with neural network model","volume":"50","author":"Peng","year":"2015","journal-title":"Appl. Ergon."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1016\/j.eswa.2016.06.042","article-title":"Dynamic driver fatigue detection using hidden Markov model in real driving condition","volume":"63","author":"Fu","year":"2016","journal-title":"Expert Syst. Appl."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"8028","DOI":"10.1109\/ACCESS.2018.2889751","article-title":"A Comparative Study of Aggressive Driving Behavior Recognition Algorithms Based on Vehicle Motion Data","volume":"7","author":"Ma","year":"2018","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1894","DOI":"10.1109\/TMC.2017.2776286","article-title":"Leveraging Smartphones for Vehicle Lane-Level Localization on Highways","volume":"17","author":"Xu","year":"2017","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Liu, X., Mei, H., Lu, H., Kuang, H., and Ma, X. (2017). A Vehicle Steering Recognition System Based on Low-Cost Smartphone Sensors. Sensors, 17.","DOI":"10.3390\/s17030633"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1964","DOI":"10.1109\/TITS.2019.2909107","article-title":"An Ensemble Learning-Based Vehicle Steering Detector Using Smartphones","volume":"21","author":"Ouyang","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Khandakar, A., Chowdhury, M.E., Ahmed, R., Dhib, A., Mohammed, M., Al-Emadi, N.A.M.A., and Michelson, D. (2019). Portable System for Monitoring and Controlling Driver Behavior and the Use of a Mobile Phone While Driving. Sensors, 19.","DOI":"10.3390\/s19071563"},{"key":"ref_22","unstructured":"Jesse, B., Weber, M., and Helmling, M. (2020, August 29). The Future with SOA, POSIX, TSN; Automotive Ethernet: Trends and Challenges. Available online: https:\/\/pdfs.semanticscholar.org\/d62a\/a0106453905b441cc3e6e37eef39cbf43577.pdf."},{"key":"ref_23","unstructured":"Yang, X., Scholz, D., and Helm, M. (2020, August 29). Deterministic Networking (DetNet) vs Time Sensitive Networking (TSN). Available online: https:\/\/www.net.in.tum.de\/fileadmin\/TUM\/NET\/NET-2019-10-1.pdf."},{"key":"ref_24","unstructured":"Staggs, J. (2020, August 14). How to Hack Your Mini Cooper: Reverse Engineering CAN Messages on Passenger Automobiles. Available online: https:\/\/www.defcon.org\/images\/defcon-21\/dc-21-presentations\/Staggs\/DEFCON-21-Staggs-How-to-Hack-Your-Mini-Cooper-WP.pdf."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Koscher, K., Czeskis, A., Roesner, F., Patel, S., Kohno, T., Checkoway, S., McCoy, D., Kantor, B., Anderson, D., and Shacham, H. (2010, January 16\u201319). Experimental Security Analysis of a Modern Automobile. Proceedings of the 2010 IEEE Symposium on Security and Privacy, Berkeley\/Oakland, CA, USA.","DOI":"10.1109\/SP.2010.34"},{"key":"ref_26","first-page":"43","article-title":"Field classification, modeling and anomaly detection in unknown CAN bus networks","volume":"9","author":"Markovitz","year":"2017","journal-title":"Veh. Commun."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1083","DOI":"10.1109\/TIFS.2018.2870826","article-title":"READ: Reverse Engineering of Automotive Data Frames","volume":"14","author":"Marchetti","year":"2018","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Verma, M., Bridges, R., and Hollifield, S. (2018, January 13\u201315). ACTT: Automotive CAN Tokenization and Translation. Proceedings of the 2018 International Conference on Computational Science and Computational Intelligence (CSCI), Las Vegas, NV, USA.","DOI":"10.1109\/CSCI46756.2018.00061"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Kang, T.U., Song, H.M., Jeong, S., and Kim, H.K. (2018, January 27\u201330). Automated Reverse Engineering and Attack for CAN Using OBD-II. Proceedings of the 2018 IEEE 88th Vehicular Technology Conference (VTC-Fall), Chicago, IL, USA.","DOI":"10.1109\/VTCFall.2018.8690781"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Song, H.M., and Kim, H.K. (2020). Discovering CAN specification using On-Board Diagnostics. IEEE Des. Test, in press.","DOI":"10.1109\/MDAT.2020.3011036"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"102021","DOI":"10.1109\/ACCESS.2019.2926040","article-title":"MIT Advanced Vehicle Technology Study: Large-Scale Naturalistic Driving Study of Driver Behavior and Interaction With Automation","volume":"7","author":"Fridman","year":"2019","journal-title":"IEEE Access"},{"key":"ref_32","unstructured":"(2019, October 15). Harness AI at the Edge with the Jetson TX2 Developer Kit. Available online: https:\/\/developer.nvidia.com\/embedded\/jetson-tx2-developer-kit."},{"key":"ref_33","unstructured":"(2019, October 15). Keras Documentation. Available online: https:\/\/keras.io\/."},{"key":"ref_34","unstructured":"Salvador, S., and Chan, P. (2020, August 14). FastDTW: Toward Accurate Dynamic Time Warping in Linear Time Space. Available online: https:\/\/www.semanticscholar.org\/paper\/FastDTW%3A-Toward-Accurate-Dynamic-Time-Warping-in-Salvador-Chan\/05a20cde15e172fc82f32774dd0cf4fe5827cad2?p2df."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/18\/5197\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:09:18Z","timestamp":1760177358000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/18\/5197"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,11]]},"references-count":34,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["s20185197"],"URL":"https:\/\/doi.org\/10.3390\/s20185197","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,11]]}}}