{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T02:15:17Z","timestamp":1771467317367,"version":"3.50.1"},"reference-count":51,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2022,12,15]],"date-time":"2022-12-15T00:00:00Z","timestamp":1671062400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"SeoulTech (Seoul National University of Science and Technology)"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper presents an interactive lane keeping model for an advanced driver assistant system and autonomous vehicle. The proposed model considers not only the lane markers but also the interaction with surrounding vehicles in determining steering inputs. The proposed algorithm is designed based on the Recurrent Neural Network (RNN) with long short-term memory cells, which are configured by the collected driving data. A data collection vehicle is equipped with a front camera, LiDAR, and DGPS. The input features of the RNN consist of lane information, surrounding targets, and ego vehicle states. The output feature is the steering wheel angle to keep the lane. The proposed algorithm is evaluated through similarity analysis and a case study with driving data. The proposed algorithm shows accurate results compared to the conventional algorithm, which only considers the lane markers. In addition, the proposed algorithm effectively responds to the surrounding targets by considering the interaction with the ego vehicle.<\/jats:p>","DOI":"10.3390\/s22249889","type":"journal-article","created":{"date-parts":[[2022,12,16]],"date-time":"2022-12-16T03:55:39Z","timestamp":1671162939000},"page":"9889","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Interactive Lane Keeping System for Autonomous Vehicles Using LSTM-RNN Considering Driving Environments"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9193-7349","authenticated-orcid":false,"given":"Yonghwan","family":"Jeong","sequence":"first","affiliation":[{"name":"Department of Mechanical and Automotive Engineering, Seoul National University of Science and Technology, 232 Gongneung-ro, Nowon-gu, Seoul 01811, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,15]]},"reference":[{"key":"ref_1","unstructured":"An, X., Wu, M., and He, H. (2006, January 14\u201317). A novel approach to provide lane departure warning using only one forward-looking camera. Proceedings of the International Symposium on Collaborative Technologies and Systems, Las Vegas, NV, USA."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1016\/j.trc.2007.09.003","article-title":"Potential benefits of an adaptive forward collision warning system","volume":"16","author":"Jamson","year":"2008","journal-title":"Transp. Res. C"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Shaout, A., Colella, D., and Awad, S. (2011, January 27\u201328). Advanced driver assistance systems-past, present and future. Proceedings of the 2011 Seventh International Computer Engineering Conference, Cairo, Egypt.","DOI":"10.1109\/ICENCO.2011.6153935"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/TIE.2002.807690","article-title":"Development of advanced parking assistance system","volume":"50","author":"Wada","year":"2003","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Feig, P., K\u00f6nig, A., Gschwendtner, K., Lohrer, J., Schatz, J., and Lienkamp, M. (2017, January 27\u201328). Deriving system parameters of a 360\u00b0 low speed autonomous emergency braking driver assistance system for parking and maneuvering based on naturalistic driving studies. Proceedings of the 2017 IEEE International Conference on Vehicular Electronics and Safety, Vienna, Austria.","DOI":"10.1109\/ICVES.2017.7991918"},{"key":"ref_6","unstructured":"Rosen, E. (2013, January 11\u201313). Autonomous emergency braking for vulnerable road users. Proceedings of the IRCOBI conference, Gothenburg, Sweden."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1016\/j.conengprac.2008.09.006","article-title":"Design, tuning, and evaluation of a full-range adaptive cruise control system with collision avoidance","volume":"17","author":"Moon","year":"2009","journal-title":"Control Eng. Pract."},{"key":"ref_8","unstructured":"Johansson, J. (2020). Specify the Curve Speed Adaption parameters within the Adaptive Cruise Control System. [Master\u2019s Thesis, Chalmers University of Technology]."},{"key":"ref_9","unstructured":"Ishida, S., and Gayko, J.E. (2004, January 14\u201317). Development, evaluation and introduction of a lane keeping assistance system. Proceedings of the IEEE Intelligent Vehicles Symposium, Parma, Italy."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Hsu, J.Y., Jhang, T.K., Yeh, C.J., and Chang, P. (2016, January 20\u201322). Vehicle lane following achieved by two degree-of-freedom steering control architecture. Proceedings of the 2016 IEEE International Conference on Intelligent Transportation Engineering, Singapore.","DOI":"10.1109\/ICITE.2016.7581330"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"103213","DOI":"10.1016\/j.ergon.2021.103213","article-title":"Shared steering control: How strong and how prompt should the intervention be for a better driving experience?","volume":"86","author":"Park","year":"2021","journal-title":"Int. J. Ind. Ergon."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"556","DOI":"10.1109\/TIV.2020.2991962","article-title":"The safety potential of lane keeping assistance and possible actions to improve the potential","volume":"5","author":"Utriainen","year":"2020","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Marino, R., Scalzi, S., Orlando, G., and Netto, M. (2009, January 10\u201312). A nested PID steering control for lane keeping in vision based autonomous vehicles. Proceedings of the 2009 American Control Conference, St. Louis, MO, USA.","DOI":"10.1109\/ACC.2009.5160343"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Diab, M.K., Ammar, H.H., and Shalaby, R.E. (2020, January 20\u201321). Self-Driving Car Lane-keeping Assist using PID and Pure Pursuit Control. Proceedings of the 2020 International Conference on Innovation and Intelligence for Informatics, Computing and Technologies, Sakheer, Bahrain.","DOI":"10.1109\/3ICT51146.2020.9311987"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Basjaruddin, N.C., Saefudin, D., and Aryani, S.A. (2015, January 29\u201330). Lane Keeping Assist System based on fuzzy logic. Proceedings of the 2015 International Electronics Symposium, Surabaya, Indonesia.","DOI":"10.1109\/ELECSYM.2015.7380824"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"762","DOI":"10.1177\/0954407019849257","article-title":"Vehicle lane keeping system based on TSK fuzzy extension control","volume":"234","author":"Wang","year":"2020","journal-title":"Proc. Inst. Mech. Eng. D"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Sentouh, C., Nguyen, A.T., Floris, J., and Popieul, J.C. (2018, January 7\u201310). Multiple Controller Switching Concept for Human-Machine Shared Control of Lane Keeping Assist Systems. Proceedings of the 2018 IEEE International Conference on Systems, Man, and Cybernetics, Miyazaki, Japan.","DOI":"10.1109\/SMC.2018.00466"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1962","DOI":"10.1109\/TCST.2018.2842211","article-title":"Driver-automation cooperation oriented approach for shared control of lane keeping assist systems","volume":"27","author":"Sentouh","year":"2018","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"404","DOI":"10.3182\/20100831-4-FR-2021.00071","article-title":"Toward a shared lateral control between driver and steering assist controller","volume":"43","author":"Sentouh","year":"2010","journal-title":"IFAC Proc. Vol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1177\/03611981211056636","article-title":"Mode switching control using lane keeping assist and waypoints tracking for autonomous driving in a city environment","volume":"2676","author":"Horri","year":"2022","journal-title":"Transp. Res. Rec."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Netto, M.S., Chaib, S., and Mammar, S. (July, January 30). Lateral adaptive control for vehicle lane keeping. Proceedings of the 2004 American Control Conference, Boston, MA, USA.","DOI":"10.23919\/ACC.2004.1383872"},{"key":"ref_22","first-page":"15332","article-title":"On nonlinear control for lane keeping assist system in steer-by-wire road wheeled vehicles","volume":"53","author":"Perozzi","year":"2020","journal-title":"IFAC-Pap."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Perozzi, G., Rath, J.J., Sentouh, C., Floris, J., and Popieul, J.C. (2021). Lateral shared sliding mode control for lane-keeping assist system in steer-by-wire vehicles: Theory and experiments. IEEE Trans. Intell. Veh., in press.","DOI":"10.1016\/j.ifacol.2020.12.2343"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ge, Z., Wang, Z., Bai, X., and Wang, X. (2021, January 1\u20134). Robust Sliding Mode-Based Learning Control for Lane-Keeping Systems in Autonomous Vehicles. Proceedings of the 2021 IEEE 16th Conference on Industrial Electronics and Applications, Chengdu, China.","DOI":"10.1109\/ICIEA51954.2021.9516248"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Kamat, S. (2019, January 29\u201331). Lane keeping of vehicle using model predictive control. Proceedings of the 2019 IEEE 5th International Conference for Convergence in Technology, Bombay, India.","DOI":"10.1109\/I2CT45611.2019.9033958"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Liang, Y., Yin, Z., and Nie, L. (2021). Shared steering control for lane keeping and obstacle avoidance based on multi-objective MPC. Sensors, 21.","DOI":"10.3390\/s21144671"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1109\/TITS.2019.2892533","article-title":"An advanced lane-keeping assistance system with switchable assistance modes","volume":"21","author":"Bian","year":"2019","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"510","DOI":"10.1115\/1.2192835","article-title":"Lyapunov based performance guarantees for the potential field lane-keeping assistance system","volume":"128","author":"Rossetter","year":"2006","journal-title":"J. Dyn. Sys. Meas. Control"},{"key":"ref_29","first-page":"155","article-title":"Data-driven shared steering control design for lane keeping","volume":"51","author":"Huang","year":"2018","journal-title":"IFAC-Pap."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"9145","DOI":"10.1109\/TVT.2018.2854406","article-title":"A learning-based approach for lane departure warning systems with a personalized driver model","volume":"67","author":"Wang","year":"2018","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_31","unstructured":"Lefevre, S., Gao, Y., Vasquez, D., Tseng, H.E., Bajcsy, R., and Borrelli, F. (2014, January 22\u201326). Lane keeping assistance with learning-based driver model and model predictive control. Proceedings of the 12th International Symposium on Advanced Vehicle Control, Tokyo, Japan."},{"key":"ref_32","unstructured":"Sallab, A.E., Abdou, M., Perot, E., and Yogamani, S. (2016). End-to-end deep reinforcement learning for lane keeping assist. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Bing, Z., Meschede, C., Huang, K., Chen, G., Rohrbein, F., Akl, M., and Knoll, A. (2018, January 21\u201325). End to end learning of spiking neural network based on r-stdp for a lane keeping vehicle. Proceedings of the 2018 IEEE international conference on robotics and automation, Brisbane, Australia.","DOI":"10.1109\/ICRA.2018.8460482"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Yang, J.H., Choi, W.Y., and Chung, C.C. (2019, January 15\u201318). Recurrent End-to-End Neural Network Design with Temporal Dependencies for Model-Free Lane Keeping Systems. Proceedings of the 2019 19th International Conference on Control, Automation and Systems, Jeju, Republic of Korea.","DOI":"10.23919\/ICCAS47443.2019.8971744"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1049\/trit.2018.1025","article-title":"End-to-end learning for high-precision lane keeping via multi-state model","volume":"3","author":"Yuan","year":"2018","journal-title":"CAAI Trans. Intell. Technol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1109\/MITS.2018.2879224","article-title":"Building an autonomous lane keeping simulator using real-world data and end-to-end learning","volume":"12","author":"Chen","year":"2018","journal-title":"IEEE Intell. Transp. Syst. Mag."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Innocenti, C., Lind\u00e9n, H., Panahandeh, G., Svensson, L., and Mohammadiha, N. (2017, January 16\u201319). Imitation learning for vision-based lane keeping assistance. Proceedings of the 2017 IEEE 20th International Conference on Intelligent Transportation Systems, Yokohama, Japan.","DOI":"10.1109\/ITSC.2017.8317915"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Yang, J.H., Choi, W.Y., Lee, S.H., and Chung, C.C. (2019, January 27\u201330). Autonomous lane keeping control system based on road lane model using deep convolutional neural networks. Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference, Auckland, New Zealand.","DOI":"10.1109\/ITSC.2019.8917507"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Feher, A., Aradi, S., and Becsi, T. (2018, January 21\u201322). Q-learning based reinforcement learning approach for lane keeping. Proceedings of the 2018 IEEE 18th International Symposium on Computational Intelligence and Informatics, Budapest, Hungary.","DOI":"10.1109\/CINTI.2018.8928230"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zhang, Q., Luo, R., Zhao, D., Luo, C., and Qian, D. (2019, January 14\u201319). Model-free reinforcement learning based lateral control for lane keeping. Proceedings of the 2019 International Joint Conference on Neural Networks, Budapest, Hungary.","DOI":"10.1109\/IJCNN.2019.8851766"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Wang, Q., Zhuang, W., Wang, L., and Ju, F. (2020). Lane keeping assist for an autonomous vehicle based on deep reinforcement learning. SAE Tech. Pap., 1\u20137.","DOI":"10.4271\/2020-01-0728"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"012020","DOI":"10.1088\/1742-6596\/2347\/1\/012020","article-title":"Exploration Strategy Improved DDPG for Lane Keeping Tasks in Autonomous Driving","volume":"2347","author":"Hua","year":"2022","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"084503","DOI":"10.1115\/1.4050396","article-title":"Vision-based uncertainty-aware lane keeping strategy using deep reinforcement learning","volume":"143","author":"Kim","year":"2021","journal-title":"J. Dyn. Sys. Meas. Control"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"K\u0151v\u00e1ri, B., Heged\u00fcs, F., and B\u00e9csi, T. (2020). Design of a reinforcement learning-based lane keeping planning agent for automated vehicles. Appl. Sci., 10.","DOI":"10.3390\/app10207171"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"144985","DOI":"10.1109\/ACCESS.2021.3122869","article-title":"Predictive lane change decision making using bidirectional long shot-term memory for autonomous driving on highways","volume":"9","author":"Jeong","year":"2021","journal-title":"IEEE Access"},{"key":"ref_46","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_48","unstructured":"Sutskever, I., Martens, J., Dahl, G., and Hinton, G. (2013, January 16\u201321). On the importance of initialization and momentum in deep learning. Proceedings of the International conference on machine learning, Atlanta, GA, USA."},{"key":"ref_49","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"2178","DOI":"10.1109\/TITS.2014.2312720","article-title":"Probabilistic and holistic prediction of vehicle states using sensor fusion for application to integrated vehicle safety systems","volume":"15","author":"Kim","year":"2014","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Jung, C., Kim, H., Son, Y., Lee, K., and Yi, K. (2014, January 8\u201311). Parameter adaptive steering control for autonomous driving. Proceedings of the 17th International IEEE Conference on Intelligent Transportation Systems, Qingdao, China.","DOI":"10.1109\/ITSC.2014.6957892"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/24\/9889\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:42:08Z","timestamp":1760146928000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/24\/9889"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,15]]},"references-count":51,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["s22249889"],"URL":"https:\/\/doi.org\/10.3390\/s22249889","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,15]]}}}