{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T18:22:37Z","timestamp":1773512557308,"version":"3.50.1"},"reference-count":44,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2018,8,3]],"date-time":"2018-08-03T00:00:00Z","timestamp":1533254400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Vision-based sensors are widely used in lateral control of autonomous vehicles, but the large computational cost of the visual algorithms often induces uneven time delays. In this paper, a hierarchical vision-based lateral control scheme is proposed, where the upper controller is designed by robust H\u221e-based linear quadratic regulator (LQR) algorithm to compensate sensor-induced delays, and the lower controller is based on logic threshold method, in order to achieve strong convergence of the steering angle. Firstly, the vehicle lateral model is built, and the nonlinear uncertainties induced by time delays are linearized with Taylor expansion. Secondly, the state space of the system is augmented to describe such uncertainties with polytopic inclusions, which is controlled by an H\u221e-based LQR controller with a low cost of online computation. Then, a lower controller is designed for the control of the steering motor. According to the results of the vehicle experiment as well as the hardware-in-the-loop (HIL) experiment, the proposed control scheme shows good performance in vehicle\u2019s lateral control task, and exhibits better robustness compared with a conventional LQR controller. The proposed control scheme provides a feasible solution for the lateral control of autonomous driving.<\/jats:p>","DOI":"10.3390\/s18082544","type":"journal-article","created":{"date-parts":[[2018,8,3]],"date-time":"2018-08-03T11:03:26Z","timestamp":1533294206000},"page":"2544","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Hierarchical Lateral Control Scheme for Autonomous Vehicle with Uneven Time Delays Induced by Vision Sensors"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7687-3954","authenticated-orcid":false,"given":"Qi","family":"Liu","sequence":"first","affiliation":[{"name":"State Key Laboratory of Automotive Safety and Energy, Tsinghua University, Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yahui","family":"Liu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Automotive Safety and Energy, Tsinghua University, Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Congzhi","family":"Liu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Automotive Safety and Energy, Tsinghua University, Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Baiming","family":"Chen","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Automotive Safety and Energy, Tsinghua University, Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenhao","family":"Zhang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Automotive Safety and Energy, Tsinghua University, Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liang","family":"Li","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Automotive Safety and Energy, Tsinghua University, Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuewu","family":"Ji","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Automotive Safety and Energy, Tsinghua University, Beijing 100084, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,8,3]]},"reference":[{"key":"ref_1","first-page":"1","article-title":"Modelling and Control Strategies in Path Tracking Control for Autonomous Ground Vehicles: A Review of State of the Art and Challenges","volume":"86","author":"Amer","year":"2016","journal-title":"J. Int. Robot. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1335","DOI":"10.1109\/TITS.2014.2361515","article-title":"Robust Wheel Torque Control for Traction\/Braking Force Tracking Under Combined Longitudinal and Lateral Motion","volume":"16","author":"Hsiao","year":"2015","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_3","unstructured":"On-Road Automated Vehicle Standards Committee (2014). Taxonomy and Definitions for Terms Related to on-Road Motor Vehicle Automated Driving Systems, SAE."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"4379","DOI":"10.1109\/TVT.2015.2473115","article-title":"Torque-Overlay-Based Robust Steering Wheel Angle Control of Electrical Power Steering for a Lane-Keeping System of Automated Vehicles","volume":"65","author":"Kim","year":"2016","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_5","first-page":"1344","article-title":"Interactive Control Paradigm based Robust Lateral Stability Controller Design for Autonomous Automobile Path Tracking with Uncertain Disturbance: A Dynamic Game Approach","volume":"56","author":"Ji","year":"2018","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.conengprac.2018.04.007","article-title":"Adaptive-neural-network-based robust lateral motion control for autonomous vehicle at driving limits","volume":"76","author":"Ji","year":"2018","journal-title":"Control Eng. Pract."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Ji, X., Liu, Y., Na, X., and Liu, Y. (2018). Research on interactive steering control strategy between driver and AFS in different game equilibrium strategies and information patterns. Veh. Syst. Dyn.","DOI":"10.1080\/00423114.2018.1435890"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Han, G., Fu, W., Wang, W., and Wu, Z. (2017). The Lateral Tracking Control for the Intelligent Vehicle Based on Adaptive PID Neural Network. Sensors, 17.","DOI":"10.3390\/s17061244"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"14569","DOI":"10.3390\/s150614569","article-title":"On-Board Event-Based State Estimation for Trajectory Approaching and Tracking of a Vehicle","volume":"15","author":"Espinosa","year":"2015","journal-title":"Sensors"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"556","DOI":"10.1109\/TCST.2010.2049203","article-title":"Model Predictive Multi-Objective Vehicular Adaptive Cruise Control","volume":"19","author":"Li","year":"2011","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.ymssp.2016.03.002","article-title":"Fuel consumption optimization for smart hybrid electric vehicle during a car-following process","volume":"87","author":"Li","year":"2017","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Elbanhawi, M., Simic, M., and Jazar, R. (2017). Receding horizon lateral vehicle control for pure pursuit path tracking. J. Vib. Control, 24.","DOI":"10.1177\/1077546316646906"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1590\/S1679-78252014000400004","article-title":"A path-following driver\/vehicle model with optimized lateral dynamic controller","volume":"11","author":"Mashadi","year":"2013","journal-title":"Lat. Am. J. Sol. Struct."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1041","DOI":"10.1243\/095440605X31896","article-title":"Driver Steering Control and a New Perspective on Car Handling Qualities","volume":"219","author":"Sharp","year":"2005","journal-title":"Proc. Inst. Mech. Eng. Part C J. Mech. Eng. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1109\/TCST.2007.894653","article-title":"Predictive Active Steering Control for Autonomous Vehicle Systems","volume":"15","author":"Falcone","year":"2007","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1354","DOI":"10.1016\/j.conengprac.2008.03.004","article-title":"An adaptive dynamic controller for autonomous mobile robot trajectory tracking","volume":"16","author":"Martins","year":"2008","journal-title":"Control Eng. Pract."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1109\/TCST.2008.924558","article-title":"Combined Automatic Lane-Keeping and Driver\u2019s Steering Through a 2-DOF Control Strategy","volume":"17","author":"Cerone","year":"2008","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/j.arcontrol.2011.03.009","article-title":"Pushing the limits: From lane keeping to autonomous racing","volume":"35","author":"Talvala","year":"2011","journal-title":"Annu. Rev. Control."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Netto, M.S., Chaib, S., and Mammar, S. (July, January 30). Lateral adaptive control for vehicle lane keeping. Proceedings of the 2004 American Control Conference. Boston, MA, USA, USA.","DOI":"10.23919\/ACC.2004.1383872"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Olivares-Mendez, M.A., Sanchez-Lopez, J.L., Jimenez, F., Campoy, P., Sajadi-Alamdari, S.A., and Voos, H. (2016). Vision-Based Steering Control, Speed Assistance and Localization for Inner-City Vehicles. Sensors, 16.","DOI":"10.3390\/s16030362"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, L., Tofael, A., Yan, Z., Gao, P., and Takigawa, T. (2016). Vision-Based Leader Vehicle Trajectory Tracking for Multiple Agricultural Vehicles. Sensors, 16.","DOI":"10.3390\/s16040578"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Vetrella, A.R., Fasano, G., Accardo, D., and Moccia, A. (2016). Differential GNSS and Vision-Based Tracking to Improve Navigation Performance in Cooperative Multi-UAV Systems. Sensors, 16.","DOI":"10.3390\/s16122164"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, Y., Nguyen, B.M., Fujimoto, H., and Hori, Y. (2013, January 28\u201331). Vision-based integrated lateral control system for electric vehicles considering multi-rate and measurable uneven time delay issues. Proceedings of the IEEE International Symposium Industrial Electronics, Taipei, Taiwan.","DOI":"10.1109\/ISIE.2013.6563772"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wang, Y., Zhou, Z., Wei, C., Liu, Y., and Yin, C. (2018). Host-Target Vehicle Model-based Lateral State Estimation for Preceding Target Vehicles Considering Measurement Delay. IEEE Trans. Ind. Inf.","DOI":"10.1109\/TII.2018.2828125"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wang, Y., Liu, Y., Fujimoto, H., and Hori, Y. (2018). Vision-Based Lateral State Estimation for Integrated Control of Automated Vehicles considering Multi-rate and Uneven Measurement Delay Issues. IEEE\/ASME Trans. Mechatron., in press.","DOI":"10.1109\/TMECH.2018.2870639"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.ast.2005.09.001","article-title":"The modeling and estimation of asynchronous multirate multisensor dynamic systems","volume":"10","author":"Yan","year":"2006","journal-title":"Aerosp. Sci. Technol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3378","DOI":"10.1109\/TVT.2014.2356204","article-title":"Robust Multirate Control Scheme With Predictive Virtual Lanes for Lane-Keeping System of Autonomous Highway Driving","volume":"64","author":"Son","year":"2015","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1109\/TCST.2016.2562607","article-title":"Robust Multirate On-Road Vehicle Localization for Autonomous Highway Driving Vehicles","volume":"25","author":"Lee","year":"2017","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Kang, C., Sung Gu, Y., Jeon, S., Son, Y., Kim, W., Lee, S., and Chung, C. (2016). Lateral Control System for Autonomous Lane Change System on Highways. SAE Int. J. Passeng. Cars-Mech. Syst., 9.","DOI":"10.4271\/2016-01-1641"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1049\/iet-cta.2014.1299","article-title":"Robust output feedback control for unknown non-linear systems with external disturbance","volume":"10","author":"Kim","year":"2016","journal-title":"IET Control Theory Appl."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1016\/j.ymssp.2017.07.051","article-title":"An innovative information fusion method with adaptive Kalman filter for integrated INS\/GPS navigation of autonomous vehicles","volume":"100","author":"Liu","year":"2017","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_32","unstructured":"Schlatow, J., M\u00f6stl, M., Ernst, R., Nolte, M., Jatzkowski, I., and Maurer, M. (November, January 29). Towards model-based integration of component-based automotive software systems. Proceedings of the Annual Conference of the IEEE Ind. Electron. Society (IECON17), Beijing, China."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1109\/TVT.2013.2279843","article-title":"Combined AFS and DYC Control of Four-Wheel-Independent-Drive Electric Vehicles over CAN Network with Time-Varying Delays","volume":"63","author":"Shuai","year":"2014","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"4985","DOI":"10.1109\/TVT.2014.2383402","article-title":"Robust Lateral Motion Control of Electric Ground Vehicles with Random Network-Induced Delays","volume":"64","author":"Zhu","year":"2015","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1016\/j.neucom.2016.06.041","article-title":"Robust Output-feedback Based Vehicle Lateral Motion Control Considering Network-induced Delay and Tire Force Saturation","volume":"214","author":"Wang","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Huang, C., Du, H., Naghdy, F., and Li, W. (2015, January 27\u201330). Robust fuzzy tracking control of uncertain steer-by-wire systems with network time delays. Proceedings of the 2015 Australasian Universities Power Engineering Conference (AUPEC), Wollongong, NSW, Australia.","DOI":"10.1109\/AUPEC.2015.7324795"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zakaria, M.I., Husain, A.R., Mohamed, Z., Fezazi, N.E., and Shah, M.B.N. (2015, January 27\u201329). Lyapunov-Krasovskii stability condition for system with bounded delay\u2014An application to steer-by-wire system. Proceedings of the 2015 IEEE International Conference on Control System, Computing and Engineering (ICCSCE), George Town, Malaysia.","DOI":"10.1109\/ICCSCE.2015.7482244"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Xie, R., Zhang, T., Li, J., and Dai, M. (2017). Compensating Unknown Time-Varying Delay in Opto-Electronic Platform Tracking Servo System. Sensors, 17.","DOI":"10.3390\/s17051071"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Rajamani, R. (2012). Vehicle Dynamics and Control, Springer. [2nd ed.].","DOI":"10.1007\/978-1-4614-1433-9"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1080\/00423119608969311","article-title":"Analysis of Automatic Steering Control for Highway Vehicles with Look-down Lateral Reference Systems","volume":"26","author":"Guldner","year":"1996","journal-title":"Veh. Syst. Dyn."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2609","DOI":"10.1109\/TCYB.2015.2482984","article-title":"An Empirical Human Controller Model for Preview Tracking Tasks","volume":"46","author":"Pool","year":"2016","journal-title":"IEEE Trans. Cybern."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1016\/j.automatica.2010.01.002","article-title":"On polytopic inclusions as a modeling framework for systems with time-varying delays","volume":"46","author":"Gielen","year":"2010","journal-title":"Automatica"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1668","DOI":"10.1109\/TAC.2006.883030","article-title":"Stabilization of Arbitrary Switched Linear Systems with Unknown Time-Varying Delays","volume":"51","author":"Hetel","year":"2006","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"044501","DOI":"10.1115\/1.4024007","article-title":"Optimal H\u221e-Based Linear-Quadratic Regulator Tracking Control for Discrete-Time Takagi\u2013Sugeno Fuzzy Systems with Preview Actions","volume":"135","author":"Zhang","year":"2013","journal-title":"J. Dyn. Syst. Meas. Control."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/8\/2544\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:16:28Z","timestamp":1760195788000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/8\/2544"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8,3]]},"references-count":44,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2018,8]]}},"alternative-id":["s18082544"],"URL":"https:\/\/doi.org\/10.3390\/s18082544","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,8,3]]}}}