{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T10:22:39Z","timestamp":1776334959372,"version":"3.51.2"},"reference-count":40,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2023,5,31]],"date-time":"2023-05-31T00:00:00Z","timestamp":1685491200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The personalization of autonomous vehicles or advanced driver assistance systems has been a widely researched topic, with many proposals aiming to achieve human-like or driver-imitating methods. However, these approaches rely on an implicit assumption that all drivers prefer the vehicle to drive like themselves, which may not hold true for all drivers. To address this issue, this study proposes an online personalized preference learning method (OPPLM) that utilizes a pairwise comparison group preference query and the Bayesian approach. The proposed OPPLM adopts a two-layer hierarchical structure model based on utility theory to represent driver preferences on the trajectory. To improve the accuracy of learning, the uncertainty of driver query answers is modeled. In addition, informative query and greedy query selection methods are used to improve learning speed. To determine when the driver\u2019s preferred trajectory has been found, a convergence criterion is proposed. To evaluate the effectiveness of the OPPLM, a user study is conducted to learn the driver\u2019s preferred trajectory in the curve of the lane centering control (LCC) system. The results show that the OPPLM can converge quickly, requiring only about 11 queries on average. Moreover, it accurately learned the driver\u2019s favorite trajectory, and the estimated utility of the driver preference model is highly consistent with the subject evaluation score.<\/jats:p>","DOI":"10.3390\/s23115246","type":"journal-article","created":{"date-parts":[[2023,6,1]],"date-time":"2023-06-01T02:39:47Z","timestamp":1685587187000},"page":"5246","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Online Personalized Preference Learning Method Based on In-Formative Query for Lane Centering Control Trajectory"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-3747-7724","authenticated-orcid":false,"given":"Wei","family":"Ran","sequence":"first","affiliation":[{"name":"School of Automotive Studies, Tongji University, Shanghai 201804, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hui","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Automotive Studies, Tongji University, Shanghai 201804, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Taokai","family":"Xia","sequence":"additional","affiliation":[{"name":"School of Automotive Studies, Tongji University, Shanghai 201804, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yosuke","family":"Nishimura","sequence":"additional","affiliation":[{"name":"JTEKT Corporation, Nara 634-8555, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chaopeng","family":"Guo","sequence":"additional","affiliation":[{"name":"JTEKT Corporation, Nara 634-8555, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Youyu","family":"Yin","sequence":"additional","affiliation":[{"name":"JTEKT Research and Development Center (WUXI) Co., Ltd., Wuxi 214161, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1016\/j.aap.2018.08.028","article-title":"Modelling driver acceptance of driver support systems","volume":"121","author":"Rahman","year":"2018","journal-title":"Accid. Anal. Prev."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1016\/j.trf.2017.11.015","article-title":"Crash avoidance and driver assistance technologies\u2014Are they used?","volume":"52","author":"Reagan","year":"2018","journal-title":"Transp. Res. Part F Traffic Psychol. Behav."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1109\/TIV.2019.2955910","article-title":"A Survey of Personalization for Advanced Driver Assistance Systems","volume":"5","author":"Hasenjager","year":"2020","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1109\/TIV.2019.2960935","article-title":"Implicit Personalization in Driving Assistance: State-of-the-Art and Open Issues","volume":"5","author":"Yi","year":"2020","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"12482","DOI":"10.1109\/TVT.2020.3020335","article-title":"Personalized Adaptive Cruise Control Based on Online Driving Style Recognition Technology and Model Predictive Control","volume":"69","author":"Gao","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"D\u00f6rr, D., Grabengiesser, D., and Gauterin, F. (2014, January 8\u201311). Online driving style recognition using fuzzy logic. Proceedings of the 17th International IEEE Conference on Intelligent Transportation Systems (ITSC), Qingdao, China.","DOI":"10.1109\/ITSC.2014.6957822"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1107","DOI":"10.1109\/JAS.2020.1003261","article-title":"Study on the driving style adaptive vehicle longitudinal control strategy","volume":"7","author":"Huang","year":"2020","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"666","DOI":"10.1109\/TITS.2017.2706978","article-title":"Driving Style Recognition for Intelligent Vehicle Control and Advanced Driver Assistance: A Survey","volume":"19","author":"Heucke","year":"2018","journal-title":"IEEE Trans. Intell. Transport. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"14128","DOI":"10.1109\/TITS.2022.3144867","article-title":"A Survey on Imitation Learning Techniques for End-to-End Autonomous Vehicles","volume":"23","author":"Yi","year":"2022","journal-title":"IEEE Trans. Intell. Transport. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"5624","DOI":"10.1109\/TITS.2020.2988303","article-title":"Autonomous Driving Learning Preference of Collision Avoidance Maneuvers","volume":"22","author":"Nagahama","year":"2021","journal-title":"IEEE Trans. Intell. Transport. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1109\/TSMC.2016.2529582","article-title":"A Driver Steering Model with Personalized Desired Path Generation","volume":"47","author":"Schnelle","year":"2017","journal-title":"IEEE Trans. Syst. Man Cybern Syst."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"7341","DOI":"10.1109\/TITS.2020.3001131","article-title":"Learning From Naturalistic Driving Data for Human-Like Autonomous Highway Driving","volume":"22","author":"Xu","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1002\/rob.21918","article-title":"A survey of deep learning techniques for autonomous driving","volume":"37","author":"Grigorescu","year":"2020","journal-title":"J. Field Robotics"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1016\/j.trc.2018.10.024","article-title":"Human-like autonomous car-following model with deep reinforcement learning","volume":"97","author":"Zhu","year":"2018","journal-title":"Transp. Res. Part C Emerg. Technol."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wu, Z., Qu, F., Yang, L., and Gong, J. (2022). Human-like Decision Making for Autonomous Vehicles at the Intersection Using Inverse Reinforcement Learning. Sensors, 22.","DOI":"10.3390\/s22124500"},{"key":"ref_16","unstructured":"Ziebart, B.D., Maas, A.L., Bagnell, J.A., and Dey, A.K. (2008, January 13\u201317). Maximum entropy inverse reinforcement learning. Proceedings of the 23rd AAAI conference on Artificial Intelligence (AAAI 2008), Chicago, IL, USA."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lu, C., Gong, J., Lv, C., Chen, X., Cao, D., and Chen, Y. (2019). A Personalized Behavior Learning System for Human-Like Longitudinal Speed Control of Autonomous Vehicles. Sensors, 19.","DOI":"10.3390\/s19173672"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Abbeel, P., and Ng, A.Y. (2004, January 4\u20138). Apprenticeship learning via inverse reinforcement learning. Proceedings of the 21st International Conference on Machine Learning, Banff, AB, Canada.","DOI":"10.1145\/1015330.1015430"},{"key":"ref_19","unstructured":"K\u00e4thner, D., and Griesche, S. (2017, January 26\u201329). Should my vehicle drive as I do? A methodology to determine drivers\u2018 preference for automated driving styles. Proceedings of the TeaP 2017, Dresden, Germany."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Basu, C., Yang, Q., Hungerman, D., Singhal, M., and Dragan, A.D. (2017, January 6\u20139). Do You Want Your Autonomous Car to Drive Like You?. Proceedings of the HRI \u201917 ACM\/IEEE International Conference on Human-Robot Interaction, Vienna, Austria.","DOI":"10.1145\/2909824.3020250"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yusof, N.M., Karjanto, J., Terken, J., Delbressine, F., Hassan, M.Z., and Rauterberg, M. (2016, January 24\u201326). The Exploration of Autonomous Vehicle Driving Styles. Proceedings of the AutomotiveUI\u201916: 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Ann Arbor, MI, USA.","DOI":"10.1145\/3003715.3005455"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1111\/j.1559-1816.1999.tb01392.x","article-title":"The Effect of Perceived Control on Risk Taking1","volume":"29","author":"Horswill","year":"1999","journal-title":"J. Appl. Social Pyschol."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"F\u00fcrnkranz, J., and H\u00fcllermeier, E. (2010). Preference learning, Springer.","DOI":"10.1007\/978-3-642-14125-6"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"F\u00fcrnkranz, J. (2010). Preference Learning, Springer.","DOI":"10.1007\/978-3-642-14125-6"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1016\/j.robot.2008.10.024","article-title":"A survey of robot learning from demonstration","volume":"57","author":"Argall","year":"2009","journal-title":"Robot. Auton. Syst."},{"key":"ref_26","unstructured":"Levine, S., Vanhoucke, V., and Goldberg, K. (2017, January 13\u201315). Learning Robot Objectives from Physical Human Interaction. Proceedings of the 1st Annual Conference on Robot Learning (CoRL 2017), Mountain View, CA, USA."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Akgun, B., Cakmak, M., Yoo, J.W., and Thomaz, A.L. (2012, January 5\u20138). Trajectories and keyframes for kinesthetic teaching. Proceedings of the seventh annual ACM\/IEEE international conference on Human-Robot Interaction\u2014HRI \u203212, Boston, MA, USA.","DOI":"10.1145\/2157689.2157815"},{"key":"ref_28","unstructured":"B\u0131y\u0131k, E., Palan, M., Landolfi, N.C., Losey, D.P., and Sadigh, D. (2023, February 21). Asking Easy Questions: A User-Friendly Approach to Active Reward Learning. Available online: http:\/\/arxiv.org\/pdf\/1910.04365v1."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Cui, Y., and Niekum, S. (2018, January 21\u201325). Active Reward Learning from Critiques. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, QLD, Australia.","DOI":"10.1109\/ICRA.2018.8460854"},{"key":"ref_30","first-page":"116","article-title":"APRIL: Active Preference-learning based Reinforcement Learning","volume":"7524","author":"Akrour","year":"2012","journal-title":"arXiv"},{"key":"ref_31","unstructured":"Cakmak, M., and Thomaz, A.L. (2011, January 2). Active learning with mixed query types in learning from demonstration. Proceedings of the ICML Workshop on New Developments in Imitation Learning, Bellevue, WA, USA."},{"key":"ref_32","unstructured":"Billard, A., Dragan, A., Peters, J., and Morimoto, J. (2018, January 29\u201331). Batch Active Preference-Based Learning of Reward Functions. Proceedings of the 2nd Conference on Robot Learning, Z\u00fcrich, Switzerland."},{"key":"ref_33","unstructured":"Wilde, N., B\u0131y\u0131k, E., Sadigh, D., and Smith, S.L. (2021). Learning Reward Functions from Scale Feedback. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"3545","DOI":"10.1109\/LRA.2021.3063927","article-title":"Human-Guided Robot Behavior Learning: A GAN-Assisted Preference-Based Reinforcement Learning Approach","volume":"6","author":"Zhan","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_35","unstructured":"Chandrayee, B., Singhal, M., and Dragan, A.D. (2018, January 5\u20138). Learning from Richer Human Guidance: Augmenting Comparison-Based Learning with Feature Queries. Proceedings of the 2018 13th ACM\/IEEE International Conference on Human-Robot Interaction (HRI), Chicage, IL, USA."},{"key":"ref_36","unstructured":"Ben-Akiva, M.E., Lerman, S.R., and Lerman, S.R. (1985). Discrete Choice Analysis: Theory and Application to Travel Demand, MIT Press."},{"key":"ref_37","unstructured":"Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1287","DOI":"10.1080\/00423114.2018.1497185","article-title":"An optimal hierarchical framework of the trajectory following by convex optimisation for highly automated driving vehicles","volume":"57","author":"Cao","year":"2018","journal-title":"Veh. Syst. Dyn."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Hoffman, G.M., Tomlin, C.J., Montemerlo, M., and Thrun, S. (2007, January 9\u201313). Autonomous Automobile Trajectory Tracking for Off-Road Drriving: Controller Design, Experimental Validation and Racing. Proceedings of the 2007 American Control Conference, New York, NY, USA.","DOI":"10.1109\/ACC.2007.4282788"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"175","DOI":"10.3758\/BF03193146","article-title":"G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences","volume":"39","author":"Faul","year":"2007","journal-title":"Behav. Res. Methods"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/11\/5246\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:46:33Z","timestamp":1760125593000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/11\/5246"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,31]]},"references-count":40,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["s23115246"],"URL":"https:\/\/doi.org\/10.3390\/s23115246","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,31]]}}}