{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T04:08:20Z","timestamp":1783656500004,"version":"3.55.0"},"reference-count":12,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,6,13]],"date-time":"2024-06-13T00:00:00Z","timestamp":1718236800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,6,13]],"date-time":"2024-06-13T00:00:00Z","timestamp":1718236800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62088101"],"award-info":[{"award-number":["62088101"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Auton. Intell. Syst."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Artificial intelligence empowers the rapid development of autonomous intelligent systems (AISs), but it still struggles to cope with open, complex, dynamic, and uncertain environments, limiting its large-scale industrial application. Reliable human feedback provides a mechanism for aligning machine behavior with human values and holds promise as a new paradigm for the evolution and enhancement of machine intelligence. This paper analyzes the engineering insights from ChatGPT and elaborates on the evolution from traditional feedback to human feedback. Then, a unified framework for self-evolving intelligent driving (ID) based on human feedback is proposed. Finally, an application in the congested ramp scenario illustrates the effectiveness of the proposed framework.<\/jats:p>","DOI":"10.1007\/s43684-024-00071-z","type":"journal-article","created":{"date-parts":[[2024,6,13]],"date-time":"2024-06-13T08:01:51Z","timestamp":1718265711000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Human feedback enhanced autonomous intelligent systems: a perspective from intelligent driving"],"prefix":"10.1007","volume":"4","author":[{"given":"Kang","family":"Yuan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanjun","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lulu","family":"Guo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hong","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jie","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,6,13]]},"reference":[{"issue":"80","key":"71_CR1","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.adi3099","volume":"8","author":"V. Verma","year":"2023","unstructured":"V. Verma, M.W. Maimone, D.M. Gaines et al., Autonomous robotics is driving perseverance rover\u2019s progress on Mars. Sci. Robot. 8(80), eadi3099 (2023)","journal-title":"Sci. Robot."},{"key":"71_CR2","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-023-00798-4","author":"C. Paterson","year":"2023","unstructured":"C. Paterson, C. Picardi, Hazards help autonomous cars to drive safely. Nature (2023). https:\/\/doi.org\/10.1038\/d41586-023-00798-4","journal-title":"Nature"},{"key":"71_CR3","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1126\/science.adj3312","volume":"381","author":"M. Yip","year":"2023","unstructured":"M. Yip, S. Salcudean, K. Goldberg et al., Artificial intelligence meets medical robotics. Science 381, 141\u2013146 (2023)","journal-title":"Science"},{"key":"71_CR4","doi-asserted-by":"publisher","first-page":"660","DOI":"10.1109\/ITSC48978.2021.9565085","volume-title":"2021 IEEE International Intelligent Transportation Systems Conference (ITSC)","author":"A. Aksjonov","year":"2021","unstructured":"A. Aksjonov, V. Kyrki, Rule-based decision-making system for autonomous vehicles at intersections with mixed traffic environment, in 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), Indianapolis, IN, USA (IEEE, New York, 2021), pp. 660\u2013666"},{"key":"71_CR5","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1109\/TRO.2023.3324580","volume":"40","author":"P.M. Wensing","year":"2023","unstructured":"P.M. Wensing, M. Posa, Y. Hu et al., Optimization-based control for dynamic legged robots. IEEE Trans. Robot. 40, 43\u201363 (2023)","journal-title":"IEEE Trans. Robot."},{"issue":"11","key":"71_CR6","doi-asserted-by":"publisher","first-page":"1040","DOI":"10.1038\/s42256-022-00542-z","volume":"4","author":"C. Zhou","year":"2022","unstructured":"C. Zhou, M.C. Miao, X.R. Chen et al., Human-behaviour-based social locomotion model improves the humanization of social robots. Nat. Mach. Intell. 4(11), 1040\u20131052 (2022)","journal-title":"Nat. Mach. Intell."},{"issue":"9","key":"71_CR7","doi-asserted-by":"publisher","first-page":"14128","DOI":"10.1109\/TITS.2022.3144867","volume":"23","author":"L. Le Mero","year":"2022","unstructured":"L. Le Mero, D. Yi, M. Dianati et al., A survey on imitation learning techniques for end-to-end autonomous vehicles. IEEE Trans. Intell. Transp. Syst. 23(9), 14128\u201314147 (2022)","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"issue":"3","key":"71_CR8","doi-asserted-by":"publisher","first-page":"2874","DOI":"10.1109\/TITS.2022.3227738","volume":"24","author":"R. Bhattacharyya","year":"2022","unstructured":"R. Bhattacharyya, B. Wulfe, D.J. Phillips et al., Modeling human driving behavior through generative adversarial imitation learning. IEEE Trans. Intell. Transp. Syst. 24(3), 2874\u20132887 (2022)","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"71_CR9","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2021.103500","volume":"297","author":"S. Arora","year":"2021","unstructured":"S. Arora, P. Doshi, A survey of inverse reinforcement learning: challenges, methods and progress. Artif. Intell. 297, 103500 (2021)","journal-title":"Artif. Intell."},{"key":"71_CR10","volume-title":"Reinforcement Learning: An Introduction","author":"R.S. Sutton","year":"2018","unstructured":"R.S. Sutton, A.G. Barto, Reinforcement Learning: An Introduction (MIT Press, Cambridge, 2018)"},{"key":"71_CR11","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1016\/j.eng.2023.03.018","volume":"33","author":"K. Yuan","year":"2024","unstructured":"K. Yuan, Y. Huang, S. Yang et al., Evolutionary decision-making and planning for autonomous driving based on safe and rational exploration and exploitation. Engineering 33, 108\u2013120 (2024)","journal-title":"Engineering"},{"issue":"1","key":"71_CR12","doi-asserted-by":"publisher","first-page":"602","DOI":"10.1109\/TITS.2023.3307873","volume":"25","author":"Y. Huang","year":"2024","unstructured":"Y. Huang, S. Yang, L. Wang et al., An efficient self-evolution method of autonomous driving for any given algorithm. IEEE Trans. Intell. Transp. Syst. 25(1), 602\u2013612 (2024)","journal-title":"IEEE Trans. Intell. Transp. Syst."}],"container-title":["Autonomous Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43684-024-00071-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s43684-024-00071-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s43684-024-00071-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,13]],"date-time":"2024-06-13T08:33:57Z","timestamp":1718267637000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s43684-024-00071-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,13]]},"references-count":12,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["71"],"URL":"https:\/\/doi.org\/10.1007\/s43684-024-00071-z","relation":{},"ISSN":["2730-616X"],"issn-type":[{"value":"2730-616X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,13]]},"assertion":[{"value":"11 March 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 May 2024","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 May 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 June 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Profs. Yanjun Huang, Hong Chen, and Jie Chen serve as editorial board members of the journal and were not involved in the review or the decision on this article. All authors declare that there are no other competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"9"}}