{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,2]],"date-time":"2026-01-02T07:27:08Z","timestamp":1767338828320,"version":"3.37.3"},"reference-count":66,"publisher":"Springer Science and Business Media LLC","issue":"16","license":[{"start":{"date-parts":[[2023,2,25]],"date-time":"2023-02-25T00:00:00Z","timestamp":1677283200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,2,25]],"date-time":"2023-02-25T00:00:00Z","timestamp":1677283200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100023863","name":"Munich Center for Machine Learning","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100023863","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100005713","name":"Technische Universit\u00e4t M\u00fcnchen","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005713","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Appl Intell"],"published-print":{"date-parts":[[2023,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Supervised deep learning methods using image data as input have shown promising results in the context of vehicle control. However, these supervised methods have two main disadvantages: 1) They require a copious amount of labeled training data, which is difficult and expensive to collect. 2) Such models do not perform well, when situations that are not in the distribution of the training set are encountered. This includes deviations from the designated driving behavior. We therefore provide a framework to mitigate these problems from merely an unlabeled sequence of images. Visual Odometry is first used to determine the vehicle trajectory. Model Predictive Control (MPC) then uses this trajectory to implicitly infer the steering labels. Meanwhile, synthesized images at deviated trajectories are included in the training distribution for enhanced robustness of the neural network model. Experimental results demonstrate that the performance of our network is at par with methods requiring additional data collection or supervision. Code and supplementary information is available here: <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/github.com\/idilsulo\/nn-driving\">https:\/\/github.com\/idilsulo\/nn-driving<\/jats:ext-link><\/jats:p>","DOI":"10.1007\/s10489-023-04478-8","type":"journal-article","created":{"date-parts":[[2023,2,25]],"date-time":"2023-02-25T17:02:25Z","timestamp":1677344545000},"page":"19186-19198","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Learning vision based autonomous lateral vehicle control without supervision"],"prefix":"10.1007","volume":"53","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7674-0596","authenticated-orcid":false,"given":"Qadeer","family":"Khan","sequence":"first","affiliation":[]},{"given":"Idil","family":"S\u00fcl\u00f6","sequence":"additional","affiliation":[]},{"given":"Melis","family":"\u00d6cal","sequence":"additional","affiliation":[]},{"given":"Daniel","family":"Cremers","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,2,25]]},"reference":[{"key":"4478_CR1","unstructured":"Pomerleau DA (1989) Alvinn: an autonomous land vehicle in a neural network. In: Advances in neural information processing systems, vol 1"},{"issue":"9","key":"4478_CR2","doi-asserted-by":"publisher","first-page":"661","DOI":"10.1002\/rob.v23:9","volume":"23","author":"S Thrun","year":"2006","unstructured":"Thrun S (2006) Stanley: the robot that won the darpa grand challenge: research articles. J Robot Syst 23(9):661\u2013692. https:\/\/doi.org\/10.1002\/rob.v23:9","journal-title":"J Robot Syst"},{"key":"4478_CR3","unstructured":"Bojarski M, Testa DD, Dworakowski D, Firner B, Flepp B, Goyal P, Jackel LD, Monfort M, Muller U, Zhang J, Zhang X, Zhao J, Zieba K (2016) End to end learning for self-driving cars. CoRR arXiv:1604.07316"},{"issue":"8","key":"4478_CR4","doi-asserted-by":"publisher","first-page":"5152","DOI":"10.1109\/TII.2020.3033794","volume":"17","author":"N Wang","year":"2021","unstructured":"Wang N, He H (2021) Extreme learning-based monocular visual servo of an unmanned surface vessel. IEEE Trans Industr Inf 17(8):5152\u20135163. https:\/\/doi.org\/10.1109\/TII.2020.3033794","journal-title":"IEEE Trans Industr Inf"},{"issue":"6","key":"4478_CR5","doi-asserted-by":"publisher","first-page":"3198","DOI":"10.1109\/TMECH.2021.3055450","volume":"26","author":"N Wang","year":"2021","unstructured":"Wang N, Ahn CK (2021) Coordinated trajectory-tracking control of a marine aerial-surface heterogeneous system. IEEE\/ASME Trans Mechatronics 26(6):3198\u20133210. https:\/\/doi.org\/10.1109\/TMECH.2021.3055450","journal-title":"IEEE\/ASME Trans Mechatronics"},{"issue":"3","key":"4478_CR6","doi-asserted-by":"publisher","first-page":"2358","DOI":"10.1109\/TVT.2021.3136670","volume":"71","author":"N Wang","year":"2022","unstructured":"Wang N, Zhang Y, Ahn CK, Xu Q (2022) Autonomous pilot of unmanned surface vehicles: bridging path planning and tracking. IEEE Trans Vehicular Technol 71(3):2358\u20132374. https:\/\/doi.org\/10.1109\/TVT.2021.3136670","journal-title":"IEEE Trans Vehicular Technol"},{"issue":"11","key":"4478_CR7","doi-asserted-by":"publisher","first-page":"849","DOI":"10.1109\/EE.1944.6440576","volume":"63","author":"WH Gille","year":"1944","unstructured":"Gille WH, Kutzler RJ (1944) Application of electronics to aircraft flight control. Electr Eng 63(11):849\u2013853. https:\/\/doi.org\/10.1109\/EE.1944.6440576","journal-title":"Electr Eng"},{"issue":"3","key":"4478_CR8","doi-asserted-by":"publisher","first-page":"7209","DOI":"10.1109\/LRA.2022.3181755","volume":"7","author":"R Penicka","year":"2022","unstructured":"Penicka R, Song Y, Kaufmann E, Scaramuzza D (2022) Learning minimum-time flight in cluttered environments. IEEE Robot Autom Lett 7(3):7209\u20137216. https:\/\/doi.org\/10.1109\/LRA.2022.3181755","journal-title":"IEEE Robot Autom Lett"},{"key":"4478_CR9","doi-asserted-by":"publisher","unstructured":"Chen Z, Huang X (2017) End-to-end learning for lane keeping of self-driving cars. In: 2017 IEEE intelligent vehicles symposium (IV), pp 1856\u20131860. https:\/\/doi.org\/10.1109\/IVS.2017.7995975","DOI":"10.1109\/IVS.2017.7995975"},{"key":"4478_CR10","doi-asserted-by":"publisher","unstructured":"Toromanoff M, Wirbel E, Wilhelm F, Vejarano C, Perrotton X, Moutarde F (2018) End to end vehicle lateral control using a single fisheye camera. In: 2018 IEEE\/RSJ international conference on intelligent robots and systems (IROS), pp 3613\u20133619. https:\/\/doi.org\/10.1109\/IROS.2018.8594090","DOI":"10.1109\/IROS.2018.8594090"},{"key":"4478_CR11","doi-asserted-by":"publisher","unstructured":"Kendall A, Hawke J, Janz D, Mazur P, Reda D, Allen J-M, Lam V-D, Bewley A, Shah A (2019) Learning to drive in a day. In: 2019 International conference on robotics and automation (ICRA), pp 8248\u20138254. https:\/\/doi.org\/10.1109\/ICRA.2019.8793742","DOI":"10.1109\/ICRA.2019.8793742"},{"key":"4478_CR12","unstructured":"Ross S, Bagnell D (2010) Efficient reductions for imitation learning. In: Teh YW, Titterington M (eds) Proceedings of the thirteenth international conference on artificial intelligence and statistics. Proceedings of machine learning research. PMLR, Chia Laguna Resort, Sardinia, Italy, vol 9, pp 661\u2013668. http:\/\/proceedings.mlr.press\/v9\/ross10a.html"},{"key":"4478_CR13","doi-asserted-by":"crossref","unstructured":"Bansal M, Krizhevsky A, Ogale A (2018) Chauffeurnet: learning to drive by imitating the best and synthesizing the worst. CoRR arXiv:1812.03079","DOI":"10.15607\/RSS.2019.XV.031"},{"key":"4478_CR14","unstructured":"Wenzel P, Khan Q, Cremers D, Leal-Taix\u00e9 L (2018) Modular vehicle control for transferring semantic information between weather conditions using GANs. In: Conference on robot learning (coRL)"},{"key":"4478_CR15","doi-asserted-by":"publisher","unstructured":"Hubschneider C, Bauer A, Weber M, Z\u00f6llner J (2017) Adding navigation to the equation: turning decisions for end-to-end vehicle control. In: 2017 IEEE 20th international conference on intelligent transportation systems (ITSC), pp 1\u20138. https:\/\/doi.org\/10.1109\/ITSC.2017.8317923","DOI":"10.1109\/ITSC.2017.8317923"},{"key":"4478_CR16","doi-asserted-by":"crossref","unstructured":"Codevilla F, M\u00fcller M, L\u00f3pez A, Koltun V, Dosovitskiy A (2018) End-to-end driving via conditional imitation learning. In: 2018 IEEE international conference on robotics and automation (ICRA). IEEE, pp 1\u20139","DOI":"10.1109\/ICRA.2018.8460487"},{"key":"4478_CR17","unstructured":"Laskey M, Lee J, Fox R, Dragan A, Goldberg K (2017) Dart: noise injection for robust imitation learning. In: Proceedings of the 1st annual conference on robot learning. Proceedings of machine learning research, vol 78, pp 143\u2013156. http:\/\/proceedings.mlr.press\/v78\/laskey17a.html"},{"key":"4478_CR18","doi-asserted-by":"publisher","unstructured":"Zhang Q, Luo R, Zhao D, Luo C, Qian D (2019) Model-free reinforcement learning based lateral control for lane keeping. In: 2019 International joint conference on neural networks (IJCNN), pp 1\u20137. https:\/\/doi.org\/10.1109\/IJCNN.2019.8851766","DOI":"10.1109\/IJCNN.2019.8851766"},{"issue":"2","key":"4478_CR19","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1109\/MCI.2019.2901089","volume":"14","author":"D Li","year":"2019","unstructured":"Li D, Zhao D, Zhang Q, Chen Y (2019) Reinforcement learning and deep learning based lateral control for autonomous driving [application notes]. IEEE Comput Intell Mag 14(2):83\u201398. https:\/\/doi.org\/10.1109\/MCI.2019.2901089","journal-title":"IEEE Comput Intell Mag"},{"issue":"3","key":"4478_CR20","doi-asserted-by":"publisher","first-page":"3553","DOI":"10.1007\/s11042-021-11437-3","volume":"81","author":"\u00d3 P\u00e9rez-Gil","year":"2022","unstructured":"P\u00e9rez-Gil \u00d3, Barea R, L\u00f3pez-Guill\u00e9n E, Bergasa LM, G\u00f3mez-Hu\u00e9lamo C, Guti\u00e9rrez R, D\u00edaz-D\u00edaz A (2022) Deep reinforcement learning based control for autonomous vehicles in carla. Multimed Tools Appl 81(3):3553\u20133576","journal-title":"Multimed Tools Appl"},{"key":"4478_CR21","unstructured":"Sutton RS, Barto AG (2018) Reinforcement learning: an introduction. MIT Press"},{"key":"4478_CR22","doi-asserted-by":"crossref","unstructured":"Roitberg A, Schneider D, Djamal A, Seibold C, Rei\u00df S, Stiefelhagen R (2021) Let\u2019s play for action: recognizing activities of daily living by learning from life simulation video games. In: 2021 IEEE\/RSJ international conference on intelligent robots and systems (IROS). IEEE","DOI":"10.1109\/IROS51168.2021.9636381"},{"key":"4478_CR23","doi-asserted-by":"publisher","unstructured":"Xinlei Pan ZW, You Y, Lu C (2017) Virtual to real reinforcement learning for autonomous driving. In: Proceedings of the British machine vision conference (BMVC). https:\/\/doi.org\/10.5244\/C.31.11","DOI":"10.5244\/C.31.11"},{"key":"4478_CR24","doi-asserted-by":"publisher","unstructured":"Vithayathil Varghese N, Mahmoud QH (2020) A survey of multi-task deep reinforcement learning. Electronics, vol 9(9). https:\/\/doi.org\/10.3390\/electronics9091363","DOI":"10.3390\/electronics9091363"},{"key":"4478_CR25","unstructured":"Khan Q, Wenzel P, Cremers D (2021) Self-supervised steering angle prediction for vehicle control using visual odometry. In: Proceedings of the 24th international conference on artificial intelligence and statistics. Proceedings of machine learning research, vol 130, pp 3781\u20133789. http:\/\/proceedings.mlr.press\/v130\/khan21a.html"},{"key":"4478_CR26","doi-asserted-by":"publisher","unstructured":"Li C, Wang J, Wang X, Zhang Y (2015) A model based path planning algorithm for self-driving cars in dynamic environment. In: 2015 Chinese automation congress (CAC), pp 1123\u20131128. https:\/\/doi.org\/10.1109\/CAC.2015.7382666","DOI":"10.1109\/CAC.2015.7382666"},{"key":"4478_CR27","doi-asserted-by":"publisher","unstructured":"Oliveira R, Lima PF, Collares Pereira G, M\u00e5rtensson J, Wahlberg B (2019) Path planning for autonomous bus driving in highly constrained environments. In: 2019 IEEE intelligent transportation systems conference (ITSC), pp 2743\u20132749. https:\/\/doi.org\/10.1109\/ITSC.2019.8916773","DOI":"10.1109\/ITSC.2019.8916773"},{"key":"4478_CR28","doi-asserted-by":"publisher","unstructured":"Matute JA, Marcano M, Zubizarreta A, Perez J (2018) Longitudinal model predictive control with comfortable speed planner. In: 2018 IEEE international conference on autonomous robot systems and competitions (ICARSC), pp 60\u201364. https:\/\/doi.org\/10.1109\/ICARSC.2018.8374161","DOI":"10.1109\/ICARSC.2018.8374161"},{"issue":"8","key":"4478_CR29","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1016\/j.ifacol.2019.08.044","volume":"52","author":"Y Mizushima","year":"2019","unstructured":"Mizushima Y, Okawa I, Nonaka K (2019) Model predictive control for autonomous vehicles with speed profile shaping. IFAC-PapersOnLine 52(8):31\u201336. https:\/\/doi.org\/10.1016\/j.ifacol.2019.08.044. 10th IFAC symposium on intelligent autonomous vehicles IAV 2019","journal-title":"IFAC-PapersOnLine"},{"key":"4478_CR30","doi-asserted-by":"crossref","unstructured":"Uebel S, Kutter S, Hipp K, Schr\u00f6del F (2019) A computationally efficient MPC for green light optimal speed advisory of highly automated vehicles. In: VEHITS, pp 444\u2013451","DOI":"10.5220\/0007717304440451"},{"key":"4478_CR31","unstructured":"Bansal S, Tolani V, Gupta S, Malik J, Tomlin C (2020) Combining optimal control and learning for visual navigation in novel environments. In: Conference on robot learning. PMLR, pp 420\u2013429"},{"issue":"22","key":"4478_CR32","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1016\/j.ifacol.2018.11.593","volume":"51","author":"F Mohseni","year":"2018","unstructured":"Mohseni F, Voronov S, Frisk E (2018) Deep learning model predictive control for autonomous driving in unknown environments. IFAC-PapersOnLine 51(22):447\u2013452. https:\/\/doi.org\/10.1016\/j.ifacol.2018.11.593. 12th IFAC symposium on robot control SYROCO 2018","journal-title":"IFAC-PapersOnLine"},{"key":"4478_CR33","doi-asserted-by":"crossref","unstructured":"Qian R, Garg D, Wang Y, You Y, Belongie S, Hariharan B, Campbell M, Weinberger KQ, Chao W-L (2020) End-to-end pseudo-lidar for image-based 3d object detection. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 5881\u20135890","DOI":"10.1109\/CVPR42600.2020.00592"},{"issue":"18","key":"4478_CR34","doi-asserted-by":"publisher","first-page":"512","DOI":"10.1016\/j.ifacol.2018.09.373","volume":"51","author":"SS Pon Kumar","year":"2018","unstructured":"Pon Kumar SS, Tulsyan A, Gopaluni B, Loewen P (2018) A deep learning architecture for predictive control. IFAC-PapersOnLine 51(18):512\u2013517. https:\/\/doi.org\/10.1016\/j.ifacol.2018.09.373. 10th IFAC symposium on advanced control of chemical processes ADCHEM 2018","journal-title":"IFAC-PapersOnLine"},{"key":"4478_CR35","doi-asserted-by":"crossref","unstructured":"Geiger A, Lenz P, Urtasun R (2012) Are we ready for autonomous driving? the kitti vision benchmark suite. In: Conference on computer vision and pattern recognition (CVPR)","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"4478_CR36","doi-asserted-by":"publisher","unstructured":"Varma B, Swamy N, Mukherjee S (2020) Trajectory tracking of autonomous vehicles using different control techniques(pid vs lqr vs mpc). In: 2020 International conference on smart technologies in computing, electrical and electronics (ICSTCEE), pp 84\u201389. https:\/\/doi.org\/10.1109\/ICSTCEE49637.2020.9276986","DOI":"10.1109\/ICSTCEE49637.2020.9276986"},{"issue":"2","key":"4478_CR37","doi-asserted-by":"publisher","first-page":"78","DOI":"10.18196\/jrc.2256","volume":"2","author":"M Samuel","year":"2021","unstructured":"Samuel M, Mohamad M, Hussein M, Saad SM (2021) Lane keeping maneuvers using proportional integral derivative (pid) and model predictive control (mpc). J Robot Control (JRC) 2(2):78\u201382. https:\/\/doi.org\/10.18196\/jrc.2256","journal-title":"J Robot Control (JRC)"},{"key":"4478_CR38","doi-asserted-by":"publisher","unstructured":"Liu J, Yang Z, Huang Z, Li W, Dang S, Li H (2021) Simulation performance evaluation of pure pursuit, stanley, lqr, mpc controller for autonomous vehicles. In: 2021 IEEE international conference on real-time computing and robotics (RCAR), pp 1444\u20131449. https:\/\/doi.org\/10.1109\/RCAR52367.2021.9517448","DOI":"10.1109\/RCAR52367.2021.9517448"},{"issue":"6","key":"4478_CR39","doi-asserted-by":"publisher","first-page":"2376","DOI":"10.1109\/TITS.2019.2918176","volume":"21","author":"S Cheng","year":"2020","unstructured":"Cheng S, Li L, Guo H-Q, Chen Z-G, Song P (2020) Longitudinal collision avoidance and lateral stability adaptive control system based on mpc of autonomous vehicles. IEEE Trans Intell Transp Syst 21(6):2376\u20132385. https:\/\/doi.org\/10.1109\/TITS.2019.2918176","journal-title":"IEEE Trans Intell Transp Syst"},{"key":"4478_CR40","unstructured":"Wang D, Fing Q (2001) Trajectory planning for a four-wheel-steering vehicle. In: IEEE international conference on robotics and automation (ICRA)"},{"key":"4478_CR41","doi-asserted-by":"crossref","unstructured":"Rajamani R (2012) Vehicle dynamics and control. In: Second edn, publisher: Springer","DOI":"10.1007\/978-1-4614-1433-9"},{"key":"4478_CR42","doi-asserted-by":"crossref","unstructured":"Godard C, Mac Aodha O, Firman M, Brostow GJ (2019) Digging into self-supervised monocular depth prediction. The international conference on computer vision (ICCV)","DOI":"10.1109\/ICCV.2019.00393"},{"key":"4478_CR43","doi-asserted-by":"crossref","unstructured":"Wiles O, Gkioxari G, Szeliski R, Johnson J (2020) Synsin: end-to-end view synthesis from a single image. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 7467\u20137477","DOI":"10.1109\/CVPR42600.2020.00749"},{"key":"4478_CR44","doi-asserted-by":"crossref","unstructured":"Godard C, Mac Aodha O, Brostow GJ (2017) Unsupervised monocular depth estimation with left-right consistency. In: CVPR","DOI":"10.1109\/CVPR.2017.699"},{"key":"4478_CR45","doi-asserted-by":"crossref","unstructured":"Zhu S, Brazil G, Liu X (2020) The edge of depth: explicit constraints between segmentation and depth. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (CVPR)","DOI":"10.1109\/CVPR42600.2020.01313"},{"key":"4478_CR46","unstructured":"Imran S, Kyung C-M, Mukaram S, Karim Khan MU (2020) Unsupervised monocular depth estimation with multi-baseline stereo. In: The 31st British machine vision conference. British machine vision virtual conference"},{"key":"4478_CR47","doi-asserted-by":"publisher","unstructured":"Khan Q, Wenzel P, Cremers D, Leal-Taix\u00e9 L (2019) Towards generalizing sensorimotor control across weather conditions. In: 2019 IEEE\/RSJ international conference on intelligent robots and systems (IROS), pp 4497\u20134503. https:\/\/doi.org\/10.1109\/IROS40897.2019.8968451","DOI":"10.1109\/IROS40897.2019.8968451"},{"issue":"5","key":"4478_CR48","doi-asserted-by":"publisher","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","volume":"31","author":"JMM Mur-Artal","year":"2015","unstructured":"Mur-Artal JMM, Montiel R, Tardos JD (2015) ORB- SLAM: a versatile and accurate monocular SLAM system. IEEE Trans Robot 31(5):1147\u20131163. https:\/\/doi.org\/10.1109\/TRO.2015.2463671","journal-title":"IEEE Trans Robot"},{"issue":"3","key":"4478_CR49","doi-asserted-by":"publisher","first-page":"611","DOI":"10.1109\/TPAMI.2017.2658577","volume":"40","author":"J Engel","year":"2018","unstructured":"Engel J, Koltun V, Cremers D (2018) Direct sparse odometry. IEEE Trans Pattern Anal Mach Intell 40(3):611\u2013625. https:\/\/doi.org\/10.1109\/TPAMI.2017.2658577","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"4478_CR50","doi-asserted-by":"crossref","unstructured":"Engel J, Cremers D (2014) Lsd-slam: large-scale direct monocular slam. In: In ECCV","DOI":"10.1007\/978-3-319-10605-2_54"},{"issue":"5","key":"4478_CR51","doi-asserted-by":"publisher","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","volume":"33","author":"R Mur-Artal","year":"2017","unstructured":"Mur-Artal R, Tard\u00f3s JD (2017) ORB-SLAM2: an open-source SLAM system for monocular, stereo and RGB-d cameras. IEEE Trans Robot 33(5):1255\u20131262. https:\/\/doi.org\/10.1109\/TRO.2017.2705103","journal-title":"IEEE Trans Robot"},{"key":"4478_CR52","doi-asserted-by":"crossref","unstructured":"Wang R, Schw\u00f6rer M, Cremers D (2017) Stereo dso: large-scale direct sparse visual odometry with stereo cameras. In: International conference on computer vision (ICCV), Venice, Italy","DOI":"10.1109\/ICCV.2017.421"},{"key":"4478_CR53","doi-asserted-by":"crossref","unstructured":"Caesar H, Bankiti V, Lang AH, Vora S, Liong VE, Xu Q, Krishnan A, Pan Y, Baldan G, Beijbom O (2020) Nuscenes: a multimodal dataset for autonomous driving. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (CVPR)","DOI":"10.1109\/CVPR42600.2020.01164"},{"key":"4478_CR54","doi-asserted-by":"crossref","unstructured":"Sun P, Kretzschmar H, Dotiwalla X, Chouard A, Patnaik V, Tsui P, Guo J, Zhou Y, Chai Y, Caine B et al (2020) Scalability in perception for autonomous driving: waymo open dataset. In: Conference on computer vision and pattern recognition (CVPR)","DOI":"10.1109\/CVPR42600.2020.00252"},{"key":"4478_CR55","doi-asserted-by":"crossref","unstructured":"Wenzel P, Wang R, Yang N, Cheng Q, Khan Q, Von Stumberg L, Zeller N, Cremers D (2020) 4Seasons: a cross-season dataset for multi-weather SLAM in autonomous driving. In: Proceedings of the german conference on pattern recognition (GCPR)","DOI":"10.1007\/978-3-030-71278-5_29"},{"key":"4478_CR56","unstructured":"Geyer J, Kassahun Y, Mahmudi M, Ricou X, Durgesh R, Chung AS, Hauswald L, Pham VH, M\u00fchlegg M, Dorn S, Fernandez T, J\u00e4nicke M, Mirashi S, Savani C, Sturm M , Vorobiov O, Oelker M, Garreis S, Schuberth P (2020) A2D2: audi autonomous driving dataset. CoRR arXiv:2004.06320 [cs.CV]"},{"key":"4478_CR57","doi-asserted-by":"crossref","unstructured":"Codevilla F, L\u00f3pez AM, Koltun V, Dosovitskiy A (2018) On offline evaluation of vision-based driving models. In: Proceedings of the European conference on computer vision (ECCV), pp 236\u2013251","DOI":"10.1007\/978-3-030-01267-0_15"},{"key":"4478_CR58","doi-asserted-by":"crossref","unstructured":"Shah S, Dey D, Lovett C, Kapoor A (2017) Airsim: high-fidelity visual and physical simulation for autonomous vehicles. In: Field and service robotics. arXiv:1705.05065","DOI":"10.1007\/978-3-319-67361-5_40"},{"key":"4478_CR59","doi-asserted-by":"publisher","unstructured":"Koenig N, Howard A (2004) Design and use paradigms for gazebo, an open-source multi-robot simulator. In: 2004 IEEE\/RSJ international conference on intelligent robots and systems (IROS) (IEEE Cat. No.04CH37566), vol 3, pp 2149\u201321543. https:\/\/doi.org\/10.1109\/IROS.2004.1389727","DOI":"10.1109\/IROS.2004.1389727"},{"key":"4478_CR60","unstructured":"Dosovitskiy A, Ros G, Codevilla F, Lopez A, Koltun V (2017) CARLA: an open urban driving simulator. In: Conference on robot learning (coRL)"},{"key":"4478_CR61","unstructured":"Espi\u00e9 E, Guionneau C, Wymann B, Dimitrakakis C, Coulom R, Sumner A (2005) Torcs, the open racing car simulator"},{"key":"4478_CR62","doi-asserted-by":"publisher","unstructured":"Wang T, Chang DE (2019) Improved reinforcement learning through imitation learning pretraining towards image-based autonomous driving. In: 2019 19th international conference on control, automation and systems (ICCAS), pp 1306\u20131310. https:\/\/doi.org\/10.23919\/ICCAS47443.2019.8971737","DOI":"10.23919\/ICCAS47443.2019.8971737"},{"key":"4478_CR63","doi-asserted-by":"crossref","unstructured":"Wenzel P, Sch\u00f6n T, Leal-Taix\u00e9 L, Cremers D (2021) Vision-based mobile robotics obstacle avoidance with deep reinforcement learning. In: Proceedings of the IEEE international conference on robotics and automation (ICRA)","DOI":"10.1109\/ICRA48506.2021.9560787"},{"issue":"2","key":"4478_CR64","doi-asserted-by":"publisher","first-page":"890","DOI":"10.1109\/LRA.2020.2965031","volume":"5","author":"L Von Stumberg","year":"2020","unstructured":"Von Stumberg L, Wenzel P, Khan Q, Cremers D (2020) GN-Net: the gauss-newton loss for multi-weather relocalization. IEEE Robot Autom Lett (RA-L) 5(2):890\u2013897","journal-title":"IEEE Robot Autom Lett (RA-L)"},{"key":"4478_CR65","doi-asserted-by":"crossref","unstructured":"Dusmanu M, Rocco I, Pajdla T, Pollefeys M, Sivic J, Torii A, Sattler T (2019) D2-Net: a trainable CNN for joint detection and description of local features. In: Proceedings of the 2019 IEEE\/CVF conference on computer vision and pattern recognition","DOI":"10.1109\/CVPR.2019.00828"},{"key":"4478_CR66","unstructured":"Revaud J, Weinzaepfel P, De Souza CR, Humenberger M (2019) R2D2: repeatable and reliable detector and descriptor. In: NeurIPS"}],"container-title":["Applied Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-023-04478-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10489-023-04478-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10489-023-04478-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,28]],"date-time":"2023-08-28T05:08:30Z","timestamp":1693199310000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10489-023-04478-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,25]]},"references-count":66,"journal-issue":{"issue":"16","published-print":{"date-parts":[[2023,8]]}},"alternative-id":["4478"],"URL":"https:\/\/doi.org\/10.1007\/s10489-023-04478-8","relation":{},"ISSN":["0924-669X","1573-7497"],"issn-type":[{"type":"print","value":"0924-669X"},{"type":"electronic","value":"1573-7497"}],"subject":[],"published":{"date-parts":[[2023,2,25]]},"assertion":[{"value":"17 January 2023","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 February 2023","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors see no bias or conflict of competing interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Competing interests"}}]}}