{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T19:27:04Z","timestamp":1773775624777,"version":"3.50.1"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,8,4]],"date-time":"2023-08-04T00:00:00Z","timestamp":1691107200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,4]],"date-time":"2023-08-04T00:00:00Z","timestamp":1691107200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Hochschule Ruhr West"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Legal restrictions allow to give full control to automated vehicles for longer time periods either in restricted areas or when moving with reduced speed. Although being technically feasible for a wide range of driving scenarios, the restrictions are still in place due to the lack of a clear safety strategy. An essential step towards safety is the introduction of a self-monitoring component. In this study, a self-evaluation concept is presented which assesses a system based on a physics-defined minimum prediction horizon for state-of-the-art Deep Learning-based trajectory prediction models. Since User Experience is a key metric for car manufacturers, a further manoeuvre constraint is added to the model. We emphasize the generalizability of the presented assessment concept, however, in order to demonstrate feasibility in practical use, three specific scenarios are discussed. The results are gained with real data from publicly available driving campaigns as well as synthetically generated simulation data. Two exemplary models, a simple LSTM-based model and VectorNet, a prominent motion prediction model, are evaluated. A quantitative assessment shows a lack of training data in the public datasets for vehicle speeds &gt; 25 m\/s in order to offer safe driving above such vehicle speeds.<\/jats:p>","DOI":"10.1038\/s41598-023-39811-1","type":"journal-article","created":{"date-parts":[[2023,8,4]],"date-time":"2023-08-04T17:01:50Z","timestamp":1691168510000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Self-evaluation of automated vehicles based on physics, state-of-the-art motion prediction and user experience"],"prefix":"10.1038","volume":"13","author":[{"given":"Anne","family":"Stockem Novo","sequence":"first","affiliation":[]},{"given":"Christian","family":"H\u00fcrten","sequence":"additional","affiliation":[]},{"given":"Robin","family":"Baumann","sequence":"additional","affiliation":[]},{"given":"Philipp","family":"Sieberg","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,8,4]]},"reference":[{"key":"39811_CR1","unstructured":"Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles. SAE J3016. (SAE International, 2021)."},{"key":"39811_CR2","unstructured":"Strayer, D.L., Cooper, J.M., Turrill, J., Coleman, J.R. & Hopman, R.J. The smartphone and the driver\u2019s cognitive workload: A comparison of Apple, Google, and Microsoft\u2019s intelligent personal assistants. in Technical Report (AAA Foundation For Traffic Safety, 2015)."},{"key":"39811_CR3","unstructured":"Strayer, D.L., Cooper, J.M., Turrill, J., Coleman, J.R. & Hopman, R.J. Measuring cognitive distraction in the automobile III: A comparison of ten 2015 in-vehicle information systems. in Technical Report (AAA Foundation For Traffic Safety, 2015)."},{"key":"39811_CR4","doi-asserted-by":"publisher","unstructured":"Mehmed, A., Antlanger, M., Steiner, W. & Punnekkat, S. Forecast horizon for automated safety actions in automated driving systems. In International Conference on Computer Safety, Reliability, and Security 11698, 113\u2013127. https:\/\/doi.org\/10.1007\/978-3-030-26601-1_8 (Springer, Cham)(2019).","DOI":"10.1007\/978-3-030-26601-1_8"},{"key":"39811_CR5","doi-asserted-by":"publisher","first-page":"132","DOI":"10.3390\/physics4010011","volume":"4","author":"A Stockem Novo","year":"2022","unstructured":"Stockem Novo, A., Kr\u00fcger, M., Stolpe, M. & Bertram, T. A review on scene prediction for automated driving. Physics 4, 132\u2013159 (2022).","journal-title":"Physics"},{"key":"39811_CR6","doi-asserted-by":"publisher","first-page":"1259","DOI":"10.1287\/trsc.2021.1110","volume":"56","author":"D R\u00edos Insua","year":"2022","unstructured":"R\u00edos Insua, D., Caballero, W. N. & Naveiro, R. Managing driving modes in automated driving systems. Transp. Sci. 56, 1259\u20131278. https:\/\/doi.org\/10.1287\/trsc.2021.1110 (2022).","journal-title":"Transp. Sci."},{"key":"39811_CR7","doi-asserted-by":"publisher","first-page":"642","DOI":"10.1177\/0018720819829572","volume":"61","author":"AD McDonald","year":"2019","unstructured":"McDonald, A. D. et al. Toward computational simulations of behavior during automated driving takeovers: A review of the empirical and modeling literatures. Hum. Factors 61, 642\u2013688. https:\/\/doi.org\/10.1177\/0018720819829572 (2019).","journal-title":"Hum. Factors"},{"key":"39811_CR8","unstructured":"UNEWS. Up to 27 Seconds of Inattention After Talking to Your Car or Smartphone. https:\/\/unews.utah.edu\/up-to-27-seconds-of-inattention-after-talking-to-your-car-or-smart-phone\/ Accessed 09 Jan 2023 (2015)."},{"key":"39811_CR9","doi-asserted-by":"publisher","unstructured":"Dargahi\u00a0Nobari, K., Albers, F., Bartsch, K. & Bertram, T. Online feedback control for driver-vehicle interaction in automated driving. in International Conference on Applied Human Factors and Ergonomics. 159\u2013165. https:\/\/doi.org\/10.1007\/978-3-030-50943-9_21 (Springer, 2020).","DOI":"10.1007\/978-3-030-50943-9_21"},{"key":"39811_CR10","unstructured":"Road Vehicles\u2014Functional Safety\u2014Part 1: Vocabulary. ISO 26262-1. (International Organization for Standardization, 2011)."},{"key":"39811_CR11","unstructured":"Road Vehicles\u2014Functional Safety\u2014Part 1: Vocabulary. ISO 26262-1. (International Organization for Standardization, 2018)."},{"key":"39811_CR12","doi-asserted-by":"publisher","unstructured":"Karle, P., Geisslinger, M., Betz, J. & Lienkamp, M. Scenario understanding and motion prediction for autonomous vehicles-review and comparison. in IEEE Transactions on Intelligent Transportation Systems. Vol. 23. https:\/\/doi.org\/10.1109\/TITS.2022.3156011 (2022).","DOI":"10.1109\/TITS.2022.3156011"},{"key":"39811_CR13","doi-asserted-by":"publisher","first-page":"4909","DOI":"10.1109\/TITS.2021.3054625","volume":"23","author":"BR Kiran","year":"2022","unstructured":"Kiran, B. R. et al. Deep reinforcement learning for autonomous driving: A survey. IEEE Trans. Intell. Transp. Syst. 23, 4909\u20134926. https:\/\/doi.org\/10.1109\/TITS.2021.3054625 (2022).","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"39811_CR14","doi-asserted-by":"publisher","first-page":"740","DOI":"10.1109\/TITS.2020.3024655","volume":"23","author":"S Aradi","year":"2022","unstructured":"Aradi, S. Survey of deep reinforcement learning for motion planning of autonomous vehicles. IEEE Trans. Intell. Transp. Syst. 23, 740\u2013759. https:\/\/doi.org\/10.1109\/TITS.2020.3024655 (2022).","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"39811_CR15","doi-asserted-by":"publisher","unstructured":"Bighashdel, A. & Dubbelman, G. A survey on path prediction techniques for vulnerable road users: From traditional to deep-learning approaches. In 2019 IEEE Intelligent Transportation Systems Conference (ITSC). 1039\u20131046. https:\/\/doi.org\/10.1109\/ITSC.2019.8917053 (2019).","DOI":"10.1109\/ITSC.2019.8917053"},{"key":"39811_CR16","unstructured":"Nuscenes Prediction Task. https:\/\/www.nuscenes.org\/prediction. Accessed 09 Jan 2023 (2023)."},{"key":"39811_CR17","unstructured":"Argoverse 2: Motion Forecasting Competition. https:\/\/eval.ai\/web\/challenges\/challenge-page\/1719\/leaderboard. Accessed 09 Jan 2023 (2023)."},{"key":"39811_CR18","doi-asserted-by":"crossref","unstructured":"Limeros, S.\u00a0C. et\u00a0al. Towards trustworthy multi-modal motion prediction: Evaluation and interpretability. arXiv preprint arXiv:2210.16144 (2022).","DOI":"10.2139\/ssrn.4255360"},{"key":"39811_CR19","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1080\/16484142.2007.9638118","volume":"22","author":"N Kudarauskas","year":"2007","unstructured":"Kudarauskas, N. Analysis of emergency braking of a vehicle. Transport 22, 154\u2013159. https:\/\/doi.org\/10.1080\/16484142.2007.9638118 (2007).","journal-title":"Transport"},{"key":"39811_CR20","doi-asserted-by":"crossref","unstructured":"Gao, J. et\u00a0al. Vectornet: Encoding HD maps and agent dynamics from vectorized representation. in Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 11525\u201311533 (2020).","DOI":"10.1109\/CVPR42600.2020.01154"},{"key":"39811_CR21","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1016\/j.sbspro.2011.04.448","volume":"16","author":"S Gurupackiam","year":"2011","unstructured":"Gurupackiam, S. & Jones, S. L. Empirical study of lane changing in urban streets under varying traffic conditions. Proc. Soc. Behav. Sci. 16, 259\u2013269 (2011).","journal-title":"Proc. Soc. Behav. Sci."},{"key":"39811_CR22","unstructured":"Cao, X., Young, W. & Sarvi, M. Exploring duration of lane change execution. in Australasian Transport Research Forum (2013)."},{"key":"39811_CR23","unstructured":"Li, G., Yang, Z., Pan, Y. & Ma, J. In-depth analysis of durations of discretionary lane changes on freeway under varying traffic conditions. arXiv preprint arXiv:2108.06640 (2021)."},{"key":"39811_CR24","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1016\/S1369-8478(02)00011-6","volume":"5","author":"DD Salvucci","year":"2002","unstructured":"Salvucci, D. D. & Liu, A. The time course of a lane change: Driver control and eye-movement behavior. Transp. Res. Part F Traffic Psychol. Behav. 5, 123\u2013132 (2002).","journal-title":"Transp. Res. Part F Traffic Psychol. Behav."},{"key":"39811_CR25","doi-asserted-by":"crossref","unstructured":"Olsen, E.C., Lee, S.E., Wierwille, W.W. & Goodman, M.J. Analysis of distribution, frequency, and duration of naturalistic lane changes. in Proceedings of the Human Factors and Ergonomics Society Annual Meeting. Vol.\u00a046. 1789\u20131793 (SAGE Publications, 2002).","DOI":"10.1177\/154193120204602203"},{"key":"39811_CR26","doi-asserted-by":"publisher","first-page":"2007","DOI":"10.3141\/1999-08","volume":"71\u201378","author":"T Toledo","year":"1999","unstructured":"Toledo, T. & Zohar, D. Modeling duration of lane changes. Transp. Res. Rec. 71\u201378, 2007. https:\/\/doi.org\/10.3141\/1999-08 (1999).","journal-title":"Transp. Res. Rec."},{"key":"39811_CR27","unstructured":"Intelligent Transport Systems\u2014Partially Automated Lane Change Systems (PALS)\u2014Functional\/Operational Requirements and Test Procedures. ISO 21202. (International Organization for Standardization, 2020)."},{"key":"39811_CR28","unstructured":"MATLAB. 9.8.0.1538580 (R2020a) (The MathWorks Inc., 2020)."},{"key":"39811_CR29","doi-asserted-by":"crossref","unstructured":"Lopez, P.A. et\u00a0al. Microscopic traffic simulation using sumo. in The 21st IEEE International Conference on Intelligent Transportation Systems. 2575\u20132582 (IEEE, 2018).","DOI":"10.1109\/ITSC.2018.8569938"},{"key":"39811_CR30","doi-asserted-by":"crossref","unstructured":"Acosta, A.\u00a0F., Espinosa, J.\u00a0E. & Espinosa, J. TraCI4matlab: Enabling the integration of the SUMO road traffic simulator and Matlab\u00ae through a software re-engineering process. in Modeling Mobility with Open Data. 155\u2013170 (Springer, 2015).","DOI":"10.1007\/978-3-319-15024-6_9"},{"key":"39811_CR31","doi-asserted-by":"publisher","DOI":"10.3390\/app11104687","author":"PM Sieberg","year":"2021","unstructured":"Sieberg, P. M. & Schramm, D. Central non-linear model-based predictive vehicle dynamics control. Appl. Sci.https:\/\/doi.org\/10.3390\/app11104687 (2021).","journal-title":"Appl. Sci."},{"key":"39811_CR32","doi-asserted-by":"publisher","unstructured":"H\u00fcrten., C., Sieberg., P. & Schramm., D. Generating a multi-fidelity simulation model estimating the models\u2019 applicability with machine learning algorithms. in Proceedings of the 12th International Conference on Simulation and Modeling Methodologies, Technologies and Applications\u2014SIMULTECH. 131\u2013141. https:\/\/doi.org\/10.5220\/0011318100003274. INSTICC (SciTePress, 2022).","DOI":"10.5220\/0011318100003274"},{"key":"39811_CR33","doi-asserted-by":"crossref","unstructured":"Schramm, D., Hiller, M. & Bardini, R. Vehicle Dynamics: Modeling and Simulation. 2 ed. (Springer, 2018).","DOI":"10.1007\/978-3-662-54483-9"},{"key":"39811_CR34","unstructured":"Fiala, E. Mensch und Fahrzeug: Fahrzeugf\u00fchrung und sanfte Technik [Human and Vehicle: Vehicle Guidance and Gentle Technology] (Vieweg+Teubner Verlag Wiesbaden, 2006)."},{"key":"39811_CR35","doi-asserted-by":"publisher","first-page":"1233","DOI":"10.1068\/p5343","volume":"33","author":"DD Salvucci","year":"2004","unstructured":"Salvucci, D. D. & Gray, R. A two-point visual control model of steering. Perception 33, 1233\u20131248. https:\/\/doi.org\/10.1068\/p5343 (2004).","journal-title":"Perception"}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-39811-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-39811-1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-39811-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,17]],"date-time":"2023-11-17T16:08:52Z","timestamp":1700237332000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-39811-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,4]]},"references-count":35,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["39811"],"URL":"https:\/\/doi.org\/10.1038\/s41598-023-39811-1","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,4]]},"assertion":[{"value":"22 February 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 July 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 August 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"12692"}}