{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,2]],"date-time":"2025-11-02T09:13:16Z","timestamp":1762074796103,"version":"build-2065373602"},"reference-count":23,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2022,11,14]],"date-time":"2022-11-14T00:00:00Z","timestamp":1668384000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100017409","name":"Federal Highway Research Institute","doi-asserted-by":"publisher","award":["FE82.0708"],"award-info":[{"award-number":["FE82.0708"]}],"id":[{"id":"10.13039\/100017409","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Vehicles equipped with so-called partially automated driving functions are becoming more and more common nowadays. The special feature of this automation level is that the driver is relieved of the execution of the lateral and longitudinal driving task, although they must still monitor the driving environment and the automated system. The method presented in this paper should enable the assessment of the usability and safety of such systems in a standardized manner. It is designed to capture a driver\u2019s interaction with a system via the human\u2013machine interface in specific scenarios in user studies. It evaluates several observable aspects of this interaction in real time and codes inadequate behavior in the categories \u201csystem operation\u201d, \u201cdriving behavior\u201d and \u201cmonitoring behavior\u201d. A generic rating regarding the overall handling of the scenario is derived from these criteria. The method can be used with the assistance of a tablet application called the S.A.D.E. app (Standardized Application for Automated Driving Evaluation). Initial studies using driving simulators show promising results regarding its ability to detect problems related to a system or HMI, with some future challenges remaining open.<\/jats:p>","DOI":"10.3390\/info13110538","type":"journal-article","created":{"date-parts":[[2022,11,15]],"date-time":"2022-11-15T02:32:16Z","timestamp":1668479536000},"page":"538","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["S.A.D.E.\u2014A Standardized, Scenario-Based Method for the Real-Time Assessment of Driver Interaction with Partially Automated Driving Systems"],"prefix":"10.3390","volume":"13","author":[{"given":"Nadja","family":"Sch\u00f6mig","sequence":"first","affiliation":[{"name":"W\u00fcrzburg Institute for Traffic Sciences GmbH (WIVW), Robert-Bosch-Str. 4, 97209 Veitshoechheim, Germany"}]},{"given":"Katharina","family":"Wiedemann","sequence":"additional","affiliation":[{"name":"W\u00fcrzburg Institute for Traffic Sciences GmbH (WIVW), Robert-Bosch-Str. 4, 97209 Veitshoechheim, Germany"}]},{"given":"Andr\u00e9","family":"Wiggerich","sequence":"additional","affiliation":[{"name":"Federal Highway Research Institute, 51427 Bergisch-Gladbach, Germany"}]},{"given":"Alexandra","family":"Neukum","sequence":"additional","affiliation":[{"name":"W\u00fcrzburg Institute for Traffic Sciences GmbH (WIVW), Robert-Bosch-Str. 4, 97209 Veitshoechheim, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2022,11,14]]},"reference":[{"key":"ref_1","unstructured":"(2021). SAE On-Road Automated Vehicle Standards Committee. Taxonomy and definitions for terms related to on-road motor vehicle automated driving systems (Standard No. J3016_202104)."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Bainbridge, L. (1983). Ironies of automation. Analysis, Design and Evaluation of Man\u2013Machine Systems, Elsevier.","DOI":"10.1016\/B978-0-08-029348-6.50026-9"},{"key":"ref_3","unstructured":"National Transportation Safety Board (2017). Collision between a Car Operating with Automated Vehicle Control Systems and a Tractor-Semitrailer Truck near Williston, Florida, May 7, 2016, Highway Accident Report NTSB\/HAR-17\/02."},{"key":"ref_4","unstructured":"Schaller, T., Schiehlen, J., and Gradenegger, B. (2008). Stauassistenz\u2013Unterst\u00fctzung des Fahrers in der Quer- und L\u00e4ngsf\u00fchrung: Systementwicklung und Kundenakzeptanz. 3 Tagung Aktive Sicherheit durch Fahrerassistenz, Lehrstuhl f\u00fcr Fahrzeugtechnik, Technische Universit\u00e4t."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1109\/TITS.2013.2277725","article-title":"Tactical driving behavior with different levels of automation","volume":"1","author":"Kircher","year":"2014","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_6","unstructured":"Begiatto, M., Hartwich, F., Schleinitz, K., Krems, J., Othersen, I., and Petermann-Stock, I. (2015). What would drivers like to know during automated driving? Information needs at different levels of automation. 7. Tagung Fahrerassistenzsysteme, Lehrstuhl f\u00fcr Fahrzzeugtechnik, Technische Universtit\u00e4t."},{"key":"ref_7","unstructured":"Large, D.R., Banks, V.A., Burnett, G., Baverstock, S., and Skrypchuk, L. (2017, January 20\u201322). Exploring the behaviour of distracted drivers during different levels of automation in driving. Proceedings of the 5th International Conference on Driver Distraction and Inattention (DDI2017), Paris, France."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Llaneras, R.E., Salinger, J., and Green, C.A. (2013, January 17\u201320). Human Factors Issues Associated with Limited Ability Autonomous Driving Systems: Drivers\u2019 Allocation of Visual Attention to the Forward Roadway. Proceedings of the 7th International Driving Symposium on Human Factors in Driver Assessment, Training, and Vehicle Design, Bolton, NY, USA.","DOI":"10.17077\/drivingassessment.1472"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.trf.2016.01.011","article-title":"Secondary task engagement and vehicle automation\u2014Comparing the effects of different automation levels in an on-road experiment","volume":"38","author":"Naujoks","year":"2016","journal-title":"Transp. Res. Part F"},{"key":"ref_10","unstructured":"Kleen, A.T. (2014). Beherrschbarkeit von teilautomatisierten Eingriffen in die Fahrzeugf\u00fchrung. [Ph.D. Thesis, Technische Universit\u00e4t Braunschweig]."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"870","DOI":"10.1016\/j.trf.2019.03.020","article-title":"Engaging in NDRTs affects drivers\u2019 responses and glance patterns after silent automation failures","volume":"62","author":"Louw","year":"2019","journal-title":"Transp. Res. Part F Traffic Psychol. Behav."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1207\/S15327566IJCE0503_5","article-title":"Automating the driver\u2019s control tasks","volume":"5","author":"Stanton","year":"2001","journal-title":"Int. J. Cogn. Ergon."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wulf, F., Zeeb, K., Rimini-D\u00f6ring, M., Arnon, M., and Gauterin, F. (2013, January 6\u20139). Effects of human-machine interaction mechanisms on situation awareness in partly automated driving. Proceedings of the 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013), The Hague, The Netherlands.","DOI":"10.1109\/ITSC.2013.6728525"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1016\/j.mex.2018.05.007","article-title":"Expert-based controllability assessment of control transitions from automated to manual driving","volume":"5","author":"Naujoks","year":"2018","journal-title":"MethodsX"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1080\/15389588.2019.1603374","article-title":"Test procedure for evaluating the human\u2013machine interface of vehicles with automated driving systems","volume":"20","author":"Naujoks","year":"2019","journal-title":"Traffic Inj. Prev."},{"key":"ref_16","unstructured":"National Highway Traffic Safety Administration (2017). Federal Automated Vehicles Policy 2.0. Washington, DC: National Highway Traffic Safety Administration (NHTSA), Department of Transportation (DOT)."},{"key":"ref_17","unstructured":"Wiggerich, A., Hoffmann, H., Sch\u00f6mig, N., Wiedemann, K., and Segler, K. (2020, January 16\u201317). Bewertung der Sicherheit der Mensch-Maschine-Interaktion teilautomatisierter Fahrfunktionen (Level 2). Proceedings of the Beitrag auf dem 13, Uni-DAS e.V. Workshop Fahrerassistenz und automatisiertes Fahren, digital conference."},{"key":"ref_18","unstructured":"Menold, N., and Bogner, K. (2015). Gestaltung von Ratingskalen in Frageb\u00f6gen. Mannh. GESIS\u2014Leibniz-Inst. F\u00fcr Soz. (SDM Surv. Guidel.)."},{"key":"ref_19","unstructured":"Maurer, M., and Stiller, C. (2008, January 2\u20134). ACC-Stop&Go: Fahrerverhalten an funktionalen Systemgrenzen. Proceedings of the Workshop Fahrerassistenzsysteme\u2014FAS2008, Walting, Germany."},{"key":"ref_20","unstructured":"Kaussner, Y. (2013, January 25\u201326). Assessment of driver fitness: An alcohol calibration study in a high-fidelity simulation. Proceedings of the Fit to Drive 7th International Traffic Expert Congress, Berlin, Germany."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1097\/JCP.0000000000000285","article-title":"Driving performance under alcohol in simulated representative driving tasks: An alcohol calibration study for impairments related to medicinal drugs","volume":"35","author":"Kaussner","year":"2015","journal-title":"J. Clin. Psychopharmacol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/j.aap.2017.03.013","article-title":"Evaluation of methods for the assessment of attention while driving","volume":"114","author":"Kircher","year":"2018","journal-title":"Accid. Anal. Prev."},{"key":"ref_23","first-page":"14","article-title":"Eye scanning rules for drivers: How do they compare with actual observed eye scanning behaviour","volume":"1403","author":"Zwahlen","year":"1991","journal-title":"Transp. Res. Rec. J. Transp. Res. Board"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/13\/11\/538\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:18:06Z","timestamp":1760145486000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/13\/11\/538"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,14]]},"references-count":23,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2022,11]]}},"alternative-id":["info13110538"],"URL":"https:\/\/doi.org\/10.3390\/info13110538","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2022,11,14]]}}}