{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T00:14:00Z","timestamp":1783037640467,"version":"3.54.6"},"reference-count":49,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,4,10]],"date-time":"2021-04-10T00:00:00Z","timestamp":1618012800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Horizon 2020","award":["875597"],"award-info":[{"award-number":["875597"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>In automated driving, the user interface plays an essential role in guiding transitions between automated and manual driving. This literature review identified 25 studies that explicitly studied the effectiveness of user interfaces in automated driving. Our main selection criterion was how the user interface (UI) affected take-over performance in higher automation levels allowing drivers to take their eyes off the road (SAE3 and SAE4). We categorized user interface (UI) factors from an automated vehicle-related information perspective. Short take-over times are consistently associated with take-over requests (TORs) initiated by the auditory modality with high urgency levels. On the other hand, take-over requests directly displayed on non-driving-related task devices and augmented reality do not affect take-over time. Additional explanations of take-over situation, surrounding and vehicle information while driving, and take-over guiding information were found to improve situational awareness. Hence, we conclude that advanced user interfaces can enhance the safety and acceptance of automated driving. Most studies showed positive effects of advanced UI, but a number of studies showed no significant benefits, and a few studies showed negative effects of advanced UI, which may be associated with information overload. The occurrence of positive and negative results of similar UI concepts in different studies highlights the need for systematic UI testing across driving conditions and driver characteristics. Our findings propose future UI studies of automated vehicle focusing on trust calibration and enhancing situation awareness in various scenarios.<\/jats:p>","DOI":"10.3390\/info12040162","type":"journal-article","created":{"date-parts":[[2021,4,12]],"date-time":"2021-04-12T03:04:06Z","timestamp":1618196646000},"page":"162","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":44,"title":["Effects of User Interfaces on Take-Over Performance: A Review of the Empirical Evidence"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7028-6978","authenticated-orcid":false,"given":"Soyeon","family":"Kim","sequence":"first","affiliation":[{"name":"Department of Human-Centered Design, Faculty of Industrial Design Engineering, Delft University of Technology, 2628 CE Delft, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5015-0670","authenticated-orcid":false,"given":"Ren\u00e9","family":"van Egmond","sequence":"additional","affiliation":[{"name":"Department of Human-Centered Design, Faculty of Industrial Design Engineering, Delft University of Technology, 2628 CE Delft, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5878-3472","authenticated-orcid":false,"given":"Riender","family":"Happee","sequence":"additional","affiliation":[{"name":"Department of Cognitive Robotics, Faculty of Mechanical, Maritime and Materials Engineering, Delft University of Technology, 2628 CD Delft, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,4,10]]},"reference":[{"key":"ref_1","unstructured":"SAE International (2018). Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles (J3016), SAE International."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"642","DOI":"10.1177\/0018720816634226","article-title":"Taking over Control from Highly Automated Vehicles in Complex Traffic Situations","volume":"58","author":"Gold","year":"2016","journal-title":"Hum. Factors"},{"key":"ref_3","unstructured":"Jarosch, O., Gold, C., Naujoks, F., Wandtner, B., Marberger, C., Weidl, G., and Schrauf, M. (2019, January 21\u201322). The Impact of Non-Driving Related Tasks on Take-over Performance in Conditionally Automated Driving\u2014A Review of the Empirical Evidence. Proceedings of the 9th Tagung Automatisiertes Fahren, Munich, Germany."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Naujoks, F., Befelein, D., Wiedemann, K., and Neukum, A. (2018). A review of non-driving-related tasks used in studies on automated driving. Advances in Intelligent Systems and Computing, Springer.","DOI":"10.1007\/978-3-319-60441-1_52"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Merat, N., Jamson, A.H., Lai, F.C., Daly, M., and Carsten, O.M. (2014). Transition to Manual: Driver Behaviour when Resuming Control from a Highly Automated Vehicle, Elsevier Ltd.","DOI":"10.1016\/j.trf.2014.09.005"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1518\/001872095779049543","article-title":"Toward a Theory of Situation Awareness in Dynamic Systems","volume":"37","author":"Endsley","year":"1995","journal-title":"Hum. Factors"},{"key":"ref_7","unstructured":"Mok, B.K.-J., Johns, M., Lee, K.J., Ive, H.P., Miller, D., and Ju, W. (July, January 28). Timing of unstructured transitions of control in automated driving. Proceedings of the IEEE Intelligent Vehicles Symposium, Seoul, Korea."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1016\/j.trf.2019.04.020","article-title":"Determinants of take-over time from automated driving: A meta-analysis of 129 studies","volume":"64","author":"Zhang","year":"2019","journal-title":"Transp. Res. Part F Traffic Psychol. Behav."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Weaver, B.W., and DeLucia, P.R. (2020). A Systematic Review and Meta-Analysis of Takeover Performance During Conditionally Automated Driving. Hum. Factors.","DOI":"10.1177\/0018720820976476"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"642","DOI":"10.1177\/0018720819829572","article-title":"Toward Computational Simulations of Behavior During Automated Driving Takeovers: A Review of the Empirical and Modeling Literatures","volume":"61","author":"McDonald","year":"2019","journal-title":"Hum. Factors"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1177\/0018720816685832","article-title":"Takeover Time in Highly Automated Vehicles: Noncritical Transitions to and From Manual Control","volume":"59","author":"Eriksson","year":"2017","journal-title":"Hum. Factors"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Mirnig, A.G., G\u00e4rtner, M., Laminger, A., Meschtscherjakov, A., Tr\u00f6sterer, S., Tscheligi, M., McCall, R., and McGee, F. (2017, January 24\u201327). Control transition interfaces in semiautonomous vehicles: A categorization framework and literature analysis. Proceedings of the AutomotiveUI 2017\u20149th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, Oldenburg, Germany.","DOI":"10.1145\/3122986.3123014"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kerschbaum, P., Lorenz, L., and Bengler, K. (2014, January 27\u201331). Highly Automated Driving With a Decoupled Steering Wheel; Highly Automated Driving With a Decoupled Steering Wheel. Proceedings of the Human Factors and Ergonomics Society 58th Annual Meeting, Chicago, IL, USA.","DOI":"10.1177\/1541931214581352"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Gold, C., Damb\u00f6ck, D., Lorenz, L., and Bengler, K. (October, January 30). Take over! How long does it take to get the driver back into the loop?. Proceedings of the Human Factors and Ergonomics Society 57th Annual Meeting, San Diego, CA, USA.","DOI":"10.1177\/1541931213571433"},{"key":"ref_15","first-page":"137","article-title":"Human-Computer Interaction: Overview on State of the Art","volume":"1","author":"Karray","year":"2008","journal-title":"Int. J. Smart Sens. Intell."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Borojeni, S.S., Chuang, L., Heuten, W., and Boll, S. (2016, January 24\u201326). Assisting drivers with ambient take-over requests in highly automated driving. Proceedings of the AutomotiveUI 2016\u20148th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Ann Arbor, MI, USA.","DOI":"10.1145\/3003715.3005409"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Cohen-Lazry, G., Borowsky, A., and Oron-Gilad, T. (2017, January 9\u201313). The Effects of Continuous Driving-Related Feedback on Drivers\u2019 Response to Automation Failures. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Austin, TX, USA.","DOI":"10.1177\/1541931213601974"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.trf.2019.07.025","article-title":"Directional tactile alerts for take-over requests in highly-automated driving","volume":"65","author":"Katzman","year":"2019","journal-title":"Transp. Res. Part F Traffic Psychol. Behav."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1109\/THMS.2018.2883862","article-title":"Rolling Out the Red (and Green) Carpet: Supporting Driver Decision Making in Automation-to-Manual Transitions","volume":"49","author":"Eriksson","year":"2019","journal-title":"IEEE Trans. Hum. Mach. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/j.aap.2017.09.019","article-title":"Driver compliance to take-over requests with different auditory outputs in conditional automation","volume":"109","author":"Forster","year":"2017","journal-title":"Accid. Anal. Prev."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Helldin, T., Falkman, G., Riveiro, M., and Davidsson, S. (2013, January 28\u201330). Presenting system uncertainty in automotive UIs for supporting trust calibration in autonomous driving. Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2013, Eindhoven, The Netherlands.","DOI":"10.1145\/2516540.2516554"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"K\u00f6hn, T., Gottlieb, M., Schermann, M., and Krcmar, H. (2019, January 16\u201320). Improving take-over quality in automated driving by interrupting non-driving tasks. Proceedings of the 24th International Conference on Intelligent User Interfaces, Los Angles, CA, USA.","DOI":"10.1145\/3301275.3302323"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1080\/00140139.2018.1547842","article-title":"Automation transparency: Implications of uncer-tainty communication for human-automation interaction and interfaces","volume":"62","author":"Kunze","year":"2019","journal-title":"Ergonomics"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Langlois, S., and Soualmi, B. (2016, January 1\u20134). Augmented reality versus classical HUD to take over from automated driving: An aid to smooth reactions and to anticipate maneuvers. Proceedings of the IEEE Conference on Intelligent Transportation Systems (ITSC), Rio de Janeiro, Brazil.","DOI":"10.1109\/ITSC.2016.7795767"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Lindemann, P., Muller, N., and Rigolll, G. (2019, January 9\u201312). Exploring the use of augmented reality interfaces for driver assistance in short-notice takeovers. Proceedings of the 2019 IEEE Intelligent Vehicles Symposium (IV), Paris, France.","DOI":"10.1109\/IVS.2019.8814237"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Lorenz, L., Kerschbaum, P., and Schumann, J. (2014, January 27\u201331). Designing take over scenarios for automated driving: How does augmented reality support the driver to get back into the loop?. Proceedings of the Human Factors and Ergonomics Society 58th Annual Meeting, Chicago, IL, USA.","DOI":"10.1177\/1541931214581351"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2867","DOI":"10.1016\/j.promfg.2015.07.788","article-title":"Take-Over Requests for Automated Driv-ing","volume":"3","author":"Melcher","year":"2015","journal-title":"Procedia Manuf."},{"key":"ref_28","unstructured":"Naujoks, F., Mai, C., and Neukum, A. (2014, January 19\u201323). The Effect of Urgency of Take-Over Requests During Highly Automated Driving Under Distraction Conditions. Proceedings of the 5th International Conference on Applied Human Factors and Ergonomics AHFE, Krakow, Poland."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1016\/j.aap.2016.12.001","article-title":"Comparing spatially static and dynamic vibrotactile take-over re-quests in the driver seat","volume":"99","author":"Petermeijer","year":"2017","journal-title":"Accid. Anal. Prev."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Petermeijer, S., Doubek, F., and De Winter, J. (2017, January 5\u20138). Driver response times to auditory, visual, and tactile take-over requests: A simulator study with 101 participants. Proceedings of the 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Banff, AB, Canada.","DOI":"10.1109\/SMC.2017.8122827"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Politis, I., Brewster, S.A., and Pollick, F.E. (2015, January 1\u20133). Language-based multimodal displays for the handover of control in autonomous cars. Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Nottingham, UK.","DOI":"10.1145\/2799250.2799262"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Razin, P., Matysiak, A., Kruszewski, M., and Niezgoda, M. (2018, January 12\u201313). The impact of the interfaces of the driving automation system on a driver with regard to road traffic safety. Proceedings of the 12th International Road Safety Conference GAMBIT 2018, Gdansk, Poland.","DOI":"10.1051\/matecconf\/201823104011"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Roche, F., and Brandenburg, S. (2018, January 4\u20137). Should the urgency of auditory-tactile takeover requests match the criticality of takeover situations?. Proceedings of the IEEE Conference on Intelligent Transportation Systems (ITSC), Maui, HI, USA.","DOI":"10.1109\/ITSC.2018.8569650"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"839","DOI":"10.1177\/0018720818814963","article-title":"Behavioral Changes to Repeated Takeovers in Highly Automated Driving: Effects of the Takeover-Request Design and the Nondriving-Related Task Modality","volume":"61","author":"Roche","year":"2019","journal-title":"Hum. Factors"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Telpaz, A., Rhindress, B., Zelman, I., and Tsimhoni, O. (2015, January 1\u20133). Haptic Seat for Automated Driving: Preparing the Driver to Take Control Effectively. Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications; Automotive UI 2015, Nottingham, UK.","DOI":"10.1145\/2799250.2799267"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/j.trf.2016.09.009","article-title":"Supporting the changing driver\u2019s task: Exploration of interface designs for supervision and intervention in automated driving","volume":"43","author":"Beukel","year":"2016","journal-title":"Transp. Res. Part F Traffic Psychol. Behav."},{"key":"ref_37","unstructured":"White, H., Large, D.R., Salanitri, D., Burnett, G., Lawson, A., and Box, E. (May, January 29). Rebuilding Drivers\u2019 Situation Awareness During Take-Over Requests in Level 3 Automated Cars. Proceedings of the Contemporary Ergonomics & Human Factors, Stratford-upon-Avon, UK."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Wintersberger, P., Riener, A., Schartm\u00fcller, C., Frison, A., and Weigl, K. (2018, January 23\u201325). Let me finish before I take over: Towards attention aware device integration in highly automated vehicles. Proceedings of the 10th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2018, Toronto, ON, Canada.","DOI":"10.1145\/3239060.3239085"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Yang, Y., Karakaya, B., Dominioni, G.C., Kawabe, K., and Bengler, K. (2018, January 4\u20137). An HMI Concept to Improve Driver\u2019s Visual Behavior and Situation Awareness in Automated Vehicle. Proceedings of the IEEE Conference on Intelligent Transportation Systems, Proceedings (ITSC), Maui, HI, USA.","DOI":"10.1109\/ITSC.2018.8569986"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1016\/j.aap.2018.11.018","article-title":"The effects of takeover request modalities on highly automated car control transitions","volume":"123","author":"Yoon","year":"2019","journal-title":"Accid. Anal. Prev."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Seppelt, B.D., and Victor, T.W. (2016). Potential Solutions to Human Factors Challenges in Road Vehicle Automation. Road Vehicle Automation 3, Springer International Publishing.","DOI":"10.1007\/978-3-319-40503-2_11"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1518\/001872006779166334","article-title":"Supporting trust calibration and the effective use of decision aids by presenting dynamic system confidence information","volume":"48","author":"McGuirl","year":"2006","journal-title":"Hum. Factors J. Hum. Factors Ergon. Soc."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1109\/THMS.2017.2776209","article-title":"Creating Appropriate Trust for Autonomous Vehicles. A Framework For HMI Design","volume":"48","author":"Ekman","year":"2015","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_44","unstructured":"Heydra, C.G., Jansen, R.J., and Van Egmond, R. (2014, January 3). Auditory Signal Design for Automatic Number Plate Recognition System. Proceedings of the Chi Sparks 2014 Conference, The Hague, The Netherlands."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Pauzie, A. (2015). Head up Display in Automotive: A New Reality for the Driver, Springer.","DOI":"10.1007\/978-3-319-20889-3_47"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Miller, D., Johns, M., Mok, B., Gowda, N., Sirkin, D., Lee, K., and Ju, W. (2016, January 19\u201323). Behavioral Measurement of Trust in Automation. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Prague, Czech Republic.","DOI":"10.1177\/1541931213601422"},{"key":"ref_47","first-page":"585","article-title":"The \u2018problem\u2019 with automation: Inappropriate feedback and interaction, not \u2018over-automation\u2019","volume":"327","author":"Norman","year":"1990","journal-title":"Philos. Trans. R. Soc. Lond. Ser. B Biol. Sci."},{"key":"ref_48","unstructured":"Yang, Y., G\u00f6tze, M., Laqua, A., Dominioni, G.C., Kawabe, K., and Bengler, K. (2017, January 28\u201330). A method to improve driver\u2019s situation awareness in automated driving. Proceedings of the 2017 Annual Meeting of the Human Factors and Ergonomics Society Europe Chapter, Rome, Italy."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"620","DOI":"10.1016\/j.trf.2018.11.015","article-title":"Non-driving-related tasks, workload, and takeover performance in highly automated driving contexts. Transp","volume":"60","author":"Yoon","year":"2019","journal-title":"Res. Part F Traffic Psychol. Behav."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/12\/4\/162\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:59:23Z","timestamp":1760363963000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/12\/4\/162"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,10]]},"references-count":49,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,4]]}},"alternative-id":["info12040162"],"URL":"https:\/\/doi.org\/10.3390\/info12040162","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,10]]}}}