{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,18]],"date-time":"2025-11-18T05:25:09Z","timestamp":1763443509061,"version":"3.45.0"},"reference-count":29,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2025,11,16]],"date-time":"2025-11-16T00:00:00Z","timestamp":1763251200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>In-vehicle voice assistants face usability challenges due to limitations in delivering feedback within the constraints of the driving environment. The presented study explores the potential of Rich Visual Feedback (RVF) on Head-Up Displays (HUDs) as a multimodal solution to enhance system usability. A user study with 32 participants evaluated three HUD User Interface (UI) designs: the AR Fusion UI, which integrates augmented reality elements for layered, dynamic information presentation; the Baseline UI, which displays only essential keywords; and the Flat Fusion UI, which uses conventional vertical scrolling. To explore HUD interface principles and inform future HUD design without relying on specific hardware, a simulated near-field overlay was used. Usability was measured using the System Usability Scale (SUS), and distraction was assessed with a penalty point method. Results show that RVF on the HUD significantly influences usability, with both content quantity and presentation style affecting outcomes. The minimal Baseline UI achieved the highest overall usability. However, among the two Fusion designs, the AR-based layered information mechanism outperformed the flat scrolling method. Distraction effects were not statistically significant, indicating the need for further research. These findings suggest RVF-enabled HUDs can enhance in-vehicle voice assistant usability, potentially contributing to safer, more efficient driving.<\/jats:p>","DOI":"10.3390\/mti9110114","type":"journal-article","created":{"date-parts":[[2025,11,17]],"date-time":"2025-11-17T10:24:58Z","timestamp":1763375098000},"page":"114","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Evaluating Rich Visual Feedback on Head-Up Displays for In-Vehicle Voice Assistants: A User Study"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-7724-1212","authenticated-orcid":false,"given":"Mahmoud","family":"Baghdadi","sequence":"first","affiliation":[{"name":"Human Computer Interaction Lab, Department of Computer Science, RPTU University Kaiserslautern-Landau, 67663 Kaiserslautern, Germany"},{"name":"Department of Computer Information Technology, Faculty of The Applied College, King Abdulaziz University, Jeddah 21589, Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-4973-386X","authenticated-orcid":false,"given":"Dilara","family":"Samad-Zada","sequence":"additional","affiliation":[{"name":"Human Computer Interaction Lab, Department of Computer Science, RPTU University Kaiserslautern-Landau, 67663 Kaiserslautern, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7938-6732","authenticated-orcid":false,"given":"Achim","family":"Ebert","sequence":"additional","affiliation":[{"name":"Human Computer Interaction Lab, Department of Computer Science, RPTU University Kaiserslautern-Landau, 67663 Kaiserslautern, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,11,16]]},"reference":[{"key":"ref_1","unstructured":"International Organization for Standardization (2024, April 04). Ergonomics of Human-System Interaction\u2014Part 110: Interaction Principles. Available online: https:\/\/www.iso.org\/standard\/77520.html."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Nielsen, J. (1994, January 24\u201328). Enhancing the explanatory power of usability heuristics. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Boston, MA, USA. CHI \u201994.","DOI":"10.1145\/259963.260333"},{"key":"ref_3","unstructured":"Shneiderman, B., Plaisant, C., Cohen, M., Jacobs, S.M., and Elmqvist, N. (2017). Designing the User Interface: Strategies for Effective Human-Computer Interaction, Pearson. [6th ed.]."},{"key":"ref_4","first-page":"170","article-title":"Factors Affecting User Perception of a Spoken Language vs. Textual Search Interface: A Content Analysis","volume":"28","author":"Begany","year":"2016","journal-title":"Interact. Comput."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"103380","DOI":"10.1016\/j.ergon.2022.103380","article-title":"Evaluation of driver distraction from in-vehicle information systems: A simulator study of interaction modes and secondary tasks classes on eight production cars","volume":"92","author":"Ma","year":"2022","journal-title":"Int. J. Ind. Ergon."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Jung, J., Lee, S., Hong, J., Youn, E., and Lee, G. (2020, January 25\u201330). Voice+Tactile: Augmenting In-vehicle Voice User Interface with Tactile Touchpad Interaction. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA. CHI \u201920.","DOI":"10.1145\/3313831.3376863"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1007\/s12193-019-00301-2","article-title":"Visualizing natural language interaction for conversational in-vehicle information systems to minimize driver distraction","volume":"13","author":"Braun","year":"2019","journal-title":"J. Multimodal User Interfaces"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hofmann, H., Tobisch, V., Ehrlich, U., Berton, A., and Mahr, A. (2014, January 24\u201327). Comparison of speech-based in-car HMI concepts in a driving simulation study. Proceedings of the 19th International Conference on Intelligent User Interfaces, Haifa, Israel. IUI \u201914.","DOI":"10.1145\/2557500.2557509"},{"key":"ref_9","first-page":"700","article-title":"User interface for in-vehicle systems with on-wheel finger spreading gestures and head-up displays","volume":"7","author":"Lee","year":"2020","journal-title":"J. Comput. Des. Eng."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wen, S., Ping, S., Wang, J., Liang, H.N., Xu, X., and Yan, Y. (2024, January 11\u201316). AdaptiveVoice: Cognitively Adaptive Voice Interface for Driving Assistance. Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA. CHI \u201924.","DOI":"10.1145\/3613904.3642876"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zhang, X., Chen, Z., Zhu, X., and Gu, Z. (2022). Dora: An AR-HUD interactive system that combines gesture recognition and eye-tracking. Human Factors in Virtual Environments and Game Design, AHFE Open Acces.","DOI":"10.54941\/ahfe1002086"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1016\/j.trf.2024.06.001","article-title":"In-vehicle human-machine interface guidelines for augmented reality head-up displays: A review, guideline formulation, and future research directions","volume":"104","author":"Yamin","year":"2024","journal-title":"Transp. Res. Part F Traffic Psychol. Behav."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Baghdadi, M., and Ebert, A. (2024, January 8\u201311). Approaching Intelligent In-vehicle Infotainment Systems through Fusion Visual-Speech Multimodal Interaction: A State-of-the-Art Review. Proceedings of the European Conference on Cognitive Ergonomics 2024, Paris, France. ECCE \u201924.","DOI":"10.1145\/3673805.3673818"},{"key":"ref_14","unstructured":"Kr\u00f6mker, H. (2025). Human-Centric Design for Next-Generation Infotainment Systems. HCI in Mobility, Transport, and Automotive Systems, Springer Nature."},{"key":"ref_15","first-page":"4","article-title":"SUS-A quick and dirty usability scale","volume":"189","author":"Brooke","year":"1996","journal-title":"Usability Eval. Ind."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Abbott, K. (2002). VUI Design Principles and Techniques. Voice Enabling Web Applications: VoiceXML and Beyond, Apress.","DOI":"10.1007\/978-1-4302-0850-1"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Yankelovich, N., Levow, G.A., and Marx, M. (1995, January 7\u201311). Designing SpeechActs: Issues in speech user interfaces. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems\u2014CHI \u201995, Denver, CO, USA.","DOI":"10.1145\/223904.223952"},{"key":"ref_18","unstructured":"Aylett, M.P., Kristensson, P.O., Whittaker, S., and Vazquez-Alvarez, Y. (May, January 26). None of a CHInd: Relationship counselling for HCI and speech technology. Proceedings of the CHI \u201914 Extended Abstracts on Human Factors in Computing Systems, Toronto, ON, Canada. CHI EA \u201914."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Arons, B. (1991, January 15\u201318). Hyperspeech: Navigating in speech-only hypermedia. Proceedings of the Third Annual ACM Conference on Hypertext\u2014HYPERTEXT \u201991, San Antonio, TX, USA.","DOI":"10.1145\/122974.122989"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Schneeberger, T., von Massow, S., Moniri, M.M., Castronovo, A., M\u00fcller, C., and Macek, J. (2015, January 1\u20133). Tailoring mobile apps for safe on-road usage: How an interaction concept enables safe interaction with hotel booking, news, Wolfram Alpha and Facebook. Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Nottingham, UK. AutomotiveUI \u201915.","DOI":"10.1145\/2799250.2799264"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1016\/j.apergo.2014.08.008","article-title":"A user study of auditory, head-up and multi-modal displays in vehicles","volume":"46","author":"Jakus","year":"2015","journal-title":"Appl. Ergon."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Li, G., Zhu, F., Zhang, T., Wang, Y., He, S., and Qu, X. (2018, January 4\u20137). Evaluation of Three In-Vehicle Interactions from Drivers\u2019 Driving Performance and Eye Movement behavior. Proceedings of the 2018 21st International Conference on Intelligent Transportation Systems (ITSC), Maui, HI, USA.","DOI":"10.1109\/ITSC.2018.8569917"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zou, Z., Khan, A., Lwin, M., Alnajjar, F., and Mubin, O. (2025). Investigating the impacts of auditory and visual feedback in advanced driver assistance systems: A pilot study on driver behavior and emotional response. Front. Comput. Sci., 6.","DOI":"10.3389\/fcomp.2024.1499165"},{"key":"ref_24","unstructured":"Epic Games (2024, April 04). Unreal Engine 5. Version 5.x. Available online: https:\/\/www.unrealengine.com\/unreal-engine-5."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Braun, M., Li, J., Weber, F., Pfleging, B., Butz, A., and Alt, F. (2020, January 5\u20138). What If Your Car Would Care? Exploring Use Cases For Affective Automotive User Interfaces. Proceedings of the 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services, Oldenburg, Germany. MobileHCI \u201920.","DOI":"10.1145\/3379503.3403530"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1016\/j.ijhcs.2007.11.001","article-title":"A user study of auditory versus visual interfaces for use while driving","volume":"66","author":"Sodnik","year":"2008","journal-title":"Int. J.-Hum.-Comput. Stud."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sauro, J., and Lewis, J.R. (2016). Quantifying the User Experience: Practical Statistics for User Research, Morgan Kaufmann.","DOI":"10.1016\/B978-0-12-802308-2.00002-3"},{"key":"ref_28","unstructured":"Sauro, J. (2018). 5 Ways to Interpret a SUS Score, MeasuringU."},{"key":"ref_29","unstructured":"(2016). Road Vehicles\u2014Transport Information and Control Systems\u2014Detection-Response Task (DRT) for Assessing Attentional Effects of Cognitive Load in Driving (Standard No. ISO Standard No. 17488:2016)."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/9\/11\/114\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,18]],"date-time":"2025-11-18T05:22:19Z","timestamp":1763443339000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/9\/11\/114"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,16]]},"references-count":29,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2025,11]]}},"alternative-id":["mti9110114"],"URL":"https:\/\/doi.org\/10.3390\/mti9110114","relation":{},"ISSN":["2414-4088"],"issn-type":[{"type":"electronic","value":"2414-4088"}],"subject":[],"published":{"date-parts":[[2025,11,16]]}}}