{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T13:27:24Z","timestamp":1773840444245,"version":"3.50.1"},"reference-count":38,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,1,14]],"date-time":"2025-01-14T00:00:00Z","timestamp":1736812800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:p>In the autonomous vehicle industry, Advanced Driver Assistance Systems (ADAS) are recognized for their capacity to enhance service quality, improve on-road safety, and increase driver comfort. Driver Assistance Systems are able to provide multi-modal feedback including auditory cues, visual cues, vibrotactile cues and so on. The study will concentrate on assessing the impacts of auditory and visual feedback from assistive driving systems on drivers. A group consisting of five participants (<jats:italic>N<\/jats:italic>\u202f=\u202f5) was recruited to take part in two sets of driving experiments. During the experimental sessions, they were exposed to several reminders designed for drivers in audio-only format and audio-visual format, respectively. Their driving behaviors and performances were under researcher\u2019s observation, while their emotions were evaluated by YOLO v5 detecting model. The results reveal that the participants higher compliance rate and strong emotional reactions (especially the feelings of anger, sadness and surprise) towards the unimodal feedback of audio-only driving reminders. There is no strong evidence showing that the bimodal ADAS feedback of audio-visual cues effectively improve drivers\u2019 performance during driving period. However, both the emotion data and user satisfaction results indicate that participants experienced an increase in feelings of happiness when they were able to visualize the AI assistant while hearing the audio reminders from the assistant. The study serves as one of the pioneering studies aimed at enhancing the theoretical foundation in the field of automotive user interface design, particularly concerning the design of auditory functions.<\/jats:p>","DOI":"10.3389\/fcomp.2024.1499165","type":"journal-article","created":{"date-parts":[[2025,1,14]],"date-time":"2025-01-14T06:14:15Z","timestamp":1736835255000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Investigating the impacts of auditory and visual feedback in advanced driver assistance systems: a pilot study on driver behavior and emotional response"],"prefix":"10.3389","volume":"6","author":[{"given":"Zhao","family":"Zou","sequence":"first","affiliation":[]},{"given":"Aila","family":"Khan","sequence":"additional","affiliation":[]},{"given":"Michael","family":"Lwin","sequence":"additional","affiliation":[]},{"given":"Fady","family":"Alnajjar","sequence":"additional","affiliation":[]},{"given":"Omar","family":"Mubin","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2025,1,14]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","first-page":"445","DOI":"10.1016\/j.trf.2008.04.003","article-title":"Auditory and haptic systems for in-car speed management\u2013a comparative real life study","volume":"11","author":"Adell","year":"2008","journal-title":"Transport. Res. F: Traffic Psychol. Behav."},{"key":"ref2","doi-asserted-by":"publisher","first-page":"8820","DOI":"10.3390\/s22228820","article-title":"Development of YOLOv5-based real-time smart monitoring system for increasing lab safety awareness in educational institutions","volume":"22","author":"Ali","year":"2022","journal-title":"Sensors"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"474","DOI":"10.3390\/wevj15100474","article-title":"Driving under cognitive control: the impact of executive functions in driving","volume":"15","author":"Bamicha","year":"2024","journal-title":"World Electric Vehicle J."},{"key":"ref4","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1080\/1463922X.2017.1305465","article-title":"Analysis of driver roles: modelling the changing role of the driver in automated driving systems using EAST","volume":"20","author":"Banks","year":"2019","journal-title":"Theor. Issues Ergon. Sci."},{"key":"ref5","first-page":"14","article-title":"Review of crash effectiveness of intelligent transport systems","volume":"3","author":"Bayly","year":"2007","journal-title":"Emergency"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1177\/0361198118773569","article-title":"The challenge of advanced driver assistance systems assessment: a scale for the assessment of the human\u2013machine interface of advanced driver assistance technology","volume":"2672","author":"Biondi","year":"2018","journal-title":"Transp. Res. Rec."},{"key":"ref7","doi-asserted-by":"publisher","first-page":"788","DOI":"10.1016\/j.aap.2009.04.013","article-title":"Simulator sickness during driving simulation studies","volume":"42","author":"Brooks","year":"2010","journal-title":"Accid. Anal. Prev."},{"key":"ref8","first-page":"1015","article-title":"Driver distraction and advanced vehicle assistive systems (ADAS): investigating effects on driver behavior","author":"Cades","year":"2017"},{"key":"ref9","doi-asserted-by":"publisher","first-page":"315","DOI":"10.1016\/j.chb.2018.08.048","article-title":"Should AI-based, conversational digital assistants employ social-or task-oriented interaction style? A task-competency and reciprocity perspective for older adults","volume":"90","author":"Chattaraman","year":"2019","journal-title":"Comput. Hum. Behav."},{"key":"ref10","first-page":"1","article-title":"ESoP - European statement of principles on human-machine interface","volume":"1","year":"2008","journal-title":"Off. J. Eur. Union"},{"key":"ref11","first-page":"28","article-title":"Advantages and disadvantages of driving simulators: a discussion","volume":"2012","author":"De Winter","year":"2012","journal-title":"Proceed. Measuring Behav."},{"key":"ref12","doi-asserted-by":"publisher","first-page":"734","DOI":"10.1177\/0018720817690639","article-title":"Effects of cognitive load on driving performance: the cognitive control hypothesis","volume":"59","author":"Engstr\u00f6m","year":"2017","journal-title":"Hum. Factors"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"180","DOI":"10.1016\/j.jbusres.2020.08.058","article-title":"Understanding consumers\u2019 acceptance of automated technologies in service encounters: drivers of digital voice assistants adoption","volume":"122","author":"Fernandes","year":"2021","journal-title":"J. Bus. Res."},{"key":"ref14","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1016\/S0001-4575(01)00056-2","article-title":"Driving simulator validation for speed research","volume":"34","author":"Godley","year":"2002","journal-title":"Accid. Anal. Prev."},{"key":"ref15","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1016\/j.trc.2013.02.008","article-title":"Behavioural changes in drivers experiencing highly-automated vehicle control in varying traffic conditions","volume":"30","author":"Jamson","year":"2013","journal-title":"Transport. Res. Part C"},{"key":"ref16","article-title":"Yolov5. Code Repository","author":"Jocher","year":"2024"},{"key":"ref17","doi-asserted-by":"publisher","first-page":"394","DOI":"10.1177\/0013164409355692","article-title":"Initial scale development: sample size for pilot studies","volume":"70","author":"Johanson","year":"2010","journal-title":"Educ. Psychol. Meas."},{"key":"ref18","first-page":"231","article-title":"Advanced driver assistance system (ADAS): a review of systems and technologies","volume":"8","author":"Jumaa","year":"2019","journal-title":"IJARCET"},{"key":"ref19","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/j.bushor.2018.08.004","article-title":"Siri, Siri, in my hand: Who\u2019s the fairest in the land? On the interpretations, illustrations, and implications of artificial intelligence","volume":"62","author":"Kaplan","year":"2019","journal-title":"Bus. Horiz."},{"key":"ref20","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1016\/j.bushor.2019.09.003","article-title":"Rulers of the world, unite! The challenges and opportunities of artificial intelligence","volume":"63","author":"Kaplan","year":"2020","journal-title":"Bus. Horiz."},{"key":"ref21","doi-asserted-by":"publisher","first-page":"658","DOI":"10.1080\/1463922X.2020.1729443","article-title":"A supportive situation awareness model for human-autonomy teaming in collaborative driving","volume":"21","author":"Kridalukmana","year":"2020","journal-title":"Theor. Issues Ergon. Sci."},{"key":"ref22","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1198\/000313001317098149","article-title":"Some practical guidelines for effective sample size determination","volume":"55","author":"Lenth","year":"2001","journal-title":"Am. Stat."},{"key":"ref23","first-page":"3995","article-title":"ADAS applications for improving traffic safety","volume-title":"In 2004 IEEE international conference on systems, man and cybernetics IEEE cat","author":"Lu","year":"2004"},{"key":"ref24","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1016\/j.chb.2019.05.009","article-title":"Hey Alexa\u2026 examine the variables influencing the use of artificial intelligent in-home voice assistants","volume":"99","author":"McLean","year":"2019","journal-title":"Comput. Hum. Behav."},{"key":"ref25","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1201\/9781003048381-21","article-title":"ADAS technology: a review on challenges, legal risk mitigation and solutions","volume":"15","author":"Mishra","year":"2021","journal-title":"ADAS"},{"key":"ref26","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/TAFFC.2017.2740923","article-title":"Affectnet: a database for facial expression, valence, and arousal computing in the wild","volume":"10","author":"Mollahosseini","year":"2017","journal-title":"Transact. Affective Comput. IEEE."},{"key":"ref27","first-page":"804","article-title":"The effect of haptic guidance on curve negotiation behavior of young, experienced drivers","author":"Mulder","year":"2008"},{"key":"ref28","doi-asserted-by":"publisher","first-page":"464","DOI":"10.3390\/s22020464","article-title":"Comparing YOLOv3, YOLOv4 and YOLOv5 for autonomous landing spot detection in faulty UAVs","volume":"22","author":"Nepal","year":"2022","journal-title":"Sensors"},{"key":"ref29","volume-title":"Social responses to virtual humans: The effect of human-like characteristics","author":"Park","year":"2009"},{"key":"ref30","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1037\/1076-898X.6.1.31","article-title":"Effects of verbal and spatial-imagery tasks on eye fixations while driving","volume":"6","author":"Recarte","year":"2000","journal-title":"J. Exp. Psychol. Appl."},{"key":"ref31","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1016\/j.apergo.2019.05.005","article-title":"Comparing drivers\u2019 visual attention at junctions in real and simulated environments","volume":"80","author":"Robbins","year":"2019","journal-title":"Appl. Ergon."},{"key":"ref32","doi-asserted-by":"publisher","first-page":"264","DOI":"10.1518\/001872008X250674","article-title":"A comparison of tactile, visual, and auditory warnings for rear-end collision prevention in simulated driving","volume":"50","author":"Scott","year":"2008","journal-title":"Hum. Factors"},{"key":"ref33","doi-asserted-by":"publisher","first-page":"3429","DOI":"10.1109\/TVT.2022.3152980","article-title":"Perception of driving simulations: can the level of detail of virtual scenarios affect the Driver's behavior and emotions?","volume":"71","author":"Shi","year":"2022","journal-title":"Trans. Vehicul. Technol. IEEE."},{"key":"ref34","first-page":"3871","article-title":"Explore user behaviour in semi-autonomous driving","author":"Shi","year":"2019"},{"key":"ref35","year":"2023"},{"key":"ref36","doi-asserted-by":"publisher","first-page":"449","DOI":"10.1518\/001872008X288394","article-title":"Multiple resources and mental workload","volume":"50","author":"Wickens","year":"2008","journal-title":"Hum. Factors"},{"key":"ref37","doi-asserted-by":"publisher","first-page":"965","DOI":"10.1080\/00140130410001686294","article-title":"Auditory alerts for in-vehicle information systems: the effects of temporal conflict and sound parameters on driver attitudes and performance","volume":"47","author":"Wiese","year":"2004","journal-title":"Ergonomics"},{"key":"ref38","doi-asserted-by":"publisher","first-page":"2781","DOI":"10.1038\/s41598-024-53255-1","article-title":"A pilot study of measuring emotional response and perception of LLM-generated questionnaire and human-generated questionnaires","volume":"14","author":"Zou","year":"2024","journal-title":"Sci. Rep."}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2024.1499165\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,14]],"date-time":"2025-01-14T06:14:19Z","timestamp":1736835259000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2024.1499165\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,14]]},"references-count":38,"alternative-id":["10.3389\/fcomp.2024.1499165"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2024.1499165","relation":{},"ISSN":["2624-9898"],"issn-type":[{"value":"2624-9898","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,14]]},"article-number":"1499165"}}