{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T09:08:50Z","timestamp":1774343330543,"version":"3.50.1"},"reference-count":17,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2026,3,21]],"date-time":"2026-03-21T00:00:00Z","timestamp":1774051200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MTI"],"abstract":"<jats:p>Negative driving emotions constitute a significant factor compromising road safety. Current intelligent vehicle human machine interaction (HMI) systems predominantly focus on functional implementation, lacking the capability to perceive and adapt to the driver\u2019s psychological state. To address this issue, this study investigates the intrinsic relationship between driving emotions and HMI through multimodal experiments. Experiment One reveals the distribution patterns of drivers\u2019 visual attentional scope under different emotional states. Experiment Two establishes a color preference model for HMI interfaces corresponding to specific emotions. Experiment Three quantitatively analyzes the impact of emotional variations on the perceptual efficiency of auditory warnings. Based on the experimental data, an interaction design principle matching \u201cEmotion-Scene-Modality\u201d is formulated, guiding the design of a data-driven, emotion-adaptive HMI prototype system. This system can perceive the driver\u2019s emotional state in real time via multimodal sensors and dynamically adjust interface color themes, information layout, warning sound effects, and voice interaction style according to predefined interaction strategies. Usability testing demonstrates that, compared to traditional static HMI, this affective adaptive system effectively mitigates the driver\u2019s negative emotional load and provides alerts that are more perceptible and less likely to cause irritation during critical moments. Consequently, it offers a significant theoretical foundation and practical reference for constructing a safer and more comfortable next-generation intelligent vehicle cockpit interaction paradigm.<\/jats:p>","DOI":"10.3390\/mti10030033","type":"journal-article","created":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T11:59:36Z","timestamp":1774267176000},"page":"33","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["HMI Design of Intelligent Vehicles Based on Multimodal Experiments of Driver Emotions"],"prefix":"10.3390","volume":"10","author":[{"given":"Tongyue","family":"Sun","sequence":"first","affiliation":[{"name":"Department of Industrial Design, School of Mechano-Electronic Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-4548-6347","authenticated-orcid":false,"given":"Yongjia","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Industrial Design, School of Mechano-Electronic Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0006-6304","authenticated-orcid":false,"given":"Xihui","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Industrial Design, School of Mechano-Electronic Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,3,21]]},"reference":[{"key":"ref_1","unstructured":"(2026, January 12). Consumer Daily. \u201cHuman-Vehicle-Home\u201d Interconnected Ecosystem Collaboration Redefines Life Radius [EB\/OL]. (1 April 2025). Available online: https:\/\/dzb.xfrb.com.cn\/Html\/2025-04-01\/66957.html."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1391","DOI":"10.1080\/00140139.2024.2324007","article-title":"Influence of emotions on the aggressive driving behavior of online car-hailing drivers based on association rule mining","volume":"67","author":"Ma","year":"2024","journal-title":"Ergonomics"},{"key":"ref_3","unstructured":"Weber, M. (2018). Automotive Emotions: A Human-Centred Approach Towards the Measurement and Understanding of Drivers\u2019 Emotions and Their Triggers. [Ph.D. Thesis, Brunel University]."},{"key":"ref_4","first-page":"139","article-title":"Riding the emotional roller-coaster: Using the circumplex model of affect to model motorcycle riders\u2019 emotional state-changes at intersections","volume":"66","author":"Samuel","year":"2019","journal-title":"Transp. Res."},{"key":"ref_5","first-page":"3","article-title":"Research on Facial Expression Recognition Based on Convolutional Neural Network","volume":"3","author":"Fang","year":"2019","journal-title":"Mod. Inf. Technol."},{"key":"ref_6","unstructured":"Xue, Z. (2022). Forward-Looking Interaction: From Voice and Gesture Design to Multimodal Fusion, Electronic Industry Press."},{"key":"ref_7","first-page":"83","article-title":"Research on Measurement Methods for Visual Parameters in Vehicle Human-Machine Interaction","volume":"4","author":"Liu","year":"2020","journal-title":"Automot. Parts"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2889","DOI":"10.1109\/TVCG.2012.276","article-title":"Visual Analytics Methodology for Eye Movement Studies","volume":"18","author":"Andrienko","year":"2012","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_9","unstructured":"Poole, A., and Ball, L. (2004). Eye Tracking in Human-Computer Interaction and Usability Research: Current Status and Future Prospects. Encyclopedia of Human Computer Interaction, Idea Group Reference."},{"key":"ref_10","first-page":"4","article-title":"A Review of Eye Movement Recording Techniques and Methods","volume":"10","author":"Yan","year":"2004","journal-title":"Chin. J. Appl. Psychol."},{"key":"ref_11","unstructured":"Yarbus, A.L. (2013). Eye Movements and Vision, Springer."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"397","DOI":"10.3758\/BF03201553","article-title":"Survey of eye movement recording methods","volume":"7","author":"Young","year":"1975","journal-title":"Behav. Res. Methods"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1016\/j.cviu.2004.07.009","article-title":"An embedded system for an eye-detection sensor","volume":"98","author":"Amir","year":"2005","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_14","unstructured":"(2017). Road Vehicles\u2014Ergonomic Aspects of Transport Information and Control Systems\u2014Dialogue Management Principles and Compliance Procedures (Standard No. ISO 15005:2017)."},{"key":"ref_15","first-page":"3909","article-title":"A Review of the Impact of Driving Emotions on Traffic Safety and Their Recognition and Regulation Strategies","volume":"24","author":"Li","year":"2024","journal-title":"J. Saf. Environ."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1037\/1076-898X.12.2.67","article-title":"Modeling drivers\u2019 visual attention allocation while inter-acting with in-vehicle technologies","volume":"12","author":"Horrey","year":"2006","journal-title":"J. Exp. Psychol. Appl."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1016\/S0001-4575(00)00068-3","article-title":"In-vehicle distraction and fatal accidents in England and Wales","volume":"33","author":"Stevens","year":"2001","journal-title":"Accid. Anal. Prev."}],"container-title":["Multimodal Technologies and Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2414-4088\/10\/3\/33\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T05:35:13Z","timestamp":1774330513000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2414-4088\/10\/3\/33"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,21]]},"references-count":17,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,3]]}},"alternative-id":["mti10030033"],"URL":"https:\/\/doi.org\/10.3390\/mti10030033","relation":{},"ISSN":["2414-4088"],"issn-type":[{"value":"2414-4088","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,21]]}}}