{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T12:11:11Z","timestamp":1785413471918,"version":"3.56.0"},"reference-count":51,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T00:00:00Z","timestamp":1782950400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100005144","name":"Qualcomm","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100005144","id-type":"DOI","asserted-by":"crossref"}]},{"id":[{"id":"https:\/\/ror.org\/02ae31880","id-type":"ROR","asserted-by":"publisher"}]},{"name":"Science Foundation Ireland Centre for Research Training in Artificial Intelligence","award":["18\/CRT\/6223"],"award-info":[{"award-number":["18\/CRT\/6223"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Electroencephalography (EEG) is a noninvasive tool used by healthcare professionals to measure brain electrical activity. EEG analysis can indicate various anomalies linked to different brain pathologies, including seizures. Traditionally, the analysis is confined to two-dimensional displays and relies exclusively on the visual modality, limiting a comprehensive overview. EEG analysis through visualisation is challenging and time-consuming, and artificial intelligence (AI) is increasingly used to aid the process of seizure detection. However, the educational value of AI-assisted seizure detection models depends on the explainability of the underlying models. Explainable AI can help learners understand the features and patterns associated with seizure detection and also support informed use of AI-based decision support systems. M2EEG-VR leverages the focus and immersive capabilities of virtual reality (VR) with the aim of developing a multi-modal platform for EEG seizure detection analysis with a human-in-the-loop. The ability to understand EEG and seizure patterns is key to addressing and effectively treating many neurological conditions. Neonatal seizure detection is particularly challenging where seizure patterns are subtle and context dependent. This study advances toward multi-modal analysis by encoding EEG signals into auditory representations using AI that aids in the acoustic detection of the presence of neonatal seizures in EEG. The platform also introduces a 3D brain model with a spatial mapping of seizure regions. In a user study (N = 20, 4 prior EEG experience, 16 no prior EEG experience), participants achieved higher seizure detection accuracy in the combined visual and auditory condition (mean = 7.6 \u00b1 1.2) than in visual-only or audio-only modes. These preliminary findings suggest that a multi-modal environment may improve the accuracy of detection. However, further controlled studies are needed to ascertain the performance benefits. Usability was rated excellent (SUS = 83 \u00b1 11), and task load remained moderate (NASA-TLX = 36.6). The findings suggest that VR multi-modal interaction can reduce cognitive load and enhance the explainability of complex EEG data in a focused virtual environment. The analysis of the diagnostic accuracy showed that participants without prior EEG knowledge performed similarly across all modalities to those with prior EEG knowledge. This implies that the accessibility barrier is reduced for novice users using the tool for the EEG review\/detection task. This, together with high usability and moderate task load scores, indicates that the tool may be suitable for medical training applications. A multi-modal EEG in VR may prove useful in education and also be used as a test bench to further explore AI with human-in-the-loop paradigms for seizure detection.<\/jats:p>","DOI":"10.3390\/s26134167","type":"journal-article","created":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T11:48:32Z","timestamp":1782992912000},"page":"4167","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["M2EEG-VR: Validation of EEG Visualization and Sonification for the Detection of Neonatal Seizures on a Virtual Reality Platform"],"prefix":"10.3390","volume":"26","author":[{"given":"Adam","family":"Creed","sequence":"first","affiliation":[{"name":"Electrical and Electronic Engineering, University College Cork, 60 College Rd, The Lough, T12 HW58 Cork, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lavanya","family":"Pampana","sequence":"additional","affiliation":[{"name":"Electrical and Electronic Engineering, University College Cork, 60 College Rd, The Lough, T12 HW58 Cork, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9685-8292","authenticated-orcid":false,"given":"David","family":"Murphy","sequence":"additional","affiliation":[{"name":"MAVRIC, Computer Science and Information Technology, University College Cork, 60 College Rd, The Lough, T12 HW58 Cork, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sergi","family":"Gomez","sequence":"additional","affiliation":[{"name":"Electrical and Electronic Engineering, University College Cork, 60 College Rd, The Lough, T12 HW58 Cork, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andriy","family":"Temko","sequence":"additional","affiliation":[{"name":"Electrical and Electronic Engineering, University College Cork, 60 College Rd, The Lough, T12 HW58 Cork, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emanuel","family":"Popovici","sequence":"additional","affiliation":[{"name":"Electrical and Electronic Engineering, University College Cork, 60 College Rd, The Lough, T12 HW58 Cork, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4293-1888","authenticated-orcid":false,"given":"Andreea","family":"Factor","sequence":"additional","affiliation":[{"name":"Anatomy and Neuroscience, School of Medicine, University College Cork, 60 College Rd, The Lough, T12 HW58 Cork, Ireland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,7,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1056","DOI":"10.1016\/j.clinph.2018.01.019","article-title":"Clinical Utility of EEG in Diagnosing and Monitoring Epilepsy in Adults","volume":"129","author":"Tatum","year":"2018","journal-title":"Clin. Neurophysiol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"10.2.1","DOI":"10.1002\/0471142301.ns1002s49","article-title":"EEG Recording and Analysis for Sleep Research","volume":"49","author":"Campbell","year":"2009","journal-title":"Curr. Protoc. Neurosci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1490","DOI":"10.1016\/j.clinph.2004.01.001","article-title":"EEG Dynamics in Patients with Alzheimer\u2019s Disease","volume":"115","author":"Jeong","year":"2004","journal-title":"Clin. Neurophysiol. Off. J. Int. Fed. Clin. Neurophysiol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1816","DOI":"10.1212\/01.wnl.0000279335.85797.2c","article-title":"Long-Term Prognosis in Children with Neonatal Seizures: A population-based study","volume":"69","author":"Ronen","year":"2007","journal-title":"Neurology"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1016\/j.mcna.2018.10.002","article-title":"Seizures and Epilepsy","volume":"103","author":"Johnson","year":"2019","journal-title":"Med. Clin. N. Am."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1698","DOI":"10.1111\/j.1528-1167.2005.00273_1.x","article-title":"Comment on Epileptic Seizures and Epilepsy: Definitions Proposed by the International League Against Epilepsy (ILAE) and the International Bureau for Epilepsy (IBE)","volume":"46","author":"Beghi","year":"2005","journal-title":"Epilepsia"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"a022426","DOI":"10.1101\/cshperspect.a022426","article-title":"Seizures and Epilepsy: An Overview for Neuroscientists","volume":"5","author":"Stafstrom","year":"2015","journal-title":"Cold Spring Harb. Perspect. Med."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Frohlich, J., Johnson, M.A., McArthur, D.L., Lutkenhoff, E.S., Dell\u2019Italia, J., Real, C., Shrestha, V., Spivak, N.M., Ruiz Tejeda, J.E., and Vespa, P.M. (2021). Sedation-Induced Burst Suppression Predicts Positive Outcome Following Traumatic Brain Injury. Front. Neurol., 12.","DOI":"10.3389\/fneur.2021.750667"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1617","DOI":"10.1001\/archneur.57.11.1617","article-title":"Seizures After Stroke: A Prospective Multicenter Study","volume":"57","author":"Bladin","year":"2000","journal-title":"Arch. Neurol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1016\/S0140-6736(98)02158-8","article-title":"Medical Causes of Seizures","volume":"352","author":"Delanty","year":"1998","journal-title":"Lancet"},{"key":"ref_11","first-page":"2150008","article-title":"Deep Learning for EEG Seizure Detection in Preterm Infants","volume":"31","author":"Ahmed","year":"2020","journal-title":"Int. J. Neural Syst."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Awais, M., Belhaouari, S.B., and Kassoul, K. (2024). Graphical Insight: Revolutionizing Seizure Detection with EEG Representation. Biomedicines, 12.","DOI":"10.3390\/biomedicines12061283"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"101856","DOI":"10.1016\/j.bspc.2020.101856","article-title":"Automated Focal EEG Signal Detection Based on Third Order Cumulant Function","volume":"58","author":"Sharma","year":"2019","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.cnp.2018.03.002","article-title":"Visual EEG reviewing times with SCORE EEG","volume":"3","author":"Brogger","year":"2018","journal-title":"Clin. Neurophysiol. Pract."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/B978-0-444-64032-1.00012-6","article-title":"Chapter 12\u2014High-resolution EEG","volume":"Volume 160","author":"Levin","year":"2019","journal-title":"Handbook of Clinical Neurology"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"10932","DOI":"10.1038\/s41598-022-14894-4","article-title":"A Method for AI Assisted Human Interpretation of Neonatal EEG","volume":"12","author":"Factor","year":"2022","journal-title":"Sci. Rep."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1016\/j.siny.2013.04.004","article-title":"Monitoring Neonatal Seizures","volume":"18","author":"Boylan","year":"2013","journal-title":"Semin. Fetal Neonatal Med."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"056013","DOI":"10.1088\/1741-2552\/aace8c","article-title":"EEGNet: A compact convolutional neural network for EEG-based brain\u2013computer interfaces","volume":"15","author":"Lawhern","year":"2018","journal-title":"J. Neural Eng."},{"key":"ref_19","unstructured":"De Paolis, L.T., Arpaia, P., and Sacco, M. (2024). Brain Visualizer: A Tool for EEG Data Processing and 3D Brain Activity Visualization. Proceedings of the Extended Reality, Springer."},{"key":"ref_20","unstructured":"Steffert, T.C. (2018). Real-Time Electroencephalogram Sonification for Neurofeedback, Open University."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"109824","DOI":"10.1016\/j.yebeh.2024.109824","article-title":"Effect of virtual reality-based seizure management education program for parents (VR-ESMEPP) on seizure management: A randomized controlled trial","volume":"156","author":"Turan","year":"2024","journal-title":"Epilepsy Behav."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"105550","DOI":"10.1016\/j.nedt.2022.105550","article-title":"A pediatric seizure management virtual reality simulator for nursing students: A quasi-experimental design","volume":"119","author":"Wu","year":"2022","journal-title":"Nurse Educ. Today"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.seizure.2020.06.002","article-title":"Using sampled visual EEG review in combination with automated detection software at the EMU","volume":"80","author":"Reus","year":"2020","journal-title":"Seizure"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Donalek, C., Djorgovski, S.G., Cioc, A., Wang, A., Zhang, J., Lawler, E., Yeh, S., Mahabal, A., Graham, M., and Drake, A. (2014). Immersive and Collaborative Data Visualization Using Virtual Reality Platforms. 2014 IEEE International Conference on Big Data (Big Data), IEEE.","DOI":"10.1109\/BigData.2014.7004282"},{"key":"ref_25","first-page":"254","article-title":"Modulation of Cortical Activity in 2D versus 3D Virtual Reality Environments: An EEG Study","volume":"95","author":"Slobounov","year":"2015","journal-title":"Int. J. Psychophysiol. Off. J. Int. Organ. Psychophysiol."},{"key":"ref_26","first-page":"11","article-title":"Applications of Artificial Intelligence in Automatic Detection of Epileptic Seizures Using EEG Signals: A Review","volume":"1","author":"Saminu","year":"2023","journal-title":"Artif. Intell. Appl."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"046035","DOI":"10.1088\/1741-2552\/aac960","article-title":"Integrating Artificial Intelligence with Real-Time Intracranial EEG Monitoring to Automate Interictal Identification of Seizure Onset Zones in Focal Epilepsy","volume":"15","author":"Varatharajah","year":"2018","journal-title":"J. Neural Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1109\/RBME.2020.3008792","article-title":"Machine Learning for Predicting Epileptic Seizures Using EEG Signals: A Review","volume":"14","author":"Rasheed","year":"2021","journal-title":"IEEE Rev. Biomed. Eng."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1038\/s41746-025-01725-9","article-title":"Artificial intelligence should genuinely support clinical reasoning and decision making to bridge the translational gap","volume":"8","author":"Sokol","year":"2025","journal-title":"npj Digit. Med."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"P\u00e9rez-Elvira, R., Oltra-Cucarella, J., Agudo Juan, M., Polo-Ferrero, L., Ju\u00e1rez-Vela, R., Bosch-Bayard, J., D\u00edaz, M.Q., Neamtu, B., and Salgado-Ruiz, A. (2025). Auditory Discrimination of Parametrically Sonified EEG Signals in Alzheimer\u2019s Disease. J. Clin. Med., 15.","DOI":"10.3390\/jcm15010140"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.neunet.2019.11.023","article-title":"Neonatal Seizure Detection from Raw Multi-Channel EEG Using a Fully Convolutional Architecture","volume":"123","author":"Lightbody","year":"2020","journal-title":"Neural Netw."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"O\u2019Sullivan, F., Quintana, S.G., Temko, A., and Popovici, E. (2022). An Implementation of an AI-assisted Sonification Algorithm for Neonatal EEG Seizure Detection on an Edge Device. Proceedings of the 2022 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), IEEE.","DOI":"10.1109\/BHI56158.2022.9926876"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1109\/TETC.2024.3481035","article-title":"Low-Power Real-Time Seizure Monitoring Using AI-Assisted Sonification of Neonatal EEG","volume":"13","author":"Nguyen","year":"2024","journal-title":"IEEE Trans. Emerg. Top. Comput."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"e459","DOI":"10.1542\/peds.2008-2190","article-title":"Early EEG Findings in Hypoxic-Ischemic Encephalopathy Predict Outcomes at 2 Years","volume":"124","author":"Murray","year":"2009","journal-title":"Pediatrics"},{"key":"ref_35","unstructured":"(2026, June 24). PICO Neo3 Pro|Product Specifications|PICO Global. Available online: https:\/\/www.picoxr.com\/global\/products\/neo3-pro-eye\/specs."},{"key":"ref_36","unstructured":"(2026, June 24). Unity Real-Time Development Platform|3D, 2D, VR & AR Engine. Available online: https:\/\/unity.com."},{"key":"ref_37","unstructured":"(2026, June 24). OpenXR-High-performance Access to AR and VR \u2014Collectively Known as XR\u2014Platforms and Devices. Available online: https:\/\/www.khronos.org\/openxr\/."},{"key":"ref_38","unstructured":"(2026, June 24). C# Guide-.NET Managed Language. Available online: https:\/\/learn.microsoft.com\/en-us\/dotnet\/csharp\/."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"190039","DOI":"10.1038\/sdata.2019.39","article-title":"A Dataset of Neonatal EEG Recordings with Seizure Annotations","volume":"6","author":"Stevenson","year":"2019","journal-title":"Sci. Data"},{"key":"ref_40","unstructured":"(2026, June 24). Welcome to Python.Org. Available online: https:\/\/www.python.org\/."},{"key":"ref_41","unstructured":"(2026, June 24). NumPy. Available online: https:\/\/numpy.org\/."},{"key":"ref_42","unstructured":"(2026, June 24). Pandas\u2014Python Data Analysis Library. Available online: https:\/\/pandas.pydata.org\/."},{"key":"ref_43","first-page":"61","article-title":"Classifying Presence Scores: Insights and Analysis from Two Decades of the Igroup Presence Questionnaire (IPQ)","volume":"31","author":"Tran","year":"2024","journal-title":"ACM Trans. Comput.-Hum. Interact."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"266","DOI":"10.1162\/105474601300343603","article-title":"The Experience of Presence: Factor Analytic Insights","volume":"10","author":"Schubert","year":"2001","journal-title":"Presence Teleoperators Virtual Environ."},{"key":"ref_45","unstructured":"(2026, June 24). NASA Task Load Index|Digital Healthcare Research, Available online: https:\/\/digital.ahrq.gov\/health-it-tools-and-resources\/evaluation-resources\/workflow-assessment-health-it-toolkit\/all-workflow-tools\/nasa-task-load-index."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1080\/10447318.2018.1455307","article-title":"The System Usability Scale: Past, Present, and Future","volume":"34","author":"Lewis","year":"2018","journal-title":"Int. J. Hum.-Interact."},{"key":"ref_47","first-page":"114","article-title":"Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale","volume":"4","author":"Bangor","year":"2009","journal-title":"J. Usability Stud."},{"key":"ref_48","unstructured":"(2026, June 24). Igroup Presence Questionnaire (IPQ) Overview|Igroup.Org\u2014 Project Consortium. Available online: https:\/\/www.igroup.org\/pq\/ipq\/index.php."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"109518","DOI":"10.1016\/j.yebeh.2023.109518","article-title":"EEG based automated seizure detection\u2014A survey of medical professionals","volume":"149","author":"Wong","year":"2023","journal-title":"Epilepsy Behav."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Tsiakas, K., and Murray-Rust, D. (2022). Using human-in-the-loop and explainable AI to envisage new future work practices. Proceedings of the 15th International Conference on Pervasive Technologies Related to Assistive Environments; PETRA \u201922, ACM.","DOI":"10.1145\/3529190.3534779"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"11322","DOI":"10.1073\/pnas.1810766115","article-title":"Mammalian behavior and physiology converge to confirm sharper cochlear tuning in humans","volume":"115","author":"Sumner","year":"2018","journal-title":"Proc. Natl. Acad. Sci. USA"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/13\/4167\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T04:27:21Z","timestamp":1783484841000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/13\/4167"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,2]]},"references-count":51,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2026,7]]}},"alternative-id":["s26134167"],"URL":"https:\/\/doi.org\/10.3390\/s26134167","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,2]]}}}