{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T17:06:02Z","timestamp":1790355962859,"version":"4.1.0"},"reference-count":59,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,2,17]],"date-time":"2022-02-17T00:00:00Z","timestamp":1645056000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["PTDC\/MHC-PCN\/0101\/2014"],"award-info":[{"award-number":["PTDC\/MHC-PCN\/0101\/2014"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["SFRH\/BD\/111083\/2015"],"award-info":[{"award-number":["SFRH\/BD\/111083\/2015"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["UID\/EEA\/04436\/2019"],"award-info":[{"award-number":["UID\/EEA\/04436\/2019"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000025","name":"National Institute of Mental Health","doi-asserted-by":"publisher","award":["R01-S MH058262"],"award-info":[{"award-number":["R01-S MH058262"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000738","name":"U.S. Department of Veterans Affairs","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000738","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychiatry"],"abstract":"<jats:p>Deep learning techniques have been applied to electroencephalogram (EEG) signals, with promising applications in the field of psychiatry. Schizophrenia is one of the most disabling neuropsychiatric disorders, often characterized by the presence of auditory hallucinations. Auditory processing impairments have been studied using EEG-derived event-related potentials and have been associated with clinical symptoms and cognitive dysfunction in schizophrenia. Due to consistent changes in the amplitude of ERP components, such as the auditory N100, some have been proposed as biomarkers of schizophrenia. In this paper, we examine altered patterns in electrical brain activity during auditory processing and their potential to discriminate schizophrenia and healthy subjects. Using deep convolutional neural networks, we propose an architecture to perform the classification based on multi-channels auditory-related EEG single-trials, recorded during a passive listening task. We analyzed the effect of the number of electrodes used, as well as the laterality and distribution of the electrical activity over the scalp. Results show that the proposed model is able to classify schizophrenia and healthy subjects with an average accuracy of 78% using only 5 midline channels (Fz, FCz, Cz, CPz, and Pz). The present study shows the potential of deep learning methods in the study of impaired auditory processing in schizophrenia with implications for diagnosis. The proposed design can provide a base model for future developments in schizophrenia research.<\/jats:p>","DOI":"10.3389\/fpsyt.2021.813460","type":"journal-article","created":{"date-parts":[[2022,2,17]],"date-time":"2022-02-17T10:58:34Z","timestamp":1645095514000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":40,"title":["From Sound Perception to Automatic Detection of Schizophrenia: An EEG-Based Deep Learning Approach"],"prefix":"10.3389","volume":"12","author":[{"given":"Carla","family":"Barros","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian","family":"Roach","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Judith M.","family":"Ford","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ana P.","family":"Pinheiro","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carlos A.","family":"Silva","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2022,2,17]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1176\/appi.ajp.2020.20020147","article-title":"On the origins of schizophrenia","volume":"177","author":"Kahn","year":"2020","journal-title":"Am J Psychiatry"},{"key":"B2","doi-asserted-by":"publisher","first-page":"620","DOI":"10.1038\/nrn4005","article-title":"Social cognition in schizophrenia","volume":"16","author":"Green","year":"2015","journal-title":"Nat Rev Neurosci"},{"key":"B3","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1093\/schbul\/sbw132","article-title":"Hallucinations: a systematic review of points of similarity and difference across diagnostic classes","volume":"43","author":"Waters","year":"2016","journal-title":"Schizophren Bull"},{"key":"B4","doi-asserted-by":"publisher","first-page":"535","DOI":"10.1038\/nrn4002","article-title":"Auditory dysfunction in schizophrenia: integrating clinical and basic features","volume":"16","author":"Javitt","year":"2015","journal-title":"Nat Rev Neurosci"},{"key":"B5","doi-asserted-by":"publisher","first-page":"759","DOI":"10.1176\/appi.ajp.157.5.759","article-title":"Central auditory processing in patients with auditory hallucinations","volume":"157","author":"McKay","year":"2000","journal-title":"Am J Psychiatry"},{"key":"B6","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1037\/13619-028","article-title":"Event-related potentials","volume":"1","author":"Luck","year":"2012","journal-title":"APA Handb Res Methods Psychol"},{"key":"B7","doi-asserted-by":"publisher","first-page":"951","DOI":"10.1016\/j.biopsych.2014.09.025","article-title":"Forecasting psychosis by event-related potentials-systematic review and specific meta-analysis","volume":"77","author":"Bodatsch","year":"2015","journal-title":"Biol Psychiatry"},{"key":"B8","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1016\/j.schres.2014.09.042","article-title":"Validation of mismatch negativity and P3a for use in multi-site studies of schizophrenia: characterization of demographic, clinical, cognitive, and functional correlates in COGS-2","volume":"163","author":"Light","year":"2015","journal-title":"Schizophren Res"},{"key":"B9","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1038\/nrd2463","article-title":"Neurophysiological biomarkers for drug development in schizophrenia","volume":"7","author":"Javitt","year":"2008","journal-title":"Nat Rev Drug Discov"},{"key":"B10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/S0301-0511(03)00094-2","article-title":"Interpreting abnormality: an EEG and MEG study of P50 and the auditory paired-stimulus paradigm","volume":"65","author":"Edgar","year":"2003","journal-title":"Biol Psychol"},{"key":"B11","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1176\/appi.ajp.2017.16111203","article-title":"Clinical and cognitive significance of auditory sensory processing deficits in schizophrenia","volume":"175","author":"Hamilton","year":"2018","journal-title":"Am J Psychiatry"},{"key":"B12","doi-asserted-by":"publisher","first-page":"868","DOI":"10.3389\/fpsyt.2020.00868","article-title":"P50, N100, and P200 auditory sensory gating deficits in schizophrenia patients","volume":"11","author":"Shen","year":"2020","journal-title":"Front Psychiatry"},{"key":"B13","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1016\/j.schres.2020.02.003","article-title":"P50 inhibitory sensory gating in schizophrenia: analysis of recent studies","volume":"218","author":"Freedman","year":"2020","journal-title":"Schizophren Res"},{"key":"B14","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1016\/j.psychres.2008.03.017","article-title":"Reduced auditory evoked potential component N100 in schizophrenia\u2013A critical review","volume":"161","author":"Rosburg","year":"2008","journal-title":"Psychiatry Res"},{"key":"B15","doi-asserted-by":"publisher","first-page":"28","DOI":"10.3389\/fpsyt.2011.00028","article-title":"The neurophysiology of auditory hallucinations-a historical and contemporary review","volume":"2","author":"Van Lutterveld","year":"2011","journal-title":"Front Psychiatry"},{"key":"B16","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1016\/j.bpsc.2017.11.007","article-title":"Machine learning for precision psychiatry: opportunities and challenges","volume":"3","author":"Bzdok","year":"2018","journal-title":"Biol Psychiatry Cogn Neurosci Neuroimaging"},{"key":"B17","doi-asserted-by":"publisher","first-page":"329","DOI":"10.14569\/IJACSA.2018.090843","article-title":"EEG-based emotion recognition using 3D convolutional neural networks","volume":"9","author":"Salama","year":"2018","journal-title":"Int J Adv Comput Sci Appl"},{"key":"B18","doi-asserted-by":"publisher","first-page":"917","DOI":"10.1007\/s10618-019-00619-1","article-title":"Deep learning for time series classification: a review","volume":"33","author":"Fawaz","year":"2019","journal-title":"Data Mining Knowledge Discov"},{"key":"B19","doi-asserted-by":"publisher","first-page":"5391","DOI":"10.1002\/hbm.23730","article-title":"Deep learning with convolutional neural networks for EEG decoding and visualization","volume":"38","author":"Schirrmeister","year":"2017","journal-title":"Hum Brain Mapp"},{"key":"B20","doi-asserted-by":"publisher","first-page":"264","DOI":"10.1016\/j.nicl.2017.04.027","article-title":"Auditory prediction errors as individual biomarkers of schizophrenia","volume":"15","author":"Taylor","year":"2017","journal-title":"Neuroimage Clin"},{"key":"B21","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1504\/IJBET.2018.094728","article-title":"Optimising brain map for the diagnosis of schizophrenia","volume":"28","author":"Boostani","year":"2018","journal-title":"Int J Biomed Eng Technol"},{"key":"B22","doi-asserted-by":"publisher","first-page":"1419","DOI":"10.4172\/Neuropsychiatry.1000473","article-title":"Identification of schizophrenic patients and healthy controls based on musical perception using AEP analysis","volume":"8","author":"Hsieh","year":"2018","journal-title":"Int J Clin Skills"},{"key":"B23","article-title":"Individual recognition in schizophrenia using deep learning methods with random forest and voting classifiers: Insights from resting state EEG streams","author":"Chu","year":"2017","journal-title":"arXiv [Preprint]. arXiv:170703467."},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1109\/NER.2019.8717087","article-title":"Classification of EEG-based brain connectivity networks in schizophrenia using a multi-domain connectome convolutional neural network","author":"Phang","year":"2019","journal-title":"arXiv [Preprint]. arXiv:190308858."},{"key":"B25","doi-asserted-by":"publisher","first-page":"10","DOI":"10.14569\/IJACSA.2019.0101067","article-title":"Classification of people who suffer schizophrenia and healthy people by EEG signals using deep learning","author":"Naira","year":"2019","journal-title":"Int J Adv Comput Sci Appl"},{"key":"B26","doi-asserted-by":"publisher","first-page":"2870","DOI":"10.3390\/app9142870","article-title":"Deep convolutional neural network model for automated diagnosis of schizophrenia using EEG signals","volume":"9","author":"Oh","year":"2019","journal-title":"Appl Sci"},{"key":"B27","doi-asserted-by":"publisher","first-page":"101852","DOI":"10.1016\/j.artmed.2020.101852","article-title":"On the use of pairwise distance learning for brain signal classification with limited observations","volume":"2020","author":"Calhas","year":"2020","journal-title":"Artif Intell Med"},{"key":"B28","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1109\/JBHI.2020.2984238","article-title":"Identification of children at risk of schizophrenia via deep learning and EEG responses","volume":"25","author":"Aristizabal","year":"2020","journal-title":"IEEE J Biomed Health Inform"},{"key":"B29","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1007\/s00406-010-0176-0","article-title":"The N1 auditory evoked potential component as an endophenotype for schizophrenia: high-density electrical mapping in clinically unaffected first-degree relatives, first-episode, and chronic schizophrenia patients","volume":"261","author":"Foxe","year":"2011","journal-title":"Eur Arch Psychiatry Clin Neurosci"},{"key":"B30","doi-asserted-by":"publisher","first-page":"102039","DOI":"10.1016\/j.artmed.2021.102039","article-title":"Advanced EEG-based learning approaches to predict schizophrenia: promises and pitfalls","volume":"2021","author":"Barros","year":"2021","journal-title":"Artif Intell Med"},{"key":"B31","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1159\/000259253","article-title":"The N1 response and its applications","volume":"2","author":"Hyde","year":"1997","journal-title":"Audiol Neurotol"},{"key":"B32","doi-asserted-by":"publisher","first-page":"1300","DOI":"10.1016\/j.clinph.2011.11.036","article-title":"The auditory P200 is both increased and reduced in schizophrenia? A meta-analytic dissociation of the effect for standard and target stimuli in the oddball task","volume":"123","author":"Ferreira-Santos","year":"2012","journal-title":"Clin Neurophysiol"},{"key":"B33","doi-asserted-by":"publisher","first-page":"1059","DOI":"10.1111\/j.1469-8986.2009.00845.x","article-title":"P50, N100, and P200 sensory gating: relationships with behavioral inhibition, attention, and working memory","volume":"46","author":"Lijffijt","year":"2009","journal-title":"Psychophysiology"},{"key":"B34","first-page":"209","article-title":"Averaging, detection, and classification of single-trial ERPs","volume-title":"Event Related Potentials: A Methods Handbook","author":"Spencer","year":"2005"},{"key":"B35","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"B36","unstructured":"Batch normalization: Accelerating deep network training by reducing internal covariate shift44856\n            IoffeS\n            SzegedyC\n          \n            BachF\n            BleiD\n          LillePMLRProceedings of the 32nd International Conference on Machine Learning2015"},{"key":"B37","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach Learn"},{"key":"B38","volume-title":"Deep Learning","author":"Goodfellow","year":"2016"},{"key":"B39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TCYB.2021.3053165","article-title":"When does diversity help generalization in classification ensembles?","author":"Bian","year":"2021","journal-title":"IEEE Trans Cybernet"},{"key":"B40","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-84858-7","volume-title":"The Elements of Statistical Learning: Data Mining, Inference, and Prediction","author":"Hastie","year":"2009"},{"key":"B41","unstructured":"RoachB\n          EEG Data From Basic Sensory Task in Schizophrenia: Button Press and Auditory Tone Event Related Potentials from 81 Human Subjects2017"},{"key":"B42","doi-asserted-by":"publisher","first-page":"804","DOI":"10.1093\/schbul\/sbt072","article-title":"Did I do that? Abnormal predictive processes in schizophrenia when button pressing to deliver a tone","volume":"40","author":"Ford","year":"2013","journal-title":"Schizophren Bull"},{"key":"B43","doi-asserted-by":"publisher","first-page":"107531","DOI":"10.1016\/j.neuropsychologia.2020.107531","article-title":"Changes in motor preparation affect the sensory consequences of voice production in voice hearers","volume":"146","author":"Pinheiro","year":"2020","journal-title":"Neuropsychologia"},{"key":"B44","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1016\/j.jneumeth.2003.10.009","article-title":"EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis","volume":"134","author":"Delorme","year":"2004","journal-title":"J Neurosci Methods"},{"key":"B45","doi-asserted-by":"publisher","first-page":"152","DOI":"10.1016\/j.jneumeth.2010.07.015","article-title":"FASTER: fully automated statistical thresholding for EEG artifact rejection","volume":"192","author":"Nolan","year":"2010","journal-title":"J Neuroscience Methods"},{"key":"B46","first-page":"249","article-title":"Understanding the difficulty of training deep feedforward neural networks","volume-title":"Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics","author":"Glorot","year":"2010"},{"key":"B47","volume-title":"Machine Learning: a Probabilistic Perspective","author":"Murphy","year":"2012"},{"key":"B48","article-title":"Large scale structure of neural network loss landscapes","author":"Fort","year":"2019","journal-title":"arXiv [Preprint]. arXiv:190604724."},{"key":"B49","doi-asserted-by":"publisher","first-page":"2825","DOI":"10.5555\/1953048.2078195","article-title":"Scikit-learn: machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J Mach Learn Res"},{"key":"B50","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1038\/s41586-020-2649-2","article-title":"Array programming with NumPy","volume":"585","author":"Harris","year":"2020","journal-title":"Nature"},{"key":"B51","article-title":"What are the receptive, effective receptive, and projective fields of neurons in convolutional neural networks?","author":"Le","year":"2017","journal-title":"arXiv [Preprint]. arXiv:170507049."},{"key":"B52","doi-asserted-by":"publisher","first-page":"907","DOI":"10.1093\/schbul\/sbn093","article-title":"Event-related EEG time-frequency analysis: an overview of measures and an analysis of early gamma band phase locking in schizophrenia","volume":"34","author":"Roach","year":"2008","journal-title":"Schizophren Bull"},{"key":"B53","doi-asserted-by":"publisher","first-page":"224","DOI":"10.1016\/j.biopsych.2009.07.033","article-title":"Reduced early auditory evoked gamma-band response in patients with schizophrenia","volume":"67","author":"Leicht","year":"2010","journal-title":"Biol Psychiatry"},{"key":"B54","doi-asserted-by":"publisher","first-page":"298","DOI":"10.1016\/j.schres.2008.04.038","article-title":"An auditory processing abnormality specific to liability for schizophrenia","volume":"103","author":"Force","year":"2008","journal-title":"Schizophren Res"},{"key":"B55","doi-asserted-by":"publisher","first-page":"103","DOI":"10.3389\/fpsyg.2019.00103","article-title":"The importance of sensory processing in mental health: a proposed addition to the Research Domain Criteria (RDoC) and suggestions for RDoC 2","volume":"10","author":"Harrison","year":"2019","journal-title":"Front Psychol"},{"key":"B56","first-page":"1","article-title":"Summary of the N1-P2 cortical auditory evoked potential to estimate the auditory threshold in adults","volume-title":"Seminars in Hearing","author":"Lightfoot","year":"2016"},{"key":"B57","doi-asserted-by":"publisher","first-page":"991","DOI":"10.1093\/schbul\/sbp003","article-title":"Reductions in the N1 and P2 auditory event-related potentials in first-hospitalized and chronic schizophrenia","volume":"36","author":"Salisbury","year":"2010","journal-title":"Schizophren Bull"},{"key":"B58","doi-asserted-by":"publisher","first-page":"297","DOI":"10.3389\/fpsyt.2021.630406","article-title":"Abnormal habituation of the auditory event-related potential P2 component in patients with schizophrenia","volume":"12","author":"Mazer","year":"2021","journal-title":"Front Psychiatry"},{"key":"B59","first-page":"618","article-title":"Grad-cam: visual explanations from deep networks via gradient-based localization","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Selvaraju","year":"2017"}],"container-title":["Frontiers in Psychiatry"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyt.2021.813460\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,2,17]],"date-time":"2022-02-17T10:58:51Z","timestamp":1645095531000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyt.2021.813460\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,17]]},"references-count":59,"alternative-id":["10.3389\/fpsyt.2021.813460"],"URL":"https:\/\/doi.org\/10.3389\/fpsyt.2021.813460","relation":{},"ISSN":["1664-0640"],"issn-type":[{"value":"1664-0640","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,17]]},"article-number":"813460"}}