{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T22:14:27Z","timestamp":1782425667375,"version":"3.54.5"},"reference-count":52,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2022,11,28]],"date-time":"2022-11-28T00:00:00Z","timestamp":1669593600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"International Brain Research Organization (IBRO) Asia Pacific Regional Committee (APRC)","award":["DP170103148"],"award-info":[{"award-number":["DP170103148"]}]},{"DOI":"10.13039\/501100000923","name":"Australian Research Council","doi-asserted-by":"publisher","award":["DP170103148"],"award-info":[{"award-number":["DP170103148"]}],"id":[{"id":"10.13039\/501100000923","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In cognitive neuroscience research, computational models of event-related potentials (ERP) can provide a means of developing explanatory hypotheses for the observed waveforms. However, researchers trained in cognitive neurosciences may face technical challenges in implementing these models. This paper provides a tutorial on developing recurrent neural network (RNN) models of ERP waveforms in order to facilitate broader use of computational models in ERP research. To exemplify the RNN model usage, the P3 component evoked by target and non-target visual events, measured at channel Pz, is examined. Input representations of experimental events and corresponding ERP labels are used to optimize the RNN in a supervised learning paradigm. Linking one input representation with multiple ERP waveform labels, then optimizing the RNN to minimize mean-squared-error loss, causes the RNN output to approximate the grand-average ERP waveform. Behavior of the RNN can then be evaluated as a model of the computational principles underlying ERP generation. Aside from fitting such a model, the current tutorial will also demonstrate how to classify hidden units of the RNN by their temporal responses and characterize them using principal component analysis. Statistical hypothesis testing can also be applied to these data. This paper focuses on presenting the modelling approach and subsequent analysis of model outputs in a how-to format, using publicly available data and shared code. While relatively less emphasis is placed on specific interpretations of P3 response generation, the results initiate some interesting discussion points.<\/jats:p>","DOI":"10.3390\/s22239243","type":"journal-article","created":{"date-parts":[[2022,11,28]],"date-time":"2022-11-28T08:13:09Z","timestamp":1669623189000},"page":"9243","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["A Guided Tutorial on Modelling Human Event-Related Potentials with Recurrent Neural Networks"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2250-3077","authenticated-orcid":false,"given":"Jamie A.","family":"O\u2019Reilly","sequence":"first","affiliation":[{"name":"College of Biomedical Engineering, Rangsit University, Pathum Thani 12000, Thailand"},{"name":"School of Engineering, King Mongkut\u2019s Institute of Technology Ladkrabang, Bangkok 10520, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jordan","family":"Wehrman","sequence":"additional","affiliation":[{"name":"Brain and Mind Centre, University of Sydney, Sydney, NSW 2006, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3863-6675","authenticated-orcid":false,"given":"Paul F.","family":"Sowman","sequence":"additional","affiliation":[{"name":"School of Psychological Sciences, Macquarie University, Sydney, NSW 2109, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,11,28]]},"reference":[{"key":"ref_1","first-page":"307","article-title":"Hans Berger (1873\u20131941)\u2014The history of electroencephalography","volume":"59","author":"Tudor","year":"2005","journal-title":"Acta Med. Croat."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1016\/S0149-7634(01)00019-7","article-title":"The Novelty P3: An Event-Related Brain Potential (ERP) Sign of the Brain\u2019s Evaluation of Novelty","volume":"25","author":"Friedman","year":"2001","journal-title":"Neurosci. Biobehav. Rev."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1016\/j.clinph.2008.11.029","article-title":"The Mismatch Negativity: A Review of Underlying Mechanisms","volume":"120","author":"Garrido","year":"2009","journal-title":"Clin. Neurophysiol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2544","DOI":"10.1016\/j.clinph.2007.04.026","article-title":"The Mismatch Negativity (MMN) in Basic Research of Central Auditory Processing: A Review","volume":"118","author":"Paavilainen","year":"2007","journal-title":"Clin. Neurophysiol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1016\/j.cobeha.2016.02.022","article-title":"The Contingent Negative Variation (CNV): Timing Isn\u2019t Everything","volume":"8","author":"Kononowicz","year":"2016","journal-title":"Curr. Opin. Behav. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3355","DOI":"10.1097\/00001756-199810260-00003","article-title":"Attentional Orienting and Reorienting Is Indicated by Human Event-Related Brain Potentials","volume":"9","author":"Wolff","year":"1998","journal-title":"Neuroreport"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1037\/h0032177","article-title":"Contingent Negative Variation (CNV) and Psychological Processes in Man","volume":"77","author":"Tecce","year":"1972","journal-title":"Psychol. Bull."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.sbspro.2014.02.305","article-title":"The Role of the SMA and the Contingent Negative Variation in Interval Timing","volume":"126","author":"Kononowicz","year":"2014","journal-title":"Procedia-Soc. Behav. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Gonda, S., Tarrasch, R., and Ben Shalom, D. (2020). The Functional Significance of the P600: Some Linguistic P600\u2032s Do Localize to Language Areas. Medicine, 99.","DOI":"10.1097\/MD.0000000000023116"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1170","DOI":"10.1162\/jocn.2010.21430","article-title":"Activating without Inhibiting: Left-Edge Boundary Tones and Syntactic Processing","volume":"23","author":"Roll","year":"2011","journal-title":"J. Cogn. Neurosci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"4154","DOI":"10.1111\/ejn.15736","article-title":"Decoding Violated Sensory Expectations from the Auditory Cortex of Anaesthetised Mice: Hierarchical Recurrent Neural Network Depicts Separate \u2018Danger\u2019 and \u2018Safety\u2019 Units","volume":"56","author":"Angsuwatanakul","year":"2022","journal-title":"Eur. J. Neurosci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.neuroscience.2022.10.004","article-title":"Recurrent Neural Network Model of Human Event-Related Potentials in Response to Intensity Oddball Stimulation","volume":"504","year":"2022","journal-title":"Neuroscience"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/S0167-8760(99)00070-7","article-title":"Comparison of P300 from Passive and Active Tasks for Auditory and Visual Stimuli","volume":"34","author":"Bennington","year":"1999","journal-title":"Int. J. Psychophysiol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1016\/S1388-2457(98)00035-2","article-title":"Auditory and Visual P300 Topography from a 3 Stimulus Paradigm","volume":"110","author":"Katayama","year":"1999","journal-title":"Clin. Neurophysiol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1097\/00004691-199210000-00002","article-title":"The P300 Wave of the Human Event-Related Potential","volume":"9","author":"Picton","year":"1992","journal-title":"J. Clin. Neurophysiol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2128","DOI":"10.1016\/j.clinph.2007.04.019","article-title":"Updating P300: An Integrative Theory of P3a and P3b","volume":"118","author":"Polich","year":"2007","journal-title":"Clin. Neurophysiol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/0301-0511(95)05130-9","article-title":"Cognitive and Biological Determinants of P300: An Integrative Review","volume":"41","author":"Polich","year":"1995","journal-title":"Biol. Psychol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/S0006-3223(98)00108-5","article-title":"P300 Subcomponents Reflect Different Aspects of Psychopathology in Schizophrenia","volume":"45","author":"Gallinat","year":"1999","journal-title":"Biol. Psychiatry"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"674","DOI":"10.1093\/bja\/74.6.674","article-title":"The P300 Event-Related Potential during Propofol Sedation: A Possible Marker for Amnesia?","volume":"74","author":"Reinsel","year":"1995","journal-title":"Br. J. Anaesth."},{"key":"ref_20","first-page":"4896","article-title":"Assessment of Mismatch Negativity and P300 Response in Patients with Disorders of Consciousness","volume":"21","author":"Wang","year":"2017","journal-title":"Eur. Rev. Med. Pharmacol. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1016\/j.rehab.2017.09.004","article-title":"Brain Computer Interface with the P300 Speller: Usability for Disabled People with Amyotrophic Lateral Sclerosis","volume":"61","author":"Guy","year":"2018","journal-title":"Ann. Phys. Rehabil. Med."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Kirasirova, L., Bulanov, V., Ossadtchi, A., Kolsanov, A., Pyatin, V., and Lebedev, M. (2020). A P300 Brain-Computer Interface With a Reduced Visual Field. Front. Neurosci., 14.","DOI":"10.3389\/fnins.2020.604629"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1016\/S0167-8760(96)00743-X","article-title":"On the Number of Trials Needed for P300","volume":"25","author":"Cohen","year":"1997","journal-title":"Int. J. Psychophysiol."},{"key":"ref_24","unstructured":"Loizides, F., and Schmidt, B. (2016). Jupyter Notebook\u2014A Publishing Format for Reproducible Computational Workflows, Academic Publishing."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1109\/MCSE.2007.55","article-title":"Matplotlib: A 2D Graphics Environment","volume":"9","author":"Hunter","year":"2007","journal-title":"Comput. Sci. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Gramfort, A., Luessi, M., Larson, E., Engemann, D.A., Strohmeier, D., Brodbeck, C., Goj, R., Jas, M., Brooks, T., and Parkkonen, L. (2013). MEG and EEG Data Analysis with MNE-Python. Front. Neurosci., 7.","DOI":"10.3389\/fnins.2013.00267"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1038\/s41586-020-2649-2","article-title":"Array Programming with NumPy","volume":"585","author":"Harris","year":"2020","journal-title":"Nature"},{"key":"ref_28","first-page":"2825","article-title":"Scikit-Learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_29","unstructured":"Jones, E., Oliphant, T., and Peterson, P. (2022, September 29). Others SciPy: Open Source Scientific Tools for Python. Available online: http:\/\/www.scipy.org\/."},{"key":"ref_30","unstructured":"Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2016). TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Kappenman, E.S., Farrens, J.L., Zhang, W., Stewart, A.X., and Luck, S.J. (2021). ERP CORE: An Open Resource for Human Event-Related Potential Research. Neuroimage, 225.","DOI":"10.1016\/j.neuroimage.2020.117465"},{"key":"ref_32","unstructured":"Glorot, X., and Bengio, Y. (2010, January 13\u201315). Understanding the Difficulty of Training Deep Feedforward Neural Networks. Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, Sardinia, Italy."},{"key":"ref_33","unstructured":"Saxe, A.M., McClelland, J.L., and Ganguli, S. (2013). Exact Solutions to the Nonlinear Dynamics of Learning in Deep Linear Neural Networks. arXiv."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1016\/j.neuron.2009.09.020","article-title":"Laminar Structure of Spontaneous and Sensory-Evoked Population Activity in Auditory Cortex","volume":"64","author":"Sakata","year":"2009","journal-title":"Neuron"},{"key":"ref_35","first-page":"1603","article-title":"Principles of Image Representation in Visual Cortex","volume":"2","author":"Olshausen","year":"2003","journal-title":"Vis. Neurosci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1273","DOI":"10.1126\/science.287.5456.1273","article-title":"Sparse Coding and Decorrelation in Primary Visual Cortex During Natural Vision","volume":"287","author":"Vinje","year":"2000","journal-title":"Science"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"900","DOI":"10.1523\/JNEUROSCI.0183-18.2018","article-title":"Lateralized Suppression of Alpha-Band EEG Activity as a Mechanism of Target Processing","volume":"39","author":"Bacigalupo","year":"2019","journal-title":"J. Neurosci."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1093\/cercor\/bhj129","article-title":"Alpha Phase Reset Contributes to the Generation of ERPs","volume":"17","author":"Hanslmayr","year":"2007","journal-title":"Cereb. Cortex"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1016\/j.conb.2021.10.015","article-title":"Towards the next Generation of Recurrent Network Models for Cognitive Neuroscience","volume":"70","author":"Yang","year":"2021","journal-title":"Curr. Opin. Neurobiol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.conb.2017.06.003","article-title":"Recurrent Neural Networks as Versatile Tools of Neuroscience Research","volume":"46","author":"Barak","year":"2017","journal-title":"Curr. Opin. Neurobiol."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Annabi, L., Pitti, A., and Quoy, M. (2022). Continual Sequence Modeling With Predictive Coding. Front. Neurorobotics, 16.","DOI":"10.3389\/fnbot.2022.845955"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Pennington, J.R., and David, S.V. (2022). Can Deep Learning Provide a Generalizable Model for Dynamic Sound Encoding in Auditory Cortex?. bioRxiv.","DOI":"10.1101\/2022.06.10.495698"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Rudraraju, S., Theilman, B., Turvey, M., and Gentner, T. (2022, January 25\u201328). Predictive Coding in Auditory Cortical Neurons of Songbirds. Proceedings of the Conference on Cognitive Computational Neuroscience, San Francisco, CA, USA. Available online: https:\/\/2022.ccneuro.org\/proceedings\/0000148.pdf.","DOI":"10.32470\/CCN.2022.1276-0"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2273","DOI":"10.1162\/neco_a_01537","article-title":"Inferring Mechanisms of Auditory Attentional Modulation with Deep Neural Networks","volume":"34","author":"Kuo","year":"2022","journal-title":"Neural Comput."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Zubarev, I., Vranou, G., and Parkkonen, L. (2022). MNEflow: Neural Networks for EEG\/MEG Decoding and Interpretation. SoftwareX, 17.","DOI":"10.1016\/j.softx.2021.100951"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Kriegeskorte, N., Mur, M., and Bandettini, P. (2008). Representational Similarity Analysis-Connecting the Branches of Systems Neuroscience. Front. Syst. Neurosci., 2.","DOI":"10.3389\/neuro.06.004.2008"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/B978-0-444-52903-9.00007-8","article-title":"Anatomy and Physiology of the Afferent Visual System","volume":"102","author":"Prasad","year":"2011","journal-title":"Handb. Clin. Neurol."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Fowler, C.G., and Leigh-Paffenroth, E.D. (2007). Hearing. Encyclopedia of Gerontology, Elsevier.","DOI":"10.1016\/B0-12-370870-2\/00086-X"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1016\/j.biopsych.2013.12.008","article-title":"Resting State Electroencephalogram Oscillatory Abnormalities in Schizophrenia and Psychotic Bipolar Patients and Their Relatives from the Bipolar and Schizophrenia Network on Intermediate Phenotypes Study","volume":"76","author":"Narayanan","year":"2014","journal-title":"Biol. Psychiatry"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"3266","DOI":"10.1111\/ejn.15450","article-title":"Forgotten Rhythms? Revisiting the First Evidence for Rhythms in Cognition","volume":"55","author":"Quigley","year":"2021","journal-title":"Eur. J. Neurosci."},{"key":"ref_51","unstructured":"Luck, S.J. (2014). An Introduction to the Event-Related Potential Technique, MIT Press."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"O\u2019Reilly, J.A. (2022). Modelling Mouse Auditory Response Dynamics along a Continuum of Consciousness Using a Deep Recurrent Neural Network. J. Neural Eng., 19.","DOI":"10.1101\/2022.04.29.490019"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/23\/9243\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:28:06Z","timestamp":1760146086000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/23\/9243"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,28]]},"references-count":52,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["s22239243"],"URL":"https:\/\/doi.org\/10.3390\/s22239243","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,28]]}}}