{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T00:29:10Z","timestamp":1776731350299,"version":"3.51.2"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,7,10]],"date-time":"2024-07-10T00:00:00Z","timestamp":1720569600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,7,10]],"date-time":"2024-07-10T00:00:00Z","timestamp":1720569600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Brain Inf."],"published-print":{"date-parts":[[2024,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The flicker stimulus is a visual stimulus of intermittent illumination. A flicker stimulus can appear flickering or steady to a human subject, depending on the physical parameters associated with the stimulus. When the flickering light appears steady, flicker fusion is said to have occurred. This work aims to bridge the gap between the\u00a0psychophysics of flicker fusion and the\u00a0electrophysiology associated with flicker stimulus through a Deep Learning based computational model of flicker perception. Convolutional Recurrent Neural Networks (CRNNs) were trained with psychophysics data of flicker stimulus obtained from a human subject. We claim that many of the reported features of electrophysiology of the\u00a0flicker stimulus, including the presence of fundamentals and harmonics of the stimulus, can be explained as the result of a temporal convolution operation on the flicker stimulus. We further show that the convolution layer output of a CRNN trained with psychophysics data is more responsive to specific frequencies as in human EEG response to flicker, and the convolution layer of a trained CRNN can give a nearly sinusoidal output for 10 hertz flicker stimulus as reported for some human subjects.<\/jats:p>","DOI":"10.1186\/s40708-024-00231-0","type":"journal-article","created":{"date-parts":[[2024,7,10]],"date-time":"2024-07-10T16:02:01Z","timestamp":1720627321000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["A deep learning based cognitive model to probe the relation between psychophysics and electrophysiology of flicker stimulus"],"prefix":"10.1186","volume":"11","author":[{"given":"Keerthi S.","family":"Chandran","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kuntal","family":"Ghosh","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,7,10]]},"reference":[{"key":"231_CR1","first-page":"231","volume-title":"Progress in brain research","author":"Y Taveras-Cruz","year":"2022","unstructured":"Taveras-Cruz Y, He J, Eskew RT (2022) Visual psychophysics: luminance and color. In: Santhi N, Spitschan M (eds) Progress in brain research. Elsevier, Amsterdam, pp 231\u2013256"},{"issue":"2","key":"231_CR2","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1152\/physrev.1954.34.2.259","volume":"34","author":"C Landis","year":"1954","unstructured":"Landis C (1954) Determinants of the critical flicker-fusion threshold. Physiol Rev 34(2):259\u2013286. https:\/\/doi.org\/10.1152\/physrev.1954.34.2.259","journal-title":"Physiol Rev"},{"key":"231_CR3","volume-title":"Visual perception: physiology, psychology, and ecology","author":"B Vicki","year":"1996","unstructured":"Vicki B, Green MR (1996) Visual perception: physiology, psychology, and ecology. Psychology press, London"},{"key":"231_CR4","volume-title":"Visual psychophysics handbook of sensory physiology","author":"DH Kelly","year":"1972","unstructured":"Kelly DH (1972) Flicker. In: Jameson D, Hurvich LM (eds) Visual psychophysics handbook of sensory physiology. Springer, Berlin"},{"key":"231_CR5","doi-asserted-by":"publisher","first-page":"346","DOI":"10.1007\/s002210100682","volume":"137","author":"CS Herrmann","year":"2001","unstructured":"Herrmann CS (2001) Human eeg responses to 1\u2013100 hz flicker: resonance phenomena in visual cortex and their potential correlation to cognitive phenomena. Exp Brain Res 137:346\u2013353. https:\/\/doi.org\/10.1007\/s002210100682","journal-title":"Exp Brain Res"},{"issue":"5","key":"231_CR6","doi-asserted-by":"publisher","first-page":"1856","DOI":"10.1046\/j.1460-9568.1998.00197.x","volume":"10","author":"G Rager","year":"1998","unstructured":"Rager G, Singer W (1998) The response of cat visual cortex to flicker stimuli of variable frequency. Eur J Neurosci 10(5):1856\u20131877. https:\/\/doi.org\/10.1046\/j.1460-9568.1998.00197.x","journal-title":"Eur J Neurosci"},{"issue":"1","key":"231_CR7","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1007\/bf00160581","volume":"18","author":"LH van der Tweel","year":"1964","unstructured":"van der Tweel LH (1964) Relation between psychophysics and electrophysiology of flicker. Documenta Ophthalmologica 18(1):287\u2013304. https:\/\/doi.org\/10.1007\/bf00160581","journal-title":"Documenta Ophthalmologica"},{"issue":"1","key":"231_CR8","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1080\/00223980.1958.9916274","volume":"46","author":"SH Bartley","year":"1958","unstructured":"Bartley SH (1958) Some factors influencing critical flicker frequency. J Psychol 46(1):107\u2013115. https:\/\/doi.org\/10.1080\/00223980.1958.9916274","journal-title":"J Psychol"},{"key":"231_CR9","doi-asserted-by":"publisher","first-page":"129","DOI":"10.3389\/fncom.2016.00129","volume":"10","author":"M Labecki","year":"2016","unstructured":"Labecki M, Kus R, Brzozowska A et al (2016) Nonlinear origin of ssvep spectra-a combined experimental and modeling study. Front Comput Neurosci 10:129. https:\/\/doi.org\/10.3389\/fncom.2016.00129","journal-title":"Front Comput Neurosci"},{"issue":"1","key":"231_CR10","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0014543","volume":"6","author":"A Capilla","year":"2011","unstructured":"Capilla A, Pazo-Alvarez P, Darriba A et al (2011) Steady-state visual evoked potentials can be explained by temporal superposition of transient event-related responses. PLoS ONE 6(1):e14543. https:\/\/doi.org\/10.1371\/journal.pone.0014543","journal-title":"PLoS ONE"},{"key":"231_CR11","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2016.00010","author":"A Notbohm","year":"2016","unstructured":"Notbohm A, Kurths J, Herrmann CS (2016) Modification of brain oscillations via rhythmic light stimulation provides evidence for entrainment but not for superposition of event-related responses. Front Human Neurosci. https:\/\/doi.org\/10.3389\/fnhum.2016.00010","journal-title":"Front Human Neurosci"},{"issue":"17","key":"231_CR12","doi-asserted-by":"publisher","first-page":"1829","DOI":"10.1097\/01.wnr.0000246326.89308.ec","volume":"17","author":"K Schwab","year":"2006","unstructured":"Schwab K, Ligges C, Jungmann T et al (2006) Alpha entrainment in human electroencephalogram and magnetoencephalogram recordings. NeuroReport 17(17):1829\u20131833. https:\/\/doi.org\/10.1097\/01.wnr.0000246326.89308.ec","journal-title":"NeuroReport"},{"issue":"3","key":"231_CR13","doi-asserted-by":"publisher","first-page":"1947","DOI":"10.1016\/j.neuroimage.2012.05.054","volume":"62","author":"J Roberts","year":"2012","unstructured":"Roberts J, Robinson P (2012) Quantitative theory of driven nonlinear brain dynamics. NeuroImage 62(3):1947\u20131955. https:\/\/doi.org\/10.1016\/j.neuroimage.2012.05.054","journal-title":"NeuroImage"},{"key":"231_CR14","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.63.041909","author":"PA Robinson","year":"2001","unstructured":"Robinson PA, Loxley PN, O\u2019Connor SC et al (2001) Modal analysis of corticothalamic dynamics, electroencephalographic spectra, and evoked potentials. Phys Rev E. https:\/\/doi.org\/10.1103\/PhysRevE.63.041909","journal-title":"Phys Rev E"},{"key":"231_CR15","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1007\/BF00270757","volume":"15","author":"FHL da Silva","year":"1974","unstructured":"da Silva FHL, Hoeks A, Smits H et al (1974) Model of brain rhythmic activity. Kybernetik 15:27\u201337. https:\/\/doi.org\/10.1007\/BF00270757","journal-title":"Kybernetik"},{"key":"231_CR16","first-page":"367","volume-title":"Deep learning","author":"I Goodfellow","year":"2016","unstructured":"Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT Press, Cambridge, p 367"},{"issue":"6158","key":"231_CR17","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1038\/331679a0","volume":"331","author":"D Zipser","year":"1988","unstructured":"Zipser D, Andersen R (1988) A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons. Nature 331(6158):679\u2013684. https:\/\/doi.org\/10.1038\/331679a0","journal-title":"Nature"},{"issue":"4","key":"231_CR18","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1068\/p130387","volume":"13","author":"B Moulden","year":"1984","unstructured":"Moulden B, Renshaw J, Mather G (1984) Two channels for flicker in the human visual system. Perception 13(4):387\u2013400. https:\/\/doi.org\/10.1068\/p130387","journal-title":"Perception"},{"issue":"3","key":"231_CR19","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1017\/s0952523809990137","volume":"26","author":"MV Wyk","year":"2009","unstructured":"Wyk MV, W\u00e4ssle H, Taylor WR (2009) Receptive field properties of on- and off- ganglion cells in the mouse retina. Vis Neurosci 26(3):297\u2013308. https:\/\/doi.org\/10.1017\/s0952523809990137","journal-title":"Vis Neurosci"},{"issue":"1167","key":"231_CR20","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1098\/rspb.1980.0020","volume":"207","author":"D Marr","year":"1980","unstructured":"Marr D, Hildreth E (1980) Theory of edge detection. Proc Royal Soc Lond Ser B Biol Sci 207(1167):187\u2013217. https:\/\/doi.org\/10.1098\/rspb.1980.0020","journal-title":"Proc Royal Soc Lond Ser B Biol Sci"},{"key":"231_CR21","doi-asserted-by":"publisher","first-page":"891","DOI":"10.1016\/B978-012170960-0\/50064-5","volume-title":"The electrical engineering handbook","author":"EA da Silva","year":"2005","unstructured":"da Silva EA, Mendon\u00e7a GV (2005) Digital image processing. In: J\u00e4hne B (ed) The electrical engineering handbook. Elsevier, Amsterdam, pp 891\u2013910"},{"key":"231_CR22","doi-asserted-by":"publisher","unstructured":"Zuo Z, Shuai B, Wang G, et\u00a0al (2015) Convolutional recurrent neural networks: Learning spatial dependencies for image representation. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp 18\u201326, https:\/\/doi.org\/10.1109\/CVPRW.2015.7301268","DOI":"10.1109\/CVPRW.2015.7301268"},{"key":"231_CR23","doi-asserted-by":"publisher","DOI":"10.1098\/rsfs.2021.0088","author":"A Jim\u00e9nez","year":"2022","unstructured":"Jim\u00e9nez A, Lu Y, Jambhekar A et al (2022) Principles, mechanisms and functions of entrainment in biological oscillators. Interface Focus. https:\/\/doi.org\/10.1098\/rsfs.2021.0088","journal-title":"Interface Focus"},{"issue":"3","key":"231_CR24","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1007\/s00422-005-0547-1","volume":"92","author":"K Kirschfeld","year":"2005","unstructured":"Kirschfeld K (2005) The physical basis of alpha waves in the electroencephalogram and the origin of the \u201cberger effect\u2019\u2019. Biol Cybern 92(3):177\u2013185. https:\/\/doi.org\/10.1007\/s00422-005-0547-1","journal-title":"Biol Cybern"},{"issue":"42","key":"231_CR25","doi-asserted-by":"publisher","first-page":"10173","DOI":"10.1523\/jneurosci.1163-17.2017","volume":"37","author":"R Gulbinaite","year":"2017","unstructured":"Gulbinaite R, van Viegen T, Wieling M et al (2017) Individual alpha peak frequency predicts 10 hz flicker effects on selective attention. J Neurosci 37(42):10173\u201310184. https:\/\/doi.org\/10.1523\/jneurosci.1163-17.2017","journal-title":"J Neurosci"},{"issue":"31","key":"231_CR26","doi-asserted-by":"publisher","first-page":"6684","DOI":"10.1523\/JNEUROSCI.3134-20.2021","volume":"41","author":"K Duecker","year":"2021","unstructured":"Duecker K, Gutteling TP, Herrmann CS et al (2021) No evidence for entrainment: Endogenous gamma oscillations and rhythmic flicker responses coexist in visual cortex. J Neurosci 41(31):6684\u20136698. https:\/\/doi.org\/10.1523\/JNEUROSCI.3134-20.2021","journal-title":"J Neurosci"},{"issue":"6","key":"231_CR27","doi-asserted-by":"publisher","first-page":"515","DOI":"10.1167\/6.6.515","volume":"6","author":"J Ding","year":"2006","unstructured":"Ding J, Srinivasan R, Sperling G (2006) Flicker elicits eeg responses in two distinct cortical networks depending on attention and flicker frequency. J Vis 6(6):515. https:\/\/doi.org\/10.1167\/6.6.515","journal-title":"J Vis"},{"key":"231_CR28","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2019.116146","volume":"203","author":"R Gulbinaite","year":"2019","unstructured":"Gulbinaite R, Roozendaal DH, VanRullen R (2019) Attention differentially modulates the amplitude of resonance frequencies in the visual cortex. NeuroImage 203:116146. https:\/\/doi.org\/10.1016\/j.neuroimage.2019.116146","journal-title":"NeuroImage"},{"issue":"1","key":"231_CR29","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1146\/annurev-vision-082114-035447","volume":"1","author":"N Kriegeskorte","year":"2015","unstructured":"Kriegeskorte N (2015) Deep neural networks: a new framework for modeling biological vision and brain information processing. Ann Rev Vis Sci 1(1):417\u2013446","journal-title":"Ann Rev Vis Sci"},{"issue":"1","key":"231_CR30","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1038\/s41583-020-00395-8","volume":"22","author":"A Saxe","year":"2020","unstructured":"Saxe A, Nelli S, Summerfield C (2020) If deep learning is the answer, what is the question? Nat Rev Neurosci 22(1):55\u201367. https:\/\/doi.org\/10.1038\/s41583-020-00395-8","journal-title":"Nat Rev Neurosci"},{"issue":"4","key":"231_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pcbi.1006897","volume":"15","author":"SA Cadena","year":"2019","unstructured":"Cadena SA, Denfield GH, Walker EY et al (2019) Deep convolutional models improve predictions of macaque v1 responses to natural images. PLOS Comput Biol 15(4):1\u201327. https:\/\/doi.org\/10.1371\/journal.pcbi.1006897","journal-title":"PLOS Comput Biol"},{"key":"231_CR32","doi-asserted-by":"publisher","DOI":"10.1007\/s10827-021-00778-5","author":"N Matsumoto","year":"2021","unstructured":"Matsumoto N, Ichi Mototake Y, Kawano K et al (2021) Comparison of neuronal responses in primate inferior temporal cortex and feed forward deep neural network model with regard to information processing of faces. J Comput Neurosci. https:\/\/doi.org\/10.1007\/s10827-021-00778-5","journal-title":"J Comput Neurosci"},{"issue":"23","key":"231_CR33","doi-asserted-by":"publisher","first-page":"8619","DOI":"10.1073\/pnas.1403112111","volume":"111","author":"DLK Yamins","year":"2014","unstructured":"Yamins DLK, Hong H, Cadieu CF et al (2014) Performance-optimized hierarchical models predict neural responses in higher visual cortex. PNAS 111(23):8619\u20138624. https:\/\/doi.org\/10.1073\/pnas.1403112111","journal-title":"PNAS"},{"key":"231_CR34","doi-asserted-by":"publisher","first-page":"184","DOI":"10.1016\/j.jmp.2016.10.007","volume":"76","author":"SM Khaligh-Razavi","year":"2017","unstructured":"Khaligh-Razavi SM, Henriksson L, Kay K et al (2017) Fixed versus mixed RSA: explaining visual representations by fixed and mixed feature sets from shallow and deep computational models. J Math Psychol 76:184\u2013197. https:\/\/doi.org\/10.1016\/j.jmp.2016.10.007","journal-title":"J Math Psychol"},{"issue":"2","key":"231_CR35","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1080\/00223980.1964.9916753","volume":"58","author":"TM Nelson","year":"1964","unstructured":"Nelson TM, Bartley SH, Harper ES (1964) Cff for short trains of photic stimulation having various temporal distributions and separations. J Psychol 58(2):333\u2013341. https:\/\/doi.org\/10.1080\/00223980.1964.9916753","journal-title":"J Psychol"},{"key":"231_CR36","volume-title":"Hands-on machine learning with scikit-learn, keras, and tensorflow: concepts, tools, and techniques to build intelligent systems","author":"A Geron","year":"2019","unstructured":"Geron A (2019) Hands-on machine learning with scikit-learn, keras, and tensorflow: concepts, tools, and techniques to build intelligent systems, 2nd edn. O\u2019Reilly Media Inc., Sebastopol","edition":"2"},{"key":"231_CR37","doi-asserted-by":"publisher","first-page":"5623","DOI":"10.1109\/access.2017.2688467","volume":"5","author":"Y Yang","year":"2017","unstructured":"Yang Y (2017) A signal theoretic approach for envelope analysis of real-valued signals. IEEE Access 5:5623\u20135630. https:\/\/doi.org\/10.1109\/access.2017.2688467","journal-title":"IEEE Access"},{"issue":"4","key":"231_CR38","doi-asserted-by":"publisher","first-page":"656","DOI":"10.1016\/j.neuron.2020.05.030","volume":"107","author":"F Soto","year":"2020","unstructured":"Soto F, Hsiang JC, Rajagopal R et al (2020) Efficient coding by midget and parasol ganglion cells in the human retina. Neuron 107(4):656-666.e5. https:\/\/doi.org\/10.1016\/j.neuron.2020.05.030","journal-title":"Neuron"},{"key":"231_CR39","volume-title":"Digital systems: principles and applications","author":"RJ Tocci","year":"2007","unstructured":"Tocci RJ, Widmer NS, Moss GL (2007) Digital systems: principles and applications. Pearson Education, London"},{"issue":"03","key":"231_CR40","doi-asserted-by":"publisher","first-page":"1850050","DOI":"10.1142\/s0129065718500508","volume":"29","author":"M Labecki","year":"2019","unstructured":"Labecki M, Nowicka MM, Suffczynski P (2019) Temporal modulation of steady-state visual evoked potentials. Int J Neural Syst 29(03):1850050. https:\/\/doi.org\/10.1142\/s0129065718500508","journal-title":"Int J Neural Syst"},{"key":"231_CR41","doi-asserted-by":"publisher","DOI":"10.1016\/j.sctalk.2023.100180","volume":"6","author":"KS Chandran","year":"2023","unstructured":"Chandran KS, Ghosh K (2023) A device for mass generation of psychophysics data to train and test models of flicker fusion. Sci Talks 6:100180. https:\/\/doi.org\/10.1016\/j.sctalk.2023.100180","journal-title":"Sci Talks"}],"container-title":["Brain Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40708-024-00231-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40708-024-00231-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40708-024-00231-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,10]],"date-time":"2024-07-10T16:04:52Z","timestamp":1720627492000},"score":1,"resource":{"primary":{"URL":"https:\/\/braininformatics.springeropen.com\/articles\/10.1186\/s40708-024-00231-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,10]]},"references-count":41,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,12]]}},"alternative-id":["231"],"URL":"https:\/\/doi.org\/10.1186\/s40708-024-00231-0","relation":{},"ISSN":["2198-4018","2198-4026"],"issn-type":[{"value":"2198-4018","type":"print"},{"value":"2198-4026","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,10]]},"assertion":[{"value":"30 November 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 June 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 July 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no Competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"18"}}