{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"institution":[{"name":"bioRxiv"}],"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T19:04:44Z","timestamp":1790795084413,"version":"4.1.0"},"posted":{"date-parts":[[2023,8,14]]},"group-title":"Neuroscience","reference-count":81,"publisher":"openRxiv","license":[{"start":{"date-parts":[[2023,8,14]],"date-time":"2023-08-14T00:00:00Z","timestamp":1691971200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2024,8,26]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                <jats:p>Fixational eye movements alter the number and timing of spikes transmitted from the retina to the brain, but whether these changes enhance or degrade the retinal signal is unclear. To quantify this, we developed a Bayesian method for reconstructing natural images from the recorded spikes of hundreds of retinal ganglion cells (RGCs) in the macaque retina (male), combining a likelihood model for RGC light responses with the natural image prior implicitly embedded in an artificial neural network optimized for denoising. The method matched or surpassed the performance of previous reconstruction algorithms, and provides an interpretable framework for characterizing the retinal signal. Reconstructions were improved with artificial stimulus jitter that emulated fixational eye movements, even when the eye movement trajectory was assumed to be unknown and had to be inferred from retinal spikes. Reconstructions were degraded by small artificial perturbations of spike times, revealing more precise temporal encoding than suggested by previous studies. Finally, reconstructions were substantially degraded when derived from a model that ignored cell-to-cell interactions, indicating the importance of stimulusevoked correlations. Thus, fixational eye movements enhance the precision of the retinal representation.<\/jats:p>","DOI":"10.1101\/2023.08.12.552902","type":"posted-content","created":{"date-parts":[[2023,8,14]],"date-time":"2023-08-14T20:55:16Z","timestamp":1692046516000},"source":"Crossref","is-referenced-by-count":7,"title":["Fixational Eye Movements Enhance the Precision of Visual Information Transmitted by the Primate Retina"],"prefix":"10.64898","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8315-3288","authenticated-orcid":false,"given":"Eric G.","family":"Wu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0308-1382","authenticated-orcid":false,"given":"Nora","family":"Brackbill","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Colleen","family":"Rhoades","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5718-9313","authenticated-orcid":false,"given":"Alexandra","family":"Kling","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4262-9395","authenticated-orcid":false,"given":"Alex R.","family":"Gogliettino","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1275-0381","authenticated-orcid":false,"given":"Nishal P.","family":"Shah","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6655-6456","authenticated-orcid":false,"given":"Alexander","family":"Sher","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3973-3642","authenticated-orcid":false,"given":"Alan M.","family":"Litke","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1206-527X","authenticated-orcid":false,"given":"Eero P.","family":"Simoncelli","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5613-0248","authenticated-orcid":false,"given":"E.J.","family":"Chichilnisky","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"54368","reference":[{"key":"2024082814251441000_2023.08.12.552902v4.1","doi-asserted-by":"publisher","DOI":"10.1152\/jn.1997.78.5.2336"},{"key":"2024082814251441000_2023.08.12.552902v4.2","doi-asserted-by":"crossref","first-page":"1719","DOI":"10.1162\/neco_a_01395","article-title":"Nonlinear Decoding of Natural Images From LargeScale Primate Retinal Ganglion Recordings","volume":"33","year":"2021","journal-title":"Neural Computation"},{"key":"2024082814251441000_2023.08.12.552902v4.3","doi-asserted-by":"crossref","first-page":"e58516","DOI":"10.7554\/eLife.58516","article-title":"Reconstruction of natural images from responses of primate retinal ganglion cells","volume":"9","year":"2020","journal-title":"eLife"},{"key":"2024082814251441000_2023.08.12.552902v4.4","unstructured":"Rieke, F. , Warland, D. , de Ruyter van Steveninck, R. & Bialek, W. Spikes: Exploring the Neural Code (MIT Press, Cambridge, MA, USA, 1999)."},{"key":"2024082814251441000_2023.08.12.552902v4.5","doi-asserted-by":"publisher","DOI":"10.1038\/nature07140"},{"key":"2024082814251441000_2023.08.12.552902v4.6","unstructured":"Zhang, K. et al. Plug-and-Play Image Restoration with Deep Denoiser Prior. IEEE Transactions on Pattern Analysis and Machine Intelligence 1\u20131 (2021). URL https:\/\/ieeexplore.ieee.org\/document\/9454311\/."},{"key":"2024082814251441000_2023.08.12.552902v4.7","doi-asserted-by":"publisher","DOI":"10.1109\/TNS.2004.832706"},{"key":"2024082814251441000_2023.08.12.552902v4.8","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.neuro.30.051606.094252"},{"key":"2024082814251441000_2023.08.12.552902v4.9","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.3437-07.2007"},{"key":"2024082814251441000_2023.08.12.552902v4.10","doi-asserted-by":"crossref","first-page":"658","DOI":"10.1016\/j.neuron.2019.05.036","article-title":"Unusual Physiological Properties of Smooth Monostratified Ganglion Cell Types in Primate Retina","volume":"103","year":"2019","journal-title":"Neuron"},{"key":"2024082814251441000_2023.08.12.552902v4.11","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"ImageNet Large Scale Visual Recognition Challenge","volume":"115","year":"2015","journal-title":"International Journal of Computer Vision"},{"key":"2024082814251441000_2023.08.12.552902v4.12","doi-asserted-by":"publisher","DOI":"10.1167\/9.8.1037"},{"key":"2024082814251441000_2023.08.12.552902v4.13","first-page":"27212","volume-title":"Advances in Neural Information Processing Systems","volume":"35","year":"2022"},{"key":"2024082814251441000_2023.08.12.552902v4.14","unstructured":"Sohl-Dickstein, J. , Weiss, E. , Maheswaranathan, N. & Ganguli, S. Bach, F. & Blei, D. (eds) Deep unsupervised learning using nonequilibrium thermodynamics. (eds Bach, F. & Blei, D. ) Proceedings of the 32nd International Conference on Machine Learning, Vol. 37 of Proceedings of Machine Learning Research, 2256\u20132265 (PMLR, Lille, France, 2015). URL https:\/\/proceedings.mlr.press\/v37\/sohl-dickstein15.html."},{"key":"2024082814251441000_2023.08.12.552902v4.15","unstructured":"Song, Y. & Ermon, S. Wallach, H. et al. (eds) Generative modeling by estimating gradients of the data distribution. (eds Wallach, H. et al. ) Advances in Neural Information Processing Systems, Vol. 32 (Curran Associates, Inc., 2019). URL https:\/\/proceedings.neurips.cc\/paperfiles\/paper\/2019\/file\/3001ef257407d5a371a96dcd947c7d93-Paper.pdf."},{"key":"2024082814251441000_2023.08.12.552902v4.16","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2006.11239"},{"key":"2024082814251441000_2023.08.12.552902v4.17","first-page":"13242","volume-title":"Advances in Neural Information Processing Systems","volume":"34","year":"2021"},{"key":"2024082814251441000_2023.08.12.552902v4.18","first-page":"18152","volume-title":"Advances in Neural Information Processing Systems","volume":"34","year":"2021"},{"key":"2024082814251441000_2023.08.12.552902v4.19","first-page":"21757","volume-title":"Advances in Neural Information Processing Systems","volume":"34","year":"2021"},{"key":"2024082814251441000_2023.08.12.552902v4.20","doi-asserted-by":"crossref","unstructured":"Venkatakrishnan, S. V. , Bouman, C. A. & Wohlberg, B. Plug-and-play priors for model based reconstruction, 945\u2013948 (2013).","DOI":"10.1109\/GlobalSIP.2013.6737048"},{"key":"2024082814251441000_2023.08.12.552902v4.21","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2003.819861"},{"key":"2024082814251441000_2023.08.12.552902v4.22","doi-asserted-by":"publisher","DOI":"10.1038\/nature05866"},{"key":"2024082814251441000_2023.08.12.552902v4.23","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2012.01.050"},{"key":"2024082814251441000_2023.08.12.552902v4.24","doi-asserted-by":"publisher","DOI":"10.1167\/17.12.15"},{"key":"2024082814251441000_2023.08.12.552902v4.25","doi-asserted-by":"crossref","unstructured":"Ratnam, K. , Domdei, N. , Harmening, W. M. & Roorda, A. Benefits of retinal image motion at the limits of spatial vision. Journal of Vision 11 (2017).","DOI":"10.1167\/17.1.30"},{"key":"2024082814251441000_2023.08.12.552902v4.26","doi-asserted-by":"crossref","first-page":"795","DOI":"10.1038\/s41467-020-14616-2","article-title":"Finely tuned eye movements enhance visual acuity","volume":"11","year":"2020","journal-title":"Nature Communications"},{"key":"2024082814251441000_2023.08.12.552902v4.27","doi-asserted-by":"publisher","DOI":"10.1167\/jov.20.7.34"},{"key":"2024082814251441000_2023.08.12.552902v4.28","doi-asserted-by":"publisher","DOI":"10.1038\/27435"},{"key":"2024082814251441000_2023.08.12.552902v4.29","doi-asserted-by":"publisher","DOI":"10.1167\/8.6.14"},{"key":"2024082814251441000_2023.08.12.552902v4.30","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1925-10.2010"},{"key":"2024082814251441000_2023.08.12.552902v4.31","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1038\/s41467-023-35834-4","article-title":"Inferring visual space from ultra-fine extra-retinal knowledge of gaze position","volume":"14","year":"2023","journal-title":"Nature Communications"},{"key":"2024082814251441000_2023.08.12.552902v4.32","doi-asserted-by":"publisher","DOI":"10.1016\/0042-6989(92)90052-K"},{"key":"2024082814251441000_2023.08.12.552902v4.33","doi-asserted-by":"publisher","DOI":"10.1016\/j.tins.2015.01.005"},{"key":"2024082814251441000_2023.08.12.552902v4.34","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.0050331"},{"key":"2024082814251441000_2023.08.12.552902v4.35","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1006076107"},{"key":"2024082814251441000_2023.08.12.552902v4.36","doi-asserted-by":"crossref","unstructured":"Ahissar, E. & Arieli, A. Seeing via Miniature Eye Movements: A Dynamic Hypothesis for Vision. Frontiers in Computational Neuroscience 6 (2012). URL http:\/\/journal.frontiersin.org\/article\/10.3389\/fncom.2012.00089\/abstract.","DOI":"10.3389\/fncom.2012.00089"},{"key":"2024082814251441000_2023.08.12.552902v4.37","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1146\/annurev-vision-082114-035742","article-title":"Control and Functions of Fixational Eye Movements","volume":"1","year":"2015","journal-title":"Annual Review of Vision Science"},{"key":"2024082814251441000_2023.08.12.552902v4.38","first-page":"586","year":"2018","journal-title":"The Unreasonable Effectiveness of Deep Features as a Perceptual Metric"},{"key":"2024082814251441000_2023.08.12.552902v4.39","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.5294-08.2009"},{"key":"2024082814251441000_2023.08.12.552902v4.40","doi-asserted-by":"publisher","DOI":"10.1002\/cne.902880113"},{"key":"2024082814251441000_2023.08.12.552902v4.41","doi-asserted-by":"publisher","DOI":"10.1038\/nn821"},{"key":"2024082814251441000_2023.08.12.552902v4.42","doi-asserted-by":"crossref","first-page":"4605","DOI":"10.1038\/s41467-020-18436-2","article-title":"Ignoring correlated activity causes a failure of retinal population codes","volume":"11","year":"2020","journal-title":"Nature Communications"},{"key":"2024082814251441000_2023.08.12.552902v4.43","doi-asserted-by":"publisher","DOI":"10.1038\/35079612"},{"key":"2024082814251441000_2023.08.12.552902v4.44","doi-asserted-by":"publisher","DOI":"10.1016\/j.visres.2012.07.007"},{"key":"2024082814251441000_2023.08.12.552902v4.45","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.23-37-11539.2003"},{"key":"2024082814251441000_2023.08.12.552902v4.46","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X00068229"},{"key":"2024082814251441000_2023.08.12.552902v4.47","doi-asserted-by":"publisher","DOI":"10.1038\/nn.2199"},{"key":"2024082814251441000_2023.08.12.552902v4.48","doi-asserted-by":"publisher","DOI":"10.1007\/s10827-011-0376-2"},{"key":"2024082814251441000_2023.08.12.552902v4.49","doi-asserted-by":"publisher","DOI":"10.1037\/h0061885"},{"key":"2024082814251441000_2023.08.12.552902v4.50","doi-asserted-by":"publisher","DOI":"10.1167\/13.1.22"},{"key":"2024082814251441000_2023.08.12.552902v4.51","doi-asserted-by":"crossref","first-page":"1268","DOI":"10.1016\/j.cub.2017.03.034","article-title":"Consequences of the Oculomotor Cycle for the Dynamics of Perception","volume":"27","year":"2017","journal-title":"Current Biology"},{"key":"2024082814251441000_2023.08.12.552902v4.52","doi-asserted-by":"crossref","first-page":"e47148","DOI":"10.7554\/eLife.47148","article-title":"Human foveal cone photoreceptor topography and its dependence on eye length","volume":"8","year":"2019","journal-title":"eLife"},{"key":"2024082814251441000_2023.08.12.552902v4.53","doi-asserted-by":"crossref","first-page":"12958","DOI":"10.1038\/s41598-017-13489-8","article-title":"A self-avoiding walk with neural delays as a model of fixational eye movements","volume":"7","year":"2017","journal-title":"Scientific Reports"},{"key":"2024082814251441000_2023.08.12.552902v4.54","doi-asserted-by":"crossref","first-page":"1697","DOI":"10.1038\/s41467-022-29201-y","article-title":"Fixational drift is driven by diffusive dynamics in central neural circuitry","volume":"13","year":"2022","journal-title":"Nature Communications"},{"key":"2024082814251441000_2023.08.12.552902v4.55","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2020.07.085"},{"key":"2024082814251441000_2023.08.12.552902v4.56","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.94.10.5411"},{"key":"2024082814251441000_2023.08.12.552902v4.57","doi-asserted-by":"publisher","DOI":"10.1152\/jn.1997.77.5.2836"},{"key":"2024082814251441000_2023.08.12.552902v4.58","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(01)00322-1"},{"key":"2024082814251441000_2023.08.12.552902v4.59","doi-asserted-by":"publisher","DOI":"10.1152\/jn.01171.2003"},{"key":"2024082814251441000_2023.08.12.552902v4.60","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.23-17-06681.2003"},{"key":"2024082814251441000_2023.08.12.552902v4.61","doi-asserted-by":"publisher","DOI":"10.1152\/jn.01175.2004"},{"key":"2024082814251441000_2023.08.12.552902v4.62","doi-asserted-by":"publisher","DOI":"10.1167\/8.6.4"},{"key":"2024082814251441000_2023.08.12.552902v4.63","doi-asserted-by":"crossref","first-page":"1280","DOI":"10.1038\/s41593-021-00899-1","article-title":"Predictive encoding of motion begins in the primate retina","volume":"24","year":"2021","journal-title":"Nature Neuroscience"},{"key":"2024082814251441000_2023.08.12.552902v4.64","doi-asserted-by":"crossref","first-page":"e1006057","DOI":"10.1371\/journal.pcbi.1006057","article-title":"Nonlinear decoding of a complex movie from the mammalian retina","volume":"14","year":"2018","journal-title":"PLOS Computational Biology"},{"key":"2024082814251441000_2023.08.12.552902v4.65","doi-asserted-by":"crossref","unstructured":"Heitman, A. et al. Testing pseudo-linear models of responses to natural scenes in primate retina. preprint, Neuroscience (2016). URL http:\/\/biorxiv.org\/lookup\/doi\/10.1101\/045336.","DOI":"10.1101\/045336"},{"key":"2024082814251441000_2023.08.12.552902v4.66","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.05241"},{"key":"2024082814251441000_2023.08.12.552902v4.67","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1038\/s41467-017-00156-9","article-title":"Inference of neuronal functional circuitry with spike-triggered non-negative matrix factorization","volume":"8","year":"2017","journal-title":"Nature Communications"},{"key":"2024082814251441000_2023.08.12.552902v4.68","doi-asserted-by":"crossref","first-page":"e45743","DOI":"10.7554\/eLife.45743","article-title":"Inference of nonlinear receptive field subunits with spike-triggered clustering","volume":"9","year":"2020","journal-title":"eLife"},{"key":"2024082814251441000_2023.08.12.552902v4.69","unstructured":"McIntosh, L. , Maheswaranathan, N. , Nayebi, A. , Ganguli, S. & Baccus, S. Lee, D. , Sugiyama, M. , Luxburg, U. , Guyon, I. & Garnett, R. (eds) Deep learning models of the retinal response to natural scenes. (eds Lee, D. , Sugiyama, M. , Luxburg, U. , Guyon, I. & Garnett, R. ) Advances in Neural Information Processing Systems, Vol. 29 (Curran Associates, Inc., 2016). URL https:\/\/proceedings.neurips.cc\/paperfiles\/paper\/2016\/file\/a1d33d0dfec820b41b54430b50e96b5c-Paper.pdf."},{"key":"2024082814251441000_2023.08.12.552902v4.70","year":"2023","journal-title":"Diffusion Posterior Sampling for General Noisy Inverse Problems"},{"key":"2024082814251441000_2023.08.12.552902v4.71","year":"2023","journal-title":"Denoising Diffusion Models for Plug-and-Play Image Restoration"},{"key":"2024082814251441000_2023.08.12.552902v4.72","doi-asserted-by":"publisher","DOI":"10.1038\/nature09424"},{"key":"2024082814251441000_2023.08.12.552902v4.73","doi-asserted-by":"crossref","unstructured":"Lee, J. et al. YASS: Yet Another Spike Sorter applied to large-scale multi-electrode array recordings in primate retina. preprint, Neuroscience (2020). URL http:\/\/biorxiv.org\/lookup\/doi\/10.1101\/2020.03.18.997924.","DOI":"10.1101\/2020.03.18.997924"},{"key":"2024082814251441000_2023.08.12.552902v4.74","doi-asserted-by":"publisher","DOI":"10.1038\/nn.2353"},{"key":"2024082814251441000_2023.08.12.552902v4.75","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1080\/713663221","article-title":"A simple white noise analysis of neuronal light responses","volume":"12","year":"2001","journal-title":"Network: Computation in Neural Systems"},{"key":"2024082814251441000_2023.08.12.552902v4.76","doi-asserted-by":"crossref","unstructured":"Huang, Z. , Ran, Y. , Oesterle, J. , Euler, T. & Berens, P. Estimating smooth and sparse neural receptive fields with a flexible spline basis. Neurons, Behavior, Data analysis, and Theory 5 (2021). URL https:\/\/nbdt.scholasticahq.com\/article\/27578-estimating-smooth-and-sparse-neural-receptive-fields-with-a-flexible-spline-basis.","DOI":"10.51628\/001c.27578"},{"key":"2024082814251441000_2023.08.12.552902v4.77","doi-asserted-by":"publisher","DOI":"10.1137\/080716542"},{"key":"2024082814251441000_2023.08.12.552902v4.78","unstructured":"Liu, J. , Ji, S. & Ye, J. Multi-Task Feature Learning Via Efficient 2,1-Norm Minimization, 10 (2009)."},{"key":"2024082814251441000_2023.08.12.552902v4.79","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1109\/TCI.2019.2914773","article-title":"Image Restoration and Reconstruction using Targeted Plug-and-Play Priors","volume":"5","year":"2019","journal-title":"IEEE Transactions on Computational Imaging"},{"key":"2024082814251441000_2023.08.12.552902v4.80","doi-asserted-by":"publisher","DOI":"10.2307\/2669847"},{"key":"2024082814251441000_2023.08.12.552902v4.81","doi-asserted-by":"publisher","DOI":"10.1016\/S0006-3495(67)86596-2"}],"container-title":[],"original-title":[],"link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1101\/2023.08.12.552902","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T05:04:26Z","timestamp":1768453466000},"score":1,"resource":{"primary":{"URL":"http:\/\/biorxiv.org\/lookup\/doi\/10.1101\/2023.08.12.552902"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,14]]},"references-count":81,"URL":"https:\/\/doi.org\/10.1101\/2023.08.12.552902","relation":{"is-preprint-of":[{"id-type":"doi","id":"10.1038\/s41467-024-52304-7","asserted-by":"subject"}]},"subject":[],"published":{"date-parts":[[2023,8,14]]},"subtype":"preprint"}}