{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"institution":[{"name":"bioRxiv"}],"indexed":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T03:49:17Z","timestamp":1777002557092,"version":"3.51.4"},"posted":{"date-parts":[[2024,9,27]]},"group-title":"Neuroscience","reference-count":53,"publisher":"openRxiv","license":[{"start":{"date-parts":[[2024,9,27]],"date-time":"2024-09-27T00:00:00Z","timestamp":1727395200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nd\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2024,10,23]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                <jats:p>Sensory systems discriminate between stimuli to direct behavioral choices, a process governed by two distinct properties - neural sensitivity to specific stimuli, and neural variability that importantly includes correlations between neurons. Two questions that have received extensive investigation and debate are whether visual systems are optimized for natural scenes, and whether correlated neural variability contributes to this optimization. However, the lack of sufficient computational models has made these questions inaccessible in the context of the normal function of the visual system, which is to discriminate between natural stimuli. Here we take a direct approach to analyze discriminability under natural scenes for a population of salamander retinal ganglion cells using a model of the retinal neural code that captures both sensitivity and variability. Using methods of information geometry and generative machine learning, we analyzed the manifolds of natural stimuli and neural responses, finding that discriminability in the ganglion cell population adapts to enhance information transmission about natural scenes, in particular about localized motion. Contrary to previous proposals, correlated noise reduces information transmission and arises simply as a natural consequence of the shared circuitry that generates changing spatiotemporal visual sensitivity. These results address a long-standing debate as to the role of retinal correlations in the encoding of natural stimuli and reveal how the highly nonlinear receptive fields of the retina adapt dynamically to increase information transmission under natural scenes by performing the important ethological function of local motion discrimination.<\/jats:p>","DOI":"10.1101\/2024.09.26.615305","type":"posted-content","created":{"date-parts":[[2024,9,27]],"date-time":"2024-09-27T18:55:19Z","timestamp":1727463319000},"source":"Crossref","is-referenced-by-count":1,"title":["Adaptation of retinal discriminability to natural scenes"],"prefix":"10.64898","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4676-878X","authenticated-orcid":false,"given":"Xuehao","family":"Ding","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dongsoo","family":"Lee","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joshua B.","family":"Melander","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Surya","family":"Ganguli","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stephen A.","family":"Baccus","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"54368","reference":[{"key":"2024102514301165000_2024.09.26.615305v2.1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.neuro.24.1.1193"},{"key":"2024102514301165000_2024.09.26.615305v2.2","doi-asserted-by":"publisher","DOI":"10.1515\/ZNC-1981-9-1040"},{"key":"2024102514301165000_2024.09.26.615305v2.3","doi-asserted-by":"publisher","DOI":"10.1038\/381607a0"},{"key":"2024102514301165000_2024.09.26.615305v2.4","doi-asserted-by":"publisher","DOI":"10.1126\/science.287.5456.1273"},{"key":"2024102514301165000_2024.09.26.615305v2.5","doi-asserted-by":"publisher","DOI":"10.1016\/0042-6989(93)90163-Q"},{"key":"2024102514301165000_2024.09.26.615305v2.6","doi-asserted-by":"publisher","DOI":"10.1038\/nn.3064"},{"key":"2024102514301165000_2024.09.26.615305v2.7","doi-asserted-by":"publisher","DOI":"10.1038\/nn831"},{"key":"2024102514301165000_2024.09.26.615305v2.8","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.4036-12.2012"},{"key":"2024102514301165000_2024.09.26.615305v2.9","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.16-10-03351.1996"},{"key":"2024102514301165000_2024.09.26.615305v2.10","doi-asserted-by":"publisher","DOI":"10.1098\/rspb.1995.0204"},{"key":"2024102514301165000_2024.09.26.615305v2.11","doi-asserted-by":"publisher","DOI":"10.1068\/p3015"},{"key":"2024102514301165000_2024.09.26.615305v2.12","doi-asserted-by":"publisher","DOI":"10.1016\/S0960-9822(99)00262-6"},{"key":"2024102514301165000_2024.09.26.615305v2.13","doi-asserted-by":"publisher","DOI":"10.1167\/18.13.20"},{"key":"2024102514301165000_2024.09.26.615305v2.14","doi-asserted-by":"publisher","DOI":"10.1038\/nrn1888"},{"key":"2024102514301165000_2024.09.26.615305v2.15","unstructured":"Lane McIntosh , Niru Maheswaranathan , Aran Nayebi , Surya Ganguli , and Stephen Baccus . Deep learning models of the retinal response to natural scenes. Advances in neural information processing systems, 29, 2016."},{"key":"2024102514301165000_2024.09.26.615305v2.16","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2023.06.007"},{"key":"2024102514301165000_2024.09.26.615305v2.17","unstructured":"Hidenori Tanaka , Aran Nayebi , Niru Maheswaranathan , Lane McIntosh , Stephen Baccus , and Surya Ganguli . From deep learning to mechanistic understanding in neuroscience: the structure of retinal prediction. Advances in neural information processing systems, 32, 2019."},{"key":"2024102514301165000_2024.09.26.615305v2.18","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0020409"},{"key":"2024102514301165000_2024.09.26.615305v2.19","doi-asserted-by":"crossref","unstructured":"Xuehao Ding , Dongsoo Lee , Joshua Melander , George Sivulka , Surya Ganguli , and Stephen Baccus . Information geometry of the retinal representation manifold. Advances in Neural Information Processing Systems, 36, 2024.","DOI":"10.1101\/2023.05.17.541206"},{"key":"2024102514301165000_2024.09.26.615305v2.20","doi-asserted-by":"publisher","DOI":"10.1038\/s41583021005023"},{"key":"2024102514301165000_2024.09.26.615305v2.21","doi-asserted-by":"crossref","unstructured":"Shun-ichi Amari . Information geometry and its applications, volume 194. Springer, 2016.","DOI":"10.1007\/978-4-431-55978-8"},{"issue":"6","key":"2024102514301165000_2024.09.26.615305v2.22","doi-asserted-by":"crossref","first-page":"064406","DOI":"10.1103\/PhysRevE.106.064406","article-title":"Minimum perturbation theory of deep perceptual learning","volume":"106","year":"2022","journal-title":"Physical Review E"},{"key":"2024102514301165000_2024.09.26.615305v2.23","doi-asserted-by":"publisher","DOI":"10.1023\/A:1026553619983"},{"key":"2024102514301165000_2024.09.26.615305v2.24","doi-asserted-by":"crossref","unstructured":"Jun-Yan Zhu , Philipp Kr\u00e4henb\u00fchl , Eli Shechtman , and Alexei A Efros . Generative visual manipulation on the natural image manifold. In Computer Vision\u2013ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part V 14, pages 597\u2013613. Springer, 2016.","DOI":"10.1007\/978-3-319-46454-1_36"},{"key":"2024102514301165000_2024.09.26.615305v2.25","doi-asserted-by":"crossref","unstructured":"Xingang Pan , Ayush Tewari , Thomas Leimk\u00fchler , Lingjie Liu , Abhimitra Meka , and Christian Theobalt . Drag your gan: Interactive point-based manipulation on the generative image manifold. In ACM SIGGRAPH 2023 Conference Proceedings, pages 1\u201311, 2023.","DOI":"10.1145\/3588432.3591500"},{"key":"2024102514301165000_2024.09.26.615305v2.26","unstructured":"Jingyang Zhou , Lyndon R Duong , and Eero P Simoncelli . A common framework for discriminability and perceived intensity of sensory stimuli. bioRxiv, pages 2022\u201304, 2022."},{"key":"2024102514301165000_2024.09.26.615305v2.27","doi-asserted-by":"publisher","DOI":"10.1111\/j.1475-1313.1992.tb00296.x"},{"key":"2024102514301165000_2024.09.26.615305v2.28","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.73.814"},{"key":"2024102514301165000_2024.09.26.615305v2.29","doi-asserted-by":"publisher","DOI":"10.1007\/BF00056772"},{"key":"2024102514301165000_2024.09.26.615305v2.30","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2002.1031944"},{"issue":"4","key":"2024102514301165000_2024.09.26.615305v2.31","first-page":"1","article-title":"Phase-based video motion processing","volume":"32","year":"2013","journal-title":"ACM Transactions on Graphics (ToG)"},{"key":"2024102514301165000_2024.09.26.615305v2.32","unstructured":"Pierre-\u00c8 tienne Fiquet and Eero Simoncelli . A polar prediction model for learning to represent visual transformations. Advances in Neural Information Processing Systems, 36, 2024."},{"key":"2024102514301165000_2024.09.26.615305v2.33","doi-asserted-by":"publisher","DOI":"10.1038\/nature01652"},{"key":"2024102514301165000_2024.09.26.615305v2.34","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1508738112"},{"key":"2024102514301165000_2024.09.26.615305v2.35","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-neuro-120320-082744"},{"key":"2024102514301165000_2024.09.26.615305v2.36","doi-asserted-by":"publisher","DOI":"10.1038\/nature09570"},{"key":"2024102514301165000_2024.09.26.615305v2.37","doi-asserted-by":"publisher","DOI":"10.1038\/nn.3807"},{"key":"2024102514301165000_2024.09.26.615305v2.38","doi-asserted-by":"publisher","DOI":"10.1038\/S41586-020-2130-2"},{"key":"2024102514301165000_2024.09.26.615305v2.39","doi-asserted-by":"publisher","DOI":"10.1038\/nature04701"},{"key":"2024102514301165000_2024.09.26.615305v2.40","unstructured":"Ian Goodfellow , Jean Pouget-Abadie , Mehdi Mirza , Bing Xu , David Warde-Farley , Sherjil Ozair , Aaron Courville , and Yoshua Bengio . Generative adversarial nets. Advances in neural information processing systems, 27, 2014."},{"key":"2024102514301165000_2024.09.26.615305v2.41","unstructured":"Olivier J H\u00e8naff and Eero P Simoncelli . Geodesics of learned representations. In 4th International Conference on Learning Representations, ICLR 2016, 2016."},{"key":"2024102514301165000_2024.09.26.615305v2.42","doi-asserted-by":"publisher","DOI":"10.1163\/156856897X00357"},{"key":"2024102514301165000_2024.09.26.615305v2.43","doi-asserted-by":"publisher","DOI":"10.1163\/156856897X00366"},{"key":"2024102514301165000_2024.09.26.615305v2.44","doi-asserted-by":"publisher","DOI":"10.1038\/nn.2906"},{"key":"2024102514301165000_2024.09.26.615305v2.45","doi-asserted-by":"crossref","unstructured":"Xuehao Ding , Dongsoo Lee , Satchel Grant , Heike Stein , Lane McIntosh , Niru Maheswaranathan , and Stephen Baccus . A mechanistically interpretable model of the retinal neural code for natural scenes with multiscale adaptive dynamics. In 2021 55th Asilomar Conference on Signals, Systems, and Computers, pages 287\u2013291. IEEE, 2021.","DOI":"10.1109\/IEEECONF53345.2021.9723187"},{"key":"2024102514301165000_2024.09.26.615305v2.46","unstructured":"Jingyi Xu , Zilu Zhang , Tal Friedman , Yitao Liang , and Guy Broeck . A semantic loss function for deep learning with symbolic knowledge. In International conference on machine learning, pages 5502\u20135511. PMLR, 2018."},{"key":"2024102514301165000_2024.09.26.615305v2.47","article-title":"Adam: A method for stochastic optimization","year":"2014","journal-title":"arXiv preprint"},{"key":"2024102514301165000_2024.09.26.615305v2.48","first-page":"8026","article-title":"Pytorch: An imperative style, high-performance deep learning library","volume":"32","year":"2019","journal-title":"Advances in neural information processing systems"},{"key":"2024102514301165000_2024.09.26.615305v2.49","article-title":"Unsupervised representation learning with deep convolutional generative adversarial networks","year":"2015","journal-title":"arXiv preprint"},{"key":"2024102514301165000_2024.09.26.615305v2.50","unstructured":"Tim Salimans , Ian Goodfellow , Wojciech Zaremba , Vicki Cheung , Alec Radford , and Xi Chen . Improved techniques for training gans. Advances in neural information processing systems, 29, 2016."},{"key":"2024102514301165000_2024.09.26.615305v2.51","doi-asserted-by":"publisher","DOI":"10.1162\/NECO_a_00125"},{"key":"2024102514301165000_2024.09.26.615305v2.52","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1004218"},{"key":"2024102514301165000_2024.09.26.615305v2.53","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-neuro-070815-013851"}],"container-title":[],"original-title":[],"link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1101\/2024.09.26.615305","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T07:08:51Z","timestamp":1768460931000},"score":1,"resource":{"primary":{"URL":"http:\/\/biorxiv.org\/lookup\/doi\/10.1101\/2024.09.26.615305"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,27]]},"references-count":53,"URL":"https:\/\/doi.org\/10.1101\/2024.09.26.615305","relation":{},"subject":[],"published":{"date-parts":[[2024,9,27]]},"subtype":"preprint"}}