{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,21]],"date-time":"2026-10-21T18:40:54Z","timestamp":1792608054847,"version":"4.5.0"},"reference-count":61,"publisher":"American Association for the Advancement of Science (AAAS)","issue":"43","funder":[{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["101039524"],"award-info":[{"award-number":["101039524"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Schweizerischer Nationalfonds","award":["203018"],"award-info":[{"award-number":["203018"]}]}],"content-domain":{"domain":["www.science.org"],"crossmark-restriction":true},"short-container-title":["Sci. Adv."],"published-print":{"date-parts":[[2026,10,23]]},"abstract":"<jats:p>Natural scenes are complex arrangements of objects, surfaces, and backgrounds. For the brain\u2019s visual system to effectively operate, it needs to extract not only what objects are present but also their spatial and semantic relations. We hypothesize that such structures may be learned, in a self-supervised fashion, by exploiting temporal regularities of natural active vision: Each fixation reveals a glimpse that is related to the previous one via co-occurrence and saccade-conditioned spatial regularities. We instantiate this idea with glimpse prediction networks (GPNs), recurrent models trained to predict the embedding of the next glimpse along human-like scanpaths. GPNs are shown to successfully extract complex scene information, including object co-occurrences and spatial object arrangements, and integrate information across glimpses. GPN representations align strongly with human fMRI responses in mid- and higher-level visual cortex and match, often outperform, alternative state-of-the-art ANN models, establishing next-glimpse-prediction as a biologically plausible route toward brain-aligned scene representations.<\/jats:p>","DOI":"10.1126\/sciadv.aee1955","type":"journal-article","created":{"date-parts":[[2026,10,21]],"date-time":"2026-10-21T18:01:42Z","timestamp":1792605702000},"update-policy":"https:\/\/doi.org\/10.34133\/aaas_crossmark","source":"Crossref","is-referenced-by-count":0,"title":["Predicting upcoming visual features during eye movements yields scene representations aligned with human visual cortex"],"prefix":"10.1126","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2276-5621","authenticated-orcid":true,"given":"Sushrut","family":"Thorat","sequence":"first","affiliation":[{"name":"Institute of Cognitive Science, Osnabr\u00fcck University, Osnabr\u00fcck 49069, Germany."},{"name":"Lossfunk, Bengaluru 560038, India."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5120-9750","authenticated-orcid":true,"given":"Adrien","family":"Doerig","sequence":"additional","affiliation":[{"name":"Institute of Cognitive Science, Osnabr\u00fcck University, Osnabr\u00fcck 49069, Germany."},{"name":"Department of Education and Psychology, Freie Universit\u00e4t, Berlin 14195, Germany."},{"name":"Bernstein Center for Computational Neuroscience, Berlin 10115, Germany."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8139-0095","authenticated-orcid":true,"given":"Alexander","family":"Kroner","sequence":"additional","affiliation":[{"name":"Institute of Cognitive Science, Osnabr\u00fcck University, Osnabr\u00fcck 49069, Germany."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carmen","family":"Amme","sequence":"additional","affiliation":[{"name":"Institute of Cognitive Science, Osnabr\u00fcck University, Osnabr\u00fcck 49069, Germany."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8076-6062","authenticated-orcid":true,"given":"Tim C.","family":"Kietzmann","sequence":"additional","affiliation":[{"name":"Institute of Cognitive Science, Osnabr\u00fcck University, Osnabr\u00fcck 49069, Germany."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"221","reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41583-023-00705-w"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-019-0520-2"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1038\/nn.4244"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuropsychologia.2017.03.033"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-vision-091718-014809"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-023-00753-y"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-025-01072-0"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2023.08.007"},{"key":"e_1_3_2_10_2","doi-asserted-by":"crossref","unstructured":"C. Conwell E. McMahon A. Jagadeesh K. Vinken S. Sharma J. S. Prince G. A. Alvarez T. Konkle M. Livingstone L. Isik Monkey see model knew: Large language models accurately predict visual brain responses in humans and non-human primates. bioRxiv 641284 [Preprint] (2025). https:\/\/doi.org\/10.1101\/2025.03.05.641284.","DOI":"10.1101\/2025.03.05.641284"},{"key":"e_1_3_2_11_2","doi-asserted-by":"crossref","unstructured":"A. L. Yarbus \u201cEye movements during perception of complex objects \u201d in Eye Movements and Vision A. L. Yarbus Ed. (Springer 1967) pp. 171\u2013211.","DOI":"10.1007\/978-1-4899-5379-7_8"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2019.04.013"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.pneurobio.2019.101717"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog1402_1"},{"key":"e_1_3_2_15_2","unstructured":"A. van den Oord Y. Li O. Vinyals Representation learning with contrastive predictive coding. arXiv:1807.03748 [cs.LG] (2019)."},{"key":"e_1_3_2_16_2","doi-asserted-by":"crossref","unstructured":"S. Bakhtiari P. Mineault T. Lillicrap C. Pack B. Richards \u201cThe functional specialization of visual cortex emerges from training parallel pathways with self-supervised predictive learning \u201d in Advances in Neural Information Processing Systems (Curran Associates Inc. 2021) vol. 34 pp. 25164\u201325178.","DOI":"10.1101\/2021.06.18.448989"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1167\/jov.22.5.7"},{"key":"e_1_3_2_18_2","doi-asserted-by":"crossref","unstructured":"T.-Y. Lin M. Maire S. Belongie J. Hays P. Perona D. Ramanan P. Doll\u00e1r C. L. Zitnick \u201cMicrosoft COCO: Common Objects in Context \u201d in Computer Vision - ECCV 2014 D. Fleet T. Pajdla B. Schiele T. Tuytelaars Eds. (Springer International Publishing 2014) pp. 740\u2013755.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"e_1_3_2_19_2","unstructured":"T. B. Brown B. Mann N. Ryder M. Subbiah J. Kaplan P. Dhariwal A. Neelakantan P. Shyam G. Sastry A. Askell S. Agarwal A. Herbert-Voss G. Krueger T. Henighan R. Child A. Ramesh D. M. Ziegler J. Wu C. Winter C. Hesse M. Chen E. Sigler M. Litwin S. Gray B. Chess J. Clark C. Berner S. McCandlish A. Radford I. Sutskever D. Amodei \u201cLanguage models are few-shot learners \u201d in Advances in Neural Information Processing Systems (Curran Associates Inc. 2020) vol. 33 pp. 1877\u20131901."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-021-00962-x"},{"key":"e_1_3_2_21_2","first-page":"4","article-title":"Representational similarity analysis\u2014Connecting the branches of systems neuroscience","volume":"2","author":"Kriegeskorte N.","year":"2008","unstructured":"N. Kriegeskorte, M. Mur, P. A. Bandettini, Representational similarity analysis\u2014Connecting the branches of systems neuroscience. Front. Syst. Neurosci. 2, 4 (2008).","journal-title":"Front. Syst. Neurosci."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1038\/33402"},{"key":"e_1_3_2_23_2","doi-asserted-by":"crossref","unstructured":"M. Caron H. Touvron I. Misra H. J\u00e9gou J. Mairal P. Bojanowski A. Joulin \u201cEmerging Properties in Self-Supervised Vision Transformers \u201d in Proceedings of the IEEE\/CVF International Conference on Computer Vision (IEEE 2021) pp. 9650\u20139660.","DOI":"10.1109\/ICCV48922.2021.00951"},{"key":"e_1_3_2_24_2","doi-asserted-by":"crossref","unstructured":"M. Assran Q. Duval I. Misra P. Bojanowski P. Vincent M. Rabbat Y. LeCun N. Ballas \u201cSelf-supervised learning from images with a joint-embedding predictive architecture \u201d in Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (IEEE 2023) pp. 15619\u201315629.","DOI":"10.1109\/CVPR52729.2023.01499"},{"key":"e_1_3_2_25_2","doi-asserted-by":"crossref","unstructured":"K. He X. Chen S. Xie Y. Li P. Doll\u00e1r R. Girshick \u201cMasked autoencoders are scalable vision learners \u201d in Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (IEEE 2022) pp. 16000\u201316009.","DOI":"10.1109\/CVPR52688.2022.01553"},{"key":"e_1_3_2_26_2","unstructured":"A. Radford J. W. Kim C. Hallacy A. Ramesh G. Goh S. Agarwal G. Sastry A. Askell P. Mishkin J. Clark G. Krueger I. Sutskever \u201cLearning Transferable Visual Models From Natural Language Supervision \u201d in Proceedings of the 38th International Conference on Machine Learning (PMLR) vol. 139 of Proceedings of Machine Learning Research (PLMR 2021) pp. 8748\u20138763."},{"key":"e_1_3_2_27_2","unstructured":"M. Tschannen A. Gritsenko X. Wang M. F. Naeem I. Alabdulmohsin N. Parthasarathy T. Evans L. Beyer Y. Xia B. Mustafa O. H\u00e9naff J. Harmsen A. Steiner X. Zhai \u201cSigLIP 2: Multilingual vision-language encoders with improved semantic understanding localization and dense features. arXiv:2502.14786 [cs.CV] (2025)."},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-024-53147-y"},{"key":"e_1_3_2_29_2","unstructured":"M. Tan Q. V. Le \u201cEfficientNet: Rethinking model scaling for convolutional neural networks \u201d in Proceedings of the 36th International Conference on Machine Learning (PMLR) vol. 97 of Proceedings of Machine Learning Research (PMLR 2019) pp. 6105\u20136114."},{"key":"e_1_3_2_30_2","doi-asserted-by":"crossref","unstructured":"B. Graham A. El-Nouby H. Touvron P. Stock A. Joulin H. J\u00e9gou M. Douze \u201cLeViT: A vision transformer in ConvNet\u2019s clothing for faster inference \u201d in Proceedings of the IEEE\/CVF International Conference on Computer Vision (IEEE 2021) pp. 12259\u201312269.","DOI":"10.1109\/ICCV48922.2021.01204"},{"key":"e_1_3_2_31_2","unstructured":"N. Nayman Y. Aflalo A. Noy L. Zelnik \u201cHardCoRe-NAS: Hard constrained differentiable neural architecture search \u201d in Proceedings of the 38th International Conference on Machine Learning (PMLR 2021) pp. 7979\u20137990."},{"key":"e_1_3_2_32_2","unstructured":"M. Huh B. Cheung T. Wang P. Isola \u201cPosition: The platonic representation hypothesis \u201d in Proceedings of the 41st International Conference on Machine Learning (PMLR 2024) pp. 20617\u201320642."},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1080\/00437956.1954.11659520"},{"key":"e_1_3_2_34_2","unstructured":"T. Mikolov K. Chen G. Corrado J. Dean Efficient estimation of word representations in vector space. arXiv:1301.3781 [cs.CL] (2013)."},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(03)00167-3"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-021-24368-2"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2017.12.065"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhm017"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.2257-21.2022"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X01000115"},{"key":"e_1_3_2_41_2","first-page":"1","article-title":"A path towards autonomous machine intelligence version 0.9.2, 2022-06-27","volume":"62","author":"LeCun Y.","year":"2022","unstructured":"Y. LeCun, A path towards autonomous machine intelligence version 0.9.2, 2022-06-27. OpenReview 62, 1\u201362 (2022).","journal-title":"OpenReview"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco_a_01627"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2025.11.016"},{"key":"e_1_3_2_44_2","unstructured":"A. Paszke S. Gross F. Massa A. Lerer J. Bradbury G. Chanan T. Killeen Z. Lin N. Gimelshein L. Antiga A. Desmaison A. K\u00f6pf E. Yang Z. De Vito M. Raison A. Tejani S. Chilamkurthy B. Steiner L. Fang J. Bai S. Chintala PyTorch: An imperative style high-performance deep learning library. arXiv:1912.01703 [cs.LG] (2019)."},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2024.10.008"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0191141"},{"key":"e_1_3_2_47_2","doi-asserted-by":"crossref","unstructured":"K. He X. Zhang S. Ren J. Sun \u201cDeep residual learning for image recognition \u201d in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (IEEE 2016) pp. 770\u2013778.","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_48_2","unstructured":"T. Chen S. Kornblith M. Norouzi G. Hinton A simple framework for contrastive learning of visual representations. arXiv:2002.05709 [cs.LG] (2020)."},{"key":"e_1_3_2_49_2","article-title":"DINOv2: Learning robust visual features without supervision","author":"Oquab M.","year":"2024","unstructured":"M. Oquab, T. Darcet, T. Moutakanni, H. Vo, M. Szafraniec, V. Khalidov, P. Fernandez, D. Haziza, F. Massa, A. El-Nouby, M. Assran, N. Ballas, W. Galuba, R. Howes, P.-Y. Huang, S.-W. Li, I. Misra, M. Rabbat, V. Sharma, G. Synnaeve, H. Xu, H. Jegou, J. Mairal, P. Labatut, A. Joulin, P. Bojanowski, DINOv2: Learning robust visual features without supervision. Trans. Mach. Learn. Res. (2024). https:\/\/openreview.net\/forum?id=a68SUt6zFt.","journal-title":"Trans. Mach. Learn. Res."},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.52202\/068431-1934"},{"key":"e_1_3_2_51_2","unstructured":"R. Balestriero Y. LeCun Learning by reconstruction produces uninformative features for perception. arXiv:2402.11337 [cs.CV] (2024)."},{"key":"e_1_3_2_52_2","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python","volume":"12","author":"Pedregosa F.","year":"2011","unstructured":"F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, A. M\u00fcller, J. Nothman, G. Louppe, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, \u00c9. Duchesnay, Scikit-learn: Machine learning in Python. J. Mach. Learn. Res. 12, 2825\u20132830 (2011).","journal-title":"J. Mach. Learn. Res."},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1177\/001316447403400105"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41592-019-0686-2"},{"key":"e_1_3_2_55_2","doi-asserted-by":"crossref","unstructured":"S. Seabold J. Perktold \u201cStatsmodels: Econometric and Statistical Modeling with Python \u201d in Proceedings of the 9th Python in Science Conference (SciPy 2010) pp. 92\u201396.","DOI":"10.25080\/Majora-92bf1922-011"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(90)90007-M"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-026-01228-6"},{"key":"e_1_3_2_58_2","doi-asserted-by":"crossref","unstructured":"J. Kubilius M. Schrimpf A. Nayebi D. Bear D. L. K. Yamins J. J. DiCarlo CORnet: Modeling the neural mechanisms of core object recognition. bioRxiv 408385 [Preprint] (2018). https:\/\/doi.org\/10.1101\/408385.","DOI":"10.1101\/408385"},{"key":"e_1_3_2_59_2","doi-asserted-by":"crossref","unstructured":"Z. Liu H. Mao C.-Y. Wu C. Feichtenhofer T. Darrell S. Xie \u201cA ConvNet for the 2020s \u201d in Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (IEEE 2022) pp. 11976\u201311986.","DOI":"10.1109\/CVPR52688.2022.01167"},{"key":"e_1_3_2_60_2","unstructured":"A. Dosovitskiy L. Beyer A. Kolesnikov D. Weissenborn X. Zhai T. Unterthiner M. Dehghani M. Minderer G. Heigold S. Gelly J. Uszkoreit N. Houlsby \u201cAn image is worth 16x16 words: Transformers for image recognition at scale \u201d in International Conference on Learning Representations (OpenReview.net 2021)."},{"key":"e_1_3_2_61_2","doi-asserted-by":"crossref","unstructured":"Z. Tu H. Talebi H. Zhang F. Yang P. Milanfar A. Bovik Y. Li \u201cMaxvit: Multi-axis vision transformer \u201d in European Conference on Computer Vision vol. 13684 of Leecture Notes in Computer Science (Springer 2022) pp. 459\u2013479.","DOI":"10.1007\/978-3-031-20053-3_27"},{"key":"e_1_3_2_62_2","doi-asserted-by":"crossref","unstructured":"Z. Liu Y. Lin Y. Cao H. Hu Y. Wei Z. Zhang S. Lin B. Guo \u201cSwin transformer: Hierarchical vision transformer using shifted windows \u201d in Proceedings of the IEEE\/CVF international conference on computer vision (IEEE 2021) pp. 10012\u201310022.","DOI":"10.1109\/ICCV48922.2021.00986"}],"container-title":["Science Advances"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.science.org\/doi\/pdf\/10.1126\/sciadv.aee1955","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,21]],"date-time":"2026-10-21T18:02:40Z","timestamp":1792605760000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.science.org\/doi\/10.1126\/sciadv.aee1955"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,23]]},"references-count":61,"journal-issue":{"issue":"43","published-print":{"date-parts":[[2026,10,23]]}},"alternative-id":["10.1126\/sciadv.aee1955"],"URL":"https:\/\/doi.org\/10.1126\/sciadv.aee1955","relation":{},"ISSN":["2375-2548"],"issn-type":[{"value":"2375-2548","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,23]]},"assertion":[{"value":"2025-11-25","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-09-22","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-10-21","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"eaee1955"}}