{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,5]],"date-time":"2026-11-05T21:33:07Z","timestamp":1793914387401,"version":"4.8.0"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,10,23]],"date-time":"2023-10-23T00:00:00Z","timestamp":1698019200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,23]],"date-time":"2023-10-23T00:00:00Z","timestamp":1698019200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000065","name":"U.S. Department of Health & Human Services | NIH | National Institute of Neurological Disorders and Stroke","doi-asserted-by":"publisher","award":["NS10264"],"award-info":[{"award-number":["NS10264"]}],"id":[{"id":"10.13039\/100000065","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000025","name":"U.S. Department of Health & Human Services | NIH | National Institute of Mental Health","doi-asserted-by":"publisher","award":["MH123232"],"award-info":[{"award-number":["MH123232"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000092","name":"U.S. Department of Health & Human Services | NIH | U.S. National Library of Medicine","doi-asserted-by":"publisher","award":["LM012719"],"award-info":[{"award-number":["LM012719"]}],"id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000049","name":"U.S. Department of Health & Human Services | NIH | National Institute on Aging","doi-asserted-by":"publisher","award":["AG053949"],"award-info":[{"award-number":["AG053949"]}],"id":[{"id":"10.13039\/100000049","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000145","name":"NSF | Directorate for Computer & Information Science & Engineering | Division of Information and Intelligent Systems","doi-asserted-by":"publisher","award":["1748377"],"award-info":[{"award-number":["1748377"]}],"id":[{"id":"10.13039\/100000145","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007273","name":"Cornell University | Weill Cornell Medical College","doi-asserted-by":"publisher","award":["Intercampus Pilot Grant"],"award-info":[{"award-number":["Intercampus Pilot Grant"]}],"id":[{"id":"10.13039\/100007273","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Commun Biol"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Understanding how human brains interpret and process information is important. Here, we investigated the selectivity and inter-individual differences in human brain responses to images via functional MRI. In our first experiment, we found that images predicted to achieve maximal activations using a group level encoding model evoke higher responses than images predicted to achieve average activations, and the activation gain is positively associated with the encoding model accuracy. Furthermore, anterior temporal lobe face area (aTLfaces) and fusiform body area 1 had higher activation in response to maximal synthetic images compared to maximal natural images. In our second experiment, we found that synthetic images derived using a personalized encoding model elicited higher responses compared to synthetic images from group-level or other subjects\u2019 encoding models. The finding of aTLfaces favoring synthetic images than natural images was also replicated. Our results indicate the possibility of using data-driven and generative approaches to modulate macro-scale brain region responses and probe inter-individual differences in and functional specialization of the human visual system.<\/jats:p>","DOI":"10.1038\/s42003-023-05440-7","type":"journal-article","created":{"date-parts":[[2023,10,23]],"date-time":"2023-10-23T12:01:55Z","timestamp":1698062515000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Human brain responses are modulated when exposed to optimized natural images or synthetically generated images"],"prefix":"10.1038","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0385-2677","authenticated-orcid":false,"given":"Zijin","family":"Gu","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7139-6661","authenticated-orcid":false,"given":"Keith","family":"Jamison","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mert R.","family":"Sabuncu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5050-8342","authenticated-orcid":false,"given":"Amy","family":"Kuceyeski","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,10,23]]},"reference":[{"key":"5440_CR1","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1113\/jphysiol.1962.sp006837","volume":"160","author":"DH Hubel","year":"1962","unstructured":"Hubel, D. H. & Wiesel, T. N. Receptive fields, binocular interaction and functional architecture in the cat\u2019s visual cortex. J. Physiol. 160, 106 (1962).","journal-title":"J. Physiol."},{"key":"5440_CR2","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1113\/jphysiol.1968.sp008455","volume":"195","author":"DH Hubel","year":"1968","unstructured":"Hubel, D. H. & Wiesel, T. N. Receptive fields and functional architecture of monkey striate cortex. J. Physiol. 195, 215\u2013243 (1968).","journal-title":"J. Physiol"},{"key":"5440_CR3","doi-asserted-by":"publisher","first-page":"4302","DOI":"10.1523\/JNEUROSCI.17-11-04302.1997","volume":"17","author":"N Kanwisher","year":"1997","unstructured":"Kanwisher, N., McDermott, J. & Chun, M. M. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 17, 4302\u20134311 (1997).","journal-title":"J. Neurosci."},{"key":"5440_CR4","doi-asserted-by":"publisher","first-page":"598","DOI":"10.1038\/33402","volume":"392","author":"R Epstein","year":"1998","unstructured":"Epstein, R. & Kanwisher, N. A cortical representation of the local visual environment. Nature 392, 598\u2013601 (1998).","journal-title":"Nature"},{"key":"5440_CR5","doi-asserted-by":"publisher","first-page":"2470","DOI":"10.1126\/science.1063414","volume":"293","author":"PE Downing","year":"2001","unstructured":"Downing, P. E., Jiang, Y., Shuman, M. & Kanwisher, N. A cortical area selective for visual processing of the human body. Science 293, 2470\u20132473 (2001).","journal-title":"Science"},{"key":"5440_CR6","doi-asserted-by":"publisher","first-page":"e1004896","DOI":"10.1371\/journal.pcbi.1004896","volume":"12","author":"J Kubilius","year":"2016","unstructured":"Kubilius, J., Bracci, S. & Op de Beeck, H. P. Deep neural networks as a computational model for human shape sensitivity. PLoS Comput. Biol. 12, e1004896 (2016).","journal-title":"PLoS Comput. Biol."},{"key":"5440_CR7","unstructured":"Kubilius, J. et al. Brain-like object recognition with high-performing shallow recurrent ANNs. arXiv preprint. arxiv:1909.06161 (2019)."},{"key":"5440_CR8","doi-asserted-by":"publisher","first-page":"e2014196118","DOI":"10.1073\/pnas.2014196118","volume":"118","author":"C Zhuang","year":"2021","unstructured":"Zhuang, C. et al. Unsupervised neural network models of the ventral visual stream. Proc. Natl. Acad. Sci. 118, e2014196118 (2021).","journal-title":"Proc. Natl. Acad. Sci."},{"key":"5440_CR9","doi-asserted-by":"publisher","first-page":"e2011417118","DOI":"10.1073\/pnas.2011417118","volume":"118","author":"J Mehrer","year":"2021","unstructured":"Mehrer, J., Spoerer, C. J., Jones, E. C., Kriegeskorte, N. & Kietzmann, T. C. An ecologically motivated image dataset for deep learning yields better models of human vision. Proc. Natl. Acad. Sci. 118, e2011417118 (2021).","journal-title":"Proc. Natl. Acad. Sci."},{"key":"5440_CR10","doi-asserted-by":"publisher","first-page":"eabm2219","DOI":"10.1126\/sciadv.abm2219","volume":"8","author":"NJ Sexton","year":"2022","unstructured":"Sexton, N. J. & Love, B. C. Reassessing hierarchical correspondences between brain and deep networks through direct interface. Sci. Adv. 8, eabm2219 (2022).","journal-title":"Sci. Adv."},{"key":"5440_CR11","unstructured":"Schrimpf, M. et al. Integrative benchmarking to advance neurally mechanistic models of human intelligence. Neuron (2020). https:\/\/www.cell.com\/neuron\/fulltext\/S0896-6273(20)30605-X."},{"key":"5440_CR12","doi-asserted-by":"crossref","unstructured":"Bowers, J. S. et al. Deep problems with neural network models of human vision. Behav. Brain Sci. 1\u201374 (2022).","DOI":"10.1017\/S0140525X22002813"},{"key":"5440_CR13","unstructured":"Brock, A., Donahue, J. & Simonyan, K. Large scale GAN training for high fidelity natural image synthesis. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019 (OpenReview.net, 2019). https:\/\/openreview.net\/forum?id=B1xsqj09Fm."},{"key":"5440_CR14","unstructured":"Van Den Oord, A., Vinyals, O. et al. Neural discrete representation learning. Adv. Neural inform. Process. Syst. 30 (2017)."},{"key":"5440_CR15","doi-asserted-by":"crossref","unstructured":"Rombach, R., Blattmann, A., Lorenz, D., Esser, P. & Ommer, B. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 10684-10695 (2022).","DOI":"10.1109\/CVPR52688.2022.01042"},{"key":"5440_CR16","doi-asserted-by":"publisher","first-page":"15666","DOI":"10.1038\/s41598-023-42891-8","volume":"13","author":"F Ozcelik","year":"2023","unstructured":"Ozcelik F, VanRullen R. Natural scene reconstruction from fMRI signals using generative latent diffusion. Sci Rep. 13, 15666 (2023).","journal-title":"Sci Rep"},{"key":"5440_CR17","first-page":"1","volume":"37","author":"Z Gu","year":"2023","unstructured":"Gu, Z., Jamison, K., Kuceyeski, A. & Sabuncu, M. Decoding natural image stimuli from fmri data with a surface-based convolutional network. Proceedings of Machine Learning Research. 37, 1\u201312 (2023).","journal-title":"Proceedings of Machine Learning Research"},{"key":"5440_CR18","unstructured":"Nguyen, A., Dosovitskiy, A., Yosinski, J., Brox, T. & Clune, J. Synthesizing the preferred inputs for neurons in neural networks via deep generator networks. Adv. Neural Inform. Process. Syst. 29 (2016)."},{"key":"5440_CR19","doi-asserted-by":"publisher","first-page":"eaav9436","DOI":"10.1126\/science.aav9436","volume":"364","author":"P Bashivan","year":"2019","unstructured":"Bashivan, P., Kar, K. & DiCarlo, J. J. Neural population control via deep image synthesis. Science 364, eaav9436 (2019).","journal-title":"Science"},{"key":"5440_CR20","doi-asserted-by":"publisher","first-page":"999","DOI":"10.1016\/j.cell.2019.04.005","volume":"177","author":"CR Ponce","year":"2019","unstructured":"Ponce, C. R. et al. Evolving images for visual neurons using a deep generative network reveals coding principles and neuronal preferences. Cell 177, 999\u20131009 (2019).","journal-title":"Cell"},{"key":"5440_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41467-021-25409-6","volume":"12","author":"NA Ratan Murty","year":"2021","unstructured":"Ratan Murty, N. A., Bashivan, P., Abate, A., DiCarlo, J. J. & Kanwisher, N. Computational models of category-selective brain regions enable high-throughput tests of selectivity. Nat. Commun. 12, 1\u201314 (2021).","journal-title":"Nat. Commun."},{"key":"5440_CR22","doi-asserted-by":"publisher","first-page":"118812","DOI":"10.1016\/j.neuroimage.2021.118812","volume":"247","author":"Z Gu","year":"2022","unstructured":"Gu, Z. et al. Neurogen: activation optimized image synthesis for discovery neuroscience. NeuroImage 247, 118812 (2022).","journal-title":"NeuroImage"},{"key":"5440_CR23","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1038\/s41593-021-00962-x","volume":"25","author":"EJ Allen","year":"2021","unstructured":"Allen, E. J. et al. A massive 7t fmri dataset to bridge cognitive neuroscience and artificial intelligence. Nat. Neurosci. 25, 116\u2013126 (2021).","journal-title":"Nat. Neurosci"},{"key":"5440_CR24","doi-asserted-by":"publisher","first-page":"1382","DOI":"10.1038\/s42003-022-04347-z","volume":"5","author":"Z Gu","year":"2022","unstructured":"Gu, Z., Jamison, K., Sabuncu, M. & Kuceyeski, A. Personalized visual encoding model construction with small data. Commun. Biol. 5, 1382 (2022).","journal-title":"Commun. Biol."},{"key":"5440_CR25","doi-asserted-by":"publisher","first-page":"188","DOI":"10.1016\/j.neuroimage.2017.06.035","volume":"180","author":"G St-Yves","year":"2018","unstructured":"St-Yves, G. & Naselaris, T. The feature-weighted receptive field: an interpretable encoding model for complex feature spaces. NeuroImage 180, 188\u2013202 (2018).","journal-title":"NeuroImage"},{"key":"5440_CR26","first-page":"1097","volume":"25","author":"A Krizhevsky","year":"2012","unstructured":"Krizhevsky, A., Sutskever, I. & Hinton, G. E. Imagenet classification with deep convolutional neural networks. Adv. Neural Inform. Process. Syst. 25, 1097\u20131105 (2012).","journal-title":"Adv. Neural Inform. Process. Syst."},{"key":"5440_CR27","doi-asserted-by":"publisher","first-page":"1088","DOI":"10.1016\/j.neuroimage.2005.12.062","volume":"30","author":"R Saxe","year":"2006","unstructured":"Saxe, R., Brett, M. & Kanwisher, N. Divide and conquer: a defense of functional localizers. Neuroimage 30, 1088\u20131096 (2006).","journal-title":"Neuroimage"},{"key":"5440_CR28","doi-asserted-by":"publisher","first-page":"1077","DOI":"10.1016\/j.neuroimage.2005.08.012","volume":"30","author":"KJ Friston","year":"2006","unstructured":"Friston, K. J., Rotshtein, P., Geng, J. J., Sterzer, P. & Henson, R. N. A critique of functional localisers. Neuroimage 30, 1077\u20131087 (2006).","journal-title":"Neuroimage"},{"key":"5440_CR29","doi-asserted-by":"publisher","first-page":"1409","DOI":"10.1016\/S0042-6989(01)00073-6","volume":"41","author":"K Grill-Spector","year":"2001","unstructured":"Grill-Spector, K., Kourtzi, Z. & Kanwisher, N. The lateral occipital complex and its role in object recognition. Vis. Res. 41, 1409\u20131422 (2001).","journal-title":"Vis. Res."},{"key":"5440_CR30","doi-asserted-by":"publisher","first-page":"1054","DOI":"10.1093\/brain\/awf094","volume":"125","author":"L Cohen","year":"2002","unstructured":"Cohen, L. et al. Language-specific tuning of visual cortex? functional properties of the visual word form area. Brain 125, 1054\u20131069 (2002).","journal-title":"Brain"},{"key":"5440_CR31","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1016\/j.neuropsychologia.2014.06.005","volume":"61","author":"JA Collins","year":"2014","unstructured":"Collins, J. A. & Olson, I. R. Beyond the ffa: the role of the ventral anterior temporal lobes in face processing. Neuropsychologia 61, 65\u201379 (2014).","journal-title":"Neuropsychologia"},{"key":"5440_CR32","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1016\/j.cortex.2015.06.030","volume":"72","author":"L Henriksson","year":"2015","unstructured":"Henriksson, L., Mur, M. & Kriegeskorte, N. Faciotopy-a face-feature map with face-like topology in the human occipital face area. Cortex 72, 156\u2013167 (2015).","journal-title":"Cortex"},{"key":"5440_CR33","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1002\/hipo.20641","volume":"20","author":"MD Barense","year":"2010","unstructured":"Barense, M. D., Henson, R. N., Lee, A. C. & Graham, K. S. Medial temporal lobe activity during complex discrimination of faces, objects, and scenes: effects of viewpoint. Hippocampus 20, 389\u2013401 (2010).","journal-title":"Hippocampus"},{"key":"5440_CR34","doi-asserted-by":"publisher","first-page":"1096","DOI":"10.1093\/cercor\/bhu289","volume":"26","author":"H Yang","year":"2016","unstructured":"Yang, H., Susilo, T. & Duchaine, B. The anterior temporal face area contains invariant representations of face identity that can persist despite the loss of right ffa and ofa. Cereb. Cortex 26, 1096\u20131107 (2016).","journal-title":"Cereb. Cortex"},{"key":"5440_CR35","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1016\/j.neuroimage.2018.06.016","volume":"179","author":"S Haufe","year":"2018","unstructured":"Haufe, S. et al. Elucidating relations between fmri, ecog, and eeg through a common natural stimulus. NeuroImage 179, 79\u201391 (2018).","journal-title":"NeuroImage"},{"key":"5440_CR36","unstructured":"Midjourney. http:\/\/www.midjourney.com."},{"key":"5440_CR37","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y. et al. Microsoft coco: common objects in context. In European conference on computer vision, 740\u2013755 (Springer, 2014).","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"5440_CR38","doi-asserted-by":"publisher","first-page":"606","DOI":"10.1016\/j.neuroimage.2018.08.064","volume":"183","author":"I Charest","year":"2018","unstructured":"Charest, I., Kriegeskorte, N. & Kay, K. N. Glmdenoise improves multivariate pattern analysis of fmri data. NeuroImage 183, 606\u2013616 (2018).","journal-title":"NeuroImage"},{"key":"5440_CR39","doi-asserted-by":"publisher","first-page":"247","DOI":"10.3389\/fnins.2013.00247","volume":"7","author":"K Kay","year":"2013","unstructured":"Kay, K., Rokem, A., Winawer, J., Dougherty, R. & Wandell, B. Glmdenoise: a fast, automated technique for denoising task-based fmri data. Front. Neurosci. 7, 247 (2013).","journal-title":"Front. Neurosci."},{"key":"5440_CR40","doi-asserted-by":"publisher","first-page":"e77599","DOI":"10.7554\/eLife.77599","volume":"11","author":"JS Prince","year":"2022","unstructured":"Prince, J. S. et al. Improving the accuracy of single-trial fmri response estimates using glmsingle. Elife 11, e77599 (2022).","journal-title":"Elife"},{"key":"5440_CR41","doi-asserted-by":"publisher","DOI":"10.1093\/gigascience\/giaa133","volume":"9","author":"A Rokem","year":"2020","unstructured":"Rokem, A. & Kay, K. Fractional ridge regression: a fast, interpretable reparameterization of ridge regression. GigaScience 9, giaa133 (2020).","journal-title":"GigaScience"},{"key":"5440_CR42","doi-asserted-by":"publisher","first-page":"12412","DOI":"10.1523\/JNEUROSCI.4822-14.2015","volume":"35","author":"A Stigliani","year":"2015","unstructured":"Stigliani, A., Weiner, K. S. & Grill-Spector, K. Temporal processing capacity in high-level visual cortex is domain specific. J. Neurosci. 35, 12412\u201312424 (2015).","journal-title":"J. Neurosci."},{"key":"5440_CR43","unstructured":"Gu, Z. Neurogen dataset. figshare (2023). https:\/\/figshare.com\/articles\/dataset\/NeuroGen_Dataset\/23582403."},{"key":"5440_CR44","doi-asserted-by":"publisher","first-page":"870","DOI":"10.1016\/S1053-8119(03)00336-7","volume":"20","author":"JL Andersson","year":"2003","unstructured":"Andersson, J. L., Skare, S. & Ashburner, J. How to correct susceptibility distortions in spin-echo echo-planar images: application to diffusion tensor imaging. Neuroimage 20, 870\u2013888 (2003).","journal-title":"Neuroimage"},{"key":"5440_CR45","doi-asserted-by":"publisher","first-page":"918","DOI":"10.1038\/s41593-020-0658-y","volume":"23","author":"JD Dworkin","year":"2020","unstructured":"Dworkin, J. D. et al. The extent and drivers of gender imbalance in neuroscience reference lists. Nat. Neurosci. 23, 918\u2013926 (2020).","journal-title":"Nat. Neurosci."},{"key":"5440_CR46","unstructured":"Gu, Z. Neurogen: modulating human brain responses via synthetic image generation. neurogen zijin-gu\/NeuroGen: First release of NeuroGen. Zenodo https:\/\/github.com\/zijin-gu\/NeuroGen (2023)."},{"key":"5440_CR47","doi-asserted-by":"crossref","unstructured":"Gu, Z. Human brain responses are modulated when exposed to optimized natural images or synthetically generated images. neurogen zijin-gu\/neural-modulation: First release of neural modulation. Zenodo https:\/\/github.com\/zijin-gu\/neural-modulation (2023).","DOI":"10.1038\/s42003-023-05440-7"}],"container-title":["Communications Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s42003-023-05440-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s42003-023-05440-7","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s42003-023-05440-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,24]],"date-time":"2023-12-24T15:56:12Z","timestamp":1703433372000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s42003-023-05440-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,23]]},"references-count":47,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["5440"],"URL":"https:\/\/doi.org\/10.1038\/s42003-023-05440-7","relation":{},"ISSN":["2399-3642"],"issn-type":[{"value":"2399-3642","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,23]]},"assertion":[{"value":"10 May 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 October 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 October 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"1076"}}