{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,28]],"date-time":"2026-07-28T09:07:02Z","timestamp":1785229622578,"version":"3.55.0"},"reference-count":69,"publisher":"National Academy of Sciences","issue":"24","license":[{"start":{"date-parts":[[2024,6,3]],"date-time":"2024-06-03T00:00:00Z","timestamp":1717372800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000053","name":"HHS | NIH | National Eye Institute","doi-asserted-by":"publisher","award":["R01EY029700"],"award-info":[{"award-number":["R01EY029700"]}],"id":[{"id":"10.13039\/100000053","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-1822683"],"award-info":[{"award-number":["IIS-1822683"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-1822929"],"award-info":[{"award-number":["IIS-1822929"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.pnas.org"],"crossmark-restriction":true},"short-container-title":["Proc. Natl. Acad. Sci. U.S.A."],"published-print":{"date-parts":[[2024,6,11]]},"abstract":"<jats:p>Human pose, defined as the spatial relationships between body parts, carries instrumental information supporting the understanding of motion and action of a person. A substantial body of previous work has identified cortical areas responsive to images of bodies and different body parts. However, the neural basis underlying the visual perception of body part relationships has received less attention. To broaden our understanding of body perception, we analyzed high-resolution fMRI responses to a wide range of poses from over 4,000 complex natural scenes. Using ground-truth annotations and an application of three-dimensional (3D) pose reconstruction algorithms, we compared similarity patterns of cortical activity with similarity patterns built from human pose models with different levels of depth availability and viewpoint dependency. Targeting the challenge of explaining variance in complex natural image responses with interpretable models, we achieved statistically significant correlations between pose models and cortical activity patterns (though performance levels are substantially lower than the noise ceiling). We found that the 3D view-independent pose model, compared with two-dimensional models, better captures the activation from distinct cortical areas, including the right posterior superior temporal sulcus (pSTS). These areas, together with other pose-selective regions in the LOTC, form a broader, distributed cortical network with greater view-tolerance in more anterior patches. We interpret these findings in light of the computational complexity of natural body images, the wide range of visual tasks supported by pose structures, and possible shared principles for view-invariant processing between articulated objects and ordinary, rigid objects.<\/jats:p>","DOI":"10.1073\/pnas.2317707121","type":"journal-article","created":{"date-parts":[[2024,6,3]],"date-time":"2024-06-03T15:05:07Z","timestamp":1717427107000},"update-policy":"https:\/\/doi.org\/10.1073\/pnas.cm10313","source":"Crossref","is-referenced-by-count":3,"title":["Natural scenes reveal diverse representations of 2D and 3D body pose in the human brain"],"prefix":"10.1073","volume":"121","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4088-3536","authenticated-orcid":false,"given":"Hongru","family":"Zhu","sequence":"first","affiliation":[{"name":"Department of Cognitive Science, Johns Hopkins University, Baltimore, MD 21218"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3117-1414","authenticated-orcid":false,"given":"Yijun","family":"Ge","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Minnesota, Minneapolis, MN 55455"},{"name":"Laboratory for Consciousness, Riken Center for Brain Science, Wako, Saitama 3510198, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Bratch","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Minnesota, Minneapolis, MN 55455"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alan","family":"Yuille","sequence":"additional","affiliation":[{"name":"Department of Cognitive Science, Johns Hopkins University, Baltimore, MD 21218"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6604-9155","authenticated-orcid":false,"given":"Kendrick","family":"Kay","sequence":"additional","affiliation":[{"name":"Center for Magnetic Resonance Research, Department of Radiology, University of Minnesota, Minneapolis, MN 55455"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Kersten","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Minnesota, Minneapolis, MN 55455"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"341","published-online":{"date-parts":[[2024,6,3]]},"reference":[{"key":"e_1_3_4_1_2","first-page":"1736","article-title":"Articulated pose estimation by a graphical model with image dependent pairwise relations","volume":"27","author":"Chen X.","year":"2014","unstructured":"X. Chen, A. L. Yuille, Articulated pose estimation by a graphical model with image dependent pairwise relations. Adv. Neural Inform. Proc. Syst. 27, 1736\u20131744 (2014).","journal-title":"Adv. Neural Inform. Proc. Syst."},{"key":"e_1_3_4_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2018.2828427"},{"key":"e_1_3_4_3_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1063414"},{"key":"e_1_3_4_4_2","doi-asserted-by":"publisher","DOI":"10.1152\/jn.00513.2004"},{"key":"e_1_3_4_5_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.4698-14.2015"},{"key":"e_1_3_4_6_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-009-2093-x"},{"key":"e_1_3_4_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2021.118783"},{"key":"e_1_3_4_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2023.120240"},{"key":"e_1_3_4_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2010.09.032"},{"key":"e_1_3_4_10_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2195"},{"key":"e_1_3_4_11_2","doi-asserted-by":"publisher","DOI":"10.1038\/nn1815"},{"key":"e_1_3_4_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.143"},{"key":"e_1_3_4_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818013"},{"key":"e_1_3_4_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.303"},{"key":"e_1_3_4_15_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-021-00962-x"},{"key":"e_1_3_4_16_2","first-page":"740","volume-title":"European Conference on Computer Vision","author":"Lin T.-Y.","year":"2014","unstructured":"T.-Y. Lin , \u201cMicrosoft coco: Common objects in context\u201d in European Conference on Computer Vision, D. Fleet, T. Pajdla, B. Schiele, T. Tuytelaars, Eds. (Springer, 2014), pp. 740\u2013755."},{"key":"e_1_3_4_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00744"},{"key":"e_1_3_4_18_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0600244103"},{"key":"e_1_3_4_19_2","first-page":"4","article-title":"Representational similarity analysis-connecting the branches of systems neuroscience","volume":"2","author":"Kriegeskorte N.","year":"2008","unstructured":"N. Kriegeskorte, M. Mur, P. A. Bandettini, Representational similarity analysis-connecting the branches of systems neuroscience. Front. Syst. Neurosci. 2, 4 (2008).","journal-title":"Front. Syst. Neurosci."},{"key":"e_1_3_4_20_2","doi-asserted-by":"publisher","DOI":"10.1162\/jocn.2009.21211"},{"key":"e_1_3_4_21_2","doi-asserted-by":"publisher","DOI":"10.1162\/jocn_a_00762"},{"key":"e_1_3_4_22_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-vision-100720-113429"},{"key":"e_1_3_4_23_2","doi-asserted-by":"crossref","unstructured":"C. Conwell J. S. Prince K. N. Kay G. A. Alvarez T. Konkle What can 1.8 billion regressions tell us about the pressures shaping high-level visual representation in brains and machines? bioRxiv [Preprint] (2022). https:\/\/doi.org\/10.1101\/2022.03.28.485868 (Accessed 12 February 2024).","DOI":"10.1101\/2022.03.28.485868"},{"key":"e_1_3_4_24_2","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhaa246"},{"key":"e_1_3_4_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2015.03.006"},{"key":"e_1_3_4_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.56"},{"key":"e_1_3_4_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00371"},{"key":"e_1_3_4_28_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.3325-11.2012"},{"key":"e_1_3_4_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2015.02.058"},{"key":"e_1_3_4_30_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.4802-13.2014"},{"key":"e_1_3_4_31_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.1000608"},{"key":"e_1_3_4_32_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1003963"},{"key":"e_1_3_4_33_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-019-0520-2"},{"key":"e_1_3_4_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.354"},{"key":"e_1_3_4_35_2","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.47686"},{"key":"e_1_3_4_36_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1006613"},{"key":"e_1_3_4_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2022.09.019"},{"key":"e_1_3_4_38_2","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.74943"},{"key":"e_1_3_4_39_2","first-page":"497","volume-title":"European Conference on Computer Vision","author":"Liu Q.","year":"2022","unstructured":"Q. Liu, Y. Zhang, S. Bai, A. Yuille, \u201cExplicit occlusion reasoning for multi-person 3d human pose estimation\u201d in European Conference on Computer Vision, S. Avidan, G. Brostow, M. Ciss\u00e9, G. Farinella, T. Hassner, Eds. (Springer, 2022), pp. 497\u2013517."},{"key":"e_1_3_4_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00862"},{"key":"e_1_3_4_41_2","doi-asserted-by":"publisher","DOI":"10.1167\/jov.21.9.1878"},{"key":"e_1_3_4_42_2","doi-asserted-by":"publisher","DOI":"10.1002\/1097-0193(200101)12:1<1::AID-HBM10>3.0.CO;2-V"},{"key":"e_1_3_4_43_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.23-17-06819.2003"},{"key":"e_1_3_4_44_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuropsychologia.2004.04.015"},{"key":"e_1_3_4_45_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1714471114"},{"key":"e_1_3_4_46_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-020-2350-5"},{"key":"e_1_3_4_47_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41583-020-00393-w"},{"key":"e_1_3_4_48_2","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhx320"},{"key":"e_1_3_4_49_2","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.25544"},{"key":"e_1_3_4_50_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuropsychologia.2015.05.033"},{"key":"e_1_3_4_51_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature08103"},{"key":"e_1_3_4_52_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.2853-12.2013"},{"key":"e_1_3_4_53_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2014.03.068"},{"key":"e_1_3_4_54_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00429-017-1469-0"},{"key":"e_1_3_4_55_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2014.12.050"},{"key":"e_1_3_4_56_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0800431105"},{"key":"e_1_3_4_57_2","doi-asserted-by":"publisher","DOI":"10.1167\/16.6.14"},{"key":"e_1_3_4_58_2","doi-asserted-by":"publisher","DOI":"10.1167\/18.10.408"},{"key":"e_1_3_4_59_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2012.10.060"},{"key":"e_1_3_4_60_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2011.03.041"},{"key":"e_1_3_4_61_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2018.03.013"},{"key":"e_1_3_4_62_2","doi-asserted-by":"crossref","unstructured":"E. J. Allen A massive 7T fMRI dataset to bridge cognitive and computational neuroscience. bioRxiv [Preprint] (2021). https:\/\/doi.org\/10.1101\/2021.02.22.432340 (Accessed 12 February 2024).","DOI":"10.1038\/s41593-021-00962-x"},{"key":"e_1_3_4_63_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10851-009-0161-2"},{"key":"e_1_3_4_64_2","unstructured":"D. Cer Universal sentence encoder. arXiv [Preprint] (2018). https:\/\/doi.org\/10.48550\/arXiv.1803.11175 (Accessed 14 February 2022)."},{"key":"e_1_3_4_65_2","doi-asserted-by":"publisher","DOI":"10.3389\/fninf.2016.00027"},{"key":"e_1_3_4_66_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.4822-14.2015"},{"key":"e_1_3_4_67_2","unstructured":"E. J. Allen Natural Scenes Dataset. Natural Scenes Dataset. https:\/\/naturalscenesdataset.org\/. Accessed 14 February 2021."},{"key":"e_1_3_4_68_2","unstructured":"T.-Y. Lin COCO Dataset. COCO Dataset. https:\/\/cocodataset.org\/. Accessed 14 February 2021."},{"key":"e_1_3_4_69_2","unstructured":"H. Zhu NSD_Body_Pose. Open Science Framework. https:\/\/doi.org\/10.17605\/OSF.IO\/N3ADH. Deposited 14 May 2024."}],"container-title":["Proceedings of the National Academy of Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pnas.org\/doi\/pdf\/10.1073\/pnas.2317707121","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,3]],"date-time":"2024-06-03T15:07:35Z","timestamp":1717427255000},"score":1,"resource":{"primary":{"URL":"https:\/\/pnas.org\/doi\/10.1073\/pnas.2317707121"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,3]]},"references-count":69,"journal-issue":{"issue":"24","published-print":{"date-parts":[[2024,6,11]]}},"alternative-id":["10.1073\/pnas.2317707121"],"URL":"https:\/\/doi.org\/10.1073\/pnas.2317707121","relation":{},"ISSN":["0027-8424","1091-6490"],"issn-type":[{"value":"0027-8424","type":"print"},{"value":"1091-6490","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,3]]},"assertion":[{"value":"2023-10-19","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-04-25","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e2317707121"}}