{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T06:18:23Z","timestamp":1790230703649,"version":"4.1.0"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,7,1]],"date-time":"2025-07-01T00:00:00Z","timestamp":1751328000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,7,1]],"date-time":"2025-07-01T00:00:00Z","timestamp":1751328000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Nat Commun"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Body pose and orientation serve as vital visual signals in primate non-verbal social communication. Leveraging deep learning algorithms that extract body poses from videos of behaving monkeys, applied to a monkey avatar, we investigated neural tuning for pose and viewpoint, targeting fMRI-defined mid and anterior Superior Temporal Sulcus (STS) body patches. We modeled the pose and viewpoint selectivity of the units with keypoint-based principal component regression with cross-validation and applied model inversion as a key approach to identify effective body parts and views. Mid\u00a0STS units were effectively modeled using view-dependent 2D keypoint representations, revealing that their responses were driven by specific body parts that differed among neurons. Some anterior STS units exhibited better predictive performances with a view-dependent 3D model. On average, anterior STS units were better fitted by a keypoint-based model incorporating mirror-symmetric viewpoint tuning than by view-dependent 2D and 3D keypoint models. However, in both regions, a view-independent keypoint model resulted in worse predictive performance. This keypoint-based approach provides insights into how the primate visual system encodes socially relevant body cues, deepening our understanding of body pose representation in the STS.<\/jats:p>","DOI":"10.1038\/s41467-025-60945-5","type":"journal-article","created":{"date-parts":[[2025,7,1]],"date-time":"2025-07-01T12:27:53Z","timestamp":1751372873000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Keypoint-based modeling reveals fine-grained body pose tuning in superior temporal sulcus neurons"],"prefix":"10.1038","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5222-2156","authenticated-orcid":false,"given":"Rajani","family":"Raman","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anna","family":"Bogn\u00e1r","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ghazaleh","family":"Ghamkhari Nejad","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Albert","family":"Mukovskiy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7445-0691","authenticated-orcid":false,"given":"Lucas","family":"Martini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1178-2768","authenticated-orcid":false,"given":"Martin","family":"Giese","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8778-835X","authenticated-orcid":false,"given":"Rufin","family":"Vogels","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,7,1]]},"reference":[{"key":"60945_CR1","doi-asserted-by":"publisher","first-page":"1535","DOI":"10.1016\/j.neuropsychologia.2006.01.020","volume":"44","author":"T Jellema","year":"2006","unstructured":"Jellema, T. & Perrett, D. I. Neural representations of perceived bodily actions using a categorical frame of reference. Neuropsychologia 44, 1535\u20131546 (2006).","journal-title":"Neuropsychologia"},{"key":"60945_CR2","doi-asserted-by":"publisher","first-page":"1728","DOI":"10.1016\/S0028-3932(03)00175-1","volume":"41","author":"T Jellema","year":"2003","unstructured":"Jellema, T. & Perrett, D. I. Cells in monkey STS responsive to articulated body motions and consequent static posture: a case of implied motion? Neuropsychologia 41, 1728\u20131737 (2003).","journal-title":"Neuropsychologia"},{"key":"60945_CR3","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1007\/BF00231050","volume":"86","author":"DI Perrett","year":"1991","unstructured":"Perrett, D. I. et al. Viewer-centred and object-centred coding of heads in the macaque temporal cortex. Exp. Brain Res. 86, 159\u2013173 (1991).","journal-title":"Exp. Brain Res."},{"key":"60945_CR4","doi-asserted-by":"crossref","unstructured":"Kumar, S., Popivanov, I. D. & Vogels, R. Transformation of visual representations across ventral stream body-selective patches. Cereb Cortex 29, 215\u2013229 (2019).","DOI":"10.1093\/cercor\/bhx320"},{"key":"60945_CR5","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-18441-5","volume":"11","author":"PC Bala","year":"2020","unstructured":"Bala, P. C. et al. Automated markerless pose estimation in freely moving macaques with OpenMonkeyStudio. Nat. Commun. 11, 4560 (2020).","journal-title":"Nat. Commun."},{"key":"60945_CR6","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1038\/s41586-020-2350-5","volume":"583","author":"P Bao","year":"2020","unstructured":"Bao, P., She, L., McGill, M. & Tsao, D. Y. A map of object space in primate inferotemporal cortex. Nature 583, 103\u2013108 (2020).","journal-title":"Nature"},{"key":"60945_CR7","doi-asserted-by":"publisher","first-page":"989","DOI":"10.1038\/nn1111","volume":"6","author":"DY Tsao","year":"2003","unstructured":"Tsao, D. Y., Freiwald, W. A., Knutsen, T. A., Mandeville, J. B. & Tootell, R. B. Faces and objects in macaque cerebral cortex. Nat. Neurosci. 6, 989\u2013995 (2003).","journal-title":"Nat. Neurosci."},{"key":"60945_CR8","doi-asserted-by":"publisher","first-page":"688","DOI":"10.1152\/jn.90657.2008","volume":"101","author":"AH Bell","year":"2009","unstructured":"Bell, A. H., Hadj-Bouziane, F., Frihauf, J. B., Tootell, R. B. & Ungerleider, L. G. Object representations in the temporal cortex of monkeys and humans as revealed by functional magnetic resonance imaging. J. Neurophysiol. 101, 688\u2013700 (2009).","journal-title":"J. Neurophysiol."},{"key":"60945_CR9","doi-asserted-by":"publisher","first-page":"2581","DOI":"10.1152\/jn.91198.2008","volume":"101","author":"MA Pinsk","year":"2009","unstructured":"Pinsk, M. A. et al. Neural representations of faces and body parts in macaque and human cortex: a comparative FMRI study. J. Neurophysiol. 101, 2581\u20132600 (2009).","journal-title":"J. Neurophysiol."},{"key":"60945_CR10","doi-asserted-by":"publisher","first-page":"723","DOI":"10.1016\/j.neuroimage.2012.07.013","volume":"63","author":"ID Popivanov","year":"2012","unstructured":"Popivanov, I. D., Jastorff, J., Vanduffel, W. & Vogels, R. Stimulus representations in body-selective regions of the macaque cortex assessed with event-related fMRI. Neuroimage 63, 723\u2013741 (2012).","journal-title":"Neuroimage"},{"key":"60945_CR11","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.add6865","volume":"8","author":"J Taubert","year":"2022","unstructured":"Taubert, J. et al. A broadly tuned network for affective body language in the macaque brain. Sci. Adv. 8, eadd6865 (2022).","journal-title":"Sci. Adv."},{"key":"60945_CR12","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2023.119907","volume":"269","author":"A Bognar","year":"2023","unstructured":"Bognar, A. et al. The contribution of dynamics to macaque body and face patch responses. Neuroimage 269, 119907 (2023).","journal-title":"Neuroimage"},{"key":"60945_CR13","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1523\/JNEUROSCI.2748-13.2014","volume":"34","author":"ID Popivanov","year":"2014","unstructured":"Popivanov, I. D., Jastorff, J., Vanduffel, W. & Vogels, R. Heterogeneous single-unit selectivity in an fMRI-defined body-selective patch. J. Neurosci. 34, 95\u2013111 (2014).","journal-title":"J. Neurosci."},{"key":"60945_CR14","doi-asserted-by":"crossref","unstructured":"Vogels, R. More than the face: representations of bodies in the inferior temporal cortex. Annu. Rev. Vis. Sci. 8, 383\u2013405 (2022).","DOI":"10.1146\/annurev-vision-100720-113429"},{"key":"60945_CR15","doi-asserted-by":"publisher","first-page":"3269","DOI":"10.1016\/j.cub.2016.09.059","volume":"26","author":"E Premereur","year":"2016","unstructured":"Premereur, E., Taubert, J., Janssen, P., Vogels, R. & Vanduffel, W. Effective connectivity reveals largely independent parallel networks of face and body patches. Curr. Biol. 26, 3269\u20133279 (2016).","journal-title":"Curr. Biol."},{"key":"60945_CR16","doi-asserted-by":"publisher","DOI":"10.1016\/j.celrep.2023.113438","volume":"42","author":"R Raman","year":"2023","unstructured":"Raman, R. et al. Bodies in motion: unraveling the distinct roles of motion and shape in dynamic body responses in the temporal cortex. Cell Rep. 42, 113438 (2023).","journal-title":"Cell Rep."},{"key":"60945_CR17","doi-asserted-by":"publisher","first-page":"356","DOI":"10.1038\/nn.4244","volume":"19","author":"DL Yamins","year":"2016","unstructured":"Yamins, D. L. & DiCarlo, J. J. Using goal-driven deep learning models to understand sensory cortex. Nat. Neurosci. 19, 356\u2013365 (2016).","journal-title":"Nat. Neurosci."},{"key":"60945_CR18","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1146\/annurev-vision-082114-035447","volume":"1","author":"N Kriegeskorte","year":"2015","unstructured":"Kriegeskorte, N. Deep neural networks: a new framework for modeling biological vision and brain information processing. Annu. Rev. Vis. Sci. 1, 417\u2013446 (2015).","journal-title":"Annu. Rev. Vis. Sci."},{"key":"60945_CR19","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1145\/3065386","volume":"60","author":"A Krizhevsky","year":"2017","unstructured":"Krizhevsky, A., Sutskever, I. & Hinton, G. ImageNet classification with deep convolutional neural networks. Commun. ACM 60, 84\u201390 (2017).","journal-title":"Commun. ACM"},{"key":"60945_CR20","unstructured":"Salman, H., Ilyas, A., Engstrom, L., Kapoor, A. & Madry, A. Do adversarially robust ImageNet models transfer better? Adv. Neural Inf. Process. Syst. 33, (eds Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M. F. & Lin, H.) (Curran Associates, Inc., 2020)."},{"key":"60945_CR21","unstructured":"Geirhos, R. et al. ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustness. Oral @ International Conference on Learning Representations (ICLR 2019)."},{"key":"60945_CR22","doi-asserted-by":"publisher","first-page":"1013","DOI":"10.1016\/j.cell.2017.05.011","volume":"169","author":"L Chang","year":"2017","unstructured":"Chang, L. & Tsao, D. Y. The code for facial identity in the primate brain. Cell 169, 1013\u20131028.e1014 (2017).","journal-title":"Cell"},{"key":"60945_CR23","doi-asserted-by":"publisher","first-page":"845","DOI":"10.1126\/science.1194908","volume":"330","author":"WA Freiwald","year":"2010","unstructured":"Freiwald, W. A. & Tsao, D. Y. Functional compartmentalization and viewpoint generalization within the macaque face-processing system. Science 330, 845\u2013851 (2010).","journal-title":"Science"},{"key":"60945_CR24","doi-asserted-by":"crossref","unstructured":"Farzmahdi, A., Zarco, W., Freiwald, W. A., Kriegeskorte, N. & Golan, T. Emergence of brain-like mirror-symmetric viewpoint tuning in convolutional neural networks. Elife 13, 90256 (2024).","DOI":"10.7554\/eLife.90256"},{"key":"60945_CR25","doi-asserted-by":"publisher","first-page":"120240","DOI":"10.1016\/j.neuroimage.2023.120240","volume":"277","author":"G Marrazzo","year":"2023","unstructured":"Marrazzo, G., De Martino, F., Lage-Castellanos, A., Vaessen, M. J. & de Gelder, B. Voxelwise encoding models of body stimuli reveal a representational gradient from low-level visual features to postural features in occipitotemporal cortex. Neuroimage 277, 120240 (2023).","journal-title":"Neuroimage"},{"key":"60945_CR26","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2317707121","volume":"121","author":"H Zhu","year":"2024","unstructured":"Zhu, H. et al. Natural scenes reveal diverse representations of 2D and 3D body pose in the human brain. Proc. Natl Acad. Sci. USA 121, e2317707121 (2024).","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"60945_CR27","doi-asserted-by":"publisher","first-page":"911","DOI":"10.1016\/j.neuroimage.2011.12.087","volume":"60","author":"J Jastorff","year":"2012","unstructured":"Jastorff, J., Popivanov, I. D., Vogels, R., Vanduffel, W. & Orban, G. A. Integration of shape and motion cues in biological monkey STS. Neuroimage 60, 911\u2013921 (2012).","journal-title":"Neuroimage"},{"key":"60945_CR28","doi-asserted-by":"publisher","first-page":"363","DOI":"10.3389\/neuro.01.035.2009","volume":"3","author":"N Kriegeskorte","year":"2009","unstructured":"Kriegeskorte, N. Relating population-code representations between man, monkey, and computational models. Front. Neurosci. 3, 363\u2013373 (2009).","journal-title":"Front. Neurosci."},{"key":"60945_CR29","doi-asserted-by":"publisher","first-page":"343","DOI":"10.1038\/360343a0","volume":"360","author":"I Fujita","year":"1992","unstructured":"Fujita, I., Tanaka, K., Ito, M. & Cheng, K. Columns for visual features of objects in monkey inferotemporal cortex. Nature 360, 343\u2013346 (1992).","journal-title":"Nature"},{"key":"60945_CR30","doi-asserted-by":"publisher","first-page":"2791","DOI":"10.1523\/JNEUROSCI.4037-14.2015","volume":"35","author":"J Dubois","year":"2015","unstructured":"Dubois, J., de Berker, A. O. & Tsao, D. Y. Single-unit recordings in the macaque face patch system reveal limitations of fMRI MVPA. J. Neurosci. 35, 2791\u20132802 (2015).","journal-title":"J. Neurosci."},{"key":"60945_CR31","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1016\/j.neuron.2011.10.031","volume":"73","author":"BE Verhoef","year":"2012","unstructured":"Verhoef, B. E., Vogels, R. & Janssen, P. Inferotemporal cortex subserves three-dimensional structure categorization. Neuron 73, 171\u2013182 (2012).","journal-title":"Neuron"},{"key":"60945_CR32","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1109\/TPAMI.2019.2929257","volume":"43","author":"Z Cao","year":"2021","unstructured":"Cao, Z., Hidalgo, G., Simon, T., Wei, S. E. & Sheikh, Y. OpenPose: realtime multi-person 2D pose estimation using part affinity fields. IEEE Trans. Pattern Anal. Mach. Intell. 43, 172\u2013186 (2021).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"60945_CR33","doi-asserted-by":"publisher","first-page":"1352","DOI":"10.1038\/nn.2202","volume":"11","author":"Y Yamane","year":"2008","unstructured":"Yamane, Y., Carlson, E. T., Bowman, K. C., Wang, Z. H. & Connor, C. E. A neural code for three-dimensional object shape in macaque inferotemporal cortex. Nat. Neurosci. 11, 1352\u20131360 (2008).","journal-title":"Nat. Neurosci."},{"key":"60945_CR34","doi-asserted-by":"publisher","first-page":"3795","DOI":"10.1523\/JNEUROSCI.0150-04.2004","volume":"24","author":"Y Liu","year":"2004","unstructured":"Liu, Y., Vogels, R. & Orban, G. A. Convergence of depth from texture and depth from disparity in macaque inferior temporal cortex. J. Neurosci. 24, 3795\u20133800 (2004).","journal-title":"J. Neurosci."},{"key":"60945_CR35","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-17714-3","volume":"11","author":"R Rajalingham","year":"2020","unstructured":"Rajalingham, R., Kar, K., Sanghavi, S., Dehaene, S. & DiCarlo, J. J. The inferior temporal cortex is a potential cortical precursor of orthographic processing in untrained monkeys. Nat. Commun. 11, 3886 (2020).","journal-title":"Nat. Commun."},{"key":"60945_CR36","doi-asserted-by":"crossref","unstructured":"Wang, C. Y., Wang, Y. Z., Lin, Z. C., Yuille, A. L. & Gao, W. Robust estimation of 3D human poses from a single image. In 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2369\u22122376 (CVPR, 2014).","DOI":"10.1109\/CVPR.2014.303"},{"key":"60945_CR37","doi-asserted-by":"publisher","first-page":"670","DOI":"10.1126\/science.1119983","volume":"311","author":"DY Tsao","year":"2006","unstructured":"Tsao, D. Y., Freiwald, W. A., Tootell, R. B. & Livingstone, M. S. A cortical region consisting entirely of face-selective cells. Science 311, 670\u2013674 (2006).","journal-title":"Science"},{"key":"60945_CR38","doi-asserted-by":"publisher","first-page":"8","DOI":"10.3389\/fninf.2013.00008","volume":"7","author":"EM Meyers","year":"2013","unstructured":"Meyers, E. M. The neural decoding toolbox. Front. Neuroinform. 7, 8 (2013).","journal-title":"Front. Neuroinform."},{"key":"60945_CR39","doi-asserted-by":"crossref","unstructured":"Willeke, K. F. et al. Deep learning-driven characterization of single cell tuning in primate visual area V4 unveils topological organization. Preprint at https:\/\/www.biorxiv.org\/content\/10.1101\/2023.05.12.540591v1 (2023).","DOI":"10.1101\/2023.05.12.540591"}],"container-title":["Nature Communications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41467-025-60945-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41467-025-60945-5","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41467-025-60945-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,1]],"date-time":"2025-07-01T12:27:57Z","timestamp":1751372877000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41467-025-60945-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,1]]},"references-count":39,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["60945"],"URL":"https:\/\/doi.org\/10.1038\/s41467-025-60945-5","relation":{},"ISSN":["2041-1723"],"issn-type":[{"value":"2041-1723","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,1]]},"assertion":[{"value":"9 September 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 June 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 July 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"5796"}}