{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,26]],"date-time":"2026-03-26T06:00:33Z","timestamp":1774504833934,"version":"3.50.1"},"reference-count":66,"publisher":"MIT Press","issue":"9","license":[{"start":{"date-parts":[[2020,10,30]],"date-time":"2020-10-30T00:00:00Z","timestamp":1604016000000},"content-version":"vor","delay-in-days":2616,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2013,9,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The visual system's flexibility in estimating depth is remarkable: We readily perceive 3-D structure under diverse conditions from the seemingly random dots of a \u201cmagic eye\u201d stereogram to the aesthetically beautiful, but obviously flat, canvasses of the Old Masters. Yet, 3-D perception is often enhanced when different cues specify the same depth. This perceptual process is understood as Bayesian inference that improves sensory estimates. Despite considerable behavioral support for this theory, insights into the cortical circuits involved are limited. Moreover, extant work tested quantitatively similar cues, reducing some of the challenges associated with integrating computationally and qualitatively different signals. Here we address this challenge by measuring fMRI responses to depth structures defined by shading, binocular disparity, and their combination. We quantified information about depth configurations (convex \u201cbumps\u201d vs. concave \u201cdimples\u201d) in different visual cortical areas using pattern classification analysis. We found that fMRI responses in dorsal visual area V3B\/KO were more discriminable when disparity and shading concurrently signaled depth, in line with the predictions of cue integration. Importantly, by relating fMRI and psychophysical tests of integration, we observed a close association between depth judgments and activity in this area. Finally, using a cross-cue transfer test, we found that fMRI responses evoked by one cue afford classification of responses evoked by the other. This reveals a generalized depth representation in dorsal visual cortex that combines qualitatively different information in line with 3-D perception.<\/jats:p>","DOI":"10.1162\/jocn_a_00417","type":"journal-article","created":{"date-parts":[[2013,5,6]],"date-time":"2013-05-06T17:21:13Z","timestamp":1367860873000},"page":"1527-1541","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":26,"title":["Perceptual Integration for Qualitatively Different 3-D Cues in the Human Brain"],"prefix":"10.1162","volume":"25","author":[{"given":"Dicle","family":"D\u00f6vencio\u011flu","sequence":"first","affiliation":[{"name":"1University of Birmingham"}]},{"given":"Hiroshi","family":"Ban","sequence":"additional","affiliation":[{"name":"1University of Birmingham"},{"name":"2Japan Society for the Promotion of Science"}]},{"given":"Andrew J.","family":"Schofield","sequence":"additional","affiliation":[{"name":"1University of Birmingham"}]},{"given":"Andrew E.","family":"Welchman","sequence":"additional","affiliation":[{"name":"1University of Birmingham"}]}],"member":"281","published-online":{"date-parts":[[2013,9,1]]},"reference":[{"key":"2021072913323162800_R1","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1038\/87462","article-title":"Joint-encoding of motion and depth by visual cortical neurons: Neural basis of the Pulfrich effect.","volume":"4","author":"Anzai","year":"2001","journal-title":"Nature Neuroscience"},{"key":"2021072913323162800_R2","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1016\/S0042-6989(00)00254-6","article-title":"Experience-dependent visual cue integration based on consistencies between visual and haptic percepts.","volume":"41","author":"Atkins","year":"2001","journal-title":"Vision Research"},{"key":"2021072913323162800_R3","doi-asserted-by":"crossref","first-page":"636","DOI":"10.1038\/nn.3046","article-title":"The integration of motion and disparity cues to depth in dorsal visual cortex.","volume":"15","author":"Ban","year":"2012","journal-title":"Nature Neuroscience"},{"key":"2021072913323162800_R4","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1023\/A:1008154927611","article-title":"The bas-relief ambiguity.","volume":"35","author":"Belhumeur","year":"1999","journal-title":"International Journal of Computer Vision"},{"key":"2021072913323162800_R5","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/0262-8856(85)90006-X","article-title":"Surface descriptions from stereo and shading.","volume":"3","author":"Blake","year":"1985","journal-title":"Image and Vision Computing"},{"key":"2021072913323162800_R6","doi-asserted-by":"crossref","first-page":"609","DOI":"10.1038\/373609a0","article-title":"Integration of motion and stereopsis in middle temporal cortical area of macaques.","volume":"373","author":"Bradley","year":"1995","journal-title":"Nature"},{"key":"2021072913323162800_R7","doi-asserted-by":"crossref","first-page":"1749","DOI":"10.1364\/JOSAA.5.001749","article-title":"Integration of depth modules - Stereo and shading.","volume":"5","author":"Buelthoff","year":"1988","journal-title":"Journal of the Optical Society of America: A"},{"key":"2021072913323162800_R8","doi-asserted-by":"crossref","first-page":"7269","DOI":"10.1523\/JNEUROSCI.5551-09.2010","article-title":"Natural-scene statistics predict how the figure-ground cue of convexity affects human depth perception.","volume":"30","author":"Burge","year":"2010","journal-title":"Journal of Neuroscience"},{"key":"2021072913323162800_R9","doi-asserted-by":"crossref","first-page":"1399","DOI":"10.1016\/0042-6989(95)00213-8","article-title":"The effect of illuminant position on perceived curvature.","volume":"36","author":"Curran","year":"1996","journal-title":"Vision Research"},{"key":"2021072913323162800_R10","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.neuroimage.2008.06.037","article-title":"Combining multivariate voxel selection and support vector machines for mapping and classification of fMRI spatial patterns.","volume":"43","author":"De Martino","year":"2008","journal-title":"Neuroimage"},{"key":"2021072913323162800_R11","doi-asserted-by":"crossref","first-page":"1094","DOI":"10.1152\/jn.00717.2002","article-title":"Coding of horizontal disparity and velocity by MT neurons in the alert macaque.","volume":"89","author":"DeAngelis","year":"2003","journal-title":"Journal of Neurophysiology"},{"key":"2021072913323162800_R12","doi-asserted-by":"crossref","first-page":"2382","DOI":"10.1073\/pnas.93.6.2382","article-title":"Mapping striate and extrastriate visual areas in human cerebral cortex.","volume":"93","author":"DeYoe","year":"1996","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2021072913323162800_R13","doi-asserted-by":"crossref","first-page":"1038","DOI":"10.3758\/BF03194522","article-title":"The combined influence of binocular disparity and shading on pictorial shape.","volume":"63","author":"Doorschot","year":"2001","journal-title":"Perception & Psychophysics"},{"key":"2021072913323162800_R14","doi-asserted-by":"crossref","first-page":"973","DOI":"10.1016\/0042-6989(86)90154-9","article-title":"Tradeoffs between stereopsis and proximity luminance covariance as determinants of perceived 3-D structure.","volume":"26","author":"Dosher","year":"1986","journal-title":"Vision Research"},{"key":"2021072913323162800_R15","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1093\/cercor\/7.3.283","article-title":"The kinetic occipital region in human visual cortex.","volume":"7","author":"Dupont","year":"1997","journal-title":"Cerebral Cortex"},{"key":"2021072913323162800_R16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1167\/7.5.7","article-title":"Learning to integrate arbitrary signals from vision and touch.","volume":"7","author":"Ernst","year":"2007","journal-title":"Journal of Vision"},{"key":"2021072913323162800_R17","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1167\/3.5.3","article-title":"Real-world illumination and the perception of surface reflectance properties.","volume":"3","author":"Fleming","year":"2003","journal-title":"Journal of Vision"},{"key":"2021072913323162800_R18","doi-asserted-by":"crossref","first-page":"2416","DOI":"10.1093\/cercor\/bhn002","article-title":"The extraction of 3-D shape from texture and shading in the human brain.","volume":"18","author":"Georgieva","year":"2008","journal-title":"Cerebral Cortex"},{"key":"2021072913323162800_R19","doi-asserted-by":"crossref","first-page":"16309","DOI":"10.1073\/pnas.1006285107","article-title":"Prior knowledge of illumination for 3-D perception in the human brain.","volume":"107","author":"Gerardin","year":"2010","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2021072913323162800_R20","doi-asserted-by":"crossref","first-page":"694","DOI":"10.1016\/j.cub.2008.04.036","article-title":"Young children do not integrate visual and haptic form information.","volume":"18","author":"Gori","year":"2008","journal-title":"Current Biology"},{"key":"2021072913323162800_R21","doi-asserted-by":"crossref","first-page":"837","DOI":"10.1038\/77754","article-title":"The dynamics of object-selective activation correlate with recognition performance in humans.","volume":"3","author":"Grill-Spector","year":"2000","journal-title":"Nature Neuroscience"},{"key":"2021072913323162800_R22","doi-asserted-by":"crossref","first-page":"1627","DOI":"10.1126\/science.1075396","article-title":"Combining sensory information: Mandatory fusion within, but not between, senses.","volume":"298","author":"Hillis","year":"2002","journal-title":"Science"},{"key":"2021072913323162800_R23","first-page":"115","article-title":"Obtaining shape from shading information.","volume-title":"The psychology of computer vision","author":"Horn","year":"1975"},{"key":"2021072913323162800_R24","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1016\/S0896-6273(00)00045-3","article-title":"Three-dimensional shape coding in inferior temporal cortex.","volume":"27","author":"Janssen","year":"2000","journal-title":"Neuron"},{"key":"2021072913323162800_R25","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1146\/annurev.psych.55.090902.142005","article-title":"Object perception as Bayesian inference.","volume":"55","author":"Kersten","year":"2004","journal-title":"Annual Review of Psychology"},{"key":"2021072913323162800_R26","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1038\/nn1060","article-title":"Color brings relief to human vision.","volume":"6","author":"Kingdom","year":"2003","journal-title":"Nature Neuroscience"},{"key":"2021072913323162800_R27","doi-asserted-by":"crossref","first-page":"2539","DOI":"10.1016\/S0042-6989(03)00458-9","article-title":"Do humans optimally integrate stereo and texture information for judgments of surface slant?","volume":"43","author":"Knill","year":"2003","journal-title":"Vision Research"},{"key":"2021072913323162800_R28","doi-asserted-by":"crossref","first-page":"1090","DOI":"10.7551\/mitpress\/7131.003.0083","article-title":"Shape and shading.","volume-title":"The visual neurosciences","author":"Koenderink","year":"2003"},{"key":"2021072913323162800_R29","doi-asserted-by":"crossref","first-page":"1506","DOI":"10.1126\/science.1061133","article-title":"Representation of perceived object shape by the human lateral occipital complex.","volume":"293","author":"Kourtzi","year":"2001","journal-title":"Science"},{"key":"2021072913323162800_R30","doi-asserted-by":"crossref","first-page":"3863","DOI":"10.1073\/pnas.0600244103","article-title":"Information-based functional brain mapping.","volume":"103","author":"Kriegeskorte","year":"2006","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2021072913323162800_R31","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1016\/0042-6989(94)00176-M","article-title":"Measurement and modeling of depth cue combination - In defense of weak fusion.","volume":"35","author":"Landy","year":"1995","journal-title":"Vision Research"},{"key":"2021072913323162800_R32","doi-asserted-by":"crossref","first-page":"2940","DOI":"10.1152\/jn.00400.2010","article-title":"Orientation selectivity of motion-boundary responses in human visual cortex.","volume":"104","author":"Larsson","year":"2010","journal-title":"Journal of Neurophysiology"},{"key":"2021072913323162800_R33","article-title":"Stereo improves 3-D shape discrimination even when rich monocular shape cues are available.","volume":"11","author":"Lee","year":"2011","journal-title":"Journal of Vision"},{"key":"2021072913323162800_R34","doi-asserted-by":"crossref","first-page":"2135","DOI":"10.1016\/j.visres.2004.03.024","article-title":"Perceptual biases in the interpretation of 3-D shape from shading.","volume":"44","author":"Liu","year":"2004","journal-title":"Vision Research"},{"key":"2021072913323162800_R35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1167\/12.1.1","article-title":"Optimal integration of shading and binocular disparity for depth perception.","volume":"12","author":"Lovell","year":"2012","journal-title":"Journal of Vision"},{"key":"2021072913323162800_R36","doi-asserted-by":"crossref","first-page":"B1","DOI":"10.1016\/S0010-0277(01)00116-0","article-title":"Prior knowledge on the illumination position.","volume":"81","author":"Mamassian","year":"2001","journal-title":"Cognition"},{"key":"2021072913323162800_R37","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/BF00342882","article-title":"Perception of solid shape from shading.","volume":"53","author":"Mingolla","year":"1986","journal-title":"Biological Cybernetics"},{"key":"2021072913323162800_R38","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1167\/8.13.3","article-title":"Efficient integration across spatial frequencies for letter identification in foveal and peripheral vision.","volume":"8","author":"Nandy","year":"2008","journal-title":"Journal of Vision"},{"key":"2021072913323162800_R39","doi-asserted-by":"crossref","first-page":"17041","DOI":"10.1073\/pnas.1001699107","article-title":"Fusion of visual cues is not mandatory in children.","volume":"107","author":"Nardini","year":"2010","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2021072913323162800_R40","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1016\/j.cub.2008.04.021","article-title":"Development of cue integration in human navigation.","volume":"18","author":"Nardini","year":"2008","journal-title":"Current Biology"},{"key":"2021072913323162800_R41","doi-asserted-by":"crossref","first-page":"e8306","DOI":"10.1371\/journal.pone.0008306","article-title":"The extraction of depth structure from shading and texture in the macaque brain.","volume":"4","author":"Nelissen","year":"2009","journal-title":"Plos One"},{"key":"2021072913323162800_R42","doi-asserted-by":"crossref","first-page":"448","DOI":"10.1364\/JOSA.72.000448","article-title":"Finding the illuminant direction.","volume":"72","author":"Pentland","year":"1982","journal-title":"Journal of the Optical Society of America"},{"key":"2021072913323162800_R43","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1016\/S0042-6989(97)00166-1","article-title":"The area of spatial integration for initial horizontal disparity vergence.","volume":"38","author":"Popple","year":"1998","journal-title":"Vision Research"},{"key":"2021072913323162800_R44","doi-asserted-by":"crossref","first-page":"1688","DOI":"10.1523\/JNEUROSCI.5021-08.2009","article-title":"Adaptive estimation of three-dimensional structure in the human brain.","volume":"29","author":"Preston","year":"2009","journal-title":"Journal of Neuroscience"},{"key":"2021072913323162800_R45","doi-asserted-by":"crossref","first-page":"11315","DOI":"10.1523\/JNEUROSCI.2728-08.2008","article-title":"Multivoxel pattern selectivity for perceptually relevant binocular disparities in the human brain.","volume":"28","author":"Preston","year":"2008","journal-title":"Journal of Neuroscience"},{"key":"2021072913323162800_R46","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1038\/331163a0","article-title":"Perception of shape from shading.","volume":"331","author":"Ramachandran","year":"1988","journal-title":"Nature"},{"key":"2021072913323162800_R47","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1364\/JOSAA.2.000343","article-title":"Structure from stereo and motion.","volume":"2","author":"Richards","year":"1985","journal-title":"Journal of the Optical Society of America: A"},{"key":"2021072913323162800_R48","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.brainres.2011.01.003","article-title":"The integration of disparity, shading and motion parallax cues for depth perception in humans and monkeys.","volume":"1377","author":"Schiller","year":"2011","journal-title":"Brain Research"},{"key":"2021072913323162800_R49","doi-asserted-by":"crossref","first-page":"2317","DOI":"10.1016\/j.visres.2011.09.004","article-title":"Sun and sky: Does human vision assume a mixture of point and diffuse illumination when interpreting shape-from-shading?","volume":"51","author":"Schofield","year":"2011","journal-title":"Vision Research"},{"key":"2021072913323162800_R50","doi-asserted-by":"crossref","DOI":"10.1167\/10.9.2","article-title":"What is second-order vision for? Discriminating illumination versus material changes.","volume":"10","author":"Schofield","year":"2010","journal-title":"Journal of Vision"},{"key":"2021072913323162800_R51","doi-asserted-by":"crossref","first-page":"12893","DOI":"10.1523\/JNEUROSCI.4021-07.2007","article-title":"The representation of behavioral choice for motion in human visual cortex.","volume":"27","author":"Serences","year":"2007","journal-title":"Journal of Neuroscience"},{"key":"2021072913323162800_R52","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1016\/S0896-6273(02)00598-6","article-title":"Three-dimensional shape representation in monkey cortex.","volume":"33","author":"Sereno","year":"2002","journal-title":"Neuron"},{"key":"2021072913323162800_R53","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1126\/science.7754376","article-title":"Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging.","volume":"268","author":"Sereno","year":"1995","journal-title":"Science"},{"key":"2021072913323162800_R54","doi-asserted-by":"crossref","first-page":"10613","DOI":"10.1523\/JNEUROSCI.6016-08.2009","article-title":"A distinct representation of three-dimensional shape in macaque anterior intraparietal area: Fast, metric, and coarse.","volume":"29","author":"Srivastava","year":"2009","journal-title":"Journal of Neuroscience"},{"key":"2021072913323162800_R55","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1038\/630","article-title":"Where is the sun?","volume":"1","author":"Sun","year":"1998","journal-title":"Nature Neuroscience"},{"key":"2021072913323162800_R56","doi-asserted-by":"crossref","first-page":"959","DOI":"10.1006\/nimg.2001.0895","article-title":"Cortical areas related to attention to 3-D surface structures based on shading: An fMRI study.","volume":"14","author":"Taira","year":"2001","journal-title":"Neuroimage"},{"key":"2021072913323162800_R57","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1167\/10.8.6","article-title":"Interactions between \u201clight-from-above\u201d and convexity priors in visual development.","volume":"10","author":"Thomas","year":"2010","journal-title":"Journal of Vision"},{"key":"2021072913323162800_R58","article-title":"Illumination, shading and shadows.","volume-title":"Chapter 9 of Visual perception from a computer graphics perspective.","author":"Thompson","year":"2011"},{"key":"2021072913323162800_R59","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1093\/cercor\/11.4.298","article-title":"Where is \u201cdorsal V4\u201d in human visual cortex? Retinotopic, topographic and functional evidence.","volume":"11","author":"Tootell","year":"2001","journal-title":"Cerebral Cortex"},{"key":"2021072913323162800_R60","doi-asserted-by":"crossref","first-page":"1409","DOI":"10.1016\/S0896-6273(00)80659-5","article-title":"The retinotopy of visual spatial attention.","volume":"21","author":"Tootell","year":"1998","journal-title":"Neuron"},{"key":"2021072913323162800_R61","doi-asserted-by":"crossref","first-page":"319","DOI":"10.2174\/157340505774574772","article-title":"Extended concepts of occipital retinotopy.","volume":"1","author":"Tyler","year":"2005","journal-title":"Current Medical Imaging Reviews"},{"key":"2021072913323162800_R62","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1016\/j.neuroimage.2005.09.067","article-title":"The specificity of cortical region KO to depth structure.","volume":"30","author":"Tyler","year":"2006","journal-title":"Neuroimage"},{"key":"2021072913323162800_R63","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1068\/p5315","article-title":"Disparity and shading cues cooperate for surface interpolation.","volume":"35","author":"Vuong","year":"2006","journal-title":"Perception"},{"key":"2021072913323162800_R64","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1068\/i0401","article-title":"The shading cue in context.","volume":"1","author":"Wagemans","year":"2010","journal-title":"i-Perception"},{"key":"2021072913323162800_R65","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1093\/cercor\/13.2.189","article-title":"The processing of kinetic contours in the brain.","volume":"13","author":"Zeki","year":"2003","journal-title":"Cerebral Cortex"},{"key":"2021072913323162800_R66","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1523\/JNEUROSCI.11-03-00641.1991","article-title":"A direct demonstration of functional specialization in human visual cortex.","volume":"11","author":"Zeki","year":"1991","journal-title":"Journal of Neuroscience"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/25\/9\/1527\/1945638\/jocn_a_00417.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/25\/9\/1527\/1945638\/jocn_a_00417.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,7,1]],"date-time":"2023-07-01T14:31:32Z","timestamp":1688221892000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/25\/9\/1527\/27990\/Perceptual-Integration-for-Qualitatively-Different"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,9,1]]},"references-count":66,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2013,9,1]]},"published-print":{"date-parts":[[2013,9,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_00417","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2013,9]]},"published":{"date-parts":[[2013,9,1]]}}}