{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T14:56:26Z","timestamp":1789570586853,"version":"build-2803163510"},"reference-count":103,"publisher":"National Academy of Sciences","issue":"28","license":[{"start":{"date-parts":[[2025,7,10]],"date-time":"2025-07-10T00:00:00Z","timestamp":1752105600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["222641018-SFB\/TRR 135 TP C1"],"award-info":[{"award-number":["222641018-SFB\/TRR 135 TP C1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000781","name":"EC | European Research Council","doi-asserted-by":"publisher","award":["Advanced Grant \"STUFF\" ERC-2022-AdG-101098225"],"award-info":[{"award-number":["Advanced Grant \"STUFF\" ERC-2022-AdG-101098225"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003495","name":"Hessisches Ministerium f\u00fcr Wissenschaft und Kunst","doi-asserted-by":"publisher","award":["Cluster Project \"The Adaptive Mind\""],"award-info":[{"award-number":["Cluster Project \"The Adaptive Mind\""]}],"id":[{"id":"10.13039\/501100003495","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"HHS | NIH","doi-asserted-by":"publisher","award":["1R01EY031059"],"award-info":[{"award-number":["1R01EY031059"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["1822598"],"award-info":[{"award-number":["1822598"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.pnas.org"],"crossmark-restriction":true},"short-container-title":["Proc. Natl. Acad. Sci. U.S.A."],"published-print":{"date-parts":[[2025,7,15]]},"abstract":"<jats:p>How the brain recovers the three-dimensional structure of surfaces and objects from 2D retinal images remains mysterious. Shading patterns provide one of the most powerful\u2014yet least understood\u2014visual depth cues. Most theories assume the brain infers surface normals from luminance values. However, this seems unlikely as visual neurons are broadly insensitive to luminance. To identify alternative cues, we measured responses of model orientation-selective cell populations to images of shaded objects. We found a surprising statistical relationship between image orientations and surface curvature properties, suggesting a way to estimate shape from shading. We find that the orientation-based cues not only predict striking illusions of shape perception when lighting varies, but also the impressive robustness of shape perception when large image modifications are introduced to directly pit luminance and image orientation cues against one another. The findings resolve the longstanding question of which image measurements drive shape from shading perception.<\/jats:p>","DOI":"10.1073\/pnas.2503088122","type":"journal-article","created":{"date-parts":[[2025,7,10]],"date-time":"2025-07-10T15:26:22Z","timestamp":1752161182000},"update-policy":"https:\/\/doi.org\/10.1073\/pnas.cm10313","source":"Crossref","is-referenced-by-count":4,"title":["Orientation fields predict human perception of 3D shape from shading"],"prefix":"10.1073","volume":"122","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6000-1617","authenticated-orcid":false,"given":"Celine","family":"Aubuchon","sequence":"first","affiliation":[{"name":"Department of Experimental Psychology, Justus Liebig University Giessen","place":["Giessen, Germany"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Romain","family":"Vergne","sequence":"additional","affiliation":[{"name":"Department of Experimental Psychology, Justus Liebig University Giessen","place":["Giessen, Germany"]},{"name":"Inria Center, University of Grenoble Alpes,","place":["Montbonnot-Saint-Martin, France"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0605-4395","authenticated-orcid":false,"given":"Steven A.","family":"Cholewiak","sequence":"additional","affiliation":[{"name":"Department of Experimental Psychology, Justus Liebig University Giessen","place":["Giessen, Germany"]},{"name":"Google","place":["Mountain View"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benjamin","family":"Kunsberg","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Yale University","place":["New Haven"]},{"name":"Amazon","place":["Seattle"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Holtmann-Rice","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Yale University","place":["New Haven"]},{"name":"Google","place":["El Cerrito"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2205-6895","authenticated-orcid":false,"given":"Steven W.","family":"Zucker","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Yale University","place":["New Haven"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5033-5069","authenticated-orcid":false,"given":"Roland W.","family":"Fleming","sequence":"additional","affiliation":[{"name":"Department of Experimental Psychology, Justus Liebig University Giessen","place":["Giessen, Germany"]},{"name":"Center for Mind, Brain and Behavior, Universities of Marburg, Giessen and Darmstadt","place":["Marburg, Germany"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"341","published-online":{"date-parts":[[2025,7,10]]},"reference":[{"key":"e_1_3_4_1_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00342882"},{"key":"e_1_3_4_2_2","doi-asserted-by":"publisher","DOI":"10.3758\/BF03213268"},{"key":"e_1_3_4_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/0042-6989(95)00286-3"},{"key":"e_1_3_4_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2004.01.006"},{"key":"e_1_3_4_5_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.0956-7976.2004.00720.x"},{"key":"e_1_3_4_6_2","doi-asserted-by":"publisher","DOI":"10.1167\/4.10.7"},{"key":"e_1_3_4_7_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13414-011-0197-4"},{"key":"e_1_3_4_8_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.101.3.414"},{"key":"e_1_3_4_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0042-6989(99)00169-8"},{"key":"e_1_3_4_10_2","doi-asserted-by":"crossref","unstructured":"I. P. Howard B. J. Rogers Perceiving in Depth Volume 2: Stereoscopic Vision (Oxford University Press 2012).","DOI":"10.1093\/acprof:oso\/9780199764150.001.0001"},{"key":"e_1_3_4_11_2","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2015.0256"},{"key":"e_1_3_4_12_2","doi-asserted-by":"publisher","DOI":"10.1167\/jov.20.7.14"},{"key":"e_1_3_4_13_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.neuro.24.1.203"},{"key":"e_1_3_4_14_2","doi-asserted-by":"publisher","DOI":"10.1167\/14.2.1"},{"key":"e_1_3_4_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0042-6989(01)00021-9"},{"key":"e_1_3_4_16_2","doi-asserted-by":"publisher","DOI":"10.1364\/JOSAA.18.000012"},{"key":"e_1_3_4_17_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1114619109"},{"key":"e_1_3_4_18_2","doi-asserted-by":"publisher","DOI":"10.1098\/rspb.1990.0037"},{"key":"e_1_3_4_19_2","series-title":"Lecture Notes in Computer Science","first-page":"135","volume-title":"Computer Vision\u2014ECCV\u201992","author":"Breton P.","unstructured":"P. Breton, L. A. Iverson, M. S. Langer, S. W. Zucker, \u201cShading flows and scenel bundles: A new approach to shape from shading\u201d in Computer Vision\u2014ECCV\u201992, G. Sandini, Ed. (Lecture Notes in Computer Science, Springer Berlin Heidelberg, 1992), vol. 588, pp. 135\u2013150."},{"key":"e_1_3_4_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185590"},{"key":"e_1_3_4_21_2","doi-asserted-by":"publisher","DOI":"10.1098\/rsfs.2018.0019"},{"key":"e_1_3_4_22_2","unstructured":"B. K. Horn \u201cShape from shading: A method for obtaining the shape of a smooth opaque object from one view\u201d (Tech. Rep. 288 MIT Press Cambridge MA 1970)."},{"key":"e_1_3_4_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.1984.4767501"},{"key":"e_1_3_4_24_2","volume-title":"Shape from Shading","author":"Horn B.","year":"1989","unstructured":"B. Horn, M. J. Brooks, Shape from Shading (MIT Press, 1989)."},{"key":"e_1_3_4_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/34.784284"},{"key":"e_1_3_4_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2007.09.003"},{"key":"e_1_3_4_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/0262-8856(94)90002-7"},{"key":"e_1_3_4_28_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-005-4945-6"},{"key":"e_1_3_4_29_2","doi-asserted-by":"crossref","unstructured":"A. H. Ahmed A. A. Farag \u201cShape from shading under various imaging conditions\u201d in 2007 IEEE Conference on Computer Vision and Pattern Recognition (IEEE 2007) pp. 1\u20138.","DOI":"10.1109\/CVPR.2007.383286"},{"key":"e_1_3_4_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/34.85658"},{"key":"e_1_3_4_31_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-78199-0_23"},{"key":"e_1_3_4_32_2","doi-asserted-by":"publisher","DOI":"10.1167\/4.9.10"},{"key":"e_1_3_4_33_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.actpsy.2005.08.001"},{"key":"e_1_3_4_34_2","unstructured":"Y. Tang R. Salakhutdinov G. Hinton Deep lambertian networks. arXiv [Preprint] (2012). https:\/\/doi.org\/10.48550\/arXiv.1206.6445 (Accessed 23 March 2024)."},{"key":"e_1_3_4_35_2","unstructured":"K. Rematas Deep reflectance maps. arXiv [Preprint] (2015). https:\/\/doi.org\/10.48550\/arXiv.1511.04384 (Accessed 23 March 2024)."},{"key":"e_1_3_4_36_2","doi-asserted-by":"crossref","unstructured":"K. Heal J. Wang S. J. Gortler T. Zickler \u201cA lighting-invariant point processor for shading\u201d in 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (IEEE 2020) pp. 91\u201399.","DOI":"10.1109\/CVPR42600.2020.00017"},{"key":"e_1_3_4_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cobeha.2019.07.004"},{"key":"e_1_3_4_38_2","doi-asserted-by":"publisher","DOI":"10.1177\/0963721421990334"},{"key":"e_1_3_4_39_2","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X23001565"},{"key":"e_1_3_4_40_2","doi-asserted-by":"publisher","DOI":"10.1068\/p251009"},{"key":"e_1_3_4_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0042-6989(96)00282-9"},{"key":"e_1_3_4_42_2","doi-asserted-by":"crossref","unstructured":"F. Caniard R. W. Fleming \u201cDistortion in 3D shape estimation with changes in illumination\u201d in Proceedings of the 4th Symposium on Applied Perception in Graphics and Visualization C. Wallraven V. Sundstedt Eds. (ACM 2007) pp. 99\u2013105.","DOI":"10.1145\/1272582.1272602"},{"key":"e_1_3_4_43_2","doi-asserted-by":"publisher","DOI":"10.1167\/7.11.13"},{"key":"e_1_3_4_44_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1006285107"},{"key":"e_1_3_4_45_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.273.5278.1104"},{"key":"e_1_3_4_46_2","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhr133"},{"key":"e_1_3_4_47_2","doi-asserted-by":"publisher","DOI":"10.1113\/jphysiol.1968.sp008455"},{"key":"e_1_3_4_48_2","doi-asserted-by":"publisher","DOI":"10.1152\/jn.1976.39.6.1320"},{"key":"e_1_3_4_49_2","doi-asserted-by":"publisher","DOI":"10.1016\/0042-6989(82)90112-2"},{"key":"e_1_3_4_50_2","doi-asserted-by":"crossref","unstructured":"E. P. Simoncelli W. T. Freeman \u201cThe steerable pyramid: A flexible architecture for multi-scale derivative computation\u201d in Proceedings of International Conference on Image Processing (IEEE Computer Society Press 1995) pp. 444\u2013447.","DOI":"10.1109\/ICIP.1995.537667"},{"key":"e_1_3_4_51_2","doi-asserted-by":"publisher","DOI":"10.1038\/srep35805"},{"key":"e_1_3_4_52_2","unstructured":"E. H. Adelson A. Torralba R. W. Fleming \u201cShape from Sheen\u201d (Tech. Rep. MIT-CSAIL-TR-2009-051 Cambridge MA 2009)."},{"key":"e_1_3_4_53_2","doi-asserted-by":"publisher","DOI":"10.3758\/BF03206710"},{"key":"e_1_3_4_54_2","doi-asserted-by":"publisher","DOI":"10.1068\/p250095"},{"key":"e_1_3_4_55_2","doi-asserted-by":"publisher","DOI":"10.1364\/JOSAA.20.000987"},{"key":"e_1_3_4_56_2","doi-asserted-by":"crossref","unstructured":"S. F. Te Pas S. C. Pont \u201cA comparison of material and illumination discrimination performance for real rough real smooth and computer generated smooth spheres\u201d in Proceedings of the 2nd Symposium on Applied Perception in Graphics and Visualization (ACM 2005) pp. 75\u201381.","DOI":"10.1145\/1080402.1080415"},{"key":"e_1_3_4_57_2","doi-asserted-by":"publisher","DOI":"10.1167\/17.8.2"},{"key":"e_1_3_4_58_2","doi-asserted-by":"publisher","DOI":"10.1167\/18.13.4"},{"key":"e_1_3_4_59_2","doi-asserted-by":"publisher","DOI":"10.1167\/jov.20.5.2"},{"key":"e_1_3_4_60_2","doi-asserted-by":"publisher","DOI":"10.1167\/19.6.2"},{"key":"e_1_3_4_61_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0042-6989(00)00277-7"},{"key":"e_1_3_4_62_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.5551-09.2010"},{"key":"e_1_3_4_63_2","doi-asserted-by":"publisher","DOI":"10.1167\/13.6.22"},{"key":"e_1_3_4_64_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1311309111"},{"key":"e_1_3_4_65_2","doi-asserted-by":"publisher","DOI":"10.1167\/16.13.2"},{"key":"e_1_3_4_66_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-vision-030320-041134"},{"key":"e_1_3_4_67_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-vision-091517-034110"},{"key":"e_1_3_4_68_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2024798118"},{"key":"e_1_3_4_69_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2215097119"},{"key":"e_1_3_4_70_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2023.04.056"},{"key":"e_1_3_4_71_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2022.10.005"},{"key":"e_1_3_4_72_2","doi-asserted-by":"publisher","DOI":"10.1137\/17M1145525"},{"key":"e_1_3_4_73_2","doi-asserted-by":"publisher","DOI":"10.1167\/jov.21.13.7"},{"key":"e_1_3_4_74_2","doi-asserted-by":"publisher","DOI":"10.1068\/p3060"},{"key":"e_1_3_4_75_2","doi-asserted-by":"publisher","DOI":"10.1167\/jov.23.5.10"},{"key":"e_1_3_4_76_2","doi-asserted-by":"publisher","DOI":"10.1038\/scientificamerican0888-76"},{"key":"e_1_3_4_77_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0042-6989(01)00147-X"},{"key":"e_1_3_4_78_2","doi-asserted-by":"publisher","DOI":"10.1068\/p3178"},{"key":"e_1_3_4_79_2","doi-asserted-by":"publisher","DOI":"10.1167\/7.11.11"},{"key":"e_1_3_4_80_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.visres.2009.09.024"},{"key":"e_1_3_4_81_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.visres.2011.09.004"},{"key":"e_1_3_4_82_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-5195-1_16"},{"key":"e_1_3_4_83_2","doi-asserted-by":"publisher","DOI":"10.1167\/14.9.15"},{"key":"e_1_3_4_84_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1003576"},{"key":"e_1_3_4_85_2","doi-asserted-by":"publisher","DOI":"10.1167\/jov.22.8.6"},{"key":"e_1_3_4_86_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008154927611"},{"key":"e_1_3_4_87_2","doi-asserted-by":"publisher","DOI":"10.3758\/BF03211873"},{"key":"e_1_3_4_88_2","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9280.00335"},{"key":"e_1_3_4_89_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-vision-102122-094213"},{"key":"e_1_3_4_90_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.96.4.643"},{"key":"e_1_3_4_91_2","doi-asserted-by":"publisher","DOI":"10.3758\/BF03206861"},{"key":"e_1_3_4_92_2","volume-title":"Solid Shape","author":"Koenderink J. J.","year":"2009","unstructured":"J. J. Koenderink, Solid Shape (MIT Press, 2009)."},{"key":"e_1_3_4_93_2","doi-asserted-by":"publisher","DOI":"10.1364\/JOSAA.11.000467"},{"key":"e_1_3_4_94_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.visres.2010.05.006"},{"key":"e_1_3_4_95_2","doi-asserted-by":"publisher","DOI":"10.1038\/nn1060"},{"key":"e_1_3_4_96_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.visres.2010.09.012"},{"key":"e_1_3_4_97_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11023-015-9364-z"},{"key":"e_1_3_4_98_2","unstructured":"X. Han T. Zickler \u201cCurvature fields from shading fields\u201d in NeurIPS 2023 Workshop on Symmetry and Geometry in Neural Representations S. Sanborn C. Shewmake S. Azeglio N. Miolane Eds. (PMLR New Orleans LA 2023) vol. 228 pp. 232\u2013254."},{"key":"e_1_3_4_99_2","doi-asserted-by":"publisher","DOI":"10.3389\/fcomp.2023.1142621"},{"key":"e_1_3_4_100_2","doi-asserted-by":"crossref","unstructured":"P. S. Huggins S. W. Zucker \u201cFolds and cuts: how shading flows into edges\u201d in Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 (IEEE Computer Society 2001) pp. 153\u2013158.","DOI":"10.1109\/ICCV.2001.937618"},{"key":"e_1_3_4_101_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jphysparis.2009.05.005"},{"key":"e_1_3_4_102_2","doi-asserted-by":"crossref","unstructured":"C. Aubuchon DATASET: Orientation fields predict human perception of 3D shape from shading. OSF. https:\/\/osf.io\/rb943\/. Deposited 13 February 2025.","DOI":"10.31234\/osf.io\/5g4xj"},{"key":"e_1_3_4_103_2","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v031.i10"}],"container-title":["Proceedings of the National Academy of Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pnas.org\/doi\/pdf\/10.1073\/pnas.2503088122","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pnas.org\/doi\/pdf\/10.1073\/pnas.2503088122","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,15]],"date-time":"2025-07-15T15:26:36Z","timestamp":1752593196000},"score":1,"resource":{"primary":{"URL":"https:\/\/pnas.org\/doi\/10.1073\/pnas.2503088122"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,10]]},"references-count":103,"journal-issue":{"issue":"28","published-print":{"date-parts":[[2025,7,15]]}},"alternative-id":["10.1073\/pnas.2503088122"],"URL":"https:\/\/doi.org\/10.1073\/pnas.2503088122","relation":{},"ISSN":["0027-8424","1091-6490"],"issn-type":[{"value":"0027-8424","type":"print"},{"value":"1091-6490","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,10]]},"assertion":[{"value":"2025-02-19","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-06-16","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-10","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e2503088122"}}