{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T06:08:28Z","timestamp":1784268508926,"version":"3.55.0"},"reference-count":32,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2017,12,5]],"date-time":"2017-12-05T00:00:00Z","timestamp":1512432000000},"content-version":"vor","delay-in-days":389,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["IIS-1217765, IIS-1350323"],"award-info":[{"award-number":["IIS-1217765, IIS-1350323"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006785","name":"Google","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100006785","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2016,11,11]]},"abstract":"<jats:p>We present a novel integrated approach for estimating both spatially-varying surface reflectance and detailed geometry from a video of a rotating object under unknown static illumination. Key to our method is the decoupling of the recovery of normal and surface reflectance from the estimation of surface geometry. We define an apparent normal field with corresponding reflectance for each point (including those not on the object's surface) that best explain the observations. We observe that the object's surface goes through points where the apparent normal field and corresponding reflectance exhibit a high degree of consistency with the observations. However, estimating the apparent normal field requires knowledge of the unknown incident lighting. We therefore formulate the recovery of shape, surface reflectance, and incident lighting, as an iterative process that alternates between estimating shape and lighting, and simultaneously recovers surface reflectance at each step. To recover the shape, we first form an initial surface that passes through locations with consistent apparent temporal traces, followed by a refinement that maximizes the consistency of the surface normals with the underlying apparent normal field. To recover the lighting, we rely on appearance-from-motion using the recovered geometry from the previous step. We demonstrate our integrated framework on a variety of synthetic and real test cases exhibiting a wide variety of materials and shape.<\/jats:p>","DOI":"10.1145\/2980179.2980248","type":"journal-article","created":{"date-parts":[[2016,11,11]],"date-time":"2016-11-11T12:02:54Z","timestamp":1478865774000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":66,"title":["Recovering shape and spatially-varying surface reflectance under unknown illumination"],"prefix":"10.1145","volume":"35","author":[{"given":"Rui","family":"Xia","sequence":"first","affiliation":[{"name":"University of Science and Technology of China and Microsoft Research, Beijing"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yue","family":"Dong","sequence":"additional","affiliation":[{"name":"Microsoft Research, Beijing"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pieter","family":"Peers","sequence":"additional","affiliation":[{"name":"College of William &amp; Mary"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xin","family":"Tong","sequence":"additional","affiliation":[{"name":"Microsoft Research, Beijing"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,12,5]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","unstructured":"Ackermann J. Ritz M. Stork A. and Goesele M. 2012. Removing the example from example-based photometric stereo. In ECCV 197--210. 10.1007\/978-3-642-35740-4_16","DOI":"10.1007\/978-3-642-35740-4_16"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.126"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344814"},{"key":"e_1_2_2_4_1","doi-asserted-by":"crossref","unstructured":"Barron J. T. and Malik J. 2015. Shape illumination and reflectance from shading. IEEE PAMI.","DOI":"10.1109\/TPAMI.2014.2377712"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-006-8815-7"},{"key":"e_1_2_2_6_1","doi-asserted-by":"crossref","unstructured":"Chandraker M. 2014. On shape and material recovery from motion. In ECCV 202--217.","DOI":"10.1007\/978-3-319-10584-0_14"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/357290.357293"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778835"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661283"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.74"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","unstructured":"Hertzmann A. and Seitz S. M. 2003. Shape and materials by example: A photometric stereo approach. In CVPR 533--540.","DOI":"10.5555\/1965841.1965911"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487228.2487237"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2015.2430318"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","unstructured":"Lu F. Matsushita Y. Sato I. Okabe T. and Sato Y. 2013. Uncalibrated photometric stereo for unknown isotropic reflectances. In CVRP 1490--1497. 10.1109\/CVPR.2013.196","DOI":"10.1109\/CVPR.2013.196"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073226"},{"key":"e_1_2_2_16_1","doi-asserted-by":"crossref","unstructured":"Nicodemus F. E. Richmond J. C. Hsia J. J. Ginsberg I. W. and Limperis T. 1977. Geometric considerations and nomenclature for reflectance. Monograph 161 National Bureau of Standards (US).","DOI":"10.6028\/NBS.MONO.160"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","unstructured":"Oxholm G. and Nishino K. 2012. Shape and reflectance from natural illumination. In ECCV 528--541. 10.1007\/978-3-642-33718-5_38","DOI":"10.1007\/978-3-642-33718-5_38"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","unstructured":"Oxholm G. and Nishino K. 2014. Multiview shape and reflectance from natural illumination. In CVPR 2163--2170. 10.1109\/CVPR.2014.277","DOI":"10.1109\/CVPR.2014.277"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2012.03145.x"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","unstructured":"Romeiro F. and Zickler T. 2010. Blind reflectometry. In ECCV 45--58.","DOI":"10.5555\/1886063.1886068"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","unstructured":"Seitz S. M. Curless B. Diebel J. Scharstein D. and Szeliski R. 2006. A comparison and evaluation of multi-view stereo reconstruction algorithms. In CVPR 519--528. 10.1109\/CVPR.2006.19","DOI":"10.1109\/CVPR.2006.19"},{"key":"e_1_2_2_22_1","doi-asserted-by":"crossref","unstructured":"Treuille A. Hertzmann A. and Seitz S. M. 2004. Example-based stereo with general BRDFs. In ECCV 457--469.","DOI":"10.1007\/978-3-540-24671-8_36"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","unstructured":"Triggs B. McLauchlan P. F. Hartley R. I. and Fitzgibbon A. W. 1999. Bundle adjustment - a modern synthesis. In ICCV 298--372.","DOI":"10.5555\/646271.685629"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366206"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360640"},{"key":"e_1_2_2_26_1","doi-asserted-by":"crossref","unstructured":"Wang T.-C. Chandraker M. Efros A. and Ramamoorthi R. 2016. Svbrdf-invariant shape and reflectance estimation from light-field cameras. In CVPR.","DOI":"10.1109\/CVPR.2016.588"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","unstructured":"Weinmann M. and Klein R. 2015. Advances in geometry and reflectance acquisition. In ACM SIGGRAPH Asia Course Notes. 10.1145\/2818143.2818165","DOI":"10.1145\/2818143.2818165"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.7972479"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","unstructured":"Wu C. Wilburn B. Matsushita Y. and Theobalt C. 2011. High-quality shape from multi-view stereo and shading under general illumination. In CVPR 969--976. 10.1109\/CVPR.2011.5995388","DOI":"10.1109\/CVPR.2011.5995388"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2498617"},{"key":"e_1_2_2_31_1","volume-title":"-J","author":"Xu D.","year":"2014","unstructured":"Xu, D., Duan, Q., Zheng, J., Zhang, J., Cai, J., and Cham, T.-J. 2014. Recovering surface details under general unknown illumination using shading and coarse multi-view stereo."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.888718"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2980179.2980248","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2980179.2980248","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2980179.2980248","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,18]],"date-time":"2025-11-18T09:30:06Z","timestamp":1763458206000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2980179.2980248"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,11,11]]},"references-count":32,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2016,11,11]]}},"alternative-id":["10.1145\/2980179.2980248"],"URL":"https:\/\/doi.org\/10.1145\/2980179.2980248","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,11,11]]},"assertion":[{"value":"2016-12-05","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}