{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T02:07:10Z","timestamp":1771466830730,"version":"3.50.1"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,7,19]],"date-time":"2021-07-19T00:00:00Z","timestamp":1626652800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nd\/4.0\/"}],"funder":[{"name":"National Key Research & Development Program of China","award":["2018YFB1004300"],"award-info":[{"award-number":["2018YFB1004300"]}]},{"name":"NSF China","award":["61772457, 62022072, 61890954"],"award-info":[{"award-number":["61772457, 62022072, 61890954"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2021,8,31]]},"abstract":"<jats:p>We propose neural trace photography, a novel framework to automatically learn high-quality scanning of non-planar, complex anisotropic appearance. Our key insight is that free-form appearance scanning can be cast as a geometry learning problem on unstructured point clouds, each of which represents an image measurement and the corresponding acquisition condition. Based on this connection, we carefully design a neural network, to jointly optimize the lighting conditions to be used in acquisition, as well as the spatially independent reconstruction of reflectance from corresponding measurements. Our framework is not tied to a specific setup, and can adapt to various factors in a data-driven manner. We demonstrate the effectiveness of our framework on a number of physical objects with a wide variation in appearance. The objects are captured with a light-weight mobile device, consisting of a single camera and an RGB LED array. We also generalize the framework to other common types of light sources, including a point, a linear and an area light.<\/jats:p>","DOI":"10.1145\/3450626.3459679","type":"journal-article","created":{"date-parts":[[2021,7,20]],"date-time":"2021-07-20T00:04:26Z","timestamp":1626739466000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["Free-form scanning of non-planar appearance with neural trace photography"],"prefix":"10.1145","volume":"40","author":[{"given":"Xiaohe","family":"Ma","sequence":"first","affiliation":[{"name":"Zhejiang University, China"}]},{"given":"Kaizhang","family":"Kang","sequence":"additional","affiliation":[{"name":"Zhejiang University, China"}]},{"given":"Ruisheng","family":"Zhu","sequence":"additional","affiliation":[{"name":"Zhejiang University, China"}]},{"given":"Hongzhi","family":"Wu","sequence":"additional","affiliation":[{"name":"Zhejiang University, China"}]},{"given":"Kun","family":"Zhou","sequence":"additional","affiliation":[{"name":"Zhejiang University and ZJU-FaceUnity Joint Lab of Intelligent Graphics, Chinaa"}]}],"member":"320","published-online":{"date-parts":[[2021,7,19]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925917"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461978"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766967"},{"key":"e_1_2_2_4_1","volume-title":"Retrieved","year":"2021","unstructured":"Artec. 2021 . Space Spider Portable 3D Scanner . Retrieved January, 2021 from https:\/\/www.artec3d.com\/portable-3d-scanners\/artec-spider Artec. 2021. Space Spider Portable 3D Scanner. Retrieved January, 2021 from https:\/\/www.artec3d.com\/portable-3d-scanners\/artec-spider"},{"key":"e_1_2_2_5_1","doi-asserted-by":"crossref","unstructured":"Sai Bi Zexiang Xu Kalyan Sunkavalli David Kriegman and Ravi Ramamoorthi. 2020. Deep 3D Capture: Geometry and Reflectance from Sparse Multi-View Images. In CVPR. 5960--5969.  Sai Bi Zexiang Xu Kalyan Sunkavalli David Kriegman and Ravi Ramamoorthi. 2020. Deep 3D Capture: Geometry and Reflectance from Sparse Multi-View Images. In CVPR. 5960--5969.","DOI":"10.1109\/CVPR42600.2020.00600"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601180"},{"key":"e_1_2_2_7_1","first-page":"196","article-title":"The blur effect: perception and estimation with a new no-reference perceptual blur metric","volume":"6492","author":"Crete Frederique","year":"2007","unstructured":"Frederique Crete , Thierry Dolmiere , Patricia Ladret , and Marina Nicolas . 2007 . The blur effect: perception and estimation with a new no-reference perceptual blur metric . In Human Vision and Electronic Imaging XII , Vol. 6492. 196 -- 206 . Frederique Crete, Thierry Dolmiere, Patricia Ladret, and Marina Nicolas. 2007. The blur effect: perception and estimation with a new no-reference perceptual blur metric. In Human Vision and Electronic Imaging XII, Vol. 6492. 196 -- 206.","journal-title":"Human Vision and Electronic Imaging XII"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/300776.300778"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201378"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13765"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.visinf.2019.07.003"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661283"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778835"},{"key":"e_1_2_2_14_1","unstructured":"Mark Fiala. 2005. ARTag a fiducial marker system using digital techniques. In CVPR.  Mark Fiala. 2005. ARTag a fiducial marker system using digital techniques. In CVPR."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417767"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323042"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882342"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01493.x"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12867"},{"key":"e_1_2_2_20_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3414685.3417779","article-title":"MaterialGAN: reflectance capture using a generative SVBRDF model","volume":"39","author":"Guo Yu","year":"2020","unstructured":"Yu Guo , Cameron Smith , Milo\u0161 Ha\u0161an , Kalyan Sunkavalli , and Shuang Zhao . 2020 . MaterialGAN: reflectance capture using a generative SVBRDF model . ACM Trans. Graph. 39 , 6 (2020), 1 -- 13 . Yu Guo, Cameron Smith, Milo\u0161 Ha\u0161an, Kalyan Sunkavalli, and Shuang Zhao. 2020. MaterialGAN: reflectance capture using a generative SVBRDF model. ACM Trans. Graph. 39, 6 (2020), 1--13.","journal-title":"ACM Trans. Graph."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778836"},{"key":"e_1_2_2_22_1","volume-title":"Sankaranarayanan","author":"Hui Zhuo","year":"2017","unstructured":"Zhuo Hui , Kalyan Sunkavalli , Joon-Young Lee , Sunil Hadap , Jian Wang , and Aswin C . Sankaranarayanan . 2017 . Reflectance Capture Using Univariate Sampling of BRDFs. In ICCV. Zhuo Hui, Kalyan Sunkavalli, Joon-Young Lee, Sunil Hadap, Jian Wang, and Aswin C. Sankaranarayanan. 2017. Reflectance Capture Using Univariate Sampling of BRDFs. In ICCV."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201279"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356492"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141949"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/636886.636891"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073641"},{"key":"e_1_2_2_28_1","doi-asserted-by":"crossref","unstructured":"N. J. W. Morris and K. N. Kutulakos. 2007. Reconstructing the Surface of Inhomogeneous Transparent Scenes by Scatter-Trace Photography. In ICCV.  N. J. W. Morris and K. N. Kutulakos. 2007. Reconstructing the Surface of Inhomogeneous Transparent Scenes by Scatter-Trace Photography. In ICCV.","DOI":"10.1109\/ICCV.2007.4408882"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.46"},{"key":"e_1_2_2_30_1","volume-title":"Diego Gutierrez, and Min H Kim.","author":"Nam Giljoo","year":"2018","unstructured":"Giljoo Nam , Joo Ho Lee , Diego Gutierrez, and Min H Kim. 2018 . Practical SVBRDF acquisition of 3D objects with unstructured flash photography. In SIGGRAPH Asia Technical Papers . 267. Giljoo Nam, Joo Ho Lee, Diego Gutierrez, and Min H Kim. 2018. Practical SVBRDF acquisition of 3D objects with unstructured flash photography. In SIGGRAPH Asia Technical Papers. 267."},{"key":"e_1_2_2_31_1","volume-title":"Pointnet: Deep learning on point sets for 3d classification and segmentation. In CVPR. 652--660.","author":"Qi Charles R","year":"2017","unstructured":"Charles R Qi , Hao Su , Kaichun Mo , and Leonidas J Guibas . 2017 . Pointnet: Deep learning on point sets for 3d classification and segmentation. In CVPR. 652--660. Charles R Qi, Hao Su, Kaichun Mo, and Leonidas J Guibas. 2017. Pointnet: Deep learning on point sets for 3d classification and segmentation. In CVPR. 652--660."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964940"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12719"},{"key":"e_1_2_2_34_1","doi-asserted-by":"crossref","unstructured":"Johannes Lutz Sch\u00f6nberger Enliang Zheng Marc Pollefeys and Jan-Michael Frahm. 2016. Pixelwise View Selection for Unstructured Multi-View Stereo. In ECCV.  Johannes Lutz Sch\u00f6nberger Enliang Zheng Marc Pollefeys and Jan-Michael Frahm. 2016. Pixelwise View Selection for Unstructured Multi-View Stereo. In ECCV.","DOI":"10.1007\/978-3-319-46487-9_31"},{"key":"e_1_2_2_35_1","volume-title":"Retrieved","author":"D.","year":"2021","unstructured":"Shining3 D. 2021 . EinScan Pro 2X Plus Handheld Industrial Scanner . Retrieved January, 2021 from https:\/\/www.einscan.com\/handheld-3d-scanner\/2x-plus\/ Shining3D. 2021. EinScan Pro 2X Plus Handheld Industrial Scanner. Retrieved January, 2021 from https:\/\/www.einscan.com\/handheld-3d-scanner\/2x-plus\/"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461944"},{"key":"e_1_2_2_37_1","volume-title":"Torrance","author":"Walter Bruce","year":"2007","unstructured":"Bruce Walter , Stephen R. Marschner , Hongsong Li , and Kenneth E . Torrance . 2007 . Microfacet Models for Refraction through Rough Surfaces. In Rendering Techniques (Proc. EGWR) . Bruce Walter, Stephen R. Marschner, Hongsong Li, and Kenneth E. Torrance. 2007. Microfacet Models for Refraction through Rough Surfaces. In Rendering Techniques (Proc. EGWR)."},{"key":"e_1_2_2_38_1","doi-asserted-by":"crossref","unstructured":"Michael Weinmann and Reinhard Klein. 2015. Advances in Geometry and Reflectance Acquisition. In SIGGRAPH Asia Courses. Article 1 71 pages.  Michael Weinmann and Reinhard Klein. 2015. Advances in Geometry and Reflectance Acquisition. In SIGGRAPH Asia Courses. Article 1 71 pages.","DOI":"10.1145\/2818143.2818165"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1561\/0600000022"},{"key":"e_1_2_2_40_1","first-page":"8","article-title":"Simultaneous Localization and Appearance Estimation with a Consumer RGB-D Camera","volume":"22","author":"Wu Hongzhi","year":"2016","unstructured":"Hongzhi Wu , Zhaotian Wang , and Kun Zhou . 2016 a. Simultaneous Localization and Appearance Estimation with a Consumer RGB-D Camera . IEEE TVCG 22 , 8 (Aug 2016), 2012--2023. Hongzhi Wu, Zhaotian Wang, and Kun Zhou. 2016a. Simultaneous Localization and Appearance Estimation with a Consumer RGB-D Camera. IEEE TVCG 22, 8 (Aug 2016), 2012--2023.","journal-title":"IEEE TVCG"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12600"},{"key":"e_1_2_2_42_1","volume-title":"Towards Building an RGBD-M Scanner. CoRR abs\/1603.03875","author":"Wu Zhe","year":"2016","unstructured":"Zhe Wu , Sai-Kit Yeung , and Ping Tan . 2016b. Towards Building an RGBD-M Scanner. CoRR abs\/1603.03875 ( 2016 ). Zhe Wu, Sai-Kit Yeung, and Ping Tan. 2016b. Towards Building an RGBD-M Scanner. CoRR abs\/1603.03875 (2016)."},{"key":"e_1_2_2_43_1","doi-asserted-by":"crossref","unstructured":"Jianzhao Zhang Guojun Chen Yue Dong Jian Shi Bob Zhang and Enhua Wu. 2020. Deep Inverse Rendering for Practical Object Appearance Scan with Uncalibrated Illumination. In Advances in Computer Graphics. 71--82.  Jianzhao Zhang Guojun Chen Yue Dong Jian Shi Bob Zhang and Enhua Wu. 2020. Deep Inverse Rendering for Practical Object Appearance Scan with Uncalibrated Illumination. In Advances in Computer Graphics. 71--82.","DOI":"10.1007\/978-3-030-61864-3_7"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980247"},{"key":"e_1_2_2_45_1","volume-title":"Proc. EGSR. 253--264","author":"Zickler Todd","year":"2005","unstructured":"Todd Zickler , Sebastian Enrique , Ravi Ramamoorthi , and Peter Belhumeur . 2005 . Reflectance Sharing: Image-based Rendering from a Sparse Set of Images . In Proc. EGSR. 253--264 . Todd Zickler, Sebastian Enrique, Ravi Ramamoorthi, and Peter Belhumeur. 2005. Reflectance Sharing: Image-based Rendering from a Sparse Set of Images. In Proc. EGSR. 253--264."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3450626.3459679","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3450626.3459679","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:16Z","timestamp":1750191436000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3450626.3459679"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,19]]},"references-count":45,"aliases":["10.1145\/3476576.3476694"],"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,8,31]]}},"alternative-id":["10.1145\/3450626.3459679"],"URL":"https:\/\/doi.org\/10.1145\/3450626.3459679","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,19]]},"assertion":[{"value":"2021-07-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}