{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T00:16:25Z","timestamp":1759882585015,"version":"build-2065373602"},"reference-count":92,"publisher":"Association for Computing Machinery (ACM)","issue":"1","funder":[{"name":"European Union - NextGenerationEU"},{"name":"iNEST - Interconnected Nord-Est Innovation Ecosystem","award":["iNEST ECS_00000043 - CUP H43C22000540006"],"award-info":[{"award-number":["iNEST ECS_00000043 - CUP H43C22000540006"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2026,2,28]]},"abstract":"<jats:p>Reflectance Transformation Imaging (RTI) is a computational photography technique in which an object is acquired from a fixed point-of-view with different light directions. The aim is to estimate the light transport function at each point so that the object can be interactively relighted in a physically-accurate way, revealing its surface characteristics. In this article, we propose a novel RTI approach describing surface reflectance as an implicit neural representation acting as a \u201crelightable image\u201d for a specific object. We propose to represent the light transport function with a Neural Reflectance Field (NRF) model, feeding it with pixel coordinates, light direction, and a latent vector encoding the per-pixel reflectance in a neighbourhood. These vectors, computed during training, allow a more accurate relighting than a pure implicit representation (i.e., relying only on positional encoding) enabling the NRF to handle complex surface shadings. Moreover, they can be efficiently stored with the learned NRF for compression and transmission. As an additional contribution, we propose a novel synthetic dataset containing objects of various shapes and materials created with a physically based rendering software. An extensive experimental section shows that the proposed NRF accurately models the light transport function for challenging datasets in synthetic and real-world scenarios.<\/jats:p>","DOI":"10.1145\/3759452","type":"journal-article","created":{"date-parts":[[2025,8,28]],"date-time":"2025-08-28T11:33:06Z","timestamp":1756380786000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["A Neural Reflectance Field Model for Accurate Relighting in RTI Applications"],"prefix":"10.1145","volume":"45","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-7738-1297","authenticated-orcid":false,"given":"Shambel Fente","family":"Mengistu","sequence":"first","affiliation":[{"name":"DAIS, Ca' Foscari University of Venice","place":["Venezia, Italy"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6668-1556","authenticated-orcid":false,"given":"Filippo","family":"Bergamasco","sequence":"additional","affiliation":[{"name":"DAIS, Ca' Foscari University of Venice","place":["Venezia, Italy"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6273-290X","authenticated-orcid":false,"given":"Mara","family":"Pistellato","sequence":"additional","affiliation":[{"name":"DAIS, Ca' Foscari University of Venice","place":["Venezia, Italy"]}]}],"member":"320","published-online":{"date-parts":[[2025,10,7]]},"reference":[{"issue":"3","key":"e_1_3_4_2_1","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1561\/0600000065","article-title":"A survey of photometric stereo techniques","volume":"9","author":"Ackermann Jens","year":"2015","unstructured":"Jens Ackermann, Michael Goesele, et\u00a0al. 2015. A survey of photometric stereo techniques. Foundations and Trends\u00ae in Computer Graphics and Vision 9, 3-4 (2015), 149\u2013254.","journal-title":"Foundations and Trends\u00ae in Computer Graphics and Vision"},{"key":"e_1_3_4_3_1","article-title":"Learning to learn by gradient descent by gradient descent","volume":"29","author":"Andrychowicz Marcin","year":"2016","unstructured":"Marcin Andrychowicz, Misha Denil, Sergio Gomez, Matthew W Hoffman, David Pfau, Tom Schaul, Brendan Shillingford, and Nando De Freitas. 2016. Learning to learn by gradient descent by gradient descent. Advances in Neural Information Processing Systems 29 (2016), 3981\u20133989.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_4_4_1","first-page":"28","article-title":"Imaging techniques to simplify the PTM generation of a bas-relief","author":"Barbosa Jo\u00e3o","year":"2007","unstructured":"Jo\u00e3o Barbosa, J. Sobral, and Alberto Proen\u00e7a. 2007. Imaging techniques to simplify the PTM generation of a bas-relief. VAST\u201907: Proceedings of the 8th International Symposium on Virtual Reality, Archaeology, and Cultural Heritage, UK, 2007 7 (012007), 28\u201331.","journal-title":"VAST\u201907: Proceedings of the 8th International Symposium on Virtual Reality, Archaeology, and Cultural Heritage, UK, 2007"},{"key":"e_1_3_4_5_1","series-title":"SIGGRAPH \u201923","volume-title":"Proceedings of the ACM SIGGRAPH 2023 Conference Proceedings","author":"Bieron James","year":"2023","unstructured":"James Bieron, Xin Tong, and Pieter Peers. 2023. Single image neural material relighting. In Proceedings of the ACM SIGGRAPH 2023 Conference Proceedings (Los Angeles, CA, USA) (SIGGRAPH \u201923). Association for Computing Machinery, New York, NY, USA, Article 80, 11 pages. DOI:10.1145\/3588432.3591515"},{"volume-title":"Cultural Heritage Imaging Website","year":"2023","key":"e_1_3_4_6_1","unstructured":"CHI 2023. Cultural Heritage Imaging Website. Retrieved December 27, 2023 from https:\/\/culturalheritageimaging.org\/Technologies\/RTI\/"},{"key":"e_1_3_4_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s42452-020-03343-4"},{"issue":"1","key":"e_1_3_4_8_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/300776.300778","article-title":"Reflectance and texture of real-world surfaces","volume":"18","author":"Dana Kristin J","year":"1999","unstructured":"Kristin J Dana, Bram Van Ginneken, Shree K Nayar, and Jan J Koenderink. 1999. Reflectance and texture of real-world surfaces. ACM Transactions On Graphics (TOG) 18, 1 (1999), 1\u201334.","journal-title":"ACM Transactions On Graphics (TOG)"},{"key":"e_1_3_4_9_1","doi-asserted-by":"crossref","DOI":"10.1145\/3197517.3201378","article-title":"Single-image SVBRDF capture with a rendering-aware deep network","author":"Deschaintre Valentin","year":"2018","unstructured":"Valentin Deschaintre, Miika Aittala, Fr\u00e9do Durand, George Drettakis, and Adrien Bousseau. 2018. Single-image SVBRDF capture with a rendering-aware deep network. ACM Transactions on Graphics (TOG) 37, 4 (2018), 1\u201315. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:46990252","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_3_4_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.daach.2015.05.002"},{"key":"e_1_3_4_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2012.02.012"},{"key":"e_1_3_4_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-020-01910-9"},{"key":"e_1_3_4_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275059"},{"key":"e_1_3_4_14_1","doi-asserted-by":"crossref","unstructured":"Graeme Earl Philip James Basford Alexander Bischoff Alan K. Bowman C. Crowther Jacob Dahl Michael E. Hodgson Leif Isaksen Eleni Kotoula Kirk Martinez Hembo Pagi and Kathryn E. Piquette. 2011. Reflectance transformation imaging systems for ancient documentary artefacts. Electronic Visualisation and the Arts (EVA 2011) S. Dunnand J. P. Bowen and K. C. Ng (Eds.). (BCS: The Chartered Institute for IT 2011). 147\u2013154.","DOI":"10.14236\/ewic\/EVA2011.27"},{"key":"e_1_3_4_15_1","doi-asserted-by":"crossref","first-page":"2040","DOI":"10.1016\/j.jas.2010.03.009","article-title":"Archaeological applications of polynomial texture mapping: Analysis, conservation and representation","volume":"37","author":"Earl Graeme","year":"2010","unstructured":"Graeme Earl, Kirk Martinez, and Thomas Malzbender. 2010. Archaeological applications of polynomial texture mapping: Analysis, conservation and representation. Journal of Archaeological Science 37 (2010), 2040\u20132050. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:53641810","journal-title":"Journal of Archaeological Science"},{"issue":"1","key":"e_1_3_4_16_1","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1111\/ijag.12182","article-title":"Iridescence in ancient glass: A morphological and chemical investigation","volume":"7","author":"Emami Mohammadamin","year":"2016","unstructured":"Mohammadamin Emami, Safiyeh Nekouei, Hossein Ahmadi, Christian Pritzel, and Reinhard Trettin. 2016. Iridescence in ancient glass: A morphological and chemical investigation. International Journal of Applied Glass Science 7, 1 (2016), 59\u201368.","journal-title":"International Journal of Applied Glass Science"},{"key":"e_1_3_4_17_1","first-page":"1","volume-title":"Proceedings of the ACM SIGGRAPH 2023 Conference Proceedings","author":"Fan Jiahui","year":"2023","unstructured":"Jiahui Fan, Beibei Wang, Milos Hasan, Jian Yang, and Ling-Qi Yan. 2023. Neural biplane representation for btf rendering and acquisition. In Proceedings of the ACM SIGGRAPH 2023 Conference Proceedings. 1\u201311."},{"key":"e_1_3_4_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compind.2005.05.017"},{"issue":"3","key":"e_1_3_4_19_1","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1145\/1276377.1276441","article-title":"Multiscale shape and detail enhancement from multi-light image collections.","volume":"26","author":"Fattal Raanan","year":"2007","unstructured":"Raanan Fattal, Maneesh Agrawala, and Szymon Rusinkiewicz. 2007. Multiscale shape and detail enhancement from multi-light image collections. ACM Transactions on Graphics 26, 3 (2007), 51.","journal-title":"ACM Transactions on Graphics"},{"issue":"11","key":"e_1_3_4_20_1","doi-asserted-by":"crossref","first-page":"1921","DOI":"10.1109\/TPAMI.2008.246","article-title":"Bidirectional texture function modeling: A state of the art survey","volume":"31","author":"Filip Ji\u0159\u00ed","year":"2008","unstructured":"Ji\u0159\u00ed Filip and Michal Haindl. 2008. Bidirectional texture function modeling: A state of the art survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 11 (2008), 1921\u20131940.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"e_1_3_4_21_1","first-page":"321","article-title":"A novel hemispherical basis for accurate and efficient rendering","author":"Gautron Pascal","year":"2004","unstructured":"Pascal Gautron, Jaroslav Krivanek, Sumanta Pattanaik, and Kadi Bouatouch. 2004. A novel hemispherical basis for accurate and efficient rendering. InProceedings of the ACM SIGGRAPH 2007 Papers - International Conference on Computer Graphics and Interactive Techniques, 321\u2013330.","journal-title":"Proceedings of the ACM SIGGRAPH 2007 Papers - International Conference on Computer Graphics and Interactive Techniques"},{"key":"e_1_3_4_22_1","doi-asserted-by":"publisher","unstructured":"Wenhang Ge T. Hu Haoyu Zhao Shu Liu and Yingke Chen. 2023. Ref-NeuS: Ambiguity-reduced neural implicit surface learning for multi-view reconstruction with reflection. In Proceedings of the IEEE International Conference on Computer Vision. 4228\u20134237. DOI:10.1109\/ICCV51070.2023.00392","DOI":"10.1109\/ICCV51070.2023.00392"},{"key":"e_1_3_4_23_1","doi-asserted-by":"crossref","unstructured":"Andrea Giachetti Irina Mihaela Ciortan Claudia Daffara Giacomo Marchioro Ruggero Pintus and Enrico Gobbetti. 2018. A novel framework for highlight reflectance transformation imaging. Computer Vision and Image Understanding 168 (2018) 118\u2013131.","DOI":"10.1016\/j.cviu.2017.05.014"},{"key":"e_1_3_4_24_1","first-page":"341","volume-title":"Proceedings of the 10th IEEE International Conference on Computer Vision (ICCV\u201905)","volume":"1","author":"Goldman D.B.","year":"2005","unstructured":"D.B. Goldman, B. Curless, A. Hertzmann, and S.M. Seitz. 2005. Shape and spatially-varying BRDFs from photometric stereo. In Proceedings of the 10th IEEE International Conference on Computer Vision (ICCV\u201905), Vol. 1. 341\u2013348. DOI:10.1109\/ICCV.2005.219"},{"key":"e_1_3_4_25_1","first-page":"18388","article-title":"NeRFReN: Neural radiance fields with reflections","author":"Guo Yuanchen","year":"2021","unstructured":"Yuanchen Guo, Di Kang, Linchao Bao, Yu He, and Song-Hai Zhang. 2021. NeRFReN: Neural radiance fields with reflections. InProceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2021), 18388\u201318397. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:244729083","journal-title":"Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)"},{"key":"e_1_3_4_26_1","first-page":"13198","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Ikehata Satoshi","year":"2023","unstructured":"Satoshi Ikehata. 2023. Scalable, detailed and mask-free universal photometric stereo. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 13198\u201313207."},{"key":"e_1_3_4_27_1","volume-title":"Mitsuba 3 Renderer","author":"Jakob Wenzel","year":"2022","unstructured":"Wenzel Jakob, S\u00e9bastien Speierer, Nicolas Roussel, Merlin Nimier-David, Delio Vicini, Baptiste Nicolet Tizian Zeltner, Miguel Crespo, Vincent Leroy, and Ziyi Zhang. 2022. Mitsuba 3 Renderer. Retrieved from https:\/\/mitsuba-renderer.org"},{"key":"e_1_3_4_28_1","unstructured":"Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. 3rd International Conference on Learning Representations ICLR 2015 San Diego CA USA May 7-9 2015 Conference Track Proceedings. Retrieved from https:\/\/arxiv.org\/abs\/1412.6980 (2014)."},{"issue":"4","key":"e_1_3_4_29_1","article-title":"Neumip: Multi-resolution neural materials","volume":"40","author":"Kuznetsov Alexandr","year":"2021","unstructured":"Alexandr Kuznetsov. 2021. Neumip: Multi-resolution neural materials. ACM Transactions on Graphics (ToG) 40, 4 (2021).","journal-title":"ACM Transactions on Graphics (ToG)"},{"key":"e_1_3_4_30_1","volume-title":"Three D Scans","author":"Laric Oliver","year":"2023","unstructured":"Oliver Laric. 2023. Three D Scans. Retrieved October 28, 2023 from https:\/\/threedscans.com\/"},{"key":"e_1_3_4_31_1","doi-asserted-by":"crossref","first-page":"106582","DOI":"10.1016\/j.engfailanal.2022.106582","article-title":"Reflectance transformation imaging for the quantitative characterization of experimental fracture surfaces of bonded assemblies","volume":"140","author":"Go\u00efc Ga\u00ebtan Le","year":"2022","unstructured":"Ga\u00ebtan Le Go\u00efc, Amen Benali, Marvin Nurit, Christophe Cellard, Laurent Sohier, Alamin Mansouri, Alexandre Moretti, and Romain Cr\u00e9ac\u2019hcadec. 2022. Reflectance transformation imaging for the quantitative characterization of experimental fracture surfaces of bonded assemblies. Engineering Failure Analysis 140 (2022), 106582.","journal-title":"Engineering Failure Analysis"},{"key":"e_1_3_4_32_1","first-page":"16221","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Li Junxuan","year":"2022","unstructured":"Junxuan Li and Hongdong Li. 2022. Neural reflectance for shape recovery with shadow handling. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 16221\u201316230."},{"issue":"4","key":"e_1_3_4_33_1","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1109\/2945.895874","article-title":"Interactive virtual relighting of real scenes","volume":"6","author":"Loscos C\u00e9line","year":"2000","unstructured":"C\u00e9line Loscos, George Drettakis, and Luc Robert. 2000. Interactive virtual relighting of real scenes. IEEE Transactions on Visualization and Computer Graphics 6, 4 (2000), 289\u2013305.","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"issue":"2","key":"e_1_3_4_34_1","article-title":"Single-image SVBRDF estimation with learned gradient descent","volume":"43","author":"Luo Xuejiao","year":"2024","unstructured":"Xuejiao Luo, Leonardo Scandolo, Adrien Bousseau, and Elmar Eisemann. 2024. Single-image SVBRDF estimation with learned gradient descent. Computer Graphics Forum 43, 2 (April2024), e15018. Retrieved from https:\/\/inria.hal.science\/hal-04484036","journal-title":"Computer Graphics Forum"},{"key":"e_1_3_4_35_1","first-page":"153","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Lyu Linjie","year":"2022","unstructured":"Linjie Lyu, Ayush Tewari, Thomas Leimk\u00fchler, Marc Habermann, and Christian Theobalt. 2022. Neural radiance transfer fields for relightable novel-view synthesis with global illumination. In Proceedings of the European Conference on Computer Vision. Springer, 153\u2013169."},{"key":"e_1_3_4_36_1","first-page":"21188","article-title":"SpecNeRF: Gaussian directional encoding for specular reflections","author":"Ma Li","year":"2023","unstructured":"Li Ma, Vasu Agrawal, Haithem Turki, Changil Kim, Chen Gao, Pedro Sander, Michael Zollhofer, and Christian Richardt. 2023. SpecNeRF: Gaussian directional encoding for specular reflections. InProceedings of the 2024 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2023), 21188\u201321198. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:266375151","journal-title":"Proceedings of the 2024 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)"},{"key":"e_1_3_4_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cagd.2020.101943"},{"key":"e_1_3_4_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383320"},{"key":"e_1_3_4_39_1","series-title":"EGSR \u201906","first-page":"245","volume-title":"Proceedings of the 17th Eurographics Conference on Rendering Techniques","author":"Malzbender Tom","year":"2006","unstructured":"Tom Malzbender, Bennett Wilburn, Dan Gelb, and Bill Ambrisco. 2006. Surface enhancement using real-time photometric stereo and reflectance transformation. In Proceedings of the 17th Eurographics Conference on Rendering Techniques (Nicosia, Cyprus) (EGSR \u201906). Eurographics Association, Goslar, DEU, 245\u2013250."},{"key":"e_1_3_4_40_1","volume-title":"Proceedings of the ECCV","author":"Mildenhall Ben","year":"2020","unstructured":"Ben Mildenhall, Pratul P. Srinivasan, Matthew Tancik, Jonathan T. Barron, Ravi Ramamoorthi, and Ren Ng. 2020. NeRF: Representing scenes as neural radiance fields for view synthesis. In Proceedings of the ECCV."},{"key":"e_1_3_4_41_1","doi-asserted-by":"publisher","DOI":"10.1080\/01971360.2019.1700724"},{"key":"e_1_3_4_42_1","volume-title":"Proceedings of the IEEE Conference on Visual Analytics Science and Technology","author":"Mudge Mark","year":"2006","unstructured":"Mark Mudge, Thomas Malzbender, Carla Schroer, and Marlin Lum. 2006. New reflection transformation imaging methods for rock art and multiple-viewpoint display. In Proceedings of the IEEE Conference on Visual Analytics Science and Technology. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:220915"},{"key":"e_1_3_4_43_1","doi-asserted-by":"crossref","unstructured":"Harold Mytum and John Robert Peterson. 2018. The application of reflectance transformation imaging (RTI) in historical archaeology. Historical Archaeology 52 (2018) 489\u2013503. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:165243134","DOI":"10.1007\/s41636-018-0107-x"},{"issue":"3","key":"e_1_3_4_44_1","doi-asserted-by":"crossref","first-page":"704","DOI":"10.1145\/1015706.1015783","article-title":"Eyes for relighting","volume":"23","author":"Nishino Ko","year":"2004","unstructured":"Ko Nishino and Shree K Nayar. 2004. Eyes for relighting. ACM Transactions on Graphics (TOG) 23, 3 (2004), 704\u2013711.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_3_4_45_1","first-page":"111","volume-title":"Proceedings of the 15th International Conference on Quality Control by Artificial Vision","volume":"11794","author":"Nurit Marvin","year":"2021","unstructured":"Marvin Nurit, Ga\u00ebtan Le Go\u00efc, Stephane Maniglier, Pierre Jochum, Hermine Chatoux, and Alamin Mansouri. 2021. Improved visual saliency estimation on manufactured surfaces using high-dynamic reflectance transformation imaging. In Proceedings of the 15th International Conference on Quality Control by Artificial Vision, Vol. 11794. SPIE, 111\u2013121."},{"key":"e_1_3_4_46_1","volume-title":"Proceedings of the Museums and the Web 2014","author":"Palma Gianpaolo","year":"2014","unstructured":"Gianpaolo Palma, Monica Baldassarri, Maria Chiara Favilla, and Roberto Scopigno. 2014. Storytelling of a coin collection by means of RTI images: The case of the simoneschi collection in palazzo blu. In Proceedings of the Museums and the Web 2014, N. Proctor & R. Cherry (Ed.). Silver Spring. Retrieved from http:\/\/vcg.isti.cnr.it\/Publications\/2014\/PBFS14"},{"issue":"2","key":"e_1_3_4_47_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1841317.1841321","article-title":"Dynamic shading enhancement for reflectance transformation imaging","volume":"3","author":"Palma Gianpaolo","year":"2010","unstructured":"Gianpaolo Palma, Massimiliano Corsini, Paolo Cignoni, Roberto Scopigno, and Mark Mudge. 2010. Dynamic shading enhancement for reflectance transformation imaging. Journal on Computing and Cultural Heritage (JOCCH) 3, 2 (2010), 1\u201320.","journal-title":"Journal on Computing and Cultural Heritage (JOCCH)"},{"issue":"4","key":"e_1_3_4_48_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3450626.3459872","article-title":"Total relighting: Learning to relight portraits for background replacement","volume":"40","author":"Pandey Rohit","year":"2021","unstructured":"Rohit Pandey, Sergio Orts Escolano, Chloe Legendre, Christian Haene, Sofien Bouaziz, Christoph Rhemann, Paul Debevec, and Sean Fanello. 2021. Total relighting: Learning to relight portraits for background replacement. ACM Transactions on Graphics (TOG) 40, 4 (2021), 1\u201321.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_3_4_49_1","article-title":"Photometric stereo endoscopy","author":"Parot Vicente J","year":"2013","unstructured":"Vicente J Parot, Daryl Lim, Germ\u00e1n Gonz\u00e1lez, Giovanni Traverso, Norman S. Nishioka, Benjamin J. Vakoc, and N. Durr. 2013. Photometric stereo endoscopy. Journal of Biomedical Optics 18, 7 (2013), 076017\u2013076017. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:334534","journal-title":"Journal of Biomedical Optics"},{"issue":"5","key":"e_1_3_4_50_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3469842","article-title":"Free-viewpoint indoor neural relighting from multi-view stereo","volume":"40","author":"Philip Julien","year":"2021","unstructured":"Julien Philip, S\u00e9bastien Morgenthaler, Micha\u00ebl Gharbi, and George Drettakis. 2021. Free-viewpoint indoor neural relighting from multi-view stereo. ACM Transactions on Graphics (TOG) 40, 5 (2021), 1\u201318.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_3_4_51_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13732"},{"key":"e_1_3_4_52_1","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1007\/978-3-031-25056-9_17","volume-title":"Proceedings of the Computer Vision \u2013 ECCV 2022 Workshops","author":"Pistellato Mara","year":"2023","unstructured":"Mara Pistellato and Filippo Bergamasco. 2023. On-the-go reflectance transformation imaging with ordinary smartphones. In Proceedings of the Computer Vision \u2013 ECCV 2022 Workshops, Leonid Karlinsky, Tomer Michaeli, and Nishino (Eds.). Springer Nature Switzerland, Cham, 251\u2013267."},{"key":"e_1_3_4_53_1","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1007\/978-3-319-59126-1_46","volume-title":"Proceedings of the Image Analysis: 20th Scandinavian Conference, SCIA 2017, Troms\u00f8, Norway, June 12\u201314, 2017, Proceedings, Part I 20","author":"Pitard Gilles","year":"2017","unstructured":"Gilles Pitard, Ga\u00ebtan Le Go\u00efc, Alamin Mansouri, Hugues Favreli\u00e8re, Maurice Pillet, Sony George, and Jon Yngve Hardeberg. 2017a. Robust anomaly detection using reflectance transformation imaging for surface quality inspection. In Proceedings of the Image Analysis: 20th Scandinavian Conference, SCIA 2017, Troms\u00f8, Norway, June 12\u201314, 2017, Proceedings, Part I 20. Springer, 550\u2013561."},{"key":"e_1_3_4_54_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00138-017-0856-0"},{"key":"e_1_3_4_55_1","doi-asserted-by":"publisher","unstructured":"Federico Ponchio Massimiliano Corsini and Roberto Scopigno. 2018. A compact representation of relightable images for the web. In Proceedings of the 23rd International ACM Conference on 3D Web Technology. 1\u201310. DOI:10.1145\/3208806.3208820","DOI":"10.1145\/3208806.3208820"},{"key":"e_1_3_4_56_1","doi-asserted-by":"crossref","first-page":"101040","DOI":"10.1016\/j.gmod.2019.101040","article-title":"RELIGHT: A compact and accurate RTI representation for the web","volume":"105","author":"Ponchio Federico","year":"2019","unstructured":"Federico Ponchio, Massimiliano Corsini, and Roberto Scopigno. 2019. RELIGHT: A compact and accurate RTI representation for the web. Graphical Models 105 (2019), 101040.","journal-title":"Graphical Models"},{"key":"e_1_3_4_57_1","article-title":"Neural BTF compression and interpolation","author":"Rainer Gilles","year":"2019","unstructured":"Gilles Rainer, Wenzel Jakob, Avra Ghosh, and Tim Weyrich. 2019. Neural BTF compression and interpolation. Computer Graphics Forum 38, 2 (2019), 235\u2013244. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:84178815","journal-title":"Computer Graphics Forum"},{"key":"e_1_3_4_58_1","doi-asserted-by":"crossref","unstructured":"Mingjun Ren Gaobo Xiao Limin Zhu Wenhan Zeng and David J. Whitehouse. 2019. Model-driven photometric stereo for in-process inspection of non-diffuse curved surfaces. CIRP Annals 68 1 (2019) 563\u2013566. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:149539162","DOI":"10.1016\/j.cirp.2019.04.013"},{"key":"e_1_3_4_59_1","doi-asserted-by":"crossref","unstructured":"Peiran Ren Yue Dong Stephen Lin Xin Tong and Baining Guo. 2015. Image based relighting using neural networks. ACM Transactions on Graphics (ToG) 34 4 (2015) 1\u201312. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:207226292","DOI":"10.1145\/2766899"},{"issue":"4","key":"e_1_3_4_60_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3690390","article-title":"Efficient and user-friendly visualization of neural relightable images for cultural heritage applications","volume":"17","author":"Righetto Leonardo","year":"2024","unstructured":"Leonardo Righetto, Mohammad Khademizadeh, Andrea Giachetti, Federico Ponchio, Davit Gigilashvili, Fabio Bettio, and Enrico Gobbetti. 2024. Efficient and user-friendly visualization of neural relightable images for cultural heritage applications. ACM Journal on Computing and Cultural Heritage 17, 4 (2024), 1\u201324.","journal-title":"ACM Journal on Computing and Cultural Heritage"},{"key":"e_1_3_4_61_1","first-page":"615","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Rudnev Viktor","year":"2022","unstructured":"Viktor Rudnev, Mohamed Elgharib, William Smith, Lingjie Liu, Vladislav Golyanik, and Christian Theobalt. 2022. Nerf for outdoor scene relighting. In Proceedings of the European Conference on Computer Vision. Springer, 615\u2013631."},{"key":"e_1_3_4_62_1","doi-asserted-by":"publisher","DOI":"10.1186\/s40494-022-00813-3"},{"key":"e_1_3_4_63_1","volume-title":"Proceedings of the ECCV","author":"Sang Shen","year":"2020","unstructured":"Shen Sang and M. Chandraker. 2020. Single-shot neural relighting and SVBRDF estimation. In Proceedings of the ECCV."},{"key":"e_1_3_4_64_1","first-page":"501","volume-title":"Proceedings of the IEEE International Conference on Computer Vision Workshops","author":"Santo Hiroaki","year":"2017","unstructured":"Hiroaki Santo, Masaki Samejima, Yusuke Sugano, Boxin Shi, and Yasuyuki Matsushita. 2017. Deep photometric stereo network. In Proceedings of the IEEE International Conference on Computer Vision Workshops. 501\u2013509."},{"key":"e_1_3_4_65_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.culher.2022.10.011"},{"key":"e_1_3_4_66_1","volume-title":"Determining Shape and Reflectance Using Multiple Images","author":"Silver William M","year":"1980","unstructured":"William M Silver. 1980. Determining Shape and Reflectance Using Multiple Images. Ph. D. Dissertation. Massachusetts Institute of Technology."},{"key":"e_1_3_4_67_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0262-8856(98)00136-X"},{"key":"e_1_3_4_68_1","volume-title":"Proceedings of the CVPR","author":"Srinivasan Pratul P.","year":"2021","unstructured":"Pratul P. Srinivasan, Boyang Deng, Xiuming Zhang, Matthew Tancik, Ben Mildenhall, and Jonathan T. Barron. 2021. NeRV: Neural reflectance and visibility fields for relighting and view synthesis. In Proceedings of the CVPR."},{"key":"e_1_3_4_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323008"},{"key":"e_1_3_4_70_1","first-page":"332","volume-title":"Proceedings of the Computer Graphics Forum","volume":"40","author":"Sztrajman Alejandro","year":"2021","unstructured":"Alejandro Sztrajman, Gilles Rainer, Tobias Ritschel, and Tim Weyrich. 2021. Neural BRDF representation and importance sampling. In Proceedings of the Computer Graphics Forum, Vol. 40. Wiley Online Library, 332\u2013346."},{"key":"e_1_3_4_71_1","first-page":"7537","article-title":"Fourier features let networks learn high frequency functions in low dimensional domains","volume":"33","author":"Tancik Matthew","year":"2020","unstructured":"Matthew Tancik, Pratul Srinivasan, Ben Mildenhall, Sara Fridovich-Keil, Nithin Raghavan, Utkarsh Singhal, Ravi Ramamoorthi, Jonathan Barron, and Ren Ng. 2020. Fourier features let networks learn high frequency functions in low dimensional domains. Advances in Neural Information Processing Systems 33 (2020), 7537\u20137547.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_4_72_1","doi-asserted-by":"crossref","unstructured":"Ashish Tiwari Satoshi Ikehata and Shanmuganathan Raman. 2024. MERLiN: Single-shot material estimation and relighting for photometric stereo. In European Conference on Computer Vision. 251\u2013269.","DOI":"10.1007\/978-3-031-73254-6_15"},{"key":"e_1_3_4_73_1","first-page":"129","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Tiwari Ashish","year":"2022","unstructured":"Ashish Tiwari and Shanmuganathan Raman. 2022. Deepps2: Revisiting photometric stereo using two differently illuminated images. In Proceedings of the European Conference on Computer Vision. Springer, 129\u2013145."},{"key":"e_1_3_4_74_1","unstructured":"Wilna Du Toit. 2008. Radial basis function interpolation. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:123907500"},{"key":"e_1_3_4_75_1","first-page":"20762","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Toschi Marco","year":"2023","unstructured":"Marco Toschi, Riccardo De Matteo, Riccardo Spezialetti, Daniele De Gregorio, Luigi Di Stefano, and Samuele Salti. 2023. ReLight My NeRF: A dataset for novel view synthesis and relighting of real world objects. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 20762\u201320772."},{"key":"e_1_3_4_76_1","first-page":"5481","article-title":"Ref-NeRF: Structured view-dependent appearance for neural radiance fields","author":"Verbin Dor","year":"2021","unstructured":"Dor Verbin, Peter Hedman, Ben Mildenhall, Todd Zickler, Jonathan T. Barron, and Pratul P. Srinivasan. 2021. Ref-NeRF: Structured view-dependent appearance for neural radiance fields. 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2021), 5481\u20135490. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:244920653","journal-title":"2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)"},{"key":"e_1_3_4_77_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2003.819861"},{"key":"e_1_3_4_78_1","first-page":"513","volume-title":"Photometric Method for Determining Surface Orientation from Multiple Images","author":"Woodham Robert J.","year":"1989","unstructured":"Robert J. Woodham. 1989. Photometric Method for Determining Surface Orientation from Multiple Images. MIT Press, Cambridge, MA, USA, 513\u2013531."},{"key":"e_1_3_4_79_1","first-page":"22581","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Xu Yingyan","year":"2023","unstructured":"Yingyan Xu, Gaspard Zoss, Prashanth Chandran, Markus Gross, Derek Bradley, and Paulo Gotardo. 2023. Renerf: Relightable neural radiance fields with nearfield lighting. In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 22581\u201322591."},{"key":"e_1_3_4_80_1","first-page":"1","article-title":"Deep image-based relighting from optimal sparse samples","volume":"37","author":"Xu Zexiang","year":"2018","unstructured":"Zexiang Xu, Kalyan Sunkavalli, Sunil Hadap, and Ravi Ramamoorthi. 2018. Deep image-based relighting from optimal sparse samples. ACM Transactions on Graphics (TOG) 37 (2018), 1\u201313. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:21711632","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_3_4_81_1","first-page":"e15116","volume-title":"Proceedings of the Computer Graphics Forum","volume":"43","author":"Xue Bowen","year":"2024","unstructured":"Bowen Xue, Shuang Zhao, Henrik Wann Jensen, and Zahra Montazeri. 2024. A hierarchical architecture for neural materials. In Proceedings of the Computer Graphics Forum, Vol. 43. Wiley Online Library, e15116."},{"key":"e_1_3_4_82_1","first-page":"1568","article-title":"\\(S^{3}-NeRF\\) : Neural reflectance field from shading and shadow under a single viewpoint","volume":"35","author":"Yang Wenqi","year":"2022","unstructured":"Wenqi Yang, Guanying Chen, Chaofeng Chen, Zhenfang Chen, and Kwan-Yee K Wong. 2022. \\(S^{3}-NeRF\\) : Neural reflectance field from shading and shadow under a single viewpoint. Advances in Neural Information Processing Systems 35 (2022), 1568\u20131582.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_4_83_1","volume-title":"Proceedings of the ECCV Workshops","author":"Yeh Chia-Kai","year":"2016","unstructured":"Chia-Kai Yeh, Nathan Matsuda, Xiang Huang, Fengqiang Li, Marc Walton, and Oliver Cossairt. 2016. A streamlined photometric stereo framework for cultural heritage. In Proceedings of the ECCV Workshops. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:8256172"},{"key":"e_1_3_4_84_1","first-page":"8402","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Yi Renjiao","year":"2023","unstructured":"Renjiao Yi, Chenyang Zhu, and Kai Xu. 2023a. Weakly-supervised single-view image relighting. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 8402\u20138411."},{"key":"e_1_3_4_85_1","first-page":"8402","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Yi Renjiao","year":"2023","unstructured":"Renjiao Yi, Chenyang Zhu, and Kai Xu. 2023b. Weakly-supervised single-view image relighting. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 8402\u20138411."},{"issue":"13","key":"e_1_3_4_86_1","doi-asserted-by":"crossref","first-page":"6610","DOI":"10.3390\/app12136610","article-title":"Reflectance transformation imaging as a tool for computer-aided visual inspection","volume":"12","author":"Zendagui Abir","year":"2022","unstructured":"Abir Zendagui, Ga\u00ebtan Le Go\u00efc, Hermine Chatoux, Jean-Baptiste Thomas, Pierre Jochum, St\u00e9phane Maniglier, and Alamin Mansouri. 2022. Reflectance transformation imaging as a tool for computer-aided visual inspection. Applied Sciences 12, 13 (2022), 6610.","journal-title":"Applied Sciences"},{"key":"e_1_3_4_87_1","first-page":"1","volume-title":"Proceedings of the ACM SIGGRAPH 2023 Conference Proceedings","author":"Zeng Chong","year":"2023","unstructured":"Chong Zeng, Guojun Chen, Yue Dong, Pieter Peers, Hongzhi Wu, and Xin Tong. 2023. Relighting neural radiance fields with shadow and highlight hints. In Proceedings of the ACM SIGGRAPH 2023 Conference Proceedings. 1\u201311."},{"issue":"6","key":"e_1_3_4_88_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2980179.2982432","article-title":"Emptying, refurnishing, and relighting indoor spaces","volume":"35","author":"Zhang Edward","year":"2016","unstructured":"Edward Zhang, Michael F Cohen, and Brian Curless. 2016. Emptying, refurnishing, and relighting indoor spaces. ACM Transactions on Graphics (TOG) 35, 6 (2016), 1\u201314.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_3_4_89_1","first-page":"1","article-title":"Efficient robust image interpolation and surface properties using polynomial texture mapping","volume":"2014","author":"Zhang Mingjing","year":"2014","unstructured":"Mingjing Zhang and Mark S. Drew. 2014. Efficient robust image interpolation and surface properties using polynomial texture mapping. EURASIP Journal on Image and Video Processing 2014 (2014), 1\u201319. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:7967206","journal-title":"EURASIP Journal on Image and Video Processing"},{"key":"e_1_3_4_90_1","doi-asserted-by":"crossref","first-page":"586","DOI":"10.1109\/CVPR.2018.00068","volume-title":"Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Zhang R.","year":"2018","unstructured":"R. Zhang, P. Isola, A. A. Efros, E. Shechtman, and O. Wang. 2018. The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society, Los Alamitos, CA, USA, 586\u2013595. DOI:10.1109\/CVPR.2018.00068"},{"issue":"2","key":"e_1_3_4_91_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3490385","article-title":"A compact representation of measured BRDFs using neural processes","volume":"41","author":"Zheng Chuankun","year":"2021","unstructured":"Chuankun Zheng, Ruzhang Zheng, Rui Wang, Shuang Zhao, and Hujun Bao. 2021. A compact representation of measured BRDFs using neural processes. ACM Transactions on Graphics (TOG) 41, 2 (2021), 1\u201315.","journal-title":"ACM Transactions on Graphics (TOG)"},{"issue":"3","key":"e_1_3_4_92_1","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1016\/j.vrih.2020.03.001","article-title":"Summary study of data-driven photometric stereo methods","volume":"2","author":"Zheng Qian","year":"2020","unstructured":"Qian Zheng, Boxin Shi, and Gang Pan. 2020. Summary study of data-driven photometric stereo methods. Virtual Reality & Intelligent Hardware 2, 3 (2020), 213\u2013221.","journal-title":"Virtual Reality & Intelligent Hardware"},{"key":"e_1_3_4_93_1","article-title":"Adversarial single-image SVBRDF estimation with hybrid training","author":"Zhou Xilong","year":"2021","unstructured":"Xilong Zhou and Nima Khademi Kalantari. 2021. Adversarial single-image SVBRDF estimation with hybrid training. Computer Graphics Forum 40, 2 (2021), 315\u2013325. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:232216960","journal-title":"Computer Graphics Forum"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3759452","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,7]],"date-time":"2025-10-07T10:07:13Z","timestamp":1759831633000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3759452"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,7]]},"references-count":92,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,2,28]]}},"alternative-id":["10.1145\/3759452"],"URL":"https:\/\/doi.org\/10.1145\/3759452","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"type":"print","value":"0730-0301"},{"type":"electronic","value":"1557-7368"}],"subject":[],"published":{"date-parts":[[2025,10,7]]},"assertion":[{"value":"2024-05-22","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-24","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}