{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,27]],"date-time":"2026-09-27T07:01:54Z","timestamp":1790492514607,"version":"4.1.0"},"reference-count":52,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2017,12,5]],"date-time":"2017-12-05T00:00:00Z","timestamp":1512432000000},"content-version":"vor","delay-in-days":389,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1538618"],"award-info":[{"award-number":["1538618"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2016,11,11]]},"abstract":"<jats:p>Visualizing changes to indoor scenes is important for many applications. When looking for a new place to live, we want to see how the interior looks not with the current inhabitant's belongings, but with our own furniture. Before purchasing a new sofa, we want to visualize how it would look in our living room. In this paper, we present a system that takes an RGBD scan of an indoor scene and produces a scene model of the empty room, including light emitters, materials, and the geometry of the non-cluttered room. Our system enables realistic rendering not only of the empty room under the original lighting conditions, but also with various scene edits, including adding furniture, changing the material properties of the walls, and relighting. These types of scene edits enable many mixed reality applications in areas such as real estate, furniture retail, and interior design. Our system contains two novel technical contributions: a 3D radiometric calibration process that recovers the appearance of the scene in high dynamic range, and a global-illumination-aware inverse rendering framework that simultaneously recovers reflectance properties of scene surfaces and lighting properties for several light source types, including generalized point and line lights.<\/jats:p>","DOI":"10.1145\/2980179.2982432","type":"journal-article","created":{"date-parts":[[2016,11,11]],"date-time":"2016-11-11T12:02:54Z","timestamp":1478865774000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":80,"title":["Emptying, refurnishing, and relighting indoor spaces"],"prefix":"10.1145","volume":"35","author":[{"given":"Edward","family":"Zhang","sequence":"first","affiliation":[{"name":"University of Washington"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael F.","family":"Cohen","sequence":"additional","affiliation":[{"name":"Facebook Inc."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian","family":"Curless","sequence":"additional","affiliation":[{"name":"University of Washington"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,12,5]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Agarwal S. Mierle K. and Others. Ceres Solver."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","unstructured":"Barron J. T. and Malik J. 2013. Intrinsic scene properties from a single rgb-d image. In CVPR. 10.1109\/CVPR.2013.10","DOI":"10.1109\/CVPR.2013.10"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2014.2377712"},{"key":"e_1_2_1_4_1","volume-title":"Conference on Colour in Graphics, Imaging, and Vision","author":"Boivin S.","year":"2002","unstructured":"Boivin, S., and Gagalowicz, A. 2002. Inverse rendering from a single image. Conference on Colour in Graphics, Imaging, and Vision 2002, 1."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","unstructured":"Cabral R. and Furukawa Y. 2014. Piecewise Planar and Compact Floorplan Reconstruction from Images. In CVPR. 10.1109\/CVPR.2014.546","DOI":"10.1109\/CVPR.2014.546"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","unstructured":"Cohen M. F. Wallace J. and Hanrahan P. 1993. Radiosity and realistic image synthesis. Academic Press Professional.","DOI":"10.5555\/154731"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.95"},{"key":"e_1_2_1_8_1","unstructured":"Colburn R. A. 2014. Image-Based Remodeling: A Framework for Creating Visualizing and Editing Image-Based Models. PhD thesis University of Washington."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360656"},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Dai A. Niessner M. Zollh\u00f6fer M. Izadi S. and Theobalt C. 2016. BundleFusion: Real-time Globally Consistent 3D Reconstruction using On-the-fly Surface Reintegration. arXiv:1604.01093.","DOI":"10.1145\/3054739"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","unstructured":"Debevec P. E. and Malik J. 1997. Recovering high dynamic range radiance maps from photographs. In SIGGRAPH. 10.1145\/258734.258884","DOI":"10.1145\/258734.258884"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","unstructured":"Debevec P. 1998. Rendering synthetic objects into real scenes. In SIGGRAPH. 10.1145\/280814.280864","DOI":"10.1145\/280814.280864"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-010-0396-9"},{"key":"e_1_2_1_14_1","doi-asserted-by":"crossref","unstructured":"Furukawa Y. Curless B. Seitz S. and Szeliski R. 2009. Manhattan-world stereo. In CVPR.","DOI":"10.1109\/CVPRW.2009.5206867"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.55"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","unstructured":"Grossberg M. D. and Nayar S. K. 2002. What Can Be Known about the Radiometric Response from Images? In ECCV.","DOI":"10.5555\/645318.649359"},{"key":"e_1_2_1_17_1","unstructured":"Grossberg M. and Nayar S. 2003. What is the space of camera response functions? In CVPR."},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","unstructured":"Grundmann M. McClanahan C. and Essa I. 2013. Post-processing approach for radiometric self-calibration of video. In ICCP.","DOI":"10.1109\/ICCPhot.2013.6528307"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","unstructured":"Ikehata S. Yang H. and Furukawa Y. 2015. Structured indoor modelling. In ICCV. 10.1109\/ICCV.2015.156","DOI":"10.1109\/ICCV.2015.156"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","unstructured":"Kajiya J. T. 1986. The rendering equation. In SIGGRAPH. 10.1145\/15922.15902","DOI":"10.1145\/15922.15902"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024191"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2602146"},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Kawai J. K. Painter J. S. and Cohen M. F. 1993. Radioptimization. In SIGGRAPH.","DOI":"10.1145\/166117.166136"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487228.2487237"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.70732"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-00065-7_22"},{"key":"e_1_2_1_27_1","doi-asserted-by":"crossref","unstructured":"Li S. Handa A. Zhang Y. and Calway A. 2016. HDR-Fusion: HDR SLAM using a low-cost auto-exposure RGB-D sensor. arXiv:1604.00895.","DOI":"10.1109\/3DV.2016.40"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2015.2430318"},{"key":"e_1_2_1_29_1","doi-asserted-by":"crossref","unstructured":"Lombardi S. and Nishino K. 2016. Radiometric Scene Decomposition: Scene Reflectance Illumination and Geometry from RGB-D Images. arXiv:1604.01354.","DOI":"10.1109\/3DV.2016.39"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1486525.1486527"},{"key":"e_1_2_1_31_1","doi-asserted-by":"crossref","unstructured":"Meilland M. Barat C. and Comport A. 2013. 3D High Dynamic Range dense visual SLAM and its application to real-time object re-lighting. In ISMAR.","DOI":"10.1109\/ISMAR.2013.6671774"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-006-9273-y"},{"key":"e_1_2_1_33_1","doi-asserted-by":"crossref","unstructured":"Mourikis A. I. and Roumeliotis S. I. 2007. A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation. In ICRA.","DOI":"10.1109\/ROBOT.2007.364024"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","unstructured":"Newcombe R. A. Davison A. J. Izadi S. Kohli P. Hilliges O. Shotton J. Molyneaux D. Hodges S. Kim D. and Fitzgibbon A. 2011. KinectFusion: Real-time dense surface mapping and tracking. In ISMAR. 10.1109\/ISMAR.2011.6092378","DOI":"10.1109\/ISMAR.2011.6092378"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508374"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2003.00716.x"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","unstructured":"Pharr M. and Humphreys G. 2004. Physically Based Rendering: From Theory To Implementation. Morgan Kaufmann.","DOI":"10.5555\/975275"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","unstructured":"Ramamoorthi R. and Hanrahan P. 2001. A signal-processing framework for inverse rendering. In SIGGRAPH. 10.1145\/383259.383271","DOI":"10.1145\/383259.383271"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276472"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008177019313"},{"key":"e_1_2_1_41_1","unstructured":"Subcommittee on Photometry of the IESNA Computer Committee. 2002. Iesna standard file format for the electronic transfer of photometric data and related information. Tech. Rep. LM-63-02."},{"key":"e_1_2_1_42_1","unstructured":"Takai T. Niinuma K. Maki A. and Matsuyama T. 2004. Difference sphere: an approach to near light source estimation. In CVPR."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2013.07.001"},{"key":"e_1_2_1_44_1","unstructured":"Weber M. and Cipolla R. 2001. A practical method for estimation of point light-sources. BMVC 2."},{"key":"e_1_2_1_45_1","volume-title":"Kintinuous: Spatially Extended KinectFusion. Tech. rep., MIT CSAIL.","author":"Whelan T.","year":"2012","unstructured":"Whelan, T., Kaess, M., Fallon, M., Johannsson, H., Leonard, J., and McDonald, J. 2012. Kintinuous: Spatially Extended KinectFusion. Tech. rep., MIT CSAIL."},{"key":"e_1_2_1_46_1","volume-title":"Robotics: Science and Systems 11.","author":"Whelan T.","year":"2015","unstructured":"Whelan, T., Leutenegger, S., Moreno, R. S., Glocker, B., and Davison, A. 2015. ElasticFusion: Dense SLAM Without A Pose Graph. Robotics: Science and Systems 11."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","unstructured":"Wood D. N. Azuma D. I. Aldinger K. Curless B. Duchamp T. Salesin D. H. and Stuetzle W. 2000. Surface light fields for 3D photography. In SIGGRAPH. 10.1145\/344779.344925","DOI":"10.1145\/344779.344925"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661232"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-014-0711-y"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2008.04.007"},{"key":"e_1_2_1_51_1","doi-asserted-by":"crossref","unstructured":"Yu Y. Debevec P. Malik J. and Hawkins T. 1999. Inverse global illumination. In SIGGRAPH.","DOI":"10.1145\/311535.311559"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766887"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2980179.2982432","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2980179.2982432","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2980179.2982432","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,18]],"date-time":"2025-11-18T09:29:49Z","timestamp":1763458189000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2980179.2982432"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,11,11]]},"references-count":52,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2016,11,11]]}},"alternative-id":["10.1145\/2980179.2982432"],"URL":"https:\/\/doi.org\/10.1145\/2980179.2982432","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,11,11]]},"assertion":[{"value":"2016-12-05","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}