{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T07:29:13Z","timestamp":1775546953058,"version":"3.50.1"},"reference-count":60,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2018,12,4]],"date-time":"2018-12-04T00:00:00Z","timestamp":1543881600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2018,12,31]]},"abstract":"<jats:p>Existing online 3D shape repositories contain thousands of 3D models but lack photorealistic appearance. We present an approach to automatically assign high-quality, realistic appearance models to large scale 3D shape collections. The key idea is to jointly leverage three types of online data - shape collections, material collections, and photo collections, using the photos as reference to guide assignment of materials to shapes. By generating a large number of synthetic renderings, we train a convolutional neural network to classify materials in real photos, and employ 3D-2D alignment techniques to transfer materials to different parts of each shape model. Our system produces photorealistic, relightable, 3D shapes (PhotoShapes).<\/jats:p>","DOI":"10.1145\/3272127.3275066","type":"journal-article","created":{"date-parts":[[2018,11,28]],"date-time":"2018-11-28T19:16:10Z","timestamp":1543432570000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":56,"title":["PhotoShape"],"prefix":"10.1145","volume":"37","author":[{"given":"Keunhong","family":"Park","sequence":"first","affiliation":[{"name":"University of Washington"}]},{"given":"Konstantinos","family":"Rematas","sequence":"additional","affiliation":[{"name":"University of Washington"}]},{"given":"Ali","family":"Farhadi","sequence":"additional","affiliation":[{"name":"University of Washington and Allen Institute for AI"}]},{"given":"Steven M.","family":"Seitz","sequence":"additional","affiliation":[{"name":"University of Washington"}]}],"member":"320","published-online":{"date-parts":[[2018,12,4]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Adobe Stock: Stock photos, royalty-free images, graphics, vectors and videos. https:\/\/stock.adobe.com\/.","author":"Stock Adobe","year":"2018","unstructured":"Adobe Stock . 2018 . Adobe Stock: Stock photos, royalty-free images, graphics, vectors and videos. https:\/\/stock.adobe.com\/. (2018). Adobe Stock. 2018. Adobe Stock: Stock photos, royalty-free images, graphics, vectors and videos. https:\/\/stock.adobe.com\/. (2018)."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461978"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766967"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2462002"},{"key":"e_1_2_2_5_1","doi-asserted-by":"crossref","unstructured":"Sean Bell Paul Upchurch Noah Snavely and Kavita Bala. 2015. Material Recognition in the Wild with the Materials in Context Database. In CVPR.  Sean Bell Paul Upchurch Noah Snavely and Kavita Bala. 2015. Material Recognition in the Wild with the Materials in Context Database. In CVPR.","DOI":"10.1109\/CVPR.2015.7298970"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601193"},{"key":"e_1_2_2_7_1","unstructured":"Brent Burley and Walt Disney Animation Studios. {n. d.}. Physically-based shading at disney.  Brent Burley and Walt Disney Animation Studios. {n. d.}. Physically-based shading at disney."},{"key":"e_1_2_2_8_1","volume-title":"On Shape and Material Recovery from Motion","author":"Chandraker Manmohan","unstructured":"Manmohan Chandraker . 2014. On Shape and Material Recovery from Motion . In ECCV. Springer International Publishing , Cham . Manmohan Chandraker. 2014. On Shape and Material Recovery from Motion. In ECCV. Springer International Publishing, Cham."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818096"},{"key":"e_1_2_2_11_1","doi-asserted-by":"crossref","unstructured":"Qifeng Chen and Vladlen Koltun. 2017. Photographic Image Synthesis with Cascaded Refinement Networks. In ICCV.  Qifeng Chen and Vladlen Koltun. 2017. Photographic Image Synthesis with Cascaded Refinement Networks. In ICCV.","DOI":"10.1109\/ICCV.2017.168"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.461"},{"key":"e_1_2_2_13_1","doi-asserted-by":"crossref","unstructured":"M. Cimpoi S. Maji and A. Vedaldi. 2015. Deep filter banks for texture recognition and segmentation. In CVPR.  M. Cimpoi S. Maji and A. Vedaldi. 2015. Deep filter banks for texture recognition and segmentation. In CVPR.","DOI":"10.1109\/CVPR.2015.7299007"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237191"},{"key":"e_1_2_2_15_1","volume-title":"Imagenet: A large-scale hierarchical image database. In CVPR.","author":"Deng Jia","year":"2009","unstructured":"Jia Deng , Wei Dong , Richard Socher , Li-Jia Li , Kai Li , and Li Fei-Fei . 2009 . Imagenet: A large-scale hierarchical image database. In CVPR. Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. Imagenet: A large-scale hierarchical image database. In CVPR."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2699641"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661283"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383296"},{"key":"e_1_2_2_19_1","volume-title":"Leung","author":"Efros Alexei A.","year":"1999","unstructured":"Alexei A. Efros and Thomas K . Leung . 1999 . Texture Synthesis by Non-Parametric Sampling. In ICCV. Alexei A. Efros and Thomas K. Leung. 1999. Texture Synthesis by Non-Parametric Sampling. In ICCV."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.167"},{"key":"e_1_2_2_21_1","doi-asserted-by":"crossref","unstructured":"L. A. Gatys A. S. Ecker and M. Bethge. 2015. Texture Synthesis Using Convolutional Neural Networks. In NIPS.   L. A. Gatys A. S. Ecker and M. Bethge. 2015. Texture Synthesis Using Convolutional Neural Networks. In NIPS.","DOI":"10.1109\/CVPR.2016.265"},{"key":"e_1_2_2_22_1","volume-title":"Luc Van Gool, and Tinne Tuytelaars","author":"Georgoulis Stamatios","year":"2017","unstructured":"Stamatios Georgoulis , Konstantinos Rematas , Tobias Ritschel , Efstratios Gavves , Mario Fritz , Luc Van Gool, and Tinne Tuytelaars . 2017 a. Reflectance and Natural Illumination from Single-Material Specular Objects Using Deep Learning. IEEE TPAMI ( 2017). Stamatios Georgoulis, Konstantinos Rematas, Tobias Ritschel, Efstratios Gavves, Mario Fritz, Luc Van Gool, and Tinne Tuytelaars. 2017a. Reflectance and Natural Illumination from Single-Material Specular Objects Using Deep Learning. IEEE TPAMI (2017)."},{"key":"e_1_2_2_23_1","doi-asserted-by":"crossref","unstructured":"Stamatios Georgoulis Vincent Vanweddingen Marc Proesmans and Luc Van Gool. 2017b. Material Classification under Natural Illumination Using Reflectance Maps. In WACV.  Stamatios Georgoulis Vincent Vanweddingen Marc Proesmans and Luc Van Gool. 2017b. Material Classification under Natural Illumination Using Reflectance Maps. In WACV.","DOI":"10.1109\/WACV.2017.34"},{"key":"e_1_2_2_24_1","unstructured":"Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep residual learning for image recognition. In CVPR.  Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep residual learning for image recognition. In CVPR."},{"key":"e_1_2_2_25_1","unstructured":"Herman-Miller. 2018. Herman Miller 3D Models. https:\/\/www.hermanmiller.com\/resources\/models\/3d-models\/. (2018).  Herman-Miller. 2018. Herman Miller 3D Models. https:\/\/www.hermanmiller.com\/resources\/models\/3d-models\/. (2018)."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383295"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3158353"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766890"},{"key":"e_1_2_2_29_1","doi-asserted-by":"crossref","unstructured":"Phillip Isola Jun-Yan Zhu Tinghui Zhou and Alexei A Efros. 2017. Image-to-Image Translation with Conditional Adversarial Networks. In CVPR.  Phillip Isola Jun-Yan Zhu Tinghui Zhou and Alexei A Efros. 2017. Image-to-Image Translation with Conditional Adversarial Networks. In CVPR.","DOI":"10.1109\/CVPR.2017.632"},{"key":"e_1_2_2_30_1","doi-asserted-by":"crossref","unstructured":"Hamid Izadinia Qi Shan and Steven M Seitz. 2017. IM2CAD. In CVPR.  Hamid Izadinia Qi Shan and Steven M Seitz. 2017. IM2CAD. In CVPR.","DOI":"10.1109\/CVPR.2017.260"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366162"},{"key":"e_1_2_2_32_1","unstructured":"Alex Kendall Yarin Gal and Roberto Cipolla. 2018. Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics. In CVPR.  Alex Kendall Yarin Gal and Roberto Cipolla. 2018. Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics. In CVPR."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601209"},{"key":"e_1_2_2_34_1","unstructured":"Kihwan Kim Jinwei Gu Stephen Tyree Pavlo Molchanov Matthias Nie\u00dfner and Jan Kautz. 2017. A Lightweight Approach for On-the-Fly Reflectance Estimation. In ICCV.  Kihwan Kim Jinwei Gu Stephen Tyree Pavlo Molchanov Matthias Nie\u00dfner and Jan Kautz. 2017. A Lightweight Approach for On-the-Fly Reflectance Estimation. In ICCV."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276380"},{"key":"e_1_2_2_36_1","unstructured":"Philipp Kr\u00e4henb\u00fchl and Vladlen Koltun. 2011. Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials. In NIPS.   Philipp Kr\u00e4henb\u00fchl and Vladlen Koltun. 2011. Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials. In NIPS."},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073641"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.147"},{"key":"e_1_2_2_39_1","unstructured":"Guilin Liu Duygu Ceylan Ersin Yumer Jimei Yang and Jyh-Ming Lien. 2017. Material Editing using a Physically Based Rendering Network. In ICCV.  Guilin Liu Duygu Ceylan Ersin Yumer Jimei Yang and Jyh-Ming Lien. 2017. Material Editing using a Physically Based Rendering Network. In ICCV."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2015.2430318"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882343"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2015.2450734"},{"key":"e_1_2_2_43_1","unstructured":"Poliigon. 2018. A library of textures materials and HDR's for artists that want photorealism. https:\/\/www.poliigon.com\/. (2018).  Poliigon. 2018. A library of textures materials and HDR's for artists that want photorealism. https:\/\/www.poliigon.com\/. (2018)."},{"key":"e_1_2_2_44_1","volume-title":"Novel Views of Objects from a Single Image. TPAMI","author":"Rematas Konstantinos","year":"2017","unstructured":"Konstantinos Rematas , Chuong Nguyen , Tobias Ritschel , Mario Fritz , and Tinne Tuytelaars . 2017. Novel Views of Objects from a Single Image. TPAMI ( 2017 ). Konstantinos Rematas, Chuong Nguyen, Tobias Ritschel, Mario Fritz, and Tinne Tuytelaars. 2017. Novel Views of Objects from a Single Image. TPAMI (2017)."},{"key":"e_1_2_2_45_1","doi-asserted-by":"crossref","unstructured":"Konstantinos Rematas Tobias Ritschel Mario Fritz Efstratios Gavves and Tinne Tuytelaars. 2016. Deep Reflectance Maps. In CVPR.  Konstantinos Rematas Tobias Ritschel Mario Fritz Efstratios Gavves and Tinne Tuytelaars. 2016. Deep Reflectance Maps. In CVPR.","DOI":"10.1109\/CVPR.2016.488"},{"key":"e_1_2_2_46_1","volume-title":"Playing for data: Ground truth from computer games","author":"Richter Stephan R","unstructured":"Stephan R Richter , Vibhav Vineet , Stefan Roth , and Vladlen Koltun . 2016. Playing for data: Ground truth from computer games . In ECCV. Springer . Stephan R Richter, Vibhav Vineet, Stefan Roth, and Vladlen Koltun. 2016. Playing for data: Ground truth from computer games. In ECCV. Springer."},{"key":"e_1_2_2_47_1","volume-title":"Automatically discovering local visual material attributes. CVPR","author":"Schwartz Gabriel","year":"2015","unstructured":"Gabriel Schwartz and Ko Nishino . 2015. Automatically discovering local visual material attributes. CVPR ( 2015 ). Gabriel Schwartz and Ko Nishino. 2015. Automatically discovering local visual material attributes. CVPR (2015)."},{"key":"e_1_2_2_48_1","volume-title":"Deep Correlations for Texture Synthesis. ACM Trans. Graph. 36, 4","author":"Sendik Omry","year":"2017","unstructured":"Omry Sendik and Daniel Cohen-Or . 2017. Deep Correlations for Texture Synthesis. ACM Trans. Graph. 36, 4 ( 2017 ). Omry Sendik and Daniel Cohen-Or. 2017. Deep Correlations for Texture Synthesis. ACM Trans. Graph. 36, 4 (2017)."},{"key":"e_1_2_2_49_1","first-page":"3","article-title":"2013. Recognizing materials using perceptually inspired features","volume":"108","author":"Sharan Lavanya","year":"2013","unstructured":"Lavanya Sharan , Ce Liu , Ruth Rosenholtz , and Edward H. Adelson . 2013. Recognizing materials using perceptually inspired features . International Journal of Computer Vision 108 , 3 ( 2013 ). Lavanya Sharan, Ce Liu, Ruth Rosenholtz, and Edward H. Adelson. 2013. Recognizing materials using perceptually inspired features. International Journal of Computer Vision 108, 3 (2013).","journal-title":"International Journal of Computer Vision"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1167\/14.9.12"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.308"},{"key":"e_1_2_2_53_1","unstructured":"Vray-materials.de. 2018. Vray-materials.de - Your ultimate V-Ray material resource. https:\/\/www.vray-materials.de. (2018).  Vray-materials.de. 2018. Vray-materials.de - Your ultimate V-Ray material resource. https:\/\/www.vray-materials.de. (2018)."},{"key":"e_1_2_2_54_1","volume-title":"Proceedings of the 18th Eurographics Conference on Rendering Techniques (EGSR'07)","author":"Walter Bruce","unstructured":"Bruce Walter , Stephen R. Marschner , Hongsong Li , and Kenneth E. Torrance . 2007. Microfacet Models for Refraction Through Rough Surfaces . In Proceedings of the 18th Eurographics Conference on Rendering Techniques (EGSR'07) . Bruce Walter, Stephen R. Marschner, Hongsong Li, and Kenneth E. Torrance. 2007. Microfacet Models for Refraction Through Rough Surfaces. In Proceedings of the 18th Eurographics Conference on Rendering Techniques (EGSR'07)."},{"key":"e_1_2_2_55_1","unstructured":"Ting-Chun Wang Jun-Yan Zhu Ebi Hiroaki Manmohan Chandraker Alexei Efros and Ravi Ramamoorthi. 2016b. A 4D light-field dataset and CNN architectures for material recognition. In ECCV.  Ting-Chun Wang Jun-Yan Zhu Ebi Hiroaki Manmohan Chandraker Alexei Efros and Ravi Ramamoorthi. 2016b. A 4D light-field dataset and CNN architectures for material recognition. In ECCV."},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2982404"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508393"},{"key":"e_1_2_2_58_1","volume-title":"Joint Material and Illumination Estimation from Photo Sets in the Wild. Eurographics","author":"Mitra NJ","year":"2017","unstructured":"Mitra NJ Wang TY, Ritschel T. 2017. Joint Material and Illumination Estimation from Photo Sets in the Wild. Eurographics ( 2017 ). Mitra NJ Wang TY, Ritschel T. 2017. Joint Material and Illumination Estimation from Photo Sets in the Wild. Eurographics (2017)."},{"key":"e_1_2_2_59_1","volume-title":"Differential Angular Imaging for Material Recognition. CVPR","author":"Xue Jia","year":"2017","unstructured":"Jia Xue , Hang Zhang , Kristin J. Dana , and Ko Nishino . 2017. Differential Angular Imaging for Material Recognition. CVPR ( 2017 ). Jia Xue, Hang Zhang, Kristin J. Dana, and Ko Nishino. 2017. Differential Angular Imaging for Material Recognition. CVPR (2017)."},{"key":"e_1_2_2_60_1","unstructured":"zbyg. 2018. HDRi Pack. https:\/\/zbyg.deviantart.com\/art\/HDRi-Pack-2-103458406. (2018).  zbyg. 2018. HDRi Pack. https:\/\/zbyg.deviantart.com\/art\/HDRi-Pack-2-103458406. (2018)."},{"key":"e_1_2_2_61_1","doi-asserted-by":"crossref","unstructured":"Hang Zhang Kristin Dana and Ko Nishino. 2015. Reflectance Hashing for Material Recognition. In CVPR.  Hang Zhang Kristin Dana and Ko Nishino. 2015. Reflectance Hashing for Material Recognition. In CVPR.","DOI":"10.1109\/CVPR.2015.7298926"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980247"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3272127.3275066","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3272127.3275066","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:44:04Z","timestamp":1750207444000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3272127.3275066"}},"subtitle":["photorealistic materials for large-scale shape collections"],"short-title":[],"issued":{"date-parts":[[2018,12,4]]},"references-count":60,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2018,12,31]]}},"alternative-id":["10.1145\/3272127.3275066"],"URL":"https:\/\/doi.org\/10.1145\/3272127.3275066","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,12,4]]},"assertion":[{"value":"2018-12-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}