{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,23]],"date-time":"2026-02-23T12:32:12Z","timestamp":1771849932774,"version":"3.50.1"},"reference-count":66,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2018,12,4]],"date-time":"2018-12-04T00:00:00Z","timestamp":1543881600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Adobe Systems Inc"},{"name":"NSERC DAS","award":["RGPAS-2017-507909"],"award-info":[{"award-number":["RGPAS-2017-507909"]}]},{"DOI":"10.13039\/100004675","name":"Autodesk Inc","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100004675","id-type":"DOI","asserted-by":"crossref"}]},{"name":"NSERC Discovery","award":["RGPIN2017-05235 & RGPAS-2017-507938 & RGPIN-2017-05524"],"award-info":[{"award-number":["RGPIN2017-05235 & RGPAS-2017-507938 & RGPIN-2017-05524"]}]},{"DOI":"10.13039\/501100001804","name":"Canada Research Chairs Program","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001804","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Fields Institute"},{"name":"Connaught Funds","award":["NR2016-17"],"award-info":[{"award-number":["NR2016-17"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2018,12,31]]},"abstract":"<jats:p>\n            The image processing pipeline boasts a wide variety of complex filters and effects. Translating an individual effect to operate on 3D surface geometry inevitably results in a bespoke algorithm. Instead, we propose a general-purpose back-end optimization that allows users to edit an input 3D surface by simply selecting an off-the-shelf image processing filter. We achieve this by constructing a differentiable triangle mesh renderer, with which we can\n            <jats:italic>back propagate<\/jats:italic>\n            changes in the image domain to the 3D mesh vertex positions. The given image processing technique is applied to the entire shape via stochastic snapshots of the shape: hence, we call our method\n            <jats:italic>Paparazzi.<\/jats:italic>\n            We provide simple yet important design considerations to construct the\n            <jats:italic>Paparazzi<\/jats:italic>\n            renderer and optimization algorithms. The power of this rendering-based surface editing is demonstrated via the variety of image processing filters we apply. Each application uses an off-the-shelf implementation of an image processing method without requiring modification to the core\n            <jats:italic>Paparazzi<\/jats:italic>\n            algorithm.\n          <\/jats:p>","DOI":"10.1145\/3272127.3275047","type":"journal-article","created":{"date-parts":[[2018,11,28]],"date-time":"2018-11-28T19:16:10Z","timestamp":1543432570000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":40,"title":["P\n            <scp>aparazzi<\/scp>"],"prefix":"10.1145","volume":"37","author":[{"given":"Hsueh-Ti Derek","family":"Liu","sequence":"first","affiliation":[{"name":"University of Toronto, Canada"}]},{"given":"Michael","family":"Tao","sequence":"additional","affiliation":[{"name":"University of Toronto, Canada"}]},{"given":"Alec","family":"Jacobson","sequence":"additional","affiliation":[{"name":"University of Toronto, Canada"}]}],"member":"320","published-online":{"date-parts":[[2018,12,4]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.120"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-010-0416-3"},{"key":"e_1_2_2_3_1","volume-title":"As-exact-as-possible repair of unprintable STL files. arXiv preprint arXiv:1605.07829","author":"Attene Marco","year":"2016","unstructured":"Marco Attene . 2016. As-exact-as-possible repair of unprintable STL files. arXiv preprint arXiv:1605.07829 ( 2016 ). Marco Attene. 2016. As-exact-as-possible repair of unprintable STL files. arXiv preprint arXiv:1605.07829 (2016)."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201337"},{"key":"e_1_2_2_5_1","volume-title":"illumination, and reflectance from shading","author":"Barron Jonathan T","year":"2015","unstructured":"Jonathan T Barron and Jitendra Malik . 2015. Shape , illumination, and reflectance from shading . IEEE transactions on pattern analysis and machine intelligence 37, 8 ( 2015 ), 1670--1687. Jonathan T Barron and Jitendra Malik. 2015. Shape, illumination, and reflectance from shading. IEEE transactions on pattern analysis and machine intelligence 37, 8 (2015), 1670--1687."},{"key":"e_1_2_2_6_1","volume-title":"Optimization methods for large-scale machine learning. arXiv preprint arXiv:1606.04838","author":"Bottou L\u00e9on","year":"2016","unstructured":"L\u00e9on Bottou , Frank E Curtis , and Jorge Nocedal . 2016. Optimization methods for large-scale machine learning. arXiv preprint arXiv:1606.04838 ( 2016 ). L\u00e9on Bottou, Frank E Curtis, and Jorge Nocedal. 2016. Optimization methods for large-scale machine learning. arXiv preprint arXiv:1606.04838 (2016)."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1137\/080737617"},{"key":"e_1_2_2_8_1","volume-title":"Refining Geometry from Depth Sensors using IR Shading Images. Inter. Journal of Computer Vision","author":"Choe Gyeongmin","year":"2017","unstructured":"Gyeongmin Choe , Jaesik Park , Yu-Wing Tai , and In So Kweon . 2017. Refining Geometry from Depth Sensors using IR Shading Images. Inter. Journal of Computer Vision ( 2017 ). Gyeongmin Choe, Jaesik Park, Yu-Wing Tai, and In So Kweon. 2017. Refining Geometry from Depth Sensors using IR Shading Images. Inter. Journal of Computer Vision (2017)."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-010-0408-9"},{"key":"e_1_2_2_10_1","unstructured":"Timothy Dozat. 2016. Incorporating nesterov momentum into adam. (2016).  Timothy Dozat. 2016. Incorporating nesterov momentum into adam. (2016)."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766984"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/319351.319366"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2007.4409003"},{"key":"e_1_2_2_14_1","volume-title":"Image Style Transfer Using Convolutional Neural Networks. In 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016","author":"Gatys Leon A.","year":"2016","unstructured":"Leon A. Gatys , Alexander S. Ecker , and Matthias Bethge . 2016 . Image Style Transfer Using Convolutional Neural Networks. In 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016 , Las Vegas, NV, USA, June 27--30 , 2016. 2414--2423. Leon A. Gatys, Alexander S. Ecker, and Matthias Bethge. 2016. Image Style Transfer Using Convolutional Neural Networks. In 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, Las Vegas, NV, USA, June 27--30, 2016. 2414--2423."},{"key":"e_1_2_2_15_1","volume-title":"The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Genova Kyle","unstructured":"Kyle Genova , Forrester Cole , Aaron Maschinot , Aaron Sarna , Daniel Vlasic , and William T. Freeman . 2018. Unsupervised Training for 3D Morphable Model Regression . In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Kyle Genova, Forrester Cole, Aaron Maschinot, Aaron Sarna, Daniel Vlasic, and William T. Freeman. 2018. Unsupervised Training for 3D Morphable Model Regression. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360694"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508377"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-C.1971.223313"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566589"},{"key":"e_1_2_2_20_1","volume-title":"Fast Guided Filter. CoRR abs\/1505.00996","author":"He Kaiming","year":"2015","unstructured":"Kaiming He and Jian Sun . 2015. Fast Guided Filter. CoRR abs\/1505.00996 ( 2015 ). http:\/\/arxiv.org\/abs\/1505.00996 Kaiming He and Jian Sun. 2015. Fast Guided Filter. CoRR abs\/1505.00996 (2015). http:\/\/arxiv.org\/abs\/1505.00996"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/1886063.1886065"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461965"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383295"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258843"},{"key":"e_1_2_2_25_1","doi-asserted-by":"crossref","unstructured":"Alec Jacobson Daniele Panozzo etal 2016. libigl: A simple C++ geometry processing library. (2016). http:\/\/libigl.github.io\/libigl\/.  Alec Jacobson Daniele Panozzo et al. 2016. libigl: A simple C++ geometry processing library. (2016). http:\/\/libigl.github.io\/libigl\/.","DOI":"10.1145\/3134472.3134497"},{"key":"e_1_2_2_26_1","volume-title":"Neural 3D Mesh Renderer. CoRR abs\/1711.07566","author":"Kato Hiroharu","year":"2017","unstructured":"Hiroharu Kato , Yoshitaka Ushiku , and Tatsuya Harada . 2017. Neural 3D Mesh Renderer. CoRR abs\/1711.07566 ( 2017 ). arXiv:1711.07566 http:\/\/arxiv.org\/abs\/1711.07566 Hiroharu Kato, Yoshitaka Ushiku, and Tatsuya Harada. 2017. Neural 3D Mesh Renderer. CoRR abs\/1711.07566 (2017). arXiv:1711.07566 http:\/\/arxiv.org\/abs\/1711.07566"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/11536482_14"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2767000"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2004.08.009"},{"key":"e_1_2_2_30_1","unstructured":"Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097--1105.   Alex Krizhevsky Ilya Sutskever and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097--1105."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1060244.1060248"},{"key":"e_1_2_2_32_1","volume-title":"Scales and Scale-like Structures. Comput. Graph. Forum","author":"Landreneau Eric","year":"2010","unstructured":"Eric Landreneau and Scott Schaefer . 2010. Scales and Scale-like Structures. Comput. Graph. Forum ( 2010 ). Eric Landreneau and Scott Schaefer. 2010. Scales and Scale-like Structures. Comput. Graph. Forum (2010)."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/353981.353995"},{"key":"e_1_2_2_34_1","volume-title":"Perceptual biases in the interpretation of 3D shape from shading. Vision research","author":"Liu Baoxia","year":"2004","unstructured":"Baoxia Liu and James T Todd . 2004. Perceptual biases in the interpretation of 3D shape from shading. Vision research ( 2004 ). Baoxia Liu and James T Todd. 2004. Perceptual biases in the interpretation of 3D shape from shading. Vision research (2004)."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.248"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10584-0_11"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258847"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.5555\/647653.732291"},{"key":"e_1_2_2_39_1","volume-title":"Inverse Lighting for Photography. In Color and Imaging Conference.","author":"Stephen","unstructured":"Stephen R. Marschner and Donald P. Greenberg. 1997 . Inverse Lighting for Photography. In Color and Imaging Conference. Stephen R. Marschner and Donald P. Greenberg. 1997. Inverse Lighting for Photography. In Color and Imaging Conference."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.474"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.15388\/Informatica.2014.25"},{"key":"e_1_2_2_42_1","unstructured":"Adam Paszke Sam Gross Soumith Chintala Gregory Chanan Edward Yang Zachary DeVito Zeming Lin Alban Desmaison Luca Antiga and Adam Lerer. 2017. Automatic differentiation in PyTorch. (2017).  Adam Paszke Sam Gross Soumith Chintala Gregory Chanan Edward Yang Zachary DeVito Zeming Lin Alban Desmaison Luca Antiga and Adam Lerer. 2017. Automatic differentiation in PyTorch. (2017)."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/360825.360839"},{"key":"e_1_2_2_44_1","volume-title":"Shape from shading. Handbook of mathematical models in computer vision","author":"Prados Emmanuel","year":"2006","unstructured":"Emmanuel Prados and Olivier Faugeras . 2006. Shape from shading. Handbook of mathematical models in computer vision ( 2006 ), 375--388. Emmanuel Prados and Olivier Faugeras. 2006. Shape from shading. Handbook of mathematical models in computer vision (2006), 375--388."},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383271"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-016-0979-1"},{"key":"e_1_2_2_47_1","volume-title":"An overview of gradient descent optimization algorithms. arXiv preprint arXiv:1609.04747","author":"Ruder Sebastian","year":"2016","unstructured":"Sebastian Ruder . 2016. An overview of gradient descent optimization algorithms. arXiv preprint arXiv:1609.04747 ( 2016 ). Sebastian Ruder. 2016. An overview of gradient descent optimization algorithms. arXiv preprint arXiv:1609.04747 (2016)."},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1837026.1837034"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661267"},{"key":"e_1_2_2_50_1","volume-title":"Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556","author":"Simonyan Karen","year":"2014","unstructured":"Karen Simonyan and Andrew Zisserman . 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 ( 2014 ). Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)."},{"key":"e_1_2_2_51_1","volume-title":"Geobrush: Interactive mesh geometry cloning. In Computer Graphics Forum","author":"Takayama Kenshi","year":"2011","unstructured":"Kenshi Takayama , Ryan Schmidt , Karan Singh , Takeo Igarashi , Tamy Boubekeur , and Olga Sorkine . 2011 . Geobrush: Interactive mesh geometry cloning. In Computer Graphics Forum , Vol. 30 . Wiley Online Library , 613--622. Kenshi Takayama, Ryan Schmidt, Karan Singh, Takeo Igarashi, Tamy Boubekeur, and Olga Sorkine. 2011. Geobrush: Interactive mesh geometry cloning. In Computer Graphics Forum, Vol. 30. Wiley Online Library, 613--622."},{"key":"e_1_2_2_52_1","volume-title":"Proc. SGP.","author":"Tosun Elif","year":"2007","unstructured":"Elif Tosun , Yotam I Gingold , Jason Reisman , and Denis Zorin . 2007 . Shape optimization using reflection lines . In Proc. SGP. Elif Tosun, Yotam I Gingold, Jason Reisman, and Denis Zorin. 2007. Shape optimization using reflection lines. In Proc. SGP."},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/127719.122749"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.453"},{"key":"e_1_2_2_55_1","first-page":"151","article-title":"Painting gradients: Free-form surface design using shading patterns","volume":"96","author":"Van Overveld CWAM","year":"1996","unstructured":"CWAM Van Overveld . 1996 . Painting gradients: Free-form surface design using shading patterns .. In Graphics Interface , Vol. 96. 151 -- 158 . CWAM Van Overveld. 1996. Painting gradients: Free-form surface design using shading patterns.. In Graphics Interface, Vol. 96. 151--158.","journal-title":"Graphics Interface"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383298"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13150"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/641480.641503"},{"key":"e_1_2_2_59_1","volume-title":"Photometric method for determining surface orientation from multiple images. Optical engineering 19, 1","author":"Woodham Robert J","year":"1980","unstructured":"Robert J Woodham . 1980. Photometric method for determining surface orientation from multiple images. Optical engineering 19, 1 ( 1980 ), 191139. Robert J Woodham. 1980. Photometric method for determining surface orientation from multiple images. Optical engineering 19, 1 (1980), 191139."},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126358"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661232"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.5555\/244979.245627"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024208"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.784284"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12742"},{"key":"e_1_2_2_66_1","volume-title":"Modeling and rendering fabrics at micron-resolution","author":"Zhao Shuang","unstructured":"Shuang Zhao . 2014. Modeling and rendering fabrics at micron-resolution . Cornell University . Shuang Zhao. 2014. Modeling and rendering fabrics at micron-resolution. Cornell University."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3272127.3275047","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3272127.3275047","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:44:04Z","timestamp":1750207444000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3272127.3275047"}},"subtitle":["surface editing by way of multi-view image processing"],"short-title":[],"issued":{"date-parts":[[2018,12,4]]},"references-count":66,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2018,12,31]]}},"alternative-id":["10.1145\/3272127.3275047"],"URL":"https:\/\/doi.org\/10.1145\/3272127.3275047","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,12,4]]},"assertion":[{"value":"2018-12-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}