{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T23:37:08Z","timestamp":1785454628419,"version":"3.56.0"},"reference-count":47,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T00:00:00Z","timestamp":1695859200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2024,2,29]]},"abstract":"<jats:p>Level of detail has been widely used in interactive computer graphics. In current industrial 3D modeling pipelines, artists rely on commercial software to generate highly detailed models with UV maps and then bake textures for low-poly counterparts. In these pipelines, each step is performed separately, leading to unsatisfactory visual appearances for low polygon count models. Moreover, existing texture baking techniques assume the low-poly mesh has a small geometric difference from the high-poly, which is often not true in practice, especially with extremely low poly count models.<\/jats:p>\n          <jats:p>To alleviate the visual discrepancy of the low-poly mesh, we propose to jointly optimize UV mappings during texture baking, allowing for low-poly models to faithfully replicate the appearance of the high-poly even with large geometric differences. We formulate the optimization within a differentiable rendering framework, allowing the automatic adjustment of texture regions to encode appearance information. To compensate for view parallax when two meshes have large geometric differences, we introduce a spherical harmonic parallax mapping, which uses spherical harmonic functions to modulate per-texel UV coordinates based on the view direction. We evaluate the effectiveness and robustness of our approach on a dataset composed of online downloaded models, with varying complexities and geometric discrepancies. Our method achieves superior quality over state-of-the-art techniques and commercial solutions.<\/jats:p>","DOI":"10.1145\/3617683","type":"journal-article","created":{"date-parts":[[2023,8,30]],"date-time":"2023-08-30T09:52:38Z","timestamp":1693389158000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":22,"title":["Joint UV Optimization and Texture Baking"],"prefix":"10.1145","volume":"43","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4461-2036","authenticated-orcid":false,"given":"Julian","family":"Knodt","sequence":"first","affiliation":[{"name":"LightSpeed Studios, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9348-526X","authenticated-orcid":false,"given":"Zherong","family":"Pan","sequence":"additional","affiliation":[{"name":"LightSpeed Studios, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3326-7943","authenticated-orcid":false,"given":"Kui","family":"Wu","sequence":"additional","affiliation":[{"name":"LightSpeed Studios, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0829-7075","authenticated-orcid":false,"given":"Xifeng","family":"Gao","sequence":"additional","affiliation":[{"name":"LightSpeed Studios, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,9,28]]},"reference":[{"key":"e_1_3_2_2_1","unstructured":"Adobe. 2014. Substance Painter. Retrieved September 8 2023 from https:\/\/substance3d.adobe.com\/"},{"key":"e_1_3_2_3_1","volume-title":"Blender\u2014A 3D Modelling and Rendering Package","author":"Community Blender Online","year":"2018","unstructured":"Blender Online Community. 2018. Blender\u2014A 3D Modelling and Rendering Package. Blender Foundation, Stichting Blender Foundation, Amsterdam. http:\/\/www.blender.org"},{"key":"e_1_3_2_4_1","first-page":"115","volume-title":"Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH\u201998)","author":"Cohen Jonathan","year":"1998","unstructured":"Jonathan Cohen, Marc Olano, and Dinesh Manocha. 1998. Appearance-preserving simplification. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH\u201998). ACM, New York, NY, 115\u2013122."},{"key":"e_1_3_2_5_1","unstructured":"DGG. 2018. RapidCompact. Retrieved September 8 2023 from https:\/\/www.rapidcompact.com\/"},{"key":"e_1_3_2_6_1","unstructured":"Donya Labs AB. 2022. Simplygon 10. Retrieved September 8 2023 from https:\/\/www.simplygon.com\/"},{"key":"e_1_3_2_7_1","volume-title":"GPU Zen 2: Advanced Rendering Techniques","author":"Engel W.","year":"2019","unstructured":"W. Engel. 2019. GPU Zen 2: Advanced Rendering Techniques. Black Cat Publishing Inc., Lutterworth, UK."},{"key":"e_1_3_2_8_1","unstructured":"Epic Games. 2022. Unreal Engine 5. Retrieved September 8 2023 from https:\/\/www.unrealengine.com\/en-US\/unreal-engine-5"},{"key":"e_1_3_2_9_1","volume-title":"Eurographics Symposium on Rendering","author":"Hasselgren Jon","year":"2021","unstructured":"Jon Hasselgren, Jacob Munkberg, Jaakko Lehtinen, Miika Aittala, and Samuli Laine. 2021. Appearance-driven automatic 3D model simplification. In Eurographics Symposium on Rendering. Eurographics Association, Goslar, DEU."},{"key":"e_1_3_2_10_1","first-page":"9","article-title":"Simplicial complex augmentation framework for bijective maps","volume":"36","author":"Jiang Zhongshi","year":"2017","unstructured":"Zhongshi Jiang, Scott Schaefer, and Daniele Panozzo. 2017. Simplicial complex augmentation framework for bijective maps. ACM Transactions on Graphics 36, 6 (Nov. 2017), Article 186, 9 pages.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417769"},{"key":"e_1_3_2_12_1","doi-asserted-by":"crossref","unstructured":"Justin Johnson Nikhila Ravi Jeremy Reizenstein David Novotny Shubham Tulsiani Christoph Lassner and Steve Branson. 2020. Accelerating 3D deep learning with PyTorch3D. In SIGGRAPH Asia 2020 Courses (SA\u201920) . ACM New York NY Article 10 1 page.","DOI":"10.1145\/3415263.3419160"},{"key":"e_1_3_2_13_1","unstructured":"Tomomichi Kaneko Toshiyuki Takahei Masahiko Inami Naoki Kawakami Yasuyuki Yanagida Taro Maeda and Susumu Tachi. 2001. Detailed shape representation with parallax mapping. In Proceedings of the 11th Conference on Artificial Reality and Telexistence (ICAT\u201901) . IEEE Los Alamitos CA 205\u2013208."},{"key":"e_1_3_2_14_1","unstructured":"Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In Proceedings of the 3rd International Conference on Learning Representations (ICLR\u201915) . ACM New York NY 1\u201311."},{"key":"e_1_3_2_15_1","first-page":"14","article-title":"Modular primitives for high-performance differentiable rendering","volume":"39","author":"Laine Samuli","year":"2020","unstructured":"Samuli Laine, Janne Hellsten, Tero Karras, Yeongho Seol, Jaakko Lehtinen, and Timo Aila. 2020. Modular primitives for high-performance differentiable rendering. ACM Transactions on Graphics 39, 6 (Nov. 2020), Article 194, 14 pages.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_2_16_1","unstructured":"Bruno L\u00e9vy. 2019. Geogram. Retrieved September 8 2023 from https:\/\/github.com\/BrunoLevy\/geogram"},{"issue":"3","key":"e_1_3_2_17_1","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1145\/566654.566590","article-title":"Least squares conformal maps for automatic texture atlas generation","volume":"21","author":"L\u00e9vy Bruno","year":"2002","unstructured":"Bruno L\u00e9vy, Sylvain Petitjean, Nicolas Ray, and J\u00e9rome Maillot. 2002. Least squares conformal maps for automatic texture atlas generation. ACM Transactions on Graphics 21, 3 (July 2002), 362\u2013371.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_2_18_1","first-page":"20","article-title":"Incremental potential contact: Intersection-and inversion-free, large-deformation dynamics","volume":"39","author":"Li Minchen","year":"2020","unstructured":"Minchen Li, Zachary Ferguson, Teseo Schneider, Timothy Langlois, Denis Zorin, Daniele Panozzo, Chenfanfu Jiang, and Danny M. Kaufman. 2020. Incremental potential contact: Intersection-and inversion-free, large-deformation dynamics. ACM Transactions on Graphics 39, 4 (July 2020), Article 49, 20 pages.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_2_19_1","first-page":"24","article-title":"Codimensional incremental potential contact","volume":"40","author":"Li Minchen","year":"2021","unstructured":"Minchen Li, Danny M. Kaufman, and Chenfanfu Jiang. 2021. Codimensional incremental potential contact. ACM Transactions on Graphics 40, 4 (July 2021), Article 170, 24 pages.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_2_20_1","first-page":"13","article-title":"OptCuts: Joint optimization of surface cuts and parameterization","volume":"37","author":"Li Minchen","year":"2018","unstructured":"Minchen Li, Danny M. Kaufman, Vladimir G. Kim, Justin Solomon, and Alla Sheffer. 2018b. OptCuts: Joint optimization of surface cuts and parameterization. ACM Transactions on Graphics 37, 6 (Dec. 2018), Article 247, 13 pages.","journal-title":"ACM Transactions on Graphics"},{"issue":"6","key":"e_1_3_2_21_1","first-page":"Article 222, 11","article-title":"Differentiable Monte Carlo ray tracing through edge sampling","volume":"37","author":"Li Tzu-Mao","year":"2018","unstructured":"Tzu-Mao Li, Miika Aittala, Fr\u00e9do Durand, and Jaakko Lehtinen. 2018a. Differentiable Monte Carlo ray tracing through edge sampling. ACM Transactions on Graphics 37, 6 (2018), Article 222, 11 pages.","journal-title":"ACM Transactions on Graphics"},{"issue":"3","key":"e_1_3_2_22_1","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1007\/BF01589116","article-title":"On the limited memory BFGS method for large scale optimization","volume":"45","author":"Liu D. C.","year":"1989","unstructured":"D. C. Liu and J. Nocedal. 1989. On the limited memory BFGS method for large scale optimization. Mathematical Programming 45, 3 (1989), 503\u2013528.","journal-title":"Mathematical Programming"},{"key":"e_1_3_2_23_1","first-page":"7707","volume-title":"Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV\u201919)","author":"Liu Shichen","year":"2019","unstructured":"Shichen Liu, Weikai Chen, Tianye Li, and Hao Li. 2019. Soft Rasterizer: A differentiable renderer for image-based 3D reasoning. In Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV\u201919). IEEE, Los Alamitos, CA, 7707\u20137716."},{"key":"e_1_3_2_24_1","doi-asserted-by":"crossref","unstructured":"Matthew M. Loper and Michael J. Black. 2014. OpenDR: An approximate differentiable renderer. In Computer Vision\u2014ECCV 2014 . Lecture Notes in Computer Science Vol. 8695. Springer 154\u2013169.","DOI":"10.1007\/978-3-319-10584-0_11"},{"key":"e_1_3_2_25_1","doi-asserted-by":"crossref","unstructured":"Fujun Luan Shuang Zhao Kavita Bala and Zhao Dong. 2021. Unified shape and SVBRDF recovery using differentiable Monte Carlo rendering. arXiv:2103.15208 (2021).","DOI":"10.1111\/cgf.14344"},{"key":"e_1_3_2_26_1","unstructured":"Marmoset. 2022. Marmoset Toolbag. Retrieved September 8 2023 from https:\/\/marmoset.co\/toolbag\/"},{"key":"e_1_3_2_27_1","volume-title":"Steep Parallax Mapping","author":"McGuire Morgan","year":"2005","unstructured":"Morgan McGuire and Max McGuire. 2005. Steep Parallax Mapping. Technical Report. Brown University."},{"key":"e_1_3_2_28_1","unstructured":"Manfred M. Nerurkar. 2021. InstaLOD. Retrieved September 8 2023 from https:\/\/instalod.com"},{"key":"e_1_3_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478513.3480501"},{"key":"e_1_3_2_30_1","first-page":"17","article-title":"Mitsuba 2: A retargetable forward and inverse renderer","volume":"38","author":"Nimier-David Merlin","year":"2019","unstructured":"Merlin Nimier-David, Delio Vicini, Tizian Zeltner, and Wenzel Jakob. 2019. Mitsuba 2: A retargetable forward and inverse renderer. ACM Transactions on Graphics 38, 6 (Nov. 2019), Article 203, 17 pages.","journal-title":"ACM Transactions on Graphics"},{"issue":"4","key":"e_1_3_2_31_1","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1111\/j.1467-8659.2003.00716.x","article-title":"A survey of inverse rendering problems","volume":"22","author":"Patow Gustavo","year":"2003","unstructured":"Gustavo Patow and Xavier Pueyo. 2003. A survey of inverse rendering problems. Computer Graphics Forum 22, 4 (2003), 663\u2013687.","journal-title":"Computer Graphics Forum"},{"key":"e_1_3_2_32_1","unstructured":"Pixologic. 2022. ZBrush. Retrieved September 8 2023 from https:\/\/pixologic.com\/"},{"issue":"3","key":"e_1_3_2_33_1","doi-asserted-by":"crossref","first-page":"935","DOI":"10.1145\/1073204.1073292","article-title":"Real-time relief mapping on arbitrary polygonal surfaces","volume":"24","author":"Policarpo F\u00e1bio","year":"2005","unstructured":"F\u00e1bio Policarpo, Manuel M. Oliveira, and Jo\u00e3o L. D. Comba. 2005. Real-time relief mapping on arbitrary polygonal surfaces. ACM Transactions on Graphics 24, 3 (July 2005), 935.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_2_34_1","first-page":"16","article-title":"Scalable locally injective mappings","volume":"36","author":"Rabinovich Michael","year":"2017","unstructured":"Michael Rabinovich, Roi Poranne, Daniele Panozzo, and Olga Sorkine-Hornung. 2017. Scalable locally injective mappings. ACM Transactions on Graphics 36, 2 (April 2017), Article 16, 16 pages.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_2_35_1","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1145\/383259.383317","volume-title":"Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH\u201901)","author":"Ramamoorthi Ravi","year":"2001","unstructured":"Ravi Ramamoorthi and Pat Hanrahan. 2001. An efficient representation for irradiance environment maps. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH\u201901). ACM, New York, NY, 497\u2013500."},{"key":"e_1_3_2_36_1","first-page":"87","volume-title":"Proceedings of the 13th Eurographics Workshop on Rendering (EGRW\u201902).","author":"Sander Pedro V.","year":"2002","unstructured":"Pedro V. Sander, Steven J. Gortler, John Snyder, and Hugues Hoppe. 2002. Signal-specialized parametrization. In Proceedings of the 13th Eurographics Workshop on Rendering (EGRW\u201902).87\u201398."},{"key":"e_1_3_2_37_1","volume-title":"Proceedings of the 2003 Eurographics\/ACM SIGGRAPH Symposium on Geometry Processing (SGP\u201903).","author":"Sander P. V.","year":"2003","unstructured":"P. V. Sander, Z. J. Wood, S. J. Gortler, J. Snyder, and H. Hoppe. 2003. Multi-chart geometry images. In Proceedings of the 2003 Eurographics\/ACM SIGGRAPH Symposium on Geometry Processing (SGP\u201903). 146\u2013155."},{"key":"e_1_3_2_38_1","unstructured":"Sketchfab. 2022. Home Page. Retrieved September 8 2023 from https:\/\/sketchfab.com\/"},{"key":"e_1_3_2_39_1","first-page":"9","article-title":"Bijective parameterization with free boundaries","volume":"34","author":"Smith Jason","year":"2015","unstructured":"Jason Smith and Scott Schaefer. 2015. Bijective parameterization with free boundaries. ACM Transactions on Graphics 34, 4 (July 2015), Article 70, 9 pages.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_2_40_1","first-page":"8","article-title":"Efficient bijective parameterizations","volume":"39","author":"Su Jian-Ping","year":"2020","unstructured":"Jian-Ping Su, Chunyang Ye, Ligang Liu, and Xiao-Ming Fu. 2020. Efficient bijective parameterizations. ACM Transactions on Graphics 39, 4 (Aug. 2020), Article 111, 8 pages.","journal-title":"ACM Transactions on Graphics"},{"issue":"7","key":"e_1_3_2_41_1","article-title":"Efficient texture parameterization driven by perceptual-loss-on-screen","volume":"41","author":"Sun Haoran","year":"2022","unstructured":"Haoran Sun, Shiyi Wang, Wenhai Wu, Yao Jin, Hujun Bao, and Jin Huang. 2022. Efficient texture parameterization driven by perceptual-loss-on-screen. Computer Graphics Forum 41, 7 (2022), 1\u201312.","journal-title":"Computer Graphics Forum"},{"key":"e_1_3_2_42_1","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1145\/1185657.1185830","volume-title":"ACM SIGGRAPH 2006 Courses (SIGGRAPH\u201906).","author":"Tatarchuk Natalya","year":"2006","unstructured":"Natalya Tatarchuk. 2006. Practical parallax occlusion mapping with approximate soft shadows for detailed surface rendering. In ACM SIGGRAPH 2006 Courses (SIGGRAPH\u201906). ACM, New York, NY, 81\u2013112."},{"key":"e_1_3_2_43_1","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1145\/1057432.1057440","volume-title":"Proceedings of the 2004 Eurographics\/ACM SIGGRAPH Symposium on Geometry Processing (SGP\u201904).","author":"Tewari Geetika","year":"2004","unstructured":"Geetika Tewari, John Snyder, Pedro V. Sander, Steven J. Gortler, and Hugues Hoppe. 2004. Signal-specialized parameterization for piecewise linear reconstruction. In Proceedings of the 2004 Eurographics\/ACM SIGGRAPH Symposium on Geometry Processing (SGP\u201904). ACM, New York, NY, 55\u201364."},{"key":"e_1_3_2_44_1","doi-asserted-by":"crossref","unstructured":"Theo Thonat Francois Beaune Xin Sun Nathan Carr and Tamy Boubekeur. 2021. Tessellation-free displacement mapping for ray tracing. ACM Transactions on Graphics 40 6 (Dec. 2021) Article 282 16 pages. DOI:10.1145\/3478513.3480535","DOI":"10.1145\/3478513.3480535"},{"issue":"1","key":"e_1_3_2_45_1","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1112\/plms\/s3-13.1.743","article-title":"How to draw a graph","volume":"3","author":"Tutte W. T.","year":"1963","unstructured":"W. T. Tutte. 1963. How to draw a graph. Proceedings of the London Mathematical Society s3-13, 1 (1963), 743\u2013767.","journal-title":"Proceedings of the London Mathematical Society"},{"key":"e_1_3_2_46_1","volume-title":"Proceedings of the 2003 37th Asilomar Conference on Signals, Systems, and Computers","volume":"2","author":"Wang Z.","year":"2003","unstructured":"Z. Wang, E. P. Simoncelli, and A. C. Bovik. 2003. Multiscale structural similarity for image quality assessment. In Proceedings of the 2003 37th Asilomar Conference on Signals, Systems, and Computers, Vol. 2. IEEE, Los Alamitos, CA, 1398\u20131402."},{"key":"e_1_3_2_47_1","unstructured":"Terry Welsh. 2004. Parallax Mapping with Offset Limiting: A Per-Pixel Approximation of Uneven Surfaces . Infiscape Corporation."},{"key":"e_1_3_2_48_1","unstructured":"Jonathon Young. 2017. Xatlas. Retrieved September 8 2023 from https:\/\/github.com\/jpcy\/xatlas"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617683","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3617683","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:36:32Z","timestamp":1750178192000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617683"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,28]]},"references-count":47,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,2,29]]}},"alternative-id":["10.1145\/3617683"],"URL":"https:\/\/doi.org\/10.1145\/3617683","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,28]]},"assertion":[{"value":"2022-11-30","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-08-22","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-09-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}