{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T19:35:14Z","timestamp":1783107314067,"version":"3.54.6"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"3","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2025,6,30]]},"abstract":"<jats:p>\n            Man-made 3D shapes are naturally organized in parts and hierarchies; such structures provide important constraints for shape reconstruction and generation. Modeling shape structures is difficult, because there can be multiple hierarchies for a given shape, causing ambiguity, and across different categories, the shape structures are correlated with semantics, limiting generalization. We present\n            <jats:italic toggle=\"yes\">StructRe<\/jats:italic>\n            , a structure rewriting system, as a novel approach to structured shape modeling. Given a 3D object represented by points and components,\n            <jats:italic toggle=\"yes\">StructRe<\/jats:italic>\n            can rewrite it upward into more concise structures, or downward into more detailed structures; by iterating the rewriting process, hierarchies are obtained. Such a localized rewriting process enables probabilistic modeling of ambiguous structures and robust generalization across object categories. We train\n            <jats:italic toggle=\"yes\">StructRe<\/jats:italic>\n            on PartNet data and show its generalization to cross-category and multiple object hierarchies, and test its extension to ShapeNet. We also demonstrate the benefits of probabilistic and generalizable structure modeling for shape reconstruction, generation and editing tasks.\n          <\/jats:p>","DOI":"10.1145\/3732934","type":"journal-article","created":{"date-parts":[[2025,4,28]],"date-time":"2025-04-28T06:55:16Z","timestamp":1745823316000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["StructRe: Rewriting for Structured Shape Modeling"],"prefix":"10.1145","volume":"44","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6049-4458","authenticated-orcid":false,"given":"Jiepeng","family":"Wang","sequence":"first","affiliation":[{"name":"Department of Computer Science, The University of Hong Kong","place":["Hong Kong, Hong Kong"]},{"name":"Microsoft Research Asia","place":["Hong Kong, Hong Kong"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3628-9777","authenticated-orcid":false,"given":"Hao","family":"Pan","sequence":"additional","affiliation":[{"name":"Microsoft Research Asia","place":["Beijing, China"]},{"name":"Tsinghua University","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3768-6654","authenticated-orcid":false,"given":"Yang","family":"Liu","sequence":"additional","affiliation":[{"name":"Internet Graphics Group, Microsoft Research Asia","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8788-2453","authenticated-orcid":false,"given":"Xin","family":"Tong","sequence":"additional","affiliation":[{"name":"Microsoft Research Asia","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2729-5860","authenticated-orcid":false,"given":"Taku","family":"Komura","sequence":"additional","affiliation":[{"name":"Department of Computer Science, The University of Hong Kong","place":["Hong Kong, Hong Kong"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2284-3952","authenticated-orcid":false,"given":"Wenping","family":"Wang","sequence":"additional","affiliation":[{"name":"Texas A&M University","place":["College Station, United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,6,18]]},"reference":[{"key":"e_1_3_3_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-39966-7_18"},{"key":"e_1_3_3_3_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.94.2.115"},{"key":"e_1_3_3_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58452-8_13"},{"key":"e_1_3_3_5_1","volume-title":"ShapeNet: An Information-Rich 3D Model Repository","author":"Chang Angel X.","year":"2015","unstructured":"Angel X. Chang, Thomas Funkhouser, Leonidas Guibas, Pat Hanrahan, Qixing Huang, Zimo Li, Silvio Savarese, Manolis Savva, Shuran Song, Hao Su, Jianxiong Xiao, Li Yi, and Fisher Yu. 2015. ShapeNet: An Information-Rich 3D Model Repository. Technical Report 1512.03012. arXiv preprint."},{"key":"e_1_3_3_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01103"},{"key":"e_1_3_3_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00319"},{"key":"e_1_3_3_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.261"},{"key":"e_1_3_3_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0019-9958(85)80003-6"},{"key":"e_1_3_3_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-444-88074-1.50011-1"},{"key":"e_1_3_3_11_1","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Dosovitskiy Alexey","year":"2021","unstructured":"Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, and Neil Houlsby. 2021. An image is worth 16x16 words: Transformers for image recognition at scale. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_3_12_1","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Dziri Nouha","year":"2023","unstructured":"Nouha Dziri, Ximing Lu, Melanie Sclar, Xiang Lorraine Li, Liwei Jiang, Bill Yuchen Lin, Peter West, Chandra Bhagavatula, Ronan Le Bras, Jena D. Hwang, Soumya Sanyal, Sean Welleck, Xiang Ren, Allyson Ettinger, Zaid Harchaoui, and Yejin Choi. 2023. Faith and fate: Limits of transformers on compositionality. In Proceedings of the Advances in Neural Information Processing Systems."},{"key":"e_1_3_3_13_1","doi-asserted-by":"crossref","unstructured":"Lin Gao Jie Yang Tong Wu Yu-Jie Yuan Hongbo Fu Yu-Kun Lai and Hao Zhang. 2019. SDM-NET: Deep generative network for structured deformable mesh. ACM Trans. Graph. 38 6 Article 243 (December 2019) 15 pages.","DOI":"10.1145\/3355089.3356488"},{"key":"e_1_3_3_14_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1633"},{"key":"e_1_3_3_15_1","unstructured":"Klaus Greff Sjoerd van Steenkiste and J\u00fcrgen Schmidhuber. 2020. On the Binding Problem in Artificial Neural Networks. (2020). arXiv:2012.05208. Retrieved from https:\/\/arxiv.org\/abs\/2012.05208"},{"key":"e_1_3_3_16_1","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Gu Jiatao","year":"2018","unstructured":"Jiatao Gu, James Bradbury, Caiming Xiong, Victor O.K. Li, and Richard Socher. 2018. Non-autoregressive neural machine translation. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_3_17_1","doi-asserted-by":"crossref","unstructured":"Jianwei Guo Haiyong Jiang Bedrich Benes Oliver Deussen Xiaopeng Zhang Dani Lischinski and Hui Huang. 2020. Inverse procedural modeling of branching structures by inferring L-Systems. ACM Trans. Graph. 39 5 Article 155 (October 2020) 13 pages.","DOI":"10.1145\/3394105"},{"key":"e_1_3_3_18_1","doi-asserted-by":"crossref","unstructured":"Mohammed Hassanin Salman Khan and Murat Tahtali. 2021. Visual affordance and function understanding: A survey. ACM Comput. Surv. 54 3 Article 47 (April 2022) 35 pages.","DOI":"10.1145\/3446370"},{"key":"e_1_3_3_19_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-emnlp.624"},{"key":"e_1_3_3_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(02)01091-7"},{"issue":"1","key":"e_1_3_3_21_1","article-title":"Parts of recognition","volume":"18","author":"Hoffman Donald D.","year":"1984","unstructured":"Donald D. Hoffman and Whitman A. Richards. 1984. Parts of recognition. Cognition 18, 1 (1984), 65\u201396.","journal-title":"Cognition"},{"key":"e_1_3_3_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3592416"},{"key":"e_1_3_3_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV56688.2023.00128"},{"key":"e_1_3_3_24_1","unstructured":"Diederik P. Kingma and Max Welling. 2013. Auto-encoding variational Bayes. arXiv:1311.6114. Retrieved from https:\/\/arxiv.org\/abs\/1311.6114"},{"key":"e_1_3_3_25_1","doi-asserted-by":"crossref","unstructured":"Alexander Kirillov Eric Mintun Nikhila Ravi Hanzi Mao Chloe Rolland Laura Gustafson Tete Xiao Spencer Whitehead Alexander C. Berg Wan-Yen Lo Piotr Dollar and Ross Girshick. 2023. Segment anything. In Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV). 4015\u20134026.","DOI":"10.1109\/ICCV51070.2023.00371"},{"key":"e_1_3_3_26_1","doi-asserted-by":"publisher","DOI":"10.1002\/nav.3800020109"},{"key":"e_1_3_3_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01325"},{"key":"e_1_3_3_28_1","doi-asserted-by":"crossref","unstructured":"Jun Li Kai Xu Siddhartha Chaudhuri Ersin Yumer Hao Zhang and Leonidas Guibas. 2017. GRASS: Generative recursive autoencoders for shape structures. ACM Trans. Graph. 36 4 Article 52 (August 2017) 14 pages.","DOI":"10.1145\/3072959.3073637"},{"key":"e_1_3_3_29_1","doi-asserted-by":"crossref","unstructured":"Ruihui Li Xianzhi Li Ka-Hei Hui and Chi-Wing Fu. 2021. SP-GAN: sphere-guided 3D shape generation and manipulation. ACM Trans. Graph. 40 4 Article 151 (August 2021) 12 pages.","DOI":"10.1145\/3450626.3459766"},{"key":"e_1_3_3_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.02082"},{"key":"e_1_3_3_31_1","doi-asserted-by":"crossref","unstructured":"William E. Lorensen and Harvey E. Cline. 1987. Marching cubes: A high resolution 3D surface construction algorithm. SIGGRAPH Comput. Graph. 21 4 (July 1987) 163\u2013169.","DOI":"10.1145\/37402.37422"},{"key":"e_1_3_3_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jlap.2012.06.003"},{"key":"e_1_3_3_33_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-2049"},{"key":"e_1_3_3_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2542266.2542267"},{"key":"e_1_3_3_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00040"},{"key":"e_1_3_3_36_1","doi-asserted-by":"crossref","unstructured":"Kaichun Mo Paul Guerrero Li Yi Hao Su Peter Wonka Niloy J. Mitra and Leonidas J. Guibas. 2019. StructureNet: Hierarchical graph networks for 3D shape generation. ACM Trans. Graph. 38 6 Article 242 (December 2019) 19 pages.","DOI":"10.1145\/3355089.3356527"},{"key":"e_1_3_3_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00888"},{"key":"e_1_3_3_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58539-6_41"},{"key":"e_1_3_3_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00100"},{"key":"e_1_3_3_40_1","volume-title":"Proceedings of the 9th ACM Symposium on Solid Modeling and Applications","author":"Mortara Michela","year":"2004","unstructured":"Michela Mortara, Giuseppe Patan\u00e8, Michela Spagnuolo, Bianca Falcidieno, and Jarek Rossignac. 2004. Plumber: A method for a multi-scale decomposition of 3D Shapes into tubular primitives and bodies. In Proceedings of the 9th ACM Symposium on Solid Modeling and Applications."},{"key":"e_1_3_3_41_1","doi-asserted-by":"crossref","unstructured":"Pascal M\u00fcller Peter Wonka Simon Haegler Andreas Ulmer and Luc Van Gool. 2006. Procedural modeling of buildings. ACM Trans. Graph. 25 3 (July 2006) 614\u2013623.","DOI":"10.1145\/1141911.1141931"},{"key":"e_1_3_3_42_1","doi-asserted-by":"publisher","DOI":"10.1137\/0105003"},{"key":"e_1_3_3_43_1","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Ouyang Long","year":"2022","unstructured":"Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et\u00a0al. 2022. Training language models to follow instructions with human feedback. In Proceedings of the Advances in Neural Information Processing Systems."},{"key":"e_1_3_3_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-89657-7_27"},{"key":"e_1_3_3_45_1","article-title":"ANISE: Assembly-based neural implicit surface rEconstruction","author":"Petrov Dmitry","year":"2023","unstructured":"Dmitry Petrov, Matheus Gadelha, Radomir Mech, and Evangelos Kalogerakis. 2023. ANISE: Assembly-based neural implicit surface rEconstruction. IEEE Transactions on Visualization and Computer Graphics 30, 8 (2023), 4514\u20134526.","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"e_1_3_3_46_1","article-title":"Neurosymbolic models for computer graphics","author":"Ritchie Daniel","year":"2023","unstructured":"Daniel Ritchie, Paul Guerrero, R. Kenny Jones, Niloy J. Mitra, Adriana Schulz, Karl D. D. Willis, and Jiajun Wu. 2023. Neurosymbolic models for computer graphics. Computer Graphics Forum (Eurographics 2023 State-of-the-art report (STAR)) 42, 2 (2023), 545\u2013568.","journal-title":"Computer Graphics Forum (Eurographics 2023 State-of-the-art report (STAR))"},{"key":"e_1_3_3_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00578"},{"key":"e_1_3_3_48_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13323"},{"key":"e_1_3_3_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01042"},{"key":"e_1_3_3_50_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2007.01103.x"},{"key":"e_1_3_3_51_1","doi-asserted-by":"crossref","unstructured":"Yisheng Song Ting Wang Puyu Cai Subrota K. Mondal and Jyoti Prakash Sahoo. 2023. A Comprehensive survey of few-shot learning: Evolution Applications Challenges and Opportunities. ACM Comput. Surv. 55 13s Article 271 (December 2023) 40 pages.","DOI":"10.1145\/3582688"},{"key":"e_1_3_3_52_1","article-title":"Semi-supervised 3D shape segmentation with multilevel consistency and part substitution","author":"Sun Chunyu","year":"2022","unstructured":"Chunyu Sun, Yiqi Yang, Haoxiang Guo, pengshuai Wang, Xin Tong, Yang Liu, and Shum Heung-Yeung. 2022. Semi-supervised 3D shape segmentation with multilevel consistency and part substitution. Computational Visual Media 9, 2 (2022), 229\u2013247.","journal-title":"Computational Visual Media"},{"key":"e_1_3_3_53_1","doi-asserted-by":"crossref","unstructured":"Jerry O. Talton Yu Lou Steve Lesser Jared Duke Radom\u00edr M\u011bch and Vladlen Koltun. 2011. Metropolis procedural modeling. ACM Trans. Graph. 30 2 Article 11 (April 2011) 14 pages.","DOI":"10.1145\/1944846.1944851"},{"key":"e_1_3_3_54_1","unstructured":"Aaron van den Oord Oriol Vinyals and Koray Kavukcuoglu. 2017. Neural discrete representation learning. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS\u201917). Curran Associates Inc. Red Hook NY USA 6309\u20136318."},{"key":"e_1_3_3_55_1","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the Advances in Neural Information Processing Systems."},{"key":"e_1_3_3_56_1","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Vinyals Oriol","year":"2015","unstructured":"Oriol Vinyals, Meire Fortunato, and Navdeep Jaitly. 2015. Pointer networks. In Proceedings of the Advances in Neural Information Processing Systems."},{"key":"e_1_3_3_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-20062-5_35"},{"key":"e_1_3_3_58_1","doi-asserted-by":"crossref","unstructured":"Yue Wang Yongbin Sun Ziwei Liu Sanjay E. Sarma Michael M. Bronstein and Justin M. Solomon. 2019. Dynamic graph CNN for learning on point clouds. ACM Trans. Graph. 38 5 Article 146 (October 2019) 12 pages.","DOI":"10.1145\/3326362"},{"key":"e_1_3_3_59_1","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, brian ichter, Fei Xia, Ed Chi, Quoc V. Le, and Denny Zhou. 2022. Chain-of-thought prompting elicits reasoning in large language models. In Proceedings of the Advances in Neural Information Processing Systems."},{"key":"e_1_3_3_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00091"},{"key":"e_1_3_3_61_1","doi-asserted-by":"crossref","unstructured":"Zhijie Wu Xiang Wang Di Lin Dani Lischinski Daniel Cohen-Or and Hui Huang. 2019. SAGNet: Structure-aware generative network for 3D-shape modeling. ACM Trans. Graph. 38 4 Article 91 (August 2019) 14 pages.","DOI":"10.1145\/3306346.3322956"},{"key":"e_1_3_3_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00614"},{"key":"e_1_3_3_63_1","doi-asserted-by":"crossref","unstructured":"Jie Yang Kaichun Mo Yu-Kun Lai Leonidas J. Guibas and Lin Gao. 2022. DSG-Net: Learning disentangled structure and geometry for 3D shape generation. ACM Trans. Graph. 42 1 Article 1 (February 2023) 17 pages.","DOI":"10.1145\/3526212"},{"key":"e_1_3_3_64_1","unstructured":"Shunyu Yao Dian Yu Jeffrey Zhao Izhak Shafran Thomas L. Griffiths Yuan Cao and Karthik Narasimhan. 2023. Tree of thoughts: deliberate problem solving with large language models. In Proceedings of the 37th International Conference on Neural Information Processing Systems (NIPS\u201923). Curran Associates Inc. Red Hook NY USA Article 517 11809\u201311822."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3732934","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,23]],"date-time":"2025-07-23T14:04:07Z","timestamp":1753279447000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3732934"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,18]]},"references-count":63,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,6,30]]}},"alternative-id":["10.1145\/3732934"],"URL":"https:\/\/doi.org\/10.1145\/3732934","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,18]]},"assertion":[{"value":"2023-11-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-03-30","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-06-18","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}