{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T19:44:41Z","timestamp":1773085481245,"version":"3.50.1"},"reference-count":73,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T00:00:00Z","timestamp":1638316800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"name":"ERC","award":["758800"],"award-info":[{"award-number":["758800"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:p>We propose a novel and flexible roof modeling approach that can be used for constructing planar 3D polygon roof meshes. Our method uses a graph structure to encode roof topology and enforces the roof validity by optimizing a simple but effective planarity metric we propose. This approach is significantly more efficient than using general purpose 3D modeling tools such as 3ds Max or SketchUp, and more powerful and expressive than specialized tools such as the straight skeleton. Our optimization-based formulation is also flexible and can accommodate different styles and user preferences for roof modeling. We showcase two applications. The first application is an interactive roof editing framework that can be used for roof design or roof reconstruction from aerial images. We highlight the efficiency and generality of our approach by constructing a mesh-image paired dataset consisting of 2539 roofs. Our second application is a generative model to synthesize new roof meshes from scratch. We use our novel dataset to combine machine learning and our roof optimization techniques, by using transformers and graph convolutional networks to model roof topology, and our roof optimization methods to enforce the planarity constraint.<\/jats:p>","DOI":"10.1145\/3478513.3480494","type":"journal-article","created":{"date-parts":[[2021,12,10]],"date-time":"2021-12-10T18:29:20Z","timestamp":1639160960000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["Intuitive and efficient roof modeling for reconstruction and synthesis"],"prefix":"10.1145","volume":"40","author":[{"given":"Jing","family":"Ren","sequence":"first","affiliation":[{"name":"KAUST and Alibaba Group, Saudi Arabia"}]},{"given":"Biao","family":"Zhang","sequence":"additional","affiliation":[{"name":"KAUST, Saudi Arabia"}]},{"given":"Bojian","family":"Wu","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}]},{"given":"Jianqiang","family":"Huang","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}]},{"given":"Lubin","family":"Fan","sequence":"additional","affiliation":[{"name":"Alibaba Group, China"}]},{"given":"Maks","family":"Ovsjanikov","sequence":"additional","affiliation":[{"name":"LIX, \u00c9cole Polytechnique, France"}]},{"given":"Peter","family":"Wonka","sequence":"additional","affiliation":[{"name":"KAUST, Saudi Arabia"}]}],"member":"320","published-online":{"date-parts":[[2021,12,10]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/646715.701578"},{"key":"e_1_2_2_2_1","doi-asserted-by":"crossref","unstructured":"Oswin Aichholzer Franz Aurenhammer David Alberts and Bernd G\u00e4rtner. 1996. A novel type of skeleton for polygons. (1996) 752--761.  Oswin Aichholzer Franz Aurenhammer David Alberts and Bernd G\u00e4rtner. 1996. A novel type of skeleton for polygons. (1996) 752--761.","DOI":"10.1007\/978-3-642-80350-5_65"},{"key":"e_1_2_2_3_1","volume-title":"Remote Sensing & Spatial Information Sciences 5, 2","author":"Alidoost F","year":"2020","unstructured":"F Alidoost , H Arefi , and M Hahn . 2020. Y-Shaped convolutional neural network for 3D roof elements extraction to reconstruct building models from a single aerial image. ISPRS Annals of Photogrammetry , Remote Sensing & Spatial Information Sciences 5, 2 ( 2020 ). F Alidoost, H Arefi, and M Hahn. 2020. Y-Shaped convolutional neural network for 3D roof elements extraction to reconstruct building models from a single aerial image. ISPRS Annals of Photogrammetry, Remote Sensing & Spatial Information Sciences 5, 2 (2020)."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2421636.2421642"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3376918"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comgeo.2014.08.006"},{"key":"e_1_2_2_7_1","volume-title":"Generative and Discriminative Voxel Modeling with Convolutional Neural Networks. In Neural Inofrmation Processing Conference: 3D Deep Learning.","author":"Brock Andrew","year":"2016","unstructured":"Andrew Brock , Theodore Lim , James Millar Ritchie , and Nicholas J Weston . 2016 . Generative and Discriminative Voxel Modeling with Convolutional Neural Networks. In Neural Inofrmation Processing Conference: 3D Deep Learning. Andrew Brock, Theodore Lim, James Millar Ritchie, and Nicholas J Weston. 2016. Generative and Discriminative Voxel Modeling with Convolutional Neural Networks. In Neural Inofrmation Processing Conference: 3D Deep Learning."},{"key":"e_1_2_2_8_1","unstructured":"Cyprien Buron Jean-Eudes Marvie and Pascal Gautron. 2013. GPU Roof Grammars. In Eurographics (Short Papers). 85--88.  Cyprien Buron Jean-Eudes Marvie and Pascal Gautron. 2013. GPU Roof Grammars. In Eurographics (Short Papers). 85--88."},{"key":"e_1_2_2_9_1","volume-title":"International Conference on Machine Learning. PMLR, 864--872","author":"Chen Xi","year":"2018","unstructured":"Xi Chen , Nikhil Mishra , Mostafa Rohaninejad , and Pieter Abbeel . 2018 . Pixelsnail: An improved autoregressive generative model . In International Conference on Machine Learning. PMLR, 864--872 . Xi Chen, Nikhil Mishra, Mostafa Rohaninejad, and Pieter Abbeel. 2018. Pixelsnail: An improved autoregressive generative model. In International Conference on Machine Learning. PMLR, 864--872."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1285"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1111\/tgis.12659"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.248"},{"key":"e_1_2_2_13_1","volume-title":"NICE: Non-linear Independent Components Estimation. In International Conference on Learning Representations (ICLR), Yoshua Bengio and Yann LeCun (Eds.).","author":"Dinh Laurent","year":"2015","unstructured":"Laurent Dinh , David Krueger , and Yoshua Bengio . 2015 . NICE: Non-linear Independent Components Estimation. In International Conference on Learning Representations (ICLR), Yoshua Bengio and Yann LeCun (Eds.). Laurent Dinh, David Krueger, and Yoshua Bengio. 2015. NICE: Non-linear Independent Components Estimation. In International Conference on Learning Representations (ICLR), Yoshua Bengio and Yann LeCun (Eds.)."},{"key":"e_1_2_2_14_1","volume-title":"International Conference on Learning Representations (ICLR).","author":"Dosovitskiy Alexey","year":"2021","unstructured":"Alexey Dosovitskiy , Lucas Beyer , Alexander Kolesnikov , Dirk Weissenborn , Xiaohua Zhai , Thomas Unterthiner , Mostafa Dehghani , Matthias Minderer , Georg Heigold , Sylvain Gelly , Jakob Uszkoreit , and Neil Houlsby . 2021 . An Image is Worth 16\u00d716 Words: Transformers for Image Recognition at Scale . In International Conference on Learning Representations (ICLR). Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, and Neil Houlsby. 2021. An Image is Worth 16\u00d716 Words: Transformers for Image Recognition at Scale. In International Conference on Learning Representations (ICLR)."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipl.2017.12.001"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/PL00009479"},{"key":"e_1_2_2_17_1","volume-title":"Proceedings of Spring Conference on Computer Graphics. Citeseer.","author":"Felkel Petr","year":"1998","unstructured":"Petr Felkel and Stepan Obdrzalek . 1998 . Straight skeleton implementation . In Proceedings of Spring Conference on Computer Graphics. Citeseer. Petr Felkel and Stepan Obdrzalek. 1998. Straight skeleton implementation. In Proceedings of Spring Conference on Computer Graphics. Citeseer."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818057"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356488"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.5555\/2969033.2969125"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2012.03043.x"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cad.2017.07.003"},{"key":"e_1_2_2_23_1","volume-title":"Graph2Plan: Learning Floorplan Generation from Layout Graphs. arXiv preprint arXiv:2004.13204","author":"Hu Ruizhen","year":"2020","unstructured":"Ruizhen Hu , Zeyu Huang , Yuhan Tang , Oliver van Kaick , Hao Zhang , and Hui Huang . 2020. Graph2Plan: Learning Floorplan Generation from Layout Graphs. arXiv preprint arXiv:2004.13204 ( 2020 ). Ruizhen Hu, Zeyu Huang, Yuhan Tang, Oliver van Kaick, Hao Zhang, and Hui Huang. 2020. Graph2Plan: Learning Floorplan Generation from Layout Graphs. arXiv preprint arXiv:2004.13204 (2020)."},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818077"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130823"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275065"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1944846.1944854"},{"key":"e_1_2_2_28_1","volume-title":"Joun Yeop Lee, and Nam Soo Kim.","author":"Kim Hyeongju","year":"2020","unstructured":"Hyeongju Kim , Hyeonseung Lee , Woo Hyun Kang , Joun Yeop Lee, and Nam Soo Kim. 2020 . SoftFlow: Probabilistic Framework for Normalizing Flow on Manifolds. Advances in Neural Information Processing Systems 33 (2020). Hyeongju Kim, Hyeonseung Lee, Woo Hyun Kang, Joun Yeop Lee, and Nam Soo Kim. 2020. SoftFlow: Probabilistic Framework for Normalizing Flow on Manifolds. Advances in Neural Information Processing Systems 33 (2020)."},{"key":"e_1_2_2_29_1","volume-title":"Auto-Encoding Variational Bayes. In International Conference on Learning Representations (ICLR), Yoshua Bengio and Yann LeCun (Eds.).","author":"Diederik","unstructured":"Diederik P. Kingma and Max Welling. 2014 . Auto-Encoding Variational Bayes. In International Conference on Learning Representations (ICLR), Yoshua Bengio and Yann LeCun (Eds.). Diederik P. Kingma and Max Welling. 2014. Auto-Encoding Variational Bayes. In International Conference on Learning Representations (ICLR), Yoshua Bengio and Yann LeCun (Eds.)."},{"key":"e_1_2_2_30_1","volume-title":"Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907","author":"Kipf Thomas N","year":"2016","unstructured":"Thomas N Kipf and Max Welling . 2016. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 ( 2016 ). Thomas N Kipf and Max Welling. 2016. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016)."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1174429.1174501"},{"key":"e_1_2_2_32_1","unstructured":"Robert G Laycock and AM Day. 2003. Automatically generating roof models from building footprints. (2003).  Robert G Laycock and AM Day. 2003. Automatically generating roof models from building footprints. (2003)."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461969"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00273"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1179352.1141941"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1866158.1866203"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356527"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1179352.1141931"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12077"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.258"},{"key":"e_1_2_2_41_1","volume-title":"Proceedings of the 37th International Conference on Machine Learning (ICML) (Proceedings of Machine Learning Research)","volume":"119","author":"Nash Charlie","unstructured":"Charlie Nash , Yaroslav Ganin , S. M. Ali Eslami , and Peter W. Battaglia . 2020. PolyGen: An Autoregressive Generative Model of 3D Meshes . In Proceedings of the 37th International Conference on Machine Learning (ICML) (Proceedings of Machine Learning Research) , Vol. 119 . PMLR, 7220--7229. Charlie Nash, Yaroslav Ganin, S. M. Ali Eslami, and Peter W. Battaglia. 2020. PolyGen: An Autoregressive Generative Model of 3D Meshes. In Proceedings of the 37th International Conference on Machine Learning (ICML) (Proceedings of Machine Learning Research), Vol. 119. PMLR, 7220--7229."},{"key":"e_1_2_2_42_1","volume-title":"Generative Layout Modeling using Constraint Graphs. CoRR abs\/2011.13417","author":"Para Wamiq Reyaz","year":"2020","unstructured":"Wamiq Reyaz Para , Paul Guerrero , Tom Kelly , Leonidas J. Guibas , and Peter Wonka . 2020. Generative Layout Modeling using Constraint Graphs. CoRR abs\/2011.13417 ( 2020 ). Wamiq Reyaz Para, Paul Guerrero, Tom Kelly, Leonidas J. Guibas, and Peter Wonka. 2020. Generative Layout Modeling using Constraint Graphs. CoRR abs\/2011.13417 (2020)."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3455008"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276458"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1399504.1360675"},{"key":"e_1_2_2_46_1","unstructured":"Alec Radford Jeffrey Wu Rewon Child David Luan Dario Amodei and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. (2019).  Alec Radford Jeffrey Wu Rewon Child David Luan Dario Amodei and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. (2019)."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01219-9_43"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3455618"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2751473"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.5555\/3045118.3045281"},{"key":"e_1_2_2_51_1","volume-title":"International Conference on Learning Representations (ICLR). Open-Review.net.","author":"Salimans Tim","unstructured":"Tim Salimans , Andrej Karpathy , Xi Chen , and Diederik P. Kingma . 2017. PixelCNN++: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modifications . In International Conference on Learning Representations (ICLR). Open-Review.net. Tim Salimans, Andrej Karpathy, Xi Chen, and Diederik P. Kingma. 2017. PixelCNN++: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modifications. In International Conference on Learning Representations (ICLR). Open-Review.net."},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12531"},{"key":"e_1_2_2_53_1","volume-title":"Conditional invertible flow for point cloud generation. arXiv preprint arXiv:1910.07344","author":"Stypu\u0142kowski Micha\u0142","year":"2019","unstructured":"Micha\u0142 Stypu\u0142kowski , Maciej Zamorski , Maciej Zi\u0119ba , and Jan Chorowski . 2019. Conditional invertible flow for point cloud generation. arXiv preprint arXiv:1910.07344 ( 2019 ). Micha\u0142 Stypu\u0142kowski, Maciej Zamorski, Maciej Zi\u0119ba, and Jan Chorowski. 2019. Conditional invertible flow for point cloud generation. arXiv preprint arXiv:1910.07344 (2019)."},{"key":"e_1_2_2_54_1","doi-asserted-by":"crossref","unstructured":"Kenichi Sugihara. 2013. Straight skeleton for automatic generation of 3-D building models with general shaped roofs. (2013).  Kenichi Sugihara. 2013. Straight skeleton for automatic generation of 3-D building models with general shaped roofs. (2013).","DOI":"10.1504\/IJKWI.2012.051319"},{"key":"e_1_2_2_55_1","first-page":"101","article-title":"Straight Skeleton Computation Optimized for Roof Model Generation","volume":"27","author":"Sugihara Kenichi","year":"2019","unstructured":"Kenichi Sugihara . 2019 . Straight Skeleton Computation Optimized for Roof Model Generation . In WSCG , Vol. 27. 101 -- 109 . Kenichi Sugihara. 2019. Straight Skeleton Computation Optimized for Roof Model Generation. In WSCG, Vol. 27. 101--109.","journal-title":"WSCG"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00612"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.5555\/3157382.3157633"},{"key":"e_1_2_2_58_1","unstructured":"Aaron Van Den Oord Oriol Vinyals etal 2017. Neural discrete representation learning. In Advances in Neural Information Processing Systems. 6306--6315.  Aaron Van Den Oord Oriol Vinyals et al. 2017. Neural discrete representation learning. In Advances in Neural Information Processing Systems. 6306--6315."},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.5555\/3045390.3045575"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295349"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2732527"},{"key":"e_1_2_2_62_1","unstructured":"Xinpeng Wang Chandan Yeshwanth and Matthias NieSSner. 2020. SceneFormer: Indoor Scene Generation with Transformers. arXiv:cs.CV\/2012.09793  Xinpeng Wang Chandan Yeshwanth and Matthias NieSSner. 2020. SceneFormer: Indoor Scene Generation with Transformers. arXiv:cs.CV\/2012.09793"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.5555\/3157096.3157106"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00464"},{"key":"e_1_2_2_65_1","unstructured":"Jie Yang Kaichun Mo Yu-Kun Lai Leonidas J. Guibas and Lin Gao. 2020. DSM-Net: Disentangled Structured Mesh Net for Controllable Generation of Fine Geometry. arXiv:cs.GR\/2008.05440  Jie Yang Kaichun Mo Yu-Kun Lai Leonidas J. Guibas and Lin Gao. 2020. DSM-Net: Disentangled Structured Mesh Net for Controllable Generation of Fine Geometry. arXiv:cs.GR\/2008.05440"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.isprsjprs.2020.11.011"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964981"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01219-9_45"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00287"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/1463434.1463444"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.5555\/1927006.1927017"},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995611"},{"key":"e_1_2_2_73_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01252-6_38"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478513.3480494","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3478513.3480494","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:11:48Z","timestamp":1750191108000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478513.3480494"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12]]},"references-count":73,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["10.1145\/3478513.3480494"],"URL":"https:\/\/doi.org\/10.1145\/3478513.3480494","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12]]},"assertion":[{"value":"2021-12-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}