{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T19:14:11Z","timestamp":1783106051261,"version":"3.54.6"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2020,6,15]],"date-time":"2020-06-15T00:00:00Z","timestamp":1592179200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Key R8D Program","award":["2018YFB2100602"],"award-info":[{"award-number":["2018YFB2100602"]}]},{"name":"GD Leading Talent Program","award":["00201509"],"award-info":[{"award-number":["00201509"]}]},{"name":"DFG","award":["422037984"],"award-info":[{"award-number":["422037984"]}]},{"name":"FAR","award":["602757"],"award-info":[{"award-number":["602757"]}]},{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["61861130365, 61761146002, 61802406, and 61802362"],"award-info":[{"award-number":["61861130365, 61761146002, 61802406, and 61802362"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"LHTD","award":["20170003"],"award-info":[{"award-number":["20170003"]}]},{"name":"NSF","award":["10001387"],"award-info":[{"award-number":["10001387"]}]},{"name":"GD Higher Education Key Program","award":["2018KZDXM058"],"award-info":[{"award-number":["2018KZDXM058"]}]},{"name":"GD Laboratory of Artificial Intelligence and Digital Economy"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2020,10,31]]},"abstract":"<jats:p>We introduce an inverse procedural modeling approach that learns L-system representations of pixel images with branching structures. Our fully automatic model generates a compact set of textual rewriting rules that describe the input. We use deep learning to discover atomic structures such as line segments or branchings. Orientation and scaling of these structures are determined and the detected structures are combined into a tree. The initial representation is analyzed, and repeating parts are encoded into a small grammar by using greedy optimization while the user can control the size of the detected rules. The output is an L-system that represents the input image as a simple text and a set of terminal symbols. We apply our approach to a variety of examples, demonstrate its robustness against noise and blur, and we show that it can detect user sketches and complex input structures.<\/jats:p>","DOI":"10.1145\/3394105","type":"journal-article","created":{"date-parts":[[2020,6,15]],"date-time":"2020-06-15T22:07:36Z","timestamp":1592258856000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":65,"title":["Inverse Procedural Modeling of Branching Structures by Inferring L-Systems"],"prefix":"10.1145","volume":"39","author":[{"given":"Jianwei","family":"Guo","sequence":"first","affiliation":[{"name":"NLPR, Institute of Automation, CAS, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haiyong","family":"Jiang","sequence":"additional","affiliation":[{"name":"UCAS and NTU Singapore, UCAS, Beijing, NTU Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bedrich","family":"Benes","sequence":"additional","affiliation":[{"name":"Purdue University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oliver","family":"Deussen","sequence":"additional","affiliation":[{"name":"SIAT Shenzhen and University Konstanz"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaopeng","family":"Zhang","sequence":"additional","affiliation":[{"name":"NLPR, Institute of Automation, CAS, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dani","family":"Lischinski","sequence":"additional","affiliation":[{"name":"The Hebrew University of Jerusalem"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3212-0544","authenticated-orcid":false,"given":"Hui","family":"Huang","sequence":"additional","affiliation":[{"name":"Shenzhen University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,6,15]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12041"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897826.2927323"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/0031-3203(81)90009-1"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2421636.2421644"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778841"},{"key":"e_1_2_2_6_1","volume-title":"The OpenCV library. Dr. Dobb\u2019s J. Softw. Tools 25","author":"Bradski Gary","year":"2000","unstructured":"Gary Bradski . 2000. The OpenCV library. Dr. Dobb\u2019s J. Softw. Tools 25 ( 2000 ), 120\u2013125. Gary Bradski. 2000. The OpenCV library. Dr. Dobb\u2019s J. Softw. Tools 25 (2000), 120\u2013125."},{"key":"e_1_2_2_7_1","volume-title":"Template Matching Techniques in Computer Vision: Theory and Practice","author":"Brunelli Roberto","unstructured":"Roberto Brunelli . 2009. Template Matching Techniques in Computer Vision: Theory and Practice . Wiley Publishing . Roberto Brunelli. 2009. Template Matching Techniques in Computer Vision: Theory and Practice. Wiley Publishing."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.2005.850116"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781139194655"},{"key":"e_1_2_2_10_1","volume-title":"Digital Design of Nature: Computer Generated Plants and Organics","author":"Deussen Oliver","unstructured":"Oliver Deussen and Bernd Lintermann . 2010. Digital Design of Nature: Computer Generated Plants and Organics . Springer Publishing Company, Inc orporated. Oliver Deussen and Bernd Lintermann. 2010. Digital Design of Nature: Computer Generated Plants and Organics. Springer Publishing Company, Incorporated."},{"key":"e_1_2_2_11_1","volume-title":"Proceedings of the Conference on Neural Information Processing Systems. 6060--6069","author":"Ellis Kevin","year":"2018","unstructured":"Kevin Ellis , Daniel Ritchie , Armando Solar-Lezama , and Josh Tenenbaum . 2018 . Learning to infer graphics programs from hand-drawn images . In Proceedings of the Conference on Neural Information Processing Systems. 6060--6069 . Kevin Ellis, Daniel Ritchie, Armando Solar-Lezama, and Josh Tenenbaum. 2018. Learning to infer graphics programs from hand-drawn images. In Proceedings of the Conference on Neural Information Processing Systems. 6060--6069."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306131.3317020"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.81"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925950"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/360825.360861"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2597830"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13616"},{"key":"e_1_2_2_19_1","volume-title":"Proceedings of the International Conference on Computer Vision (ICCV\u201911)","author":"Li Yangyan","unstructured":"Yangyan Li , Qian Zheng , Andrei Sharf , Daniel Cohen-Or , Baoquan Chen , and Niloy J. Mitra . 2011. 2D-3D fusion for layer decomposition of urban facades . In Proceedings of the International Conference on Computer Vision (ICCV\u201911) . 882--889. Yangyan Li, Qian Zheng, Andrei Sharf, Daniel Cohen-Or, Baoquan Chen, and Niloy J. Mitra. 2011. 2D-3D fusion for layer decomposition of urban facades. In Proceedings of the International Conference on Computer Vision (ICCV\u201911). 882--889."},{"key":"e_1_2_2_20_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 936--944","author":"Lin Tsung-Yi","unstructured":"Tsung-Yi Lin , Piotr Doll\u00e1r , Ross B. Girshick , Kaiming He , Bharath Hariharan , and Serge J. Belongie . 2017. Feature pyramid networks for object detection . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 936--944 . Tsung-Yi Lin, Piotr Doll\u00e1r, Ross B. Girshick, Kaiming He, Bharath Hariharan, and Serge J. Belongie. 2017. Feature pyramid networks for object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 936--944."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/0022-5193(68)90079-9"},{"key":"e_1_2_2_22_1","volume-title":"Proceedings of the European Conference on Computer Vision. 21--37","author":"Liu Wei","unstructured":"Wei Liu , Dragomir Anguelov , Dumitru Erhan , Christian Szegedy , Scott E. Reed , Cheng-Yang Fu , and Alexander C. Berg . 2016. SSD: Single shot multibox detector . In Proceedings of the European Conference on Computer Vision. 21--37 . Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott E. Reed, Cheng-Yang Fu, and Alexander C. Berg. 2016. SSD: Single shot multibox detector. In Proceedings of the European Conference on Computer Vision. 21--37."},{"key":"e_1_2_2_23_1","volume-title":"Proceedings of the International Conference on Learning Representations.","author":"Liu Yunchao","unstructured":"Yunchao Liu , Jiajun Wu , Zheng Wu , Daniel Ritchie , William T. Freeman , and Joshua B. Tenenbaum . 2019. Learning to describe scenes with programs . In Proceedings of the International Conference on Learning Representations. Yunchao Liu, Jiajun Wu, Zheng Wu, Daniel Ritchie, William T. Freeman, and Joshua B. Tenenbaum. 2019. Learning to describe scenes with programs. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_2_2_24_1","volume-title":"Proceedings of the European Conference on Computer Vision, (Lecture Notes in Computer Science)","volume":"7578","author":"Martinovic Andelo","unstructured":"Andelo Martinovic , Markus Mathias , Julien Weissenberg , and Luc J . Van Gool. 2012. A three-layered approach to facade parsing . In Proceedings of the European Conference on Computer Vision, (Lecture Notes in Computer Science) , Vol. 7578 . Springer, 416--429. Andelo Martinovic, Markus Mathias, Julien Weissenberg, and Luc J. Van Gool. 2012. A three-layered approach to facade parsing. In Proceedings of the European Conference on Computer Vision, (Lecture Notes in Computer Science), Vol. 7578. Springer, 416--429."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.33"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(98)00127-7"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-92435-9_9"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141931"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276484"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237279"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/375360.375365"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622776.1622780"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925951"},{"key":"e_1_2_2_34_1","volume-title":"Proceedings of the 28th Conference on Computer Graphics and Interactive Techniques (SIGGRAPH\u201901)","author":"Yoav I.","unstructured":"Yoav I. H. Parish and Pascal M\u00fcller. 2001. Procedural modeling of cities . In Proceedings of the 28th Conference on Computer Graphics and Interactive Techniques (SIGGRAPH\u201901) . 301--308. Yoav I. H. Parish and Pascal M\u00fcller. 2001. Procedural modeling of cities. In Proceedings of the 28th Conference on Computer Graphics and Interactive Techniques (SIGGRAPH\u201901). 301--308."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566636"},{"key":"e_1_2_2_36_1","volume-title":"Proceedings of the Graphics Interface Conference. 247--253","author":"Prusinkiewicz Przemyslaw","year":"1986","unstructured":"Przemyslaw Prusinkiewicz . 1986 . Graphical applications of L-systems . In Proceedings of the Graphics Interface Conference. 247--253 . Przemyslaw Prusinkiewicz. 1986. Graphical applications of L-systems. In Proceedings of the Graphics Interface Conference. 247--253."},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/166117.166161"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/192161.192254"},{"key":"e_1_2_2_39_1","volume-title":"The Algorithmic Beauty of Plants","author":"Prusinkiewicz Przemyslaw","unstructured":"Przemyslaw Prusinkiewicz and Aristid Lindenmayer . 1990. The Algorithmic Beauty of Plants . Springer-Verlag New York, Inc. , NY. Przemyslaw Prusinkiewicz and Aristid Lindenmayer. 1990. The Algorithmic Beauty of Plants. Springer-Verlag New York, Inc., NY."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.91"},{"key":"e_1_2_2_41_1","volume-title":"Proceedings of the Conference on Neural Information Processing Systems. 91--99","author":"Ren Shaoqing","year":"2015","unstructured":"Shaoqing Ren , Kaiming He , Ross Girshick , and Jian Sun . 2015 . Faster R-CNN: Towards real-time object detection with region proposal networks . In Proceedings of the Conference on Neural Information Processing Systems. 91--99 . Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015. Faster R-CNN: Towards real-time object detection with region proposal networks. In Proceedings of the Conference on Neural Information Processing Systems. 91--99."},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766895"},{"key":"e_1_2_2_43_1","unstructured":"G. Rozenberg and A. Salomaa. 1980. The Mathematical Theory of L Systems. Academic Press Inc. NY.  G. Rozenberg and A. Salomaa. 1980. The Mathematical Theory of L Systems. Academic Press Inc. NY."},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10032-002-0082-8"},{"key":"e_1_2_2_45_1","volume-title":"OverFeat: Integrated recognition, localization and detection using convolutional networks. CoRR abs\/1312.6229","author":"Sermanet Pierre","year":"2013","unstructured":"Pierre Sermanet , David Eigen , Xiang Zhang , Micha\u00ebl Mathieu , Rob Fergus , and Yann LeCun . 2013. OverFeat: Integrated recognition, localization and detection using convolutional networks. CoRR abs\/1312.6229 ( 2013 ). Pierre Sermanet, David Eigen, Xiang Zhang, Micha\u00ebl Mathieu, Rob Fergus, and Yann LeCun. 2013. OverFeat: Integrated recognition, localization and detection using convolutional networks. CoRR abs\/1312.6229 (2013)."},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00578"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024218"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12276"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380116.2380127"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/1944846.1944851"},{"key":"e_1_2_2_51_1","volume-title":"Proceedings of the International Conference on Learning Representations.","author":"Tian Yonglong","year":"2019","unstructured":"Yonglong Tian , Andrew Luo , Xingyuan Sun , Kevin Ellis , William T. Freeman , Joshua B. Tenenbaum , and Jiajun Wu . 2019 . Learning to infer and execute 3D shape programs . In Proceedings of the International Conference on Learning Representations. Yonglong Tian, Andrew Luo, Xingyuan Sun, Kevin Ellis, William T. Freeman, Joshua B. Tenenbaum, and Jiajun Wu. 2019. Learning to infer and execute 3D shape programs. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5540190"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2366145.2366187"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2009.01636.x"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12282"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618452.1618458"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601162"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00418"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409060.1409114"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807442.2807448"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461923"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.3390\/ijgi5120230"},{"key":"e_1_2_2_63_1","volume-title":"Advances in Visual Computing","author":"Zhuo Huilong","unstructured":"Huilong Zhuo , Shengchuan Zhou , Bedrich Benes , and David Whittinghill . 2015. User-assisted inverse procedural facade modeling and compressed image rendering . In Advances in Visual Computing . Springer International Publishing , Cham , 126--136. Huilong Zhuo, Shengchuan Zhou, Bedrich Benes, and David Whittinghill. 2015. User-assisted inverse procedural facade modeling and compressed image rendering. In Advances in Visual Computing. Springer International Publishing, Cham, 126--136."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3394105","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3394105","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3394105","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:47:12Z","timestamp":1750193232000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3394105"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,15]]},"references-count":63,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2020,10,31]]}},"alternative-id":["10.1145\/3394105"],"URL":"https:\/\/doi.org\/10.1145\/3394105","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,15]]},"assertion":[{"value":"2019-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-06-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}