{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:18:00Z","timestamp":1750220280287,"version":"3.41.0"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2021,9,22]],"date-time":"2021-09-22T00:00:00Z","timestamp":1632268800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"ARL AHPCRC","award":["W911NF-07-0027"],"award-info":[{"award-number":["W911NF-07-0027"]}]},{"name":"ONR","award":["N000014-13-1-0346, N00014-17-1-2174"],"award-info":[{"award-number":["N000014-13-1-0346, N00014-17-1-2174"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Comput. Graph. Interact. Tech."],"published-print":{"date-parts":[[2021,9,22]]},"abstract":"<jats:p>We tackle the challenging problem of creating full and accurate three dimensional reconstructions of botanical trees with the topological and geometric accuracy required for subsequent physical simulation, e.g. in response to wind forces. Although certain aspects of our approach would benefit from various improvements, our results exceed the state of the art especially in geometric and topological complexity and accuracy. Starting with two dimensional RGB image data acquired from cameras attached to drones, we create point clouds, textured triangle meshes, and a simulatable and skinned cylindrical articulated rigid body model. We discuss the pros and cons of each step of our pipeline, and in order to stimulate future research we make the raw and processed data from every step of the pipeline as well as the final geometric reconstructions publicly available.<\/jats:p>","DOI":"10.1145\/3480146","type":"journal-article","created":{"date-parts":[[2021,9,28]],"date-time":"2021-09-28T04:43:36Z","timestamp":1632804216000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Three Dimensional Reconstruction of Botanical Trees with Simulatable Geometry"],"prefix":"10.1145","volume":"4","author":[{"given":"Ed","family":"Quigley","sequence":"first","affiliation":[{"name":"NVIDIA Corporation, Santa Clara, CA, USA"}]},{"given":"Winnie","family":"Lin","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}]},{"given":"Yilin","family":"Zhu","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}]},{"given":"Ronald","family":"Fedkiw","sequence":"additional","affiliation":[{"name":"Stanford University, Stanford, CA, USA"}]}],"member":"320","published-online":{"date-parts":[[2021,9,27]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2009.5459148"},{"key":"e_1_2_2_2_1","volume-title":"Joint 2d-3d-semantic data for indoor scene understanding. arXiv preprint arXiv:1702.01105","author":"Armeni Iro","year":"2017","unstructured":"Iro Armeni , Sasha Sax , Amir R Zamir , and Silvio Savarese . 2017. Joint 2d-3d-semantic data for indoor scene understanding. arXiv preprint arXiv:1702.01105 ( 2017 ). Iro Armeni, Sasha Sax, Amir R Zamir, and Silvio Savarese. 2017. Joint 2d-3d-semantic data for indoor scene understanding. arXiv preprint arXiv:1702.01105 (2017)."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.170"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344972"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/325334.325249"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/964965.808602"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.177"},{"key":"e_1_2_2_8_1","volume-title":"Comput. Graph. (SIGGRAPH Proc.)","author":"Desbrun M.","year":"1999","unstructured":"M. Desbrun , M. Meyer , P. Schr\u00f6der , and A. H. Barr . 1999. Implicit Fairing of Irregular Meshes using Diffusion and Curvature Flow . Comput. Graph. (SIGGRAPH Proc.) ( 1999 ), 317--324. M. Desbrun, M. Meyer, P. Schr\u00f6der, and A. H. Barr. 1999. Implicit Fairing of Irregular Meshes using Diffusion and Curvature Flow. Comput. Graph. (SIGGRAPH Proc.) (1999), 317--324."},{"key":"e_1_2_2_9_1","first-page":"1","article-title":"Tree topology estimation","volume":"1","author":"Estrada Rolando","year":"2015","unstructured":"Rolando Estrada , Carlo Tomasi , Scott C Schmidler , and Sina Farsiu . 2015 . Tree topology estimation . IEEE Transactions on Pattern Analysis & Machine Intelligence 1 (2015), 1 -- 1 . Rolando Estrada, Carlo Tomasi, Scott C Schmidler, and Sina Farsiu. 2015. Tree topology estimation. IEEE Transactions on Pattern Analysis & Machine Intelligence 1 (2015), 1--1.","journal-title":"IEEE Transactions on Pattern Analysis & Machine Intelligence"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/358669.358692"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.3390\/s17092022"},{"key":"e_1_2_2_12_1","volume-title":"dense, and robust multiview stereopsis","author":"Furukawa Yasutaka","year":"2010","unstructured":"Yasutaka Furukawa and Jean Ponce . 2010. Accurate , dense, and robust multiview stereopsis . IEEE transactions on pattern analysis and machine intelligence 32, 8 ( 2010 ), 1362--1376. Yasutaka Furukawa and Jean Ponce. 2010. Accurate, dense, and robust multiview stereopsis. IEEE transactions on pattern analysis and machine intelligence 32, 8 (2010), 1362--1376."},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130824"},{"key":"e_1_2_2_14_1","volume-title":"Unsupervised texture segmentation using Gabor filters. Pattern recognition 24, 12","author":"Jain Anil K","year":"1991","unstructured":"Anil K Jain and Farshid Farrokhnia . 1991. Unsupervised texture segmentation using Gabor filters. Pattern recognition 24, 12 ( 1991 ), 1167--1186. Anil K Jain and Farshid Farrokhnia. 1991. Unsupervised texture segmentation using Gabor filters. Pattern recognition 24, 12 (1991), 1167--1186."},{"key":"e_1_2_2_15_1","volume-title":"Data-Augmented Contact Model for Rigid Body Simulation. arXiv preprint arXiv:1803.04019","author":"Jiang Yifeng","year":"2018","unstructured":"Yifeng Jiang and C Karen Liu . 2018. Data-Augmented Contact Model for Rigid Body Simulation. arXiv preprint arXiv:1803.04019 ( 2018 ). Yifeng Jiang and C Karen Liu. 2018. Data-Augmented Contact Model for Rigid Body Simulation. arXiv preprint arXiv:1803.04019 (2018)."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46475-6_43"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01267-0_23"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/1281957.1281965"},{"key":"e_1_2_2_19_1","volume-title":"Combining learned and analytical models for predicting action effects. arXiv preprint arXiv:1710.04102","author":"Kloss Alina","year":"2017","unstructured":"Alina Kloss , Stefan Schaal , and Jeannette Bohg . 2017. Combining learned and analytical models for predicting action effects. arXiv preprint arXiv:1710.04102 ( 2017 ). Alina Kloss, Stefan Schaal, and Jeannette Bohg. 2017. Combining learned and analytical models for predicting action effects. arXiv preprint arXiv:1710.04102 (2017)."},{"key":"e_1_2_2_20_1","first-page":"273","article-title":"Smooth vasculature reconstruction with circular and elliptic cross sections","volume":"119","author":"Krissian Karl","year":"2006","unstructured":"Karl Krissian , Xunlei Wu , and Vincent Luboz . 2006 . Smooth vasculature reconstruction with circular and elliptic cross sections . Medicine Meets Virtual Reality 14: Accelerating Change in Healthcare: Next Medical Toolkit 119 (2006), 273 . Karl Krissian, Xunlei Wu, and Vincent Luboz. 2006. Smooth vasculature reconstruction with circular and elliptic cross sections. Medicine Meets Virtual Reality 14: Accelerating Change in Healthcare: Next Medical Toolkit 119 (2006), 273.","journal-title":"Medicine Meets Virtual Reality 14: Accelerating Change in Healthcare: Next Medical Toolkit"},{"key":"e_1_2_2_21_1","first-page":"1","article-title":"Analyzing growing plants from 4D point cloud data","volume":"32","author":"Li Yangyan","year":"2013","unstructured":"Yangyan Li , Xiaochen Fan , Niloy J Mitra , Daniel Chamovitz , Daniel Cohen-Or , and Baoquan Chen . 2013 . Analyzing growing plants from 4D point cloud data . ACM Transactions on Graphics (TOG) 32 , 6 (2013), 1 -- 10 . Yangyan Li, Xiaochen Fan, Niloy J Mitra, Daniel Chamovitz, Daniel Cohen-Or, and Baoquan Chen. 2013. Analyzing growing plants from 4D point cloud data. ACM Transactions on Graphics (TOG) 32, 6 (2013), 1--10.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_2_2_22_1","volume-title":"RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentation. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Lin Guosheng","year":"2017","unstructured":"Guosheng Lin , Anton Milan , Chunhua Shen , and Ian Reid . 2017 . RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentation. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Guosheng Lin, Anton Milan, Chunhua Shen, and Ian Reid. 2017. RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentation. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/0022-5193(68)90079-9"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1882262.1866177"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10584-0_11"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.372"},{"key":"e_1_2_2_28_1","volume-title":"Beyond the Pixel-Wise Loss for Topology-Aware Delineation. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Mosinska Agata","year":"2018","unstructured":"Agata Mosinska , Pablo M\u00e1rquez-Neila , Mateusz Kozi\u0144ski , and Pascal Fua . 2018 . Beyond the Pixel-Wise Loss for Topology-Aware Delineation. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Agata Mosinska, Pablo M\u00e1rquez-Neila, Mateusz Kozi\u0144ski, and Pascal Fua. 2018. Beyond the Pixel-Wise Loss for Topology-Aware Delineation. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_29_1","volume-title":"International Workshop on Reproducible Research in Pattern Recognition. Springer, 60--74","author":"Moulon Pierre","year":"2016","unstructured":"Pierre Moulon , Pascal Monasse , Romuald Perrot , and Renaud Marlet . 2016 . OpenMVG: Open multiple view geometry . In International Workshop on Reproducible Research in Pattern Recognition. Springer, 60--74 . Pierre Moulon, Pascal Monasse, Romuald Perrot, and Renaud Marlet. 2016. OpenMVG: Open multiple view geometry. In International Workshop on Reproducible Research in Pattern Recognition. Springer, 60--74."},{"key":"e_1_2_2_30_1","volume-title":"Article 92","author":"M\u00fcller Matthias","year":"2011","unstructured":"Matthias M\u00fcller and Nuttapong Chentanez . 2011. Solid Simulation with Oriented Particles. ACM TOG 30, 4 , Article 92 ( 2011 ), 10 pages. Matthias M\u00fcller and Nuttapong Chentanez. 2011. Solid Simulation with Oriented Particles. ACM TOG 30, 4, Article 92 (2011), 10 pages."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073602"},{"volume-title":"Handbook of formal languages","author":"Prusinkiewicz Przemyslaw","key":"e_1_2_2_32_1","unstructured":"Przemyslaw Prusinkiewicz , Mark Hammel , Jim Hanan , and Radom\u00edr M\u011bch . 1997. Visual models of plant development . In Handbook of formal languages . Springer , 535--597. Przemyslaw Prusinkiewicz, Mark Hammel, Jim Hanan, and Radom\u00edr M\u011bch. 1997. Visual models of plant development. In Handbook of formal languages. Springer, 535--597."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3240508.3240553"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2661308"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.445"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.19"},{"volume-title":"Computer Graphics Forum","author":"Stava Ondrej","key":"e_1_2_2_38_1","unstructured":"Ondrej Stava , S\u00f6ren Pirk , Julian Kratt , Baoquan Chen , Radom\u00edr M\u011bch , Oliver Deussen , and Bedrich Benes . 2014. Inverse procedural modelling of trees . In Computer Graphics Forum , Vol. 33 . Wiley Online Library , 118--131. Ondrej Stava, S\u00f6ren Pirk, Julian Kratt, Baoquan Chen, Radom\u00edr M\u011bch, Oliver Deussen, and Bedrich Benes. 2014. Inverse procedural modelling of trees. In Computer Graphics Forum, Vol. 33. Wiley Online Library, 118--131."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276486"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/218380.218473"},{"key":"e_1_2_2_41_1","volume-title":"Proc. of the British Machine Vision Conf. (BMVC).","author":"Ventura Carles","year":"2018","unstructured":"Carles Ventura , Jordi Pont-Tuset , Sergi Caelles , Kevis-Kokitsi Maninis , and Luc Van Gool . 2018 . Iterative Deep Learning for Road Topology Extraction . In Proc. of the British Machine Vision Conf. (BMVC). Carles Ventura, Jordi Pont-Tuset, Sergi Caelles, Kevis-Kokitsi Maninis, and Luc Van Gool. 2018. Iterative Deep Learning for Road Topology Extraction. In Proc. of the British Machine Vision Conf. (BMVC)."},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/218380.218427"},{"volume-title":"Computer Graphics Forum","author":"Wither Jamie","key":"e_1_2_2_43_1","unstructured":"Jamie Wither , Fr\u00e9d\u00e9ric Boudon , M-P Cani , and Christophe Godin . 2009. Structure from silhouettes: a new paradigm for fast sketch-based design of trees . In Computer Graphics Forum , Vol. 28 . Wiley Online Library , 541--550. Jamie Wither, Fr\u00e9d\u00e9ric Boudon, M-P Cani, and Christophe Godin. 2009. Structure from silhouettes: a new paradigm for fast sketch-based design of trees. In Computer Graphics Forum, Vol. 28. Wiley Online Library, 541--550."},{"key":"e_1_2_2_44_1","unstructured":"Changchang Wu. 2011. VisualSFM: A visual structure from motion system. http:\/\/ccwu.me\/vsfm\/.  Changchang Wu. 2011. VisualSFM: A visual structure from motion system. http:\/\/ccwu.me\/vsfm\/."},{"key":"e_1_2_2_45_1","volume-title":"2013 International Conference on. IEEE, 127--134","author":"Wu Changchang","year":"2013","unstructured":"Changchang Wu . 2013 . Towards linear-time incremental structure from motion. In 3D Vision-3DV 2013 , 2013 International Conference on. IEEE, 127--134 . Changchang Wu. 2013. Towards linear-time incremental structure from motion. In 3D Vision-3DV 2013, 2013 International Conference on. IEEE, 127--134."},{"key":"e_1_2_2_46_1","first-page":"12","article-title":"Tree Modeling with Real Tree-Parts Examples","volume":"22","author":"Xie Ke","year":"2015","unstructured":"Ke Xie , Feilong Yan , Andrei Sharf , Oliver Deussen , Baoquan Chen , and Hui Huang . 2015 . Tree Modeling with Real Tree-Parts Examples . IEEE TVCG 22 , 12 (Dec 2015), 2608--2618. Ke Xie, Feilong Yan, Andrei Sharf, Oliver Deussen, Baoquan Chen, and Hui Huang. 2015. Tree Modeling with Real Tree-Parts Examples. IEEE TVCG 22, 12 (Dec 2015), 2608--2618.","journal-title":"IEEE TVCG"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3181973"},{"volume-title":"The European Conf. on Comput. Vision (ECCV). 748--764","author":"Xue Tianfan","key":"e_1_2_2_48_1","unstructured":"Tianfan Xue , Jiajun Wu , Zhoutong Zhang , Chengkai Zhang , Joshua B. Tenenbaum , and William T. Freeman . 2018. Seeing Tree Structure from Vibration . In The European Conf. on Comput. Vision (ECCV). 748--764 . Tianfan Xue, Jiajun Wu, Zhoutong Zhang, Chengkai Zhang, Joshua B. Tenenbaum, and William T. Freeman. 2018. Seeing Tree Structure from Vibration. In The European Conf. on Comput. Vision (ECCV). 748--764."},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461961"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126475"},{"key":"e_1_2_2_51_1","volume-title":"Comput. Vision and Pattern Recognition Workshops, 2008. CVPRW'08. IEEE Comput. Society Conf. on. IEEE, 1--8.","author":"Zhou Jin","year":"2008","unstructured":"Jin Zhou , Ananya Das , Feng Li , and Baoxin Li . 2008 . Circular generalized cylinder fitting for 3D reconstruction in endoscopic imaging based on MRF . In Comput. Vision and Pattern Recognition Workshops, 2008. CVPRW'08. IEEE Comput. Society Conf. on. IEEE, 1--8. Jin Zhou, Ananya Das, Feng Li, and Baoxin Li. 2008. Circular generalized cylinder fitting for 3D reconstruction in endoscopic imaging based on MRF. In Comput. Vision and Pattern Recognition Workshops, 2008. CVPRW'08. IEEE Comput. Society Conf. on. IEEE, 1--8."},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00416"}],"container-title":["Proceedings of the ACM on Computer Graphics and Interactive Techniques"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3480146","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3480146","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3480146","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:16Z","timestamp":1750188676000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3480146"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,22]]},"references-count":51,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,9,22]]}},"alternative-id":["10.1145\/3480146"],"URL":"https:\/\/doi.org\/10.1145\/3480146","relation":{},"ISSN":["2577-6193"],"issn-type":[{"type":"electronic","value":"2577-6193"}],"subject":[],"published":{"date-parts":[[2021,9,22]]},"assertion":[{"value":"2021-09-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}