{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T09:11:16Z","timestamp":1772097076986,"version":"3.50.1"},"reference-count":71,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2018,12,14]],"date-time":"2018-12-14T00:00:00Z","timestamp":1544745600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2019,2,28]]},"abstract":"<jats:p>We introduce a new method that efficiently computes a set of viewpoints and trajectories for high-quality 3D reconstructions in outdoor environments. Our goal is to automatically explore an unknown area and obtain a complete 3D scan of a region of interest (e.g., a large building). Images from a commodity RGB camera, mounted on an autonomously navigated quadcopter, are fed into a multi-view stereo reconstruction pipeline that produces high-quality results but is computationally expensive. In this setting, the scanning result is constrained by the restricted flight time of quadcopters. To this end, we introduce a novel optimization strategy that respects these constraints by maximizing the information gain from sparsely sampled viewpoints while limiting the total travel distance of the quadcopter. At the core of our method lies a hierarchical volumetric representation that allows the algorithm to distinguish between unknown, free, and occupied space. Furthermore, our information gain-based formulation leverages this representation to handle occlusions in an efficient manner. In addition to the surface geometry, we utilize free-space information to avoid obstacles and determine collision-free flight paths. Our tool can be used to specify the region of interest and to plan trajectories. We demonstrate our method by obtaining a number of compelling 3D reconstructions, and we provide a thorough quantitative evaluation showing improvement over previous state-of-the-art and regular patterns.<\/jats:p>","DOI":"10.1145\/3233794","type":"journal-article","created":{"date-parts":[[2018,12,14]],"date-time":"2018-12-14T13:19:17Z","timestamp":1544793557000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":109,"title":["Plan3D"],"prefix":"10.1145","volume":"38","author":[{"given":"Benjamin","family":"Hepp","sequence":"first","affiliation":[{"name":"ETH Zurich, Z\u00fcrich, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6093-5199","authenticated-orcid":false,"given":"Matthias","family":"Nie\u00dfner","sequence":"additional","affiliation":[{"name":"Technical University of Munich, Stanford University"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5068-3474","authenticated-orcid":false,"given":"Otmar","family":"Hilliges","sequence":"additional","affiliation":[{"name":"ETH Zurich, Z\u00fcrich, Switzerland"}]}],"member":"320","published-online":{"date-parts":[[2018,12,14]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/1888028.1888032"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2009.5459148"},{"key":"e_1_2_2_3_1","unstructured":"LLC Agisoft. 2014. Agisoft PhotoScan User Manual: Professional Edition.  LLC Agisoft. 2014. Agisoft PhotoScan User Manual: Professional Edition."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2015.7140101"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/SFCS.2005.9"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461940"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364911410755"},{"key":"e_1_2_2_8_1","unstructured":"R. Craig Coulter. 1992. Implementation of the Pure Pursuit Path Tracking AlgorithmTechnical Report. Carnegie-Mellon UNIV Pittsburgh PA Robotics INST.  R. Craig Coulter. 1992. Implementation of the Pure Pursuit Path Tracking AlgorithmTechnical Report. Carnegie-Mellon UNIV Pittsburgh PA Robotics INST."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237269"},{"key":"e_1_2_2_10_1","unstructured":"Angela Dai Matthias Nie\u00dfner Michael Zollh\u00f6fer Shahram Izadi and Christian Theobalt. 2016. BundleFusion: Real-time globally consistent 3D reconstruction using on-the-fly surface re-integration. arXiv Preprint arXiv:1604.01093.  Angela Dai Matthias Nie\u00dfner Michael Zollh\u00f6fer Shahram Izadi and Christian Theobalt. 2016. BundleFusion: Real-time globally consistent 3D reconstruction using on-the-fly surface re-integration. arXiv Preprint arXiv:1604.01093."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.2015.2461186"},{"key":"e_1_2_2_12_1","doi-asserted-by":"crossref","unstructured":"Enrique Dunn and Jan-Michael Frahm. 2009. Next best view planning for active model improvement. In BMVC. 1--11.  Enrique Dunn and Jan-Michael Frahm. 2009. Next best view planning for active model improvement. In BMVC. 1--11.","DOI":"10.5244\/C.23.53"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980225"},{"key":"e_1_2_2_14_1","volume-title":"Technical Report MS-CIS-94-18, University of Pennsylvania.","author":"Farid H.","year":"1994"},{"key":"e_1_2_2_15_1","doi-asserted-by":"crossref","unstructured":"Christian Forster Matia Pizzoli and Davide Scaramuzza. 2014. Appearance-based active monocular dense reconstruction for micro aerial vehicles. In Robotics: Science and Systems (RSS).  Christian Forster Matia Pizzoli and Davide Scaramuzza. 2014. Appearance-based active monocular dense reconstruction for micro aerial vehicles. In Robotics: Science and Systems (RSS).","DOI":"10.15607\/RSS.2014.X.029"},{"key":"e_1_2_2_16_1","first-page":"1115","article-title":"Network design considerations for non-topographic photogrammetry","volume":"50","author":"Fraser C. S.","year":"1984","journal-title":"Photogrammetric Engineering and Remote Sensing"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/IROS.2012.6385934"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601163"},{"key":"e_1_2_2_19_1","unstructured":"Simon Fuhrmann Fabian Langguth and Michael Goesele. 2014. MVE-A multi-view reconstruction environment. In GCH. 11--18.   Simon Fuhrmann Fabian Langguth and Michael Goesele. 2014. MVE-A multi-view reconstruction environment. In GCH. 11--18."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2015.09.003"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.161"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.199"},{"key":"e_1_2_2_23_1","volume-title":"IEEE 11th International Conference on Computer Vision (ICCV'07)","author":"Goesele Michael"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33709-3_39"},{"key":"e_1_2_2_25_1","doi-asserted-by":"crossref","volume-title":"Multiple View Geometry in Computer Vision","author":"Hartley Richard","DOI":"10.1017\/CBO9780511811685"},{"key":"e_1_2_2_26_1","volume-title":"2011 IEEE\/RSJ International Conference on Intelligent Robots and Systems. 4012--4019","author":"Heng L."},{"key":"e_1_2_2_27_1","first-page":"6","article-title":"Online feedback for structure-from-motion image acquisition","volume":"2","author":"Hoppe Christof","year":"2012","journal-title":"BMVC"},{"key":"e_1_2_2_28_1","volume-title":"Computer Vision Winter Workshop (CVWW)","volume":"8","author":"Hoppe Christof","year":"2012"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-012-9321-0"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2008.4587688"},{"key":"e_1_2_2_31_1","doi-asserted-by":"crossref","unstructured":"Rui Huang Danping Zou Richard Vaughan and Ping Tan. 2017. Active image-based modeling. arXiv Preprint arXiv:1705.01010.  Rui Huang Danping Zou Richard Vaughan and Ping Tan. 2017. Active image-based modeling. arXiv Preprint arXiv:1705.01010.","DOI":"10.1109\/ICRA.2018.8460673"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995693"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364911406761"},{"key":"e_1_2_2_34_1","volume-title":"Proceedings of the Fourth Eurographics Symposium on Geometry Processing","volume":"7","author":"Kazhdan Michael","year":"2006"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487228.2487237"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compind.2013.04.005"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073599"},{"key":"e_1_2_2_38_1","volume-title":"Submodular function maximization. Tractability: Practical Approaches to Hard Problems 3, 19","author":"Krause Andreas","year":"2012"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11554-013-0386-6"},{"key":"e_1_2_2_40_1","volume-title":"Proceedings (CVPR\u201992). 1992","author":"Kiriakos","year":"1992"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46487-9_29"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2015.7139761"},{"key":"e_1_2_2_43_1","first-page":"1093","article-title":"Heuristic reasoning strategy for automated sensor placement","volume":"63","author":"Scott Mason","year":"1997","journal-title":"Photogrammetric Engineering and Remote Sensing"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.501"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR.2011.6092378"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508374"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(01)00076-0"},{"key":"e_1_2_2_48_1","unstructured":"Pix4D. 2017. Pix4D. https:\/\/pix4d.com\/.  Pix4D. 2017. Pix4D. https:\/\/pix4d.com\/."},{"key":"e_1_2_2_49_1","doi-asserted-by":"crossref","unstructured":"Mike Roberts Anh Truong Debadeepta Dey Sudipta Sinha Ashish Kapoor Neel Joshi and Pat Hanrahan. 2017. Submodular trajectory optimization for aerial 3D scanning. arXiv Preprint arXiv:1705.00703.  Mike Roberts Anh Truong Debadeepta Dey Sudipta Sinha Ashish Kapoor Neel Joshi and Pat Hanrahan. 2017. Submodular trajectory optimization for aerial 3D scanning. arXiv Preprint arXiv:1705.00703.","DOI":"10.1109\/ICCV.2017.569"},{"key":"e_1_2_2_50_1","unstructured":"3DR Robotics. 2017. 3DR Site Scan. https:\/\/3dr.com\/.  3DR Robotics. 2017. 3DR Site Scan. https:\/\/3dr.com\/."},{"key":"e_1_2_2_51_1","doi-asserted-by":"crossref","unstructured":"Davide Scaramuzza Michael C. Achtelik Lefteris Doitsidis Fraundorfer Friedrich Elias Kosmatopoulos Agostino Martinelli Markus W. Achtelik Margarita Chli Savvas Chatzichristofis Laurent Kneip etal 2014. Vision-controlled micro flying robots: From system design to autonomous navigation and mapping in GPS-denied environments. IEEE Robotics 8 Automation Magazine 21 3 (2014) 26--40.  Davide Scaramuzza Michael C. Achtelik Lefteris Doitsidis Fraundorfer Friedrich Elias Kosmatopoulos Agostino Martinelli Markus W. Achtelik Margarita Chli Savvas Chatzichristofis Laurent Kneip et al. 2014. Vision-controlled micro flying robots: From system design to autonomous navigation and mapping in GPS-denied environments. IEEE Robotics 8 Automation Magazine 21 3 (2014) 26--40.","DOI":"10.1109\/MRA.2014.2322295"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.445"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46487-9_31"},{"key":"e_1_2_2_54_1","doi-asserted-by":"crossref","unstructured":"Thomas Sch\u00f6ps Johannes L Sch\u00f6nberger Silvano Galliani Torsten Sattler Konrad Schindler Marc Pollefeys and Andreas Geiger. 2017. A multi-view stereo benchmark with high-resolution images and multi-camera videos.  Thomas Sch\u00f6ps Johannes L Sch\u00f6nberger Silvano Galliani Torsten Sattler Konrad Schindler Marc Pollefeys and Andreas Geiger. 2017. A multi-view stereo benchmark with high-resolution images and multi-camera videos.","DOI":"10.1109\/CVPR.2017.272"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.19"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2011.5980357"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141964"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-007-0107-3"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2008.4587706"},{"key":"e_1_2_2_60_1","doi-asserted-by":"crossref","unstructured":"J\u00fcrgen Sturm Erik Bylow Christian Kerl Fredrik Kahl and D. Cremer. 2013. Dense tracking and mapping with a quadrocopter. Unmanned Aerial Vehicle in Geomatics (UAV-g) Rostock Germany.  J\u00fcrgen Sturm Erik Bylow Christian Kerl Fredrik Kahl and D. Cremer. 2013. Dense tracking and mapping with a quadrocopter. Unmanned Aerial Vehicle in Geomatics (UAV-g) Rostock Germany.","DOI":"10.5194\/isprsarchives-XL-1-W2-395-2013"},{"key":"e_1_2_2_61_1","unstructured":"Sebastian Thrun Wolfram Burgard and Dieter Fox. 2005. Probabilistic Robotics. MIT Press.  Sebastian Thrun Wolfram Burgard and Dieter Fox. 2005. Probabilistic Robotics. MIT Press."},{"key":"e_1_2_2_62_1","volume-title":"Fitzgibbon","author":"Triggs Bill","year":"1999"},{"key":"e_1_2_2_63_1","volume-title":"Computer Graphics Forum","author":"V\u00e1zquez Pere-Pau"},{"key":"e_1_2_2_64_1","volume-title":"European Conference on Computer Vision. Springer, 836--850","author":"Waechter Michael","year":"2014"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2007.383363"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02579435"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995552"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661242"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818075"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.5555\/523996.793157"},{"key":"e_1_2_2_71_1","doi-asserted-by":"crossref","unstructured":"Haifeng Zhang and Yevgeniy Vorobeychik. 2016. Submodular optimization with routing constraints. In AAAI. 819--826.   Haifeng Zhang and Yevgeniy Vorobeychik. 2016. Submodular optimization with routing constraints. In AAAI. 819--826.","DOI":"10.1609\/aaai.v30i1.10066"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3233794","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3233794","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:07:04Z","timestamp":1750212424000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3233794"}},"subtitle":["Viewpoint and Trajectory Optimization for Aerial Multi-View Stereo Reconstruction"],"short-title":[],"issued":{"date-parts":[[2018,12,14]]},"references-count":71,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,2,28]]}},"alternative-id":["10.1145\/3233794"],"URL":"https:\/\/doi.org\/10.1145\/3233794","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,12,14]]},"assertion":[{"value":"2018-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-12-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}