{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T15:53:36Z","timestamp":1782402816565,"version":"3.54.5"},"reference-count":39,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2020,11,27]],"date-time":"2020-11-27T00:00:00Z","timestamp":1606435200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2020,12,31]]},"abstract":"<jats:p>With rapid development in UAV technologies, it is now possible to reconstruct large-scale outdoor scenes using only images captured by low-cost drones. The problem, however, becomes how to plan the aerial path for a drone to capture images so that two conflicting goals are optimized: maximizing the reconstruction quality and minimizing mid-air image acquisition effort. Existing approaches either resort to pre-defined dense and thus inefficient view sampling strategy, or plan the path adaptively but require two onsite flight passes and intensive computation in-between. Hence, using these methods to capture and reconstruct large-scale scenes can be tedious. In this paper, we present an adaptive aerial path planning algorithm that can be done before the site visit. Using only a 2D map and a satellite image of the to-be-reconstructed area, we first compute a coarse 2.5D model for the scene based on the relationship between buildings and their shadows. A novel Max-Min optimization is then proposed to select a minimal set of viewpoints that maximizes the reconstructability under the the same number of viewpoints. Experimental results on benchmark show that our planning approach can effectively reduce the number of viewpoints needed than the previous state-of-the-art method, while maintaining comparable reconstruction quality. Since no field computation or a second visit is needed, and the view number is also minimized, our approach significantly reduces the time required in the field as well as the off-line computation cost for multi-view stereo reconstruction, making it possible to reconstruct a large-scale urban scene in a short time with moderate effort.<\/jats:p>","DOI":"10.1145\/3414685.3417791","type":"journal-article","created":{"date-parts":[[2020,11,27]],"date-time":"2020-11-27T21:51:05Z","timestamp":1606513865000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":45,"title":["Offsite aerial path planning for efficient urban scene reconstruction"],"prefix":"10.1145","volume":"39","author":[{"given":"Xiaohui","family":"Zhou","sequence":"first","affiliation":[{"name":"Shenzhen University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ke","family":"Xie","sequence":"additional","affiliation":[{"name":"Shenzhen University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kai","family":"Huang","sequence":"additional","affiliation":[{"name":"Shenzhen University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yilin","family":"Liu","sequence":"additional","affiliation":[{"name":"Shenzhen University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yang","family":"Zhou","sequence":"additional","affiliation":[{"name":"Shenzhen University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Minglun","family":"Gong","sequence":"additional","affiliation":[{"name":"University of Guelph"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hui","family":"Huang","sequence":"additional","affiliation":[{"name":"Shenzhen University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,11,27]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01928918"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2012.34"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46454-1_6"},{"key":"e_1_2_2_4_1","volume-title":"Proc. of Euro. Conf. on Computer Vision. 834--849","author":"Engel J.","unstructured":"J. Engel , T. Sch\u00f6ps , and D. Cremers . 2014. LSD-SLAM: Large-Scale Direct Monocular SLAM . In Proc. of Euro. Conf. on Computer Vision. 834--849 . J. Engel, T. Sch\u00f6ps, and D. Cremers. 2014. LSD-SLAM: Large-Scale Direct Monocular SLAM. In Proc. of Euro. Conf. on Computer Vision. 834--849."},{"key":"e_1_2_2_5_1","volume-title":"Automated View and Path Planning for Scalable Multi-Object 3D Scanning. ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2016) 35, 6","author":"Fan Xinyi","year":"2016","unstructured":"Xinyi Fan , Linguang Zhang , Benedict Brown , and Szymon Rusinkiewicz . 2016. Automated View and Path Planning for Scalable Multi-Object 3D Scanning. ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2016) 35, 6 ( 2016 ), 239:1--239:13. Xinyi Fan, Linguang Zhang, Benedict Brown, and Szymon Rusinkiewicz. 2016. Automated View and Path Planning for Scalable Multi-Object 3D Scanning. ACM Transactions on Graphics (Proc. of SIGGRAPH Asia 2016) 35, 6 (2016), 239:1--239:13."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2015.09.003"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1561\/9781601988379"},{"key":"e_1_2_2_8_1","volume-title":"Proc. of IEEE Conf. on Computer Vision & Pattern Recognition. 2033--2040","author":"Guo Ruiqi","unstructured":"Ruiqi Guo , Qieyun Dai , and D. Hoiem . 2011. Single-image Shadow Detection and Removal using Paired Regions . In Proc. of IEEE Conf. on Computer Vision & Pattern Recognition. 2033--2040 . Ruiqi Guo, Qieyun Dai, and D. Hoiem. 2011. Single-image Shadow Detection and Removal using Paired Regions. In Proc. of IEEE Conf. on Computer Vision & Pattern Recognition. 2033--2040."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12532-015-0080-8"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01267-0_27"},{"key":"e_1_2_2_11_1","article-title":"Plan3D: Viewpoint and Trajectory Optimization for Aerial Multi-View Stereo Reconstruction","volume":"38","author":"Hepp B.","year":"2018","unstructured":"B. Hepp , M. Nie\u00dfner , and O. Hilliges . 2018 b. Plan3D: Viewpoint and Trajectory Optimization for Aerial Multi-View Stereo Reconstruction . ACM Trans. on Graphics 38 , 1 (2018), 4:1--4:17. B. Hepp, M. Nie\u00dfner, and O. Hilliges. 2018b. Plan3D: Viewpoint and Trajectory Optimization for Aerial Multi-View Stereo Reconstruction. ACM Trans. on Graphics 38, 1 (2018), 4:1--4:17.","journal-title":"ACM Trans. on Graphics"},{"key":"e_1_2_2_12_1","volume-title":"Proc. of IEEE Conf. on Computer Vision & Pattern Recognition. 1--8.","author":"Hornung A.","unstructured":"A. Hornung , B. Zeng , and L. Kobbelt . 2008. Image Selection for Improved Multi-View Stereo . In Proc. of IEEE Conf. on Computer Vision & Pattern Recognition. 1--8. A. Hornung, B. Zeng, and L. Kobbelt. 2008. Image Selection for Improved Multi-View Stereo. In Proc. of IEEE Conf. on Computer Vision & Pattern Recognition. 1--8."},{"key":"e_1_2_2_13_1","volume-title":"Proc. of IEEE Conf. on Computer Vision & Pattern Recognition. IEEE, 7454--7462","author":"Hu Xiaowei","year":"2018","unstructured":"Xiaowei Hu , Chi-Wing Fu , Lei Zhu , Jing Qin , and Pheng-Ann Heng . 2018 . Direction-aware Spatial Context Features for Shadow Detection and Removal . In Proc. of IEEE Conf. on Computer Vision & Pattern Recognition. IEEE, 7454--7462 . Xiaowei Hu, Chi-Wing Fu, Lei Zhu, Jing Qin, and Pheng-Ann Heng. 2018. Direction-aware Spatial Context Features for Shadow Detection and Removal. In Proc. of IEEE Conf. on Computer Vision & Pattern Recognition. IEEE, 7454--7462."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2018.8460673"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1088\/0143-0807\/34\/3\/633"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073599"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.3390\/rs11131550"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.isprsjprs.2016.07.006"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201295"},{"key":"e_1_2_2_20_1","first-page":"1093","article-title":"Heuristic Reasoning Strategy for Automated Sensor Placement","volume":"63","author":"Mason Scott","year":"1997","unstructured":"Scott Mason . 1997 . Heuristic Reasoning Strategy for Automated Sensor Placement . Photogrammetric Engineering & Remote Sensing 63 , 9 (1997), 1093 -- 1102 . Scott Mason. 1997. Heuristic Reasoning Strategy for Automated Sensor Placement. Photogrammetric Engineering & Remote Sensing 63, 9 (1997), 1093--1102.","journal-title":"Photogrammetric Engineering & Remote Sensing"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.5244\/C.28.69"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.5244\/C.30.65"},{"key":"e_1_2_2_23_1","volume-title":"Luis Enrique Sucar, and Carolina Reta","author":"Mendoza Miguel","year":"2019","unstructured":"Miguel Mendoza , J Irving Vasquez-Gomez , Hind Taud , Luis Enrique Sucar, and Carolina Reta . 2019 . Supervised Learning of the Next-Best-View for 3D Object Reconstruction . arXiv preprint arXiv:1905.05833 (2019). Miguel Mendoza, J Irving Vasquez-Gomez, Hind Taud, Luis Enrique Sucar, and Carolina Reta. 2019. Supervised Learning of the Next-Best-View for 3D Object Reconstruction. arXiv preprint arXiv:1905.05833 (2019)."},{"key":"e_1_2_2_24_1","volume-title":"IM2HEIGHT: Height Estimation from Single Monocular Imagery via Fully Residual Convolutional-Deconvolutional Network. arXiv preprint arXiv:1802.10249","author":"Mou Lichao","year":"2018","unstructured":"Lichao Mou and Xiao Xiang Zhu . 2018. IM2HEIGHT: Height Estimation from Single Monocular Imagery via Fully Residual Convolutional-Deconvolutional Network. arXiv preprint arXiv:1802.10249 ( 2018 ). Lichao Mou and Xiao Xiang Zhu. 2018. IM2HEIGHT: Height Estimation from Single Monocular Imagery via Fully Residual Convolutional-Deconvolutional Network. arXiv preprint arXiv:1802.10249 (2018)."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(01)00076-0"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.569"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925980"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/MRA.2014.2322295"},{"key":"e_1_2_2_29_1","volume-title":"Structure-from-Motion Revisited. In Proc. of IEEE Conf. on Computer Vision & Pattern Recognition.","author":"Sch\u00f6nberger Johannes Lutz","year":"2016","unstructured":"Johannes Lutz Sch\u00f6nberger and Jan-Michael Frahm . 2016 . Structure-from-Motion Revisited. In Proc. of IEEE Conf. on Computer Vision & Pattern Recognition. Johannes Lutz Sch\u00f6nberger and Jan-Michael Frahm. 2016. Structure-from-Motion Revisited. In Proc. of IEEE Conf. on Computer Vision & Pattern Recognition."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.19"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2020.113535"},{"key":"e_1_2_2_32_1","volume-title":"Proc. of IEEE Int. Conf. on Robotics & Automation. 20--25","author":"Shen S.","unstructured":"S. Shen , N. Michael , and V. Kumar . 2011. Autonomous Multi-floor Indoor Navigation with a Computationally Constrained MAV . In Proc. of IEEE Int. Conf. on Robotics & Automation. 20--25 . S. Shen, N. Michael, and V. Kumar. 2011. Autonomous Multi-floor Indoor Navigation with a Computationally Constrained MAV. In Proc. of IEEE Int. Conf. on Robotics & Automation. 20--25."},{"key":"e_1_2_2_33_1","article-title":"Aerial Path Planning for Urban Scene Reconstruction: A Continuous Optimization Method and Benchmark","volume":"37","author":"Smith Neil","year":"2018","unstructured":"Neil Smith , Nils Moehrle , Michael Goesele , and Wolfgang Heidrich . 2018 . Aerial Path Planning for Urban Scene Reconstruction: A Continuous Optimization Method and Benchmark . ACM Trans. on Graphics (Proc. of SIGGRAPH Asia) 37 , 6 (2018), 183:1--183:15. Neil Smith, Nils Moehrle, Michael Goesele, and Wolfgang Heidrich. 2018. Aerial Path Planning for Urban Scene Reconstruction: A Continuous Optimization Method and Benchmark. ACM Trans. on Graphics (Proc. of SIGGRAPH Asia) 37, 6 (2018), 183:1--183:15.","journal-title":"ACM Trans. on Graphics (Proc. of SIGGRAPH Asia)"},{"key":"e_1_2_2_34_1","article-title":"Quality-driven Poisson-guided autoscanning","volume":"33","author":"Wu Shihao","year":"2014","unstructured":"Shihao Wu , Wei Sun , Pinxin Long , Hui Huang , Daniel Cohen-Or , Minglun Gong , Oliver Deussen , and Baoquan Chen . 2014 . Quality-driven Poisson-guided autoscanning . ACM Trans. on Graphics (Proc. of SIGGRAPH Asia) 33 (2014), 203:1--203:12. Issue 6. Shihao Wu, Wei Sun, Pinxin Long, Hui Huang, Daniel Cohen-Or, Minglun Gong, Oliver Deussen, and Baoquan Chen. 2014. Quality-driven Poisson-guided autoscanning. ACM Trans. on Graphics (Proc. of SIGGRAPH Asia) 33 (2014), 203:1--203:12. Issue 6.","journal-title":"ACM Trans. on Graphics (Proc. of SIGGRAPH Asia)"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201284"},{"key":"e_1_2_2_36_1","article-title":"3D Attention-driven Depth Acquisition for Object Identification","volume":"35","author":"Xu Kai","year":"2016","unstructured":"Kai Xu , Yifei Shi , Lintao Zheng , Junyu Zhang , Min Liu , Hui Huang , Hao Su , Daniel Cohen-Or , and Baoquan Chen . 2016 . 3D Attention-driven Depth Acquisition for Object Identification . ACM Trans. on Graphics (Proc. of SIGGRAPH Asia) 35 , 6 (2016), 238:1--238:14. Kai Xu, Yifei Shi, Lintao Zheng, Junyu Zhang, Min Liu, Hui Huang, Hao Su, Daniel Cohen-Or, and Baoquan Chen. 2016. 3D Attention-driven Depth Acquisition for Object Identification. ACM Trans. on Graphics (Proc. of SIGGRAPH Asia) 35, 6 (2016), 238:1--238:14.","journal-title":"ACM Trans. on Graphics (Proc. of SIGGRAPH Asia)"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13559"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.isprsjprs.2019.11.016"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778831"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3414685.3417791","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3414685.3417791","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:03:14Z","timestamp":1750197794000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3414685.3417791"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,27]]},"references-count":39,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2020,12,31]]}},"alternative-id":["10.1145\/3414685.3417791"],"URL":"https:\/\/doi.org\/10.1145\/3414685.3417791","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,27]]},"assertion":[{"value":"2020-11-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}