{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T14:48:41Z","timestamp":1779202121127,"version":"3.51.4"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T00:00:00Z","timestamp":1695772800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T00:00:00Z","timestamp":1695772800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Horizon 2020 Research and Innovation Programme","award":["10100359"],"award-info":[{"award-number":["10100359"]}]},{"name":"Lulea University of Technology"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Intell Robot Syst"],"published-print":{"date-parts":[[2023,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper highlights the significance of maintaining and enhancing situational awareness in Urban Search and Rescue (USAR) missions. It focuses specifically on investigating the capabilities of Unmanned Aerial Vehicles (UAV) equipped with limited sensing capabilities and onboard computational resources to perform visual inspections of apriori unknown fractured and collapsed structures in unfamiliar environments. The proposed approach, referred to as First Look Inspect-Explore (FLIE), employs a flexible bifurcated behavior tree that leverages real-time RGB image and depth cloud data. By employing a recursive and reactive synthesis of safe view pose within the inspection module, FLIE incorporates a novel active visual guidance scheme for identifying previously inspected surfaces. Furthermore, the integration of a tiered hierarchical exploration module with the visual guidance system enables the UAV to navigate towards new and unexplored structures without relying on a map. This decoupling reduces memory overhead and computational effort by eliminating the need to plan based on an incrementally built, error-prone global map. The proposed autonomy is extensively evaluated through simulation and experimental verification under various scenarios and compared against state-of-art approaches, demonstrating its performance and effectiveness.<\/jats:p>","DOI":"10.1007\/s10846-023-01961-9","type":"journal-article","created":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T02:01:34Z","timestamp":1695780094000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Towards Visual Inspection of Distributed and Irregular Structures: A Unified Autonomy Approach"],"prefix":"10.1007","volume":"109","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4383-7316","authenticated-orcid":false,"given":"Vignesh Kottayam","family":"Viswanathan","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bj\u00f6rn","family":"Lindqvist","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sumeet Gajanan","family":"Satpute","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christoforos","family":"Kanellakis","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"George","family":"Nikolakopoulos","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,9,27]]},"reference":[{"key":"1961_CR1","doi-asserted-by":"crossref","unstructured":"Viswanathan, V.K., Satpute, S., Banerjee, A., Nikolakopoulos, G.: Nonlinear model predictive control based cooperative stereo-visual coverage of an asteroid. In: 2022 American control conference (ACC), pp. 5360\u20135367 (2022). IEEE","DOI":"10.23919\/ACC53348.2022.9867595"},{"key":"1961_CR2","doi-asserted-by":"crossref","unstructured":"Viswanathan, V.K., Papadimitriou, A., Banerjee, A., Mansouri, S.S., Nikolakopolous, G.: Exogenous disturbance estimation for autonomous navigation around small celestial bodies. In: 2022 IEEE 61st conference on decision and control (CDC), pp. 3760\u20133766 (2022). IEEE","DOI":"10.1109\/CDC51059.2022.9993130"},{"key":"1961_CR3","doi-asserted-by":"crossref","unstructured":"Khaloo, A., Lattanzi, D., Jachimowicz, A., Devaney, C.: Utilizing uav and 3d computer vision for visual inspection of a large gravity dam. Front. Built Environ. 31 (2018)","DOI":"10.20944\/preprints201801.0235.v1"},{"issue":"3","key":"1961_CR4","first-page":"283","volume":"2","author":"B Chan","year":"2015","unstructured":"Chan, B., Guan, H., Jo, J., Blumenstein, M.: Towards uav-based bridge inspection systems: A review and an application perspective. Struct. Monit. Maint. 2(3), 283\u2013300 (2015)","journal-title":"Struct. Monit. Maint."},{"key":"1961_CR5","doi-asserted-by":"crossref","unstructured":"Kanellakis, C., Mansouri, S.S., Fresk, E., Kominiak, D., Nikolakopoulos, G.: Cooperative uavs as a tool for aerial inspection of large scale aging infrastructure. In: 2018 IEEE\/RSJ international conference on intelligent robots and systems (IROS), pp. 5040\u20135040 (2018). IEEE","DOI":"10.1109\/IROS.2018.8593996"},{"issue":"8","key":"1961_CR6","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1109\/MAES.2018.170145","volume":"33","author":"P Addabbo","year":"2018","unstructured":"Addabbo, P., Angrisano, A., Bernardi, M.L., Gagliarde, G., Mennella, A., Nisi, M., Ullo, S.L.: Uav system for photovoltaic plant inspection. IEEE Aerosp. Electron. Syst. Mag. 33(8), 58\u201367 (2018)","journal-title":"IEEE Aerosp. Electron. Syst. Mag."},{"issue":"8","key":"1961_CR7","doi-asserted-by":"publisher","first-page":"824","DOI":"10.3390\/rs9080824","volume":"9","author":"Y Zhang","year":"2017","unstructured":"Zhang, Y., Yuan, X., Li, W., Chen, S.: Automatic power line inspection using uav images. Remote Sens. 9(8), 824 (2017)","journal-title":"Remote Sens."},{"key":"1961_CR8","doi-asserted-by":"crossref","unstructured":"Patel, A., Lindqvist, B., Kanellakis, C., Nikolakopoulos, G.: Fast planner for mav navigation in unknown environments based on adaptive search of safe look-ahead poses. In: 2022 30th Mediterranean conference on control and automation (MED), pp. 545\u2013550 (2022). IEEE","DOI":"10.1109\/MED54222.2022.9837293"},{"issue":"2","key":"1961_CR9","doi-asserted-by":"publisher","first-page":"9650","DOI":"10.1016\/j.ifacol.2020.12.2612","volume":"53","author":"SS Mansouri","year":"2020","unstructured":"Mansouri, S.S., Kanellakis, C., Fresk, E., Lindqvist, B., Kominiak, D., Koval, A., Sopasakis, P., Nikolakopoulos, G.: Subterranean mav navigation based on nonlinear mpc with collision avoidance constraints. IFAC-PapersOnLine 53(2), 9650\u20139657 (2020)","journal-title":"IFAC-PapersOnLine"},{"key":"1961_CR10","doi-asserted-by":"crossref","unstructured":"Dang, T., Tranzatto, M., Khattak, S., Mascarich, F., Alexis, K., Hutter, M.: Graph-based subterranean exploration path planning using aerial and legged robots. J. Field Robot. 37(8), 1363\u20131388 (2020). Wiley Online Library","DOI":"10.1002\/rob.21993"},{"issue":"3","key":"1961_CR11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10846-022-01665-6","volume":"105","author":"B Lindqvist","year":"2022","unstructured":"Lindqvist, B., Kanellakis, C., Mansouri, S.S., Agha-mohammadi, A.-A., Nikolakopoulos, G.: Compra: A compact reactive autonomy framework for subterranean mav based search-and-rescue operations. J. Intell. Robot. Syst. 105(3), 1\u201321 (2022)","journal-title":"J. Intell. Robot. Syst."},{"key":"1961_CR12","doi-asserted-by":"crossref","unstructured":"Kumar, A.: Real-time performance comparison of vision-based autonomous landing of quadcopter on a ground moving target. IETE J. Res. pp. 1\u201318 (2021)","DOI":"10.1080\/03772063.2021.1963332"},{"key":"1961_CR13","doi-asserted-by":"crossref","unstructured":"Viswanathan, V.K., Satpute, S.G., Lindqvist, B., Kanellakis, C., Nikolakopoulos, G.: Experimental evaluation of a geometry-aware aerial visual inspection framework in a constrained environment. In: 2022 30th Mediterranean conference on control and automation (MED), pp. 468\u2013474 (2022). IEEE","DOI":"10.1109\/MED54222.2022.9837166"},{"issue":"1","key":"1961_CR14","doi-asserted-by":"publisher","first-page":"14","DOI":"10.3390\/ijgi9010014","volume":"9","author":"N Kerle","year":"2019","unstructured":"Kerle, N., Nex, F., Gerke, M., Duarte, D., Vetrivel, A.: Uav-based structural damage mapping: A review. ISPRS Int. J. Geo-inform. 9(1), 14 (2019)","journal-title":"ISPRS Int. J. Geo-inform."},{"key":"1961_CR15","doi-asserted-by":"crossref","unstructured":"Lauterbach, H.A., Koch, C.B., Hess, R., Eck, D., Schilling, K., N\u00fcchter, A.: The eins3d project-instantaneous uav-based 3d mapping for search and rescue applications. In: 2019 IEEE international symposium on safety, security, and rescue robotics (SSRR), pp. 1\u20136 (2019). IEEE","DOI":"10.1109\/SSRR.2019.8848972"},{"key":"1961_CR16","doi-asserted-by":"publisher","DOI":"10.1016\/j.autcon.2021.104105","volume":"135","author":"M-L Cheng","year":"2022","unstructured":"Cheng, M.-L., Matsuoka, M., Liu, W., Yamazaki, F.: Near-real-time gradually expanding 3d land surface reconstruction in disaster areas by sequential drone imagery. Autom. Constr. 135, 104105 (2022)","journal-title":"Autom. Constr."},{"issue":"2","key":"1961_CR17","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1007\/s10514-016-9610-0","volume":"42","author":"A Bircher","year":"2018","unstructured":"Bircher, A., Kamel, M., Alexis, K., Oleynikova, H., Siegwart, R.: Receding horizon path planning for 3d exploration and surface inspection. Auton. Robot. 42(2), 291\u2013306 (2018)","journal-title":"Auton. Robot."},{"key":"1961_CR18","doi-asserted-by":"crossref","unstructured":"Brogaard, R.Y., Andersen, R.E., Kovac, L., Zajaczkowski, M., Boukas, E.: Towards an autonomous, visual inspection-aware 3d exploration and mapping system for water ballast tanks of marine vessels. In: 2021 IEEE international conference on imaging systems and techniques (IST), pp. 1\u20136 (2021). IEEE","DOI":"10.1109\/IST50367.2021.9651476"},{"key":"1961_CR19","doi-asserted-by":"crossref","unstructured":"Yoder, L., Scherer, S.: Autonomous exploration for infrastructure modeling with a micro aerial vehicle. In: Field and service robotics, pp. 427\u2013440. Springer, (2016)","DOI":"10.1007\/978-3-319-27702-8_28"},{"issue":"22","key":"1961_CR20","doi-asserted-by":"publisher","first-page":"4849","DOI":"10.3390\/s19224849","volume":"19","author":"M Faria","year":"2019","unstructured":"Faria, M., Ferreira, A.S., P\u00e9rez-Leon, H., Maza, I., Viguria, A.: Autonomous 3d exploration of large structures using an uav equipped with a 2d lidar. Sens. 19(22), 4849 (2019)","journal-title":"Sens."},{"issue":"8","key":"1961_CR21","doi-asserted-by":"publisher","first-page":"1431","DOI":"10.1007\/s10514-020-09936-7","volume":"44","author":"S Song","year":"2020","unstructured":"Song, S., Kim, D., Jo, S.: Online coverage and inspection planning for 3d modeling. Auton. Robot. 44(8), 1431\u20131450 (2020)","journal-title":"Auton. Robot."},{"key":"1961_CR22","unstructured":"Yamauchi, B.: A frontier-based approach for autonomous exploration. In: Proceedings 1997 IEEE international symposium on computational intelligence in robotics and automation CIRA\u201997.\u2019Towards new computational principles for robotics and automation\u2019, pp. 146\u2013151 (1997). IEEE"},{"key":"1961_CR23","doi-asserted-by":"crossref","unstructured":"Song, S., Jo, S.: Surface-based exploration for autonomous 3d modeling. In: 2018 IEEE international conference on robotics and automation (ICRA), pp. 4319\u20134326 (2018). IEEE","DOI":"10.1109\/ICRA.2018.8460862"},{"issue":"2","key":"1961_CR24","doi-asserted-by":"publisher","first-page":"1500","DOI":"10.1109\/LRA.2020.2969191","volume":"5","author":"L Schmid","year":"2020","unstructured":"Schmid, L., Pantic, M., Khanna, R., Ott, L., Siegwart, R., Nieto, J.: An efficient sampling-based method for online informative path planning in unknown environments. IEEE Robot. Autom. Lett. 5(2), 1500\u20131507 (2020)","journal-title":"IEEE Robot. Autom. Lett."},{"key":"1961_CR25","doi-asserted-by":"crossref","unstructured":"Smith, N., Moehrle, N., Goesele, M., Heidrich, W.: Aerial path planning for urban scene reconstruction: A continuous optimization method and benchmark (2018)","DOI":"10.1145\/3272127.3275010"},{"issue":"1","key":"1961_CR26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3233794","volume":"38","author":"B Hepp","year":"2018","unstructured":"Hepp, B., Nie\u00dfner, M., Hilliges, O.: Plan3d: Viewpoint and trajectory optimization for aerial multi-view stereo reconstruction. ACM Trans. Graph. (TOG) 38(1), 1\u201317 (2018)","journal-title":"ACM Trans. Graph. (TOG)"},{"issue":"1","key":"1961_CR27","doi-asserted-by":"publisher","first-page":"372","DOI":"10.1109\/TRO.2021.3083197","volume":"38","author":"S Song","year":"2021","unstructured":"Song, S., Kim, D., Choi, S.: View path planning via online multiview stereo for 3-d modeling of large-scale structures. IEEE Trans. Robot. 38(1), 372\u2013390 (2021)","journal-title":"IEEE Trans. Robot."},{"key":"1961_CR28","doi-asserted-by":"crossref","unstructured":"Viswanathan, V.K., Satpute, S.G., Lindqvist, B., Nikolakopoulos, G.: First-look enabled autonomous aerial visual inspection of geometrically fractured objects in constrained environments. In: 2022 IEEE 31st international symposium on industrial electronics (ISIE), pp. 295\u2013300 (2022). IEEE","DOI":"10.1109\/ISIE51582.2022.9831615"},{"key":"1961_CR29","doi-asserted-by":"crossref","unstructured":"Viswanathan, V.K., Satpute, S.G., Nikolakopoulos, G.: Flie: First-look enabled inspect-explore autonomy towards visual inspection of unknown distributed and discontinuous structures. IEEE Access (2023)","DOI":"10.1109\/ACCESS.2023.3257646"},{"key":"1961_CR30","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","volume":"60","author":"DG Lowe","year":"2004","unstructured":"Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 91\u2013110 (2004)","journal-title":"Int. J. Comput. Vis."},{"key":"1961_CR31","unstructured":"Muja, M., Lowe, D.G.: Fast approximate nearest neighbors with automatic algorithm configuration. VISAPP (1) 2(331-340), 2 (2009)"},{"key":"1961_CR32","doi-asserted-by":"crossref","unstructured":"Lindqvist, B., Haluska, J., Kanellakis, C., Nikolakopoulos, G.: An adaptive 3d artificial potential field for fail-safe uav navigation. In: 2022 30th Mediterranean conference on control and automation (MED), pp. 362\u2013367 (2022). IEEE","DOI":"10.1109\/MED54222.2022.9837223"},{"key":"1961_CR33","doi-asserted-by":"crossref","unstructured":"Furrer, F., Burri, M., Achtelik, M., Siegwart, R.: RotorS\u2014A modular gazebo mav simulator framework. Robot operating system (ROS): The complete reference (Volume 1), pp. 595\u2013625. Springer, Cham (2016)","DOI":"10.1007\/978-3-319-26054-9_23"},{"key":"1961_CR34","unstructured":"Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., Ng, A.Y., et al.: Ros: an open-source robot operating system. In: ICRA workshop on open source software, vol.3, p. 5. Kobe, Japan (2009)"},{"key":"1961_CR35","unstructured":"Design and use paradigms for gazebo, an open-source multi-robot simulator. In: 2004 IEEE\/RSJ international conference on intelligent robots and systems (IROS)(IEEE Cat. No. 04CH37566), vol. 3, pp. 2149\u20132154 (2004). IEEE"},{"issue":"2","key":"1961_CR36","doi-asserted-by":"publisher","first-page":"416","DOI":"10.1002\/rob.21831","volume":"36","author":"M Labb\u00e9","year":"2019","unstructured":"Labb\u00e9, M., Michaud, F.: Rtab-map as an open-source lidar and visual simultaneous localization and mapping library for large-scale and long-term online operation. J. Field Robot. 36(2), 416\u2013446 (2019)","journal-title":"J. Field Robot."},{"key":"1961_CR37","doi-asserted-by":"crossref","unstructured":"Oleynikova, H., Taylor, Z., Fehr, M., Siegwart, R., Nieto, J.: Voxblox: Incremental 3d euclidean signed distance fields for on-board mav planning. In: IEEE\/RSJ international conference on intelligent robots and systems (IROS) (2017)","DOI":"10.1109\/IROS.2017.8202315"},{"issue":"2","key":"1961_CR38","doi-asserted-by":"publisher","first-page":"779","DOI":"10.1109\/LRA.2021.3051563","volume":"6","author":"B Zhou","year":"2021","unstructured":"Zhou, B., Zhang, Y., Chen, X., Shen, S.: Fuel: Fast uav exploration using incremental frontier structure and hierarchical planning. IEEE Robot. Autom. Lett. 6(2), 779\u2013786 (2021)","journal-title":"IEEE Robot. Autom. Lett."},{"issue":"2","key":"1961_CR39","doi-asserted-by":"publisher","first-page":"1699","DOI":"10.1109\/LRA.2019.2897343","volume":"4","author":"M Selin","year":"2019","unstructured":"Selin, M., Tiger, M., Duberg, D., Heintz, F., Jensfelt, P.: Efficient autonomous exploration planning of large-scale 3-d environments. IEEE Robot. Autom. Lett. 4(2), 1699\u20131706 (2019). https:\/\/doi.org\/10.1109\/LRA.2019.2897343","journal-title":"IEEE Robot. Autom. Lett."},{"key":"1961_CR40","doi-asserted-by":"crossref","unstructured":"Feng, C., Li, H., Gao, F., Zhou, B., Shen, S.: Predrecon: A prediction-boosted planning framework for fast and high-quality autonomous aerial reconstruction. arXiv preprint arXiv:2302.04488 (2023)","DOI":"10.1109\/ICRA48891.2023.10160933"},{"key":"1961_CR41","unstructured":"Epic Games: Unreal Engine. https:\/\/www.unrealengine.com (2023)"},{"key":"1961_CR42","doi-asserted-by":"crossref","unstructured":"Shah, S., Dey, D., Lovett, C., Kapoor, A.: Airsim: High-fidelity visual and physical simulation for autonomous vehicles. In: Field and service robotics. arXiv:1705.05065 (2017)","DOI":"10.1007\/978-3-319-67361-5_40"},{"key":"1961_CR43","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2022.116883","volume":"200","author":"A Papadimitriou","year":"2022","unstructured":"Papadimitriou, A., Jafari, H., Mansouri, S.S., Nikolakopoulos, G.: External force estimation and disturbance rejection for micro aerial vehicles. Expert Syst. Appl. 200, 116883 (2022)","journal-title":"Expert Syst. Appl."}],"container-title":["Journal of Intelligent &amp; Robotic Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10846-023-01961-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10846-023-01961-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10846-023-01961-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,29]],"date-time":"2024-10-29T06:08:14Z","timestamp":1730182094000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10846-023-01961-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,27]]},"references-count":43,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,10]]}},"alternative-id":["1961"],"URL":"https:\/\/doi.org\/10.1007\/s10846-023-01961-9","relation":{},"ISSN":["0921-0296","1573-0409"],"issn-type":[{"value":"0921-0296","type":"print"},{"value":"1573-0409","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,27]]},"assertion":[{"value":"29 March 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 August 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 September 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"All authors have read and agreed to publish this work.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"All authors have read and agreed to publish this work.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no conflict of interest.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"32"}}