{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,11]],"date-time":"2025-12-11T20:59:46Z","timestamp":1765486786299,"version":"build-2065373602"},"reference-count":54,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2022,8,3]],"date-time":"2022-08-03T00:00:00Z","timestamp":1659484800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"University of Padova under the BIRD-SEED CAR"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Industry 4.0, smart homes, and the Internet of Things are boosting the employment of autonomous aerial vehicles in indoor environments, where localization is still challenging, especially in the case of close and cluttered areas. In this paper, we propose a Visual Inertial Odometry localization method based on fiducial markers. Our approach enables multi-rotor aerial vehicle navigation in indoor environments and tackles the most challenging aspects of image-based indoor localization. In particular, we focus on a proper and continuous pose estimation, working from take-off to landing, at several different flying altitudes. With this aim, we designed a map of fiducial markers that produces results that are both dense and heterogeneous. Narrowly placed tags lead to minimal information loss during rapid aerial movements while four different classes of marker size provide consistency when the camera zooms in or out according to the vehicle distance from the ground. We have validated our approach by comparing the output of the localization algorithm with the ground-truth information collected through an optoelectronic motion capture system, using two different platforms in different flying conditions. The results show that error mean and standard deviation can remain constantly lower than 0.11\u00a0m, so not degrading when the aerial vehicle increases its altitude and, therefore, strongly improving similar state-of-the-art solutions.<\/jats:p>","DOI":"10.3390\/s22155798","type":"journal-article","created":{"date-parts":[[2022,8,3]],"date-time":"2022-08-03T23:33:01Z","timestamp":1659569581000},"page":"5798","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Indoor Visual-Based Localization System for Multi-Rotor UAVs"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5140-3254","authenticated-orcid":false,"given":"Massimiliano","family":"Bertoni","sequence":"first","affiliation":[{"name":"Department of Management and Engineering, University of Padova, Stradella S. Nicola, 3, 36100 Vicenza, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8245-3430","authenticated-orcid":false,"given":"Stefano","family":"Michieletto","sequence":"additional","affiliation":[{"name":"Department of Management and Engineering, University of Padova, Stradella S. Nicola, 3, 36100 Vicenza, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3078-2915","authenticated-orcid":false,"given":"Roberto","family":"Oboe","sequence":"additional","affiliation":[{"name":"Department of Management and Engineering, University of Padova, Stradella S. Nicola, 3, 36100 Vicenza, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1357-8077","authenticated-orcid":false,"given":"Giulia","family":"Michieletto","sequence":"additional","affiliation":[{"name":"Department of Management and Engineering, University of Padova, Stradella S. Nicola, 3, 36100 Vicenza, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1015","DOI":"10.1177\/02783649211025998","article-title":"Design of Multirotor Aerial Vehicles: A Taxonomy Based on Input Allocation","volume":"40","author":"Hamandi","year":"2021","journal-title":"Int. J. Robot. Res."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3340","DOI":"10.1109\/COMST.2019.2924143","article-title":"Design challenges of multi-UAV systems in cyber-physical applications: A comprehensive survey and future directions","volume":"21","author":"Shakeri","year":"2019","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"48572","DOI":"10.1109\/ACCESS.2019.2909530","article-title":"Unmanned aerial vehicles (UAVs): A survey on civil applications and key research challenges","volume":"7","author":"Shakhatreh","year":"2019","journal-title":"IEEE Access"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Islam, N., Rashid, M.M., Pasandideh, F., Ray, B., Moore, S., and Kadel, R. (2021). A Review of Applications and Communication Technologies for Internet of Things (IoT) and Unmanned Aerial Vehicle (UAV) Based Sustainable Smart Farming. Sustainability, 13.","DOI":"10.3390\/su13041821"},{"key":"ref_5","first-page":"44","article-title":"A review on potential applications of unmanned aerial vehicle for construction industry","volume":"1","author":"Dastgheibifard","year":"2018","journal-title":"Sustain. Struct. Mater."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Zhang, J., and Huang, H. (2021). Occlusion-aware UAV path planning for reconnaissance and surveillance. Drones, 5.","DOI":"10.3390\/drones5030098"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lo, L.Y., Yiu, C.H., Tang, Y., Yang, A.S., Li, B., and Wen, C.Y. (2021). Dynamic Object Tracking on Autonomous UAV System for Surveillance Applications. Sensors, 21.","DOI":"10.3390\/s21237888"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Gu, W., Hu, D., Cheng, L., Cao, Y., Rizzo, A., and Valavanis, K.P. (2020, January 1\u20134). Autonomous wind turbine inspection using a quadrotor. Proceedings of the 2020 International Conference on Unmanned Aircraft Systems (ICUAS), Athens, Greece.","DOI":"10.1109\/ICUAS48674.2020.9214066"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"162516","DOI":"10.1109\/ACCESS.2020.3021126","article-title":"Aerial manipulator with rolling base for inspection of pipe arrays","volume":"8","author":"Suarez","year":"2020","journal-title":"IEEE Access"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1139\/juvs-2018-0007","article-title":"A method for UAV multi-sensor fusion 3D-localization under degraded or denied GPS situation","volume":"6","author":"Bulunseechart","year":"2018","journal-title":"J. Unmanned Veh. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Goforth, H., and Lucey, S. (2019, January 20\u201324). GPS-denied UAV localization using pre-existing satellite imagery. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8793558"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Balaji, N., Kothari, M., and Abhishek, A. (2020, January 1\u20134). GPS Denied Localization and Magnetometer-Free Yaw Estimation for Multi-rotor UAVs. Proceedings of the 2020 International Conference on Unmanned Aircraft Systems (ICUAS), Athens, Greece.","DOI":"10.1109\/ICUAS48674.2020.9213895"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lissandrini, N., Michieletto, G., Antonello, R., Galvan, M., Franco, A., and Cenedese, A. (2019). Cooperative optimization of UAVs formation visual tracking. Robotics, 8.","DOI":"10.3390\/robotics8030052"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Lee, J., Moon, J., and Kim, S. (2021, January 30\u201331). UWB-based Multiple UAV Control System for Indoor Ground Vehicle Tracking. Proceedings of the 2021 IEEE VTS 17th Asia Pacific Wireless Communications Symposium (APWCS), Virtual Conference.","DOI":"10.1109\/APWCS50173.2021.9548721"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Gonz\u00e1lez de Santos, L.M., Fr\u00edas Nores, E., Mart\u00ednez S\u00e1nchez, J., and Gonz\u00e1lez Jorge, H. (2021). Indoor path-planning algorithm for UAV-based contact inspection. Sensors, 21.","DOI":"10.3390\/s21020642"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Sandino, J., Vanegas, F., Maire, F., Caccetta, P., Sanderson, C., and Gonzalez, F. (2020). UAV framework for autonomous onboard navigation and people\/object detection in cluttered indoor environments. Remote Sens., 12.","DOI":"10.3390\/rs12203386"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Lieret, M., Kogan, V., D\u00f6ll, S., and Franke, J. (2019, January 22\u201326). Automated in-house transportation of small load carriers with autonomous unmanned aerial vehicles. Proceedings of the 2019 IEEE 15th International Conference on Automation Science and Engineering (CASE), Vancouver, BC, Canada.","DOI":"10.1109\/COASE.2019.8843183"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13673-019-0207-4","article-title":"Indoor acoustic localization: A survey","volume":"10","author":"Liu","year":"2020","journal-title":"Hum.-Centric Comput. Inf. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10846-021-01500-4","article-title":"A survey on radio frequency based precise localisation technology for UAV in GPS-denied environment","volume":"103","author":"Yang","year":"2021","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Rahman, A., Li, T., and Wang, Y. (2020). Recent advances in indoor localization via visible lights: A survey. Sensors, 20.","DOI":"10.3390\/s20051382"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Morar, A., Moldoveanu, A., Mocanu, I., Moldoveanu, F., Radoi, I.E., Asavei, V., Gradinaru, A., and Butean, A. (2020). A comprehensive survey of indoor localization methods based on computer vision. Sensors, 20.","DOI":"10.3390\/s20092641"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1327","DOI":"10.1109\/COMST.2016.2632427","article-title":"Recent advances in indoor localization: A survey on theoretical approaches and applications","volume":"19","author":"Yassin","year":"2016","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2568","DOI":"10.1109\/COMST.2019.2911558","article-title":"A survey of indoor localization systems and technologies","volume":"21","author":"Zafari","year":"2019","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Mashood, A., Dirir, A., Hussein, M., Noura, H., and Awwad, F. (2016, January 6\u20138). Quadrotor object tracking using real-time motion sensing. Proceedings of the 2016 5th International Conference on Electronic Devices, Systems and Applications (ICEDSA), Ras Al Khaimah, United Arab Emirates.","DOI":"10.1109\/ICEDSA.2016.7818504"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10846-020-01307-9","article-title":"Fiducial markers for pose estimation","volume":"101","author":"Kalaitzakis","year":"2021","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Jung, Y., Bang, H., and Lee, D. (2015, January 13\u201316). Robust marker tracking algorithm for precise UAV vision-based autonomous landing. Proceedings of the 2015 15th International Conference on Control, Automation and Systems (ICCAS), Busan, Korea.","DOI":"10.1109\/ICCAS.2015.7364957"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Nguyen, P.H., Kim, K.W., Lee, Y.W., and Park, K.R. (2017). Remote marker-based tracking for UAV landing using visible-light camera sensor. Sensors, 17.","DOI":"10.3390\/s17091987"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"012062","DOI":"10.1088\/1757-899X\/646\/1\/012062","article-title":"Vision-based autonomous landing of uav on moving platform using a new marker","volume":"Volume 646","author":"Huang","year":"2019","journal-title":"Proceedings of the IOP Conference Series: Materials Science and Engineering"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wang, G., Liu, Z., and Wang, X. (2019, January 22\u201324). UAV Autonomous Landing using Visual Servo Control based on Aerostack. Proceedings of the 3rd International Conference on Computer Science and Application Engineering, Sanya, China.","DOI":"10.1145\/3331453.3361667"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Jiaxin, H., Yanning, G., Zhen, F., and Yuqing, G. (2017, January 20\u201322). Vision-based autonomous landing of unmanned aerial vehicles. Proceedings of the 2017 Chinese Automation Congress (CAC), Jinan, China.","DOI":"10.1109\/CAC.2017.8243380"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Kyristsis, S., Antonopoulos, A., Chanialakis, T., Stefanakis, E., Linardos, C., Tripolitsiotis, A., and Partsinevelos, P. (2016). Towards autonomous modular UAV missions: The detection, geo-location and landing paradigm. Sensors, 16.","DOI":"10.3390\/s16111844"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Deeds, J., Engstrom, Z., Gill, C., Wood, Z., Wang, J., Ahn, I.S., and Lu, Y. (2018, January 5\u20138). Autonomous vision-based target detection using unmanned aerial vehicle. Proceedings of the 2018 IEEE 61st International Midwest Symposium on Circuits and Systems (MWSCAS), Windsor, ON, Canada.","DOI":"10.1109\/MWSCAS.2018.8623940"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Hinas, A., Roberts, J.M., and Gonzalez, F. (2017). Vision-based target finding and inspection of a ground target using a multirotor UAV system. Sensors, 17.","DOI":"10.3390\/s17122929"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Alsalam, B.H.Y., Morton, K., Campbell, D., and Gonzalez, F. (2017, January 4\u201311). Autonomous UAV with vision based on-board decision making for remote sensing and precision agriculture. Proceedings of the 2017 IEEE Aerospace Conference, Big Sky, MT, USA.","DOI":"10.1109\/AERO.2017.7943593"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1177\/0020294019889074","article-title":"Moving target tracking method for unmanned aerial vehicle\/unmanned ground vehicle heterogeneous system based on AprilTags","volume":"53","author":"Liang","year":"2020","journal-title":"Meas. Control"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zhao, B., Li, Z., Jiang, J., and Zhao, X. (2020, January 22\u201324). Relative Localization for UAVs Based on April-Tags. Proceedings of the 2020 Chinese Control And Decision Conference (CCDC), Hefei, China.","DOI":"10.1109\/CCDC49329.2020.9164563"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Liang, X., Chen, G., Zhao, S., Tong, G., Jiang, L., and Zhang, W. (2019, January 17\u201319). Remote Guidance Method of Unmanned Aerial Vehicle Based on Multi-sensors. Proceedings of the 2019 IEEE International Conference on Unmanned Systems (ICUS), Beijing, China.","DOI":"10.1109\/ICUS48101.2019.8995915"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Mohammadi, A., Feng, Y., Zhang, C., Rawashdeh, S., and Baek, S. (2020, January 1\u20134). Vision-based Autonomous Landing Using an MPC-controlled Micro UAV on a Moving Platform. Proceedings of the 2020 International Conference on Unmanned Aircraft Systems (ICUAS), Athens, Greece.","DOI":"10.1109\/ICUAS48674.2020.9214043"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Feng, Y., Zhang, C., Baek, S., Rawashdeh, S., and Mohammadi, A. (2018). Autonomous landing of a UAV on a moving platform using model predictive control. Drones, 2.","DOI":"10.3390\/drones2040034"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"97466","DOI":"10.1109\/ACCESS.2019.2929133","article-title":"A survey on odometry for autonomous navigation systems","volume":"7","author":"Mohamed","year":"2019","journal-title":"IEEE Access"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Wu, Y., Niu, X., Du, J., Chang, L., Tang, H., and Zhang, H. (2019). Artificial Marker and MEMS IMU-Based Pose Estimation Method to Meet Multirotor UAV Landing Requirements. Sensors, 19.","DOI":"10.3390\/s19245428"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Wang, Z., She, H., and Si, W. (2017, January 3\u20136). Autonomous landing of multi-rotors UAV with monocular gimbaled camera on moving vehicle. Proceedings of the 2017 13th IEEE International Conference on Control & Automation (ICCA), Ohrid, Macedonia.","DOI":"10.1109\/ICCA.2017.8003095"},{"key":"ref_43","first-page":"2795","article-title":"Autonomous tracking and landing on moving ground vehicle with multi-rotor UAV","volume":"16","author":"Phang","year":"2021","journal-title":"J. Eng. Sci. Technol. (JESTEC)"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Li, Z., Chen, Y., Lu, H., Wu, H., and Cheng, L. (2019, January 27\u201330). Uav autonomous landing technology based on apriltags vision positioning algorithm. Proceedings of the 2019 Chinese Control Conference (CCC), Guangzhou, China.","DOI":"10.23919\/ChiCC.2019.8865757"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1007\/s10846-016-0399-z","article-title":"Vision based autonomous landing of multirotor UAV on moving platform","volume":"85","author":"Araar","year":"2017","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Zhenglong, G., Qiang, F., and Quan, Q. (2018, January 25\u201327). Pose estimation for multicopters based on monocular vision and AprilTag. Proceedings of the 2018 37th Chinese Control Conference (CCC), Wuhan, China.","DOI":"10.23919\/ChiCC.2018.8483685"},{"key":"ref_47","first-page":"1","article-title":"Automated localization of UAVs in GPS-denied indoor construction environments using fiducial markers","volume":"Volume 35","author":"Nahangi","year":"2018","journal-title":"Proceedings of the ISARC. Proceedings of the International Symposium on Automation and Robotics in Construction"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Kayhani, N., Heins, A., Zhao, W., Nahangi, M., McCabe, B., and Schoelligb, A.P. (2019, January 21\u201324). Improved tag-based indoor localization of UAVs using extended Kalman filter. Proceedings of the ISARC. International Symposium on Automation and Robotics in Construction, Banff, AB, Canada.","DOI":"10.22260\/ISARC2019\/0083"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Michieletto, G., Cenedese, A., and Franchi, A. (2019, January 11\u201313). Force-Moment Decoupling and Rotor-Failure Robustness for Star-Shaped Generically-Tilted Multi-Rotors. Proceedings of the 2019 IEEE 58th Conference on Decision and Control (CDC), Nice, France.","DOI":"10.1109\/CDC40024.2019.9030008"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Lee, T., Leok, M., and McClamroch, N.H. (2010, January 15\u201317). Geometric tracking control of a quadrotor UAV on SE(3). Proceedings of the 49th IEEE Conference on Decision and Control (CDC), Atlanta, GA, USA.","DOI":"10.1109\/CDC.2010.5717652"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"13144","DOI":"10.1016\/j.ifacol.2017.08.2168","article-title":"Nonlinear control of multi-rotor aerial vehicles based on the zero-moment direction","volume":"50","author":"Michieletto","year":"2017","journal-title":"IFAC-PapersOnLine"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Krogius, M., Haggenmiller, A., and Olson, E. (2019, January 4\u20138). Flexible layouts for fiducial tags. Proceedings of the 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.","DOI":"10.1109\/IROS40897.2019.8967787"},{"key":"ref_53","unstructured":"Raspberry Pi (2022, July 07). Available online: https:\/\/www.raspberrypi.com."},{"key":"ref_54","unstructured":"(2022, July 07). Using the ECL EKF. Available online: https:\/\/docs.px4.io\/v1.12\/en\/advanced_config\/tuning_the_ecl_ekf.html."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/15\/5798\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:03:35Z","timestamp":1760141015000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/15\/5798"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,3]]},"references-count":54,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["s22155798"],"URL":"https:\/\/doi.org\/10.3390\/s22155798","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,8,3]]}}}