{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T01:21:24Z","timestamp":1783041684309,"version":"3.54.6"},"reference-count":31,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2024,2,28]],"date-time":"2024-02-28T00:00:00Z","timestamp":1709078400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62173276"],"award-info":[{"award-number":["62173276"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62171735"],"award-info":[{"award-number":["62171735"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62101458"],"award-info":[{"award-number":["62101458"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["2023-JC-QN-0760"],"award-info":[{"award-number":["2023-JC-QN-0760"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["2021JQ-122"],"award-info":[{"award-number":["2021JQ-122"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Natural Science Basic Research Program of Shaanxi","award":["62173276"],"award-info":[{"award-number":["62173276"]}]},{"name":"Natural Science Basic Research Program of Shaanxi","award":["62171735"],"award-info":[{"award-number":["62171735"]}]},{"name":"Natural Science Basic Research Program of Shaanxi","award":["62101458"],"award-info":[{"award-number":["62101458"]}]},{"name":"Natural Science Basic Research Program of Shaanxi","award":["2023-JC-QN-0760"],"award-info":[{"award-number":["2023-JC-QN-0760"]}]},{"name":"Natural Science Basic Research Program of Shaanxi","award":["2021JQ-122"],"award-info":[{"award-number":["2021JQ-122"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>With the advancement of intelligent perception in multirobot systems, cooperative localization in dynamic environments has become a critical component. However, existing multirobot cooperative localization systems still fall short in meeting high-precision localization requirements in Global Navigation Satellite System (GNSS)-denied environments. In this paper, we propose a factor-graph-based resilient cooperative localization (FG-RCL) algorithm for multirobot systems. This algorithm integrates measurements from visual sensors and Ultra-WideBand (UWB) to achieve accurate cooperative state estimation\u2014overcoming the visibility issues of visual sensors within limited fields of view. We utilize the Joint Probabilistic Data Association (JPDA) algorithm to calculate the corresponding probabilities of multiple visual detection measurements between robots and assign them to their respective edges in the factor graph, thereby addressing the data association challenges in visual detection measurements. Finally, simulation results demonstrate that the proposed algorithm significantly reduces the influence of visual detection measurement interference on the performance of cooperative localization. Experimental results indicate that the proposed algorithm outperforms UWB-based and vision-based methods in terms of localization accuracy. The system is implemented using a factor-graph-based optimization approach, and it exhibits scalability and enables plug-and-play for sensors. Furthermore, it demonstrates resilience in abnormal situations.<\/jats:p>","DOI":"10.3390\/rs16050832","type":"journal-article","created":{"date-parts":[[2024,2,28]],"date-time":"2024-02-28T07:56:02Z","timestamp":1709106962000},"page":"832","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Resilient Cooperative Localization Based on Factor Graphs for Multirobot Systems"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9117-0029","authenticated-orcid":false,"given":"Dongjia","family":"Wang","sequence":"first","affiliation":[{"name":"School of Electronics and Information, Northwestern Polytechnical University, Xi\u2019an 710072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Baowang","family":"Lian","sequence":"additional","affiliation":[{"name":"School of Electronics and Information, Northwestern Polytechnical University, Xi\u2019an 710072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yangyang","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Electronics and Information, Northwestern Polytechnical University, Xi\u2019an 710072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bo","family":"Gao","sequence":"additional","affiliation":[{"name":"School of Electronics and Information, Northwestern Polytechnical University, Xi\u2019an 710072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shiduo","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Electronics and Information, Northwestern Polytechnical University, Xi\u2019an 710072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,2,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1079","DOI":"10.1007\/s10514-018-9783-9","article-title":"Distributed multi-robot formation control in dynamic environments","volume":"43","author":"Montijano","year":"2019","journal-title":"Auton. Robot."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1157","DOI":"10.1109\/TASE.2020.2997411","article-title":"Design and experimental validation of a distributed cooperative transportation scheme","volume":"18","author":"Ebel","year":"2020","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_3","unstructured":"Wang, L., Cheng, D., Gao, F., Cai, F., Guo, J., Lin, M., and Shen, S. (2018, January 5\u20138). A collaborative aerial-ground robotic system for fast exploration. Proceedings of the 2018 International Symposium on Experimental Robotics (ISER), Buenos Aires, Argentina."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Xu, H., Wang, C., Bo, Y., Jiang, C., Liu, Y., Yang, S., and Lai, W. (2022). An Aerial and Ground Multi-Agent Cooperative Location Framework in GNSS-Challenged Environments. Remote Sens., 14.","DOI":"10.3390\/rs14195055"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2590","DOI":"10.1109\/TCYB.2019.2905570","article-title":"Ultra-wideband and odometry-based cooperative relative localization with application to multi-UAV formation control","volume":"50","author":"Guo","year":"2019","journal-title":"IEEE Trans. Cybern."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3525","DOI":"10.1109\/TMECH.2023.3261945","article-title":"Asymptotically Efficient Estimator for Range-Based Robot Relative Localization","volume":"28","author":"Wang","year":"2023","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Xu, X., Liu, X., Zhao, B., and Yang, B. (2019). An extensible positioning system for locating mobile robots in unfamiliar environments. Sensors, 19.","DOI":"10.3390\/s19184025"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"919","DOI":"10.1007\/s10514-016-9567-z","article-title":"System for deployment of groups of unmanned micro aerial vehicles in gps-denied environments using onboard visual relative localization","volume":"41","author":"Saska","year":"2017","journal-title":"Auton. Robots"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"7004808","DOI":"10.1109\/TIM.2021.3086887","article-title":"Multirobot cooperative localization based on visible light positioning and odometer","volume":"70","author":"Yan","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"14721","DOI":"10.1109\/TITS.2021.3132375","article-title":"RDC-SLAM: A real-time distributed cooperative SLAM system based on 3D LiDAR","volume":"23","author":"Xie","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Shalihan, M., Cao, Z., Pongsirijinda, K., Guo, L., Lau, B.P.L., Liu, R., Yuen, C., and Tan, U.X. (2023, January 4\u20139). Moving Object Localization based on the Fusion of Ultra-WideBand and LiDAR with a Mobile Robot. Proceedings of the 2023 IEEE International Conference on Robotics and Biomimetics (ROBIO), Samui, Thailand.","DOI":"10.1109\/ROBIO58561.2023.10354904"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"552","DOI":"10.1002\/rob.22004","article-title":"Consistent decentralized cooperative localization for autonomous vehicles using LiDAR, GNSS, and HD maps","volume":"38","author":"Xu","year":"2021","journal-title":"J. Field Robot."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2022","DOI":"10.1109\/TRO.2021.3137751","article-title":"Kimera-multi: Robust, distributed, dense metric-semantic slam for multi-robot systems","volume":"38","author":"Tian","year":"2022","journal-title":"IEEE Trans. Robot."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Sahawneh, L.R., and Brink, K.M. (February, January 30). Factor Graphs-Based Multi-Robot Cooperative Localization: A Study of Shared Information Influence on Optimization Accuracy and Consistency. Proceedings of the 2017 International Technical Meeting of the Institute of Navigation, Monterey, CA, USA.","DOI":"10.33012\/2017.14895"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"8501525","DOI":"10.1109\/TIM.2021.3054005","article-title":"Adaptive recursive decentralized cooperative localization for multirobot systems with time-varying measurement accuracy","volume":"70","author":"Huang","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"7799","DOI":"10.1109\/LRA.2021.3100000","article-title":"Fault tolerant multi-robot cooperative localization based on covariance union","volume":"6","author":"Wang","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_17","first-page":"8504713","article-title":"Resilient Decentralized Cooperative Localization for Multisource Multirobot System","volume":"72","author":"Wang","year":"2023","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Araki, B., Gilitschenski, I., Ogata, T., Wallar, A., Schwarting, W., Choudhury, Z., and Rus, D. (2019, January 27\u201330). Range-based cooperative localization with nonlinear observability analysis. Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference (ITSC), Auckland, New Zealand.","DOI":"10.1109\/ITSC.2019.8916915"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Xu, H., Wang, L., Zhang, Y., Qiu, K., and Shen, S. (August, January 31). Decentralized visual-inertial-UWB fusion for relative state estimation of aerial swarm. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.","DOI":"10.1109\/ICRA40945.2020.9196944"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1016\/j.future.2018.05.035","article-title":"Cooperative indoor positioning with factor graph based on fim for wireless sensor network","volume":"89","author":"Hu","year":"2018","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"6175","DOI":"10.1109\/TITS.2020.2988531","article-title":"3D mapping database aided GNSS based collaborative positioning using factor graph optimization","volume":"22","author":"Zhang","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Xunt, Z., Huang, J., Li, Z., Ying, Z., Wang, Y., Xu, C., Gao, F., and Cao, Y. (2023, January 1\u20135). CREPES: Cooperative RElative Pose Estimation System. Proceedings of the 2023 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Detroit, MI, USA.","DOI":"10.1109\/IROS55552.2023.10342523"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Nguyen, T., Mohta, K., Taylor, C.J., and Kumar, V. (August, January 31). Vision-based multi-MAV localization with anonymous relative measurements using coupled probabilistic data association filter. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.","DOI":"10.1109\/ICRA40945.2020.9196793"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Gulati, D., Zhang, F., Malovetz, D., Clarke, D., and Knoll, A. (2017, January 10\u201313). Robust cooperative localization in a dynamic environment using factor graphs and probability data association filter. Proceedings of the International Conference on Information Fusion (Fusion), Xi\u2019an, China.","DOI":"10.23919\/ICIF.2017.8009654"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3374","DOI":"10.1109\/TRO.2022.3182503","article-title":"Omni-swarm: A decentralized omnidirectional visual\u2013inertial\u2013uwb state estimation system for aerial swarms","volume":"38","author":"Xu","year":"2022","journal-title":"IEEE Trans. Robot."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"958","DOI":"10.1109\/TRO.2021.3094157","article-title":"Viral-fusion: A visual-inertial-ranging-lidar sensor fusion approach","volume":"38","author":"Nguyen","year":"2021","journal-title":"IEEE Trans. Robot."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1049\/itr2.12063","article-title":"UGV-UAV robust cooperative positioning algorithm with object detection","volume":"15","author":"Wang","year":"2021","journal-title":"IET Intell. Transp. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1109\/JOE.1983.1145560","article-title":"Sonar tracking of multiple targets using joint probabilistic data association","volume":"8","author":"Fortmann","year":"1983","journal-title":"IEEE J. Oceanic Eng."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Dubois, R., Eudes, A., and Fr\u00e9mont, V. (2020, January 14\u201316). AirMuseum: A heterogeneous multi-robot dataset for stereo-visual and inertial Simultaneous Localization And Mapping. Proceedings of the 2020 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), Karlsruhe, Germany.","DOI":"10.1109\/MFI49285.2020.9235257"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","article-title":"Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras","volume":"33","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_31","unstructured":"Chen, H.A.N., Ling, P.E.I., Danping, Z.O.U., Kun, L.I.U., Yexuan, L.I., and Yu, C.A.O. (2018, January 22\u201323). An optimal selection of sensors in multi-sensor fusion navigation with factor graph. Proceedings of the 2018 Ubiquitous Positioning, Indoor Navigation and Location-Based Services (UPINLBS), Wuhan, China."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/5\/832\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:06:17Z","timestamp":1760105177000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/5\/832"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,28]]},"references-count":31,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,3]]}},"alternative-id":["rs16050832"],"URL":"https:\/\/doi.org\/10.3390\/rs16050832","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,28]]}}}