{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,30]],"date-time":"2026-01-30T03:05:45Z","timestamp":1769742345795,"version":"3.49.0"},"reference-count":46,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,10,30]],"date-time":"2025-10-30T00:00:00Z","timestamp":1761782400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>This article proposes a method that uses information about modules and desired assembly locations within a large truss structure to create a semantic and fiducial aided graph simultaneous localization and mapping (SF-GraphSLAM) algorithm that is better tailored for use during robotic in-space assembly and servicing operations. This is achieved by first reducing the number of modules using a mixed assembly method vs. a strut-by-strut method. Then, each module is correlated to a visual tag (in this article, an AprilTag) to reduce the number of elements being observed further from the number of sub-struts in that module to a single AprilTag marker. Two tags are required to ensure proper deployment of most deployable modules. Subsequently, we are able to use semantic information about the desired transformation matrix between any two adjacent module AprilTags within the desired assembly structure. For our experimentation, we expanded a factor graph smoothing and mapping model and added the semantic information, looking at the smaller number of landmark AprilTags, with a camera representing the robot for simplicity. The mathematical approach to arrive at this new method is included in this article, as are simulations to test it against the state of the art (SOA) using no structural knowledge. Overall, this research contributes to the SOA for both general SLAM work and, more specifically, to the underdeveloped field of SLAM for in-space assembly and servicing of large truss structures. It is critical to ensure that as a robot is assembling the modules, each module is within the desired tolerances to ensure the final structure is within the design requirements. Being able to build a virtual twin of the truss structure as it is being assembled is a key tent pole in achieving large space structures.<\/jats:p>","DOI":"10.3389\/frobt.2025.1426676","type":"journal-article","created":{"date-parts":[[2025,10,30]],"date-time":"2025-10-30T13:12:41Z","timestamp":1761829961000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Semantic and fiducial-aided graph simultaneous localization and mapping (SF-GraphSLAM) for robotic in-space assembly and servicing of large truss structures"],"prefix":"10.3389","volume":"12","author":[{"given":"Samantha","family":"Chapin","sequence":"first","affiliation":[]},{"given":"William","family":"Chapin","sequence":"additional","affiliation":[]},{"given":"Erik","family":"Komendera","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2025,10,30]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"117734","DOI":"10.1016\/j.eswa.2022.117734","article-title":"A survey of state-of-the-art on visual slam","volume":"205","author":"Abaspur Kazerouni","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"B2","doi-asserted-by":"publisher","first-page":"260","DOI":"10.1109\/ISMAR.2004.8","article-title":"Accuracy in optical tracking with fiducial markers: an accuracy function for artoolkit","author":"Abawi","year":"2004","journal-title":"Third IEEE ACM Int. Symposium Mix. Augmented Real."},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.2514\/6.2025-0180","article-title":"Shape reconstruction of unknown tumbling target using factor graph-based dynamic slam","author":"Asril","year":"2025","journal-title":"AIAA SciTech 2025, SAR-01 In-Space On-Orbit Serv. Robotics Sess"},{"key":"B4","doi-asserted-by":"publisher","first-page":"1185","DOI":"10.1016\/j.asr.2023.10.048","article-title":"Simultaneous localization and mapping architecture for small bodies and space exploration","volume":"73","author":"Bettens","year":"2024","journal-title":"Adv. Space Res."},{"key":"B5","first-page":"2022","article-title":"In-space servicing, assembly, and manufacturing for the new space economy","author":"Cavaciuti","year":"2022","journal-title":"Aerosp. Cent. Space Policy Strategy"},{"key":"B6","volume-title":"Semantic and fiducial aided graph simultaneous localization and mapping for robotic in-space assembly and servicing of large truss structures","author":"Chapin","year":"2024"},{"key":"B7","doi-asserted-by":"publisher","first-page":"447","DOI":"10.3390\/aerospace11060447","article-title":"Built on-orbit robotically assembled gigatruss (Borg): ground robotic demonstration","volume":"11","author":"Chapin","year":"2024","journal-title":"Aerospace"},{"key":"B8","doi-asserted-by":"publisher","first-page":"1109131","DOI":"10.3389\/frobt.2023.1109131","article-title":"Built on-orbit robotically assembled gigatruss (Borg): a mixed assembly architecture trade study","volume":"10","author":"Chapin","year":"2023","journal-title":"Front. Robotics AI"},{"key":"B9","unstructured":"Gazebo garden\n          \n          \n            \n              Chapin\n              W.\n            \n          \n          \n          2023"},{"key":"B10","doi-asserted-by":"publisher","first-page":"3010","DOI":"10.3390\/rs14133010","article-title":"An overview on visual slam: from tradition to semantic","volume":"14","author":"Chen","year":"2022","journal-title":"Remote Sens."},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1080\/02331880309257","article-title":"Bayesian filtering: from kalman filters to particle filters, and beyond","volume":"182","author":"Chen","year":"2003","journal-title":"Statistics"},{"key":"B12","volume-title":"Space servicing, assembly, and manufacturing (ISAM) state of play","author":"Dale Arney","year":"2023"},{"key":"B13","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-030-01219-9_17","article-title":"Improved structure from motion using fiducial marker matching","volume-title":"European conference on computer vision","author":"DeGol","year":"2018"},{"key":"B14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/2300000043","article-title":"Factor graphs for robot perception","volume":"6","author":"Dellaert","year":"2017","journal-title":"Found. Trends\u00ae Robotics"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.3847\/25c2cfeb.7707c9bf","article-title":"State of the profession: Nasa langley research center capabilities\/technologies for autonomous in-space assembly and modular persistent assets","volume":"53","author":"Dorsey","year":"2021","journal-title":"Bull. AAS"},{"key":"B16","doi-asserted-by":"publisher","first-page":"1317","DOI":"10.1109\/TPAMI.2009.146","article-title":"Designing highly reliable fiducial markers","volume":"32","author":"Fiala","year":"2010","journal-title":"IEEE Trans. Pattern Analysis Mach. Intell."},{"key":"B17","unstructured":"International space station\n          \n          \n            \n              Garcia\n              M.\n            \n          \n          \n          2022"},{"key":"B18","unstructured":"Hubble servicing missions overview\n          \n          \n            \n              Garner\n              R.\n            \n          \n          \n          2018"},{"key":"B19","first-page":"1","article-title":"Precision in assembled discrete lattice space structures for next-generation isam applications","volume-title":"2024 IEEE aerospace conference","author":"Gregg","year":"2024"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.2514\/6.1981-443","article-title":"Critical requirements for the design of large space structures","author":"Hedgepeth","year":"2012"},{"key":"B21","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1146\/annurev-control-042920-011106","article-title":"Grappling spacecraft","volume":"5","author":"Henshaw","year":"2022","journal-title":"Annu. Rev. Control, Robotics, Aut. Syst."},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1209.2434","article-title":"Query complexity of derivative-free optimization","volume":"25","author":"Jamieson","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"B23","first-page":"4672","volume-title":"Structure assembly by a heterogeneous team of robots using state estimation, generalized joints, and Mobile parallel manipulators","author":"Komendera","year":"2017"},{"key":"B24","doi-asserted-by":"crossref","first-page":"69580C","DOI":"10.1117\/12.779599","article-title":"Modeling, simulation, testing, and verification of the orbital express autonomous rendezvous and capture sensor system (ARCSS)","volume-title":"Sensors and systems for space applications II","author":"Leinz","year":"2008"},{"key":"B25","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1145\/3019612.3019709","article-title":"A versatile high-performance visual fiducial marker detection system with scalable identity encoding","volume-title":"Proceedings of the symposium on applied computing","author":"Lightbody","year":"2017"},{"key":"B26","doi-asserted-by":"crossref","DOI":"10.1017\/9781316661239","volume-title":"Modern robotics: mechanics, planning, and control","author":"Lynch","year":"2017"},{"key":"B27","doi-asserted-by":"publisher","first-page":"91","DOI":"10.3390\/robotics11050091","article-title":"Improved visual slam using semantic segmentation and layout estimation","volume":"11","author":"Mahmoud","year":"2022","journal-title":"Robotics"},{"key":"B28","doi-asserted-by":"crossref","first-page":"4909","DOI":"10.2514\/6.2024-4909","article-title":"Pose estimation for autonomous in-space assembly","volume-title":"Aiaa aviation forum and ascend 2024","author":"Moser","year":"2024"},{"key":"B29","doi-asserted-by":"crossref","first-page":"4700","DOI":"10.2514\/6.2023-4700","article-title":"Survey of select recent in-space servicing assembly and manufacturing related robotics projects at the jet propulsion laboratory","volume-title":"Ascend 2023","author":"Mukherjee","year":"2023"},{"key":"B30","doi-asserted-by":"crossref","first-page":"65550Y","DOI":"10.1117\/12.720284","article-title":"SUMO\/FREND: vision system for autonomous satellite grapple","volume-title":"Sensors and systems for space applications","author":"Obermark","year":"2007"},{"key":"B31","article-title":"Autonomous satellite servicing using the orbital express demonstration manipulator system","volume-title":"Proceedings of the 9th international symposium on artificial intelligence, robotics and automation in space","author":"Ogilvie","year":"2008"},{"key":"B32","doi-asserted-by":"crossref","first-page":"3400","DOI":"10.1109\/ICRA.2011.5979561","article-title":"Apriltag: a robust and flexible visual fiducial system","volume-title":"2011 IEEE international conference on robotics and automation","author":"Olson","year":"2011"},{"key":"B33","article-title":"Tagslam: robust slam with fiducial markers","author":"Pfrommer","year":"2019"},{"key":"B34","doi-asserted-by":"publisher","first-page":"530","DOI":"10.1016\/j.actaastro.2021.09.007","article-title":"Modularity for the future in space robotics: a review","volume":"189","author":"Post","year":"2021","journal-title":"Acta Astronaut."},{"key":"B35","doi-asserted-by":"publisher","first-page":"498","DOI":"10.1016\/j.ast.2016.09.014","article-title":"A large ring deployable mechanism for space satellite antenna","volume":"58","author":"Qi","year":"2016","journal-title":"Aerosp. Sci. Technol."},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.2514\/6.2017-5255","article-title":"Designing spacecraft to enable robotic servicing","author":"Reed","year":"2017"},{"key":"B37","first-page":"1","article-title":"Autonomous robot planning system for in-space assembly of reconfigurable structures","volume-title":"IEEE Aerosp. Conf.","author":"Rodr\u00edguez","year":"2021"},{"key":"B38","article-title":"Simultaneous localization and mapping for satellite rendezvous and proximity operations using random finite sets","volume-title":"AAS\/AIAA space flight mechanics meeting","author":"Schlenker","year":"2019"},{"key":"B39","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1177\/0278364906065387","article-title":"The graph slam algorithm with applications to large-scale mapping of urban structures","volume":"25","author":"Thrun","year":"2006","journal-title":"Int. J. Robotics Res."},{"key":"B40","article-title":"Factor graph-based active slam for spacecraft proximity operations","author":"Ticozzi","year":"2025"},{"key":"B41","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1002\/9781119434610.ch5","article-title":"An introduction to kalman filtering implementation for localization and tracking applications","author":"Ting Goh","year":"2019"},{"key":"B42","doi-asserted-by":"publisher","first-page":"897","DOI":"10.1002\/rob.21548","article-title":"Factor graph modeling of rigid-body dynamics for localization, mapping, and parameter estimation of a spinning object in space","volume":"32","author":"Tweddle","year":"2015","journal-title":"J. Field Robotics"},{"key":"B43","doi-asserted-by":"publisher","first-page":"1729881420919185","DOI":"10.1177\/1729881420919185","article-title":"A survey of image semantics-based visual simultaneous localization and mapping: application-Oriented solutions to autonomous navigation of Mobile robots","volume":"17","author":"Xia","year":"2020","journal-title":"Int. J. Adv. Robotic Syst."},{"key":"B44","doi-asserted-by":"publisher","first-page":"3730","DOI":"10.1109\/TNNLS.2023.3347633","article-title":"Cognition-driven structural prior for instance-dependent label transition matrix estimation","volume":"36","author":"Zhang","year":"2025","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"B45","doi-asserted-by":"publisher","first-page":"9527","DOI":"10.1109\/TMM.2024.3394681","article-title":"Part-aware correlation networks for few-shot learning","volume":"26","author":"Zhang","year":"2024","journal-title":"IEEE Trans. Multimedia"},{"key":"B46","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1109\/TMM.2021.3070138","article-title":"Deep-irtarget: an automatic target detector in infrared imagery using dual-domain feature extraction and allocation","volume":"24","author":"Zhang","year":"2022","journal-title":"IEEE Trans. Multimedia"}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2025.1426676\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,30]],"date-time":"2025-10-30T13:12:46Z","timestamp":1761829966000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2025.1426676\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,30]]},"references-count":46,"alternative-id":["10.3389\/frobt.2025.1426676"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2025.1426676","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,30]]},"article-number":"1426676"}}