{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T03:43:01Z","timestamp":1775101381285,"version":"3.50.1"},"reference-count":57,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T00:00:00Z","timestamp":1662595200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>This paper tackles the problem of spacecraft relative navigation to support the reach and capture of a passively cooperative space target using a chaser platform equipped with a robotic arm in the frame of future operations such as On Orbit Servicing and Active Debris Removal. Specifically, it presents a pose determination architecture based on monocular cameras to deal with a space target in GEO equipped with retro-reflective and black-and-white fiducial markers. The proposed architecture covers the entire processing pipeline, i.e., starting from markers\u2019 detection and identification up to pose estimation by solving the Perspective-n-Points problem with a customized implementation of the Levenberg\u2013Marquardt algorithm. It is designed to obtain relative position and attitude measurements of the target\u2019s main body with respect to the chaser, as well as of the robotic arm\u2019s end effector with respect to the selected grasping point. The design of the configuration of fiducial markers to be installed on the target\u2019s approach face to support the pose determination task is also described. A performance assessment is carried out by means of numerical simulations using the Planet and Asteroid Natural Scene Generation Utility tool to produce realistic synthetic images of the target. The proposed approach robustness is evaluated against variable illumination scenarios and considering different uncertainty levels in the knowledge of initial conditions and camera intrinsic parameters.<\/jats:p>","DOI":"10.3390\/rs14184483","type":"journal-article","created":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T09:51:09Z","timestamp":1662630669000},"page":"4483","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Monocular-Based Pose Estimation Based on Fiducial Markers for Space Robotic Capture Operations in GEO"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4448-7490","authenticated-orcid":false,"given":"Roberto","family":"Opromolla","sequence":"first","affiliation":[{"name":"Department of Industrial Engineering, University of Naples Federico II, 80125 Napoli, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7686-3185","authenticated-orcid":false,"given":"Claudio","family":"Vela","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, University of Naples Federico II, 80125 Napoli, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6801-7648","authenticated-orcid":false,"given":"Alessia","family":"Nocerino","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, University of Naples Federico II, 80125 Napoli, Italy"}]},{"given":"Carlo","family":"Lombardi","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, University of Naples Federico II, 80125 Napoli, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1109\/MRA.2009.934819","article-title":"On-orbit servicing","volume":"16","author":"Stoll","year":"2009","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.paerosci.2014.03.002","article-title":"A review of space robotics technologies for on-orbit servicing","volume":"68","author":"Ma","year":"2014","journal-title":"Prog. Aerosp. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.actaastro.2012.11.009","article-title":"Active debris removal: Recent progress and current trends","volume":"85","author":"Bonnal","year":"2013","journal-title":"Acta Astronaut."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1016\/j.actaastro.2016.10.006","article-title":"Mission concept and autonomy considerations for active Debris removal","volume":"129","author":"Peters","year":"2016","journal-title":"Acta Astronaut."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.paerosci.2019.01.004","article-title":"On-orbit service (OOS) of spacecraft: A review of engineering developments","volume":"108","author":"Li","year":"2019","journal-title":"Prog. Aerosp. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"282","DOI":"10.1016\/j.actaastro.2021.01.021","article-title":"Identifying the 50 statistically-most-concerning derelict objects in LEO","volume":"181","author":"McKnight","year":"2021","journal-title":"Acta Astronautica"},{"key":"ref_7","unstructured":"Feron, E. (2016). Spacecraft Autonomy Challenges for Next-Generation Space Missions. Advances in Control System Technology for Aerospace Applications, Springer. Lecture Notes in Control and Information Sciences."},{"key":"ref_8","unstructured":"Pavanello, Z., Branz, F., Francesconi, A., Cenedese, A., Antonello, R., Basana, F., Iob, P., Vertuani, D., Massari, M., and Colombo, C. (2021, January 25\u201329). Combined control and navigation approach to the robotic capture of space vehicles. Proceedings of the 72nd International Astronautical Congress (IAC 2021), Dubai, United Arab Emirates."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1016\/j.actaastro.2020.11.040","article-title":"Economic value analysis of on-orbit servicing for geosynchronous communication satellites","volume":"180","author":"Liu","year":"2021","journal-title":"Acta Astronaut."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1157","DOI":"10.2514\/1.A34978","article-title":"Framework for Modeling and Optimization of On-Orbit Servicing Operations under Demand Uncertainties","volume":"58","author":"Chen","year":"2021","journal-title":"J. Spacecr. Rocket."},{"key":"ref_11","unstructured":"(2022, February 16). Northrop Grumman and Intelsat Make History with Docking of Second Mission Extension Vehicle to Extend Life of Satellite. Available online: https:\/\/news.northropgrumman.com\/news\/releases\/northrop-grumman-and-intelsat-make-history-with-docking-of-second-mission-extension-vehicle-to-extend-life-of-satellite."},{"key":"ref_12","unstructured":"(2022, February 16). As Science Fiction Became Reality\u2026 36.000 km above Earth. Available online: https:\/\/www.jena-optronik.de\/en\/news\/reader\/docking-mev-2-is-10-02.html."},{"key":"ref_13","unstructured":"Clerc, X., and Retat, I. (2012, January 1\u20135). Astrium vision on space debris removal. Proceedings of the 63rd International Astronautical Congress (IAC 2012), Napoli, Italy."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s11263-008-0152-6","article-title":"EPnP: An accurate O(n) solution to the PnP problem","volume":"81","author":"Lepetit","year":"2009","journal-title":"Int. J. Comput. Vis."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Hesch, J.A., and Roumeliotis, S.I. (2011, January 6\u201313). A direct least-squares (DLS) method for PnP. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126266"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1444","DOI":"10.1109\/TPAMI.2012.41","article-title":"A robust O(n) solution to the perspective-n-point problem","volume":"34","author":"Li","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Howard, R.T., Heaton, A.F., Pinson, R.M., and Carrington, C.K. (2008, January 1\u20138). Orbital express advanced video guidance sensor. Proceedings of the 2008 IEEE Aerospace Conference, Big Sky, MT, USA.","DOI":"10.1109\/AERO.2008.4526518"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.actaastro.2017.03.008","article-title":"Robust, fast and accurate vision-based localization of a cooperative target used for space robotic arm","volume":"136","author":"Wen","year":"2017","journal-title":"Acta Astronaut."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.paerosci.2017.07.001","article-title":"A review of cooperative and uncooperative spacecraft pose determination techniques for close-proximity operations","volume":"93","author":"Opromolla","year":"2017","journal-title":"Prog. Aerosp. Sci."},{"key":"ref_20","unstructured":"Benn, M., and J\u00f8rgensen, J.L. (2008, January 23\u201325). Short range pose and position determination of spacecraft using a \u03bc-advanced stellar compass. Proceedings of the 3rd International Symposium on Formation Flying, Missions and Technologies, Noordwijk, The Netherlands."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1016\/j.actaastro.2018.02.028","article-title":"A relative navigation sensor for CubeSats based on LED fiducial markers","volume":"146","author":"Sansone","year":"2018","journal-title":"Acta Astronaut."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1046","DOI":"10.2514\/1.52193","article-title":"In-orbit demonstration of an optical navigation system for autonomous rendezvous docking","volume":"48","author":"Mokuno","year":"2011","journal-title":"J. Spacecr. Rocket."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Heaton, A., Howard, R., and Pinson, R. (2008, January 18\u201321). Orbital express AVGS validation and calibration for automated rendezvous. Proceedings of the AIAA\/AAS Astrodynamics Specialist Conference and Exhibit, Honolulu, HI, USA.","DOI":"10.2514\/6.2008-6937"},{"key":"ref_24","unstructured":"Pochard, M. (October, January 29). Qualification of videometer an optical rendezvous sensor. Proceedings of the 54th International Astronautical Congress of the International Astronautical Federation, the International Academy of Astronautics, and the International Institute of Space Law (pp. AP-07), Bremen, Germany."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Hariri, N., Gutierrez, H., Rakoczy, J., Howard, R., and Bertaska, I. (2020). Performance characterization of the smartphone video guidance sensor as vision-based positioning system. Sensors, 20.","DOI":"10.3390\/s20185299"},{"key":"ref_26","unstructured":"(2022, April 29). Pemsun: Passive Emitting Material Supporting Navigation at End-of-Life. Available online: https:\/\/blogs.esa.int\/cleanspace\/2019\/04\/17\/infrared-and-phosphorescent-markers-to-avoid-future-satellites-to-become-debris\/."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"874","DOI":"10.1002\/rob.21858","article-title":"Autonomous landing on a moving vehicle with an unmanned aerial vehicle","volume":"36","author":"Baca","year":"2019","journal-title":"J. Field Robot."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Gatrell, L.B., Hoff, W.A., and Sklair, C.W. (1991, January 14\u201315). Robust image features: Concentric contrasting circles and their image extraction. Proceedings of the Cooperative Intelligent Robotics in Space II, Boston, MA, USA.","DOI":"10.1117\/12.56761"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Goodwin, D.P., Hembree, L.E., Curran, J.P., Moyer, D.S., Strachan, R.L., Mills, I., and Valois, J.S. (1997, January 21\u201325). Orbiter space vision system on space shuttle flight STS-80. Proceedings of the Visual Information Processing VI, AeroSense \u201997, Orlando, FL, USA.","DOI":"10.1117\/12.280626"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"969","DOI":"10.2514\/1.G000687","article-title":"Relative computer vision-based navigation for small inspection spacecraft","volume":"38","author":"Tweddle","year":"2015","journal-title":"J. Guid. Control. Dyn."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Pertile, M., Chiodini, S., Giubilato, R., Mazzucato, M., Valmorbida, A., Fornaser, A., and Lorenzini, E.C. (2018). Metrological Characterization of a Vision-Based System for Relative Pose Measurements with Fiducial Marker Mapping for Spacecrafts. Robotics, 7.","DOI":"10.3390\/robotics7030043"},{"key":"ref_32","unstructured":"Fiala, M. (2005, January 2\u20136). ARTag Fiducial Marker System Applied to Vision Based Spacecraft Docking. Proceedings of the IEEE\/RSJ IROS 2005 Workshop on Robot Vision for Space Applications, Edmonton, AB, Canada."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Bondy, M., Krishnasamy, R., Crymble, D., and Jasiobedzki, P. (2007, January 18\u201320). Space vision marker system (SVMS). Proceedings of the AIAA SPACE 2007 Conference & Exposition, Long Beach, CA, USA.","DOI":"10.2514\/6.2007-6185"},{"key":"ref_34","unstructured":"Chan, M., Bultitude, J., Faber, D., Hawes, D., and Fab, O. (2019, January 3\u20138). Productization of CubeSat Rendezvous and Docking Solutions. Proceedings of the 33rd Annual AIAA\/USU Conference on Small Satellites, Logan, UT, USA."},{"key":"ref_35","unstructured":"(2022, May 03). General Mission Analysis Tool, Available online: https:\/\/opensource.gsfc.nasa.gov\/projects\/GMAT\/."},{"key":"ref_36","unstructured":"(2022, May 03). MATLAB Robotics System Toolbox. Available online: https:\/\/it.mathworks.com\/products\/robotics.html."},{"key":"ref_37","unstructured":"(2022, May 03). Planet and Asteroid Natural Scene Generation Utility (PANGU), by STAR-Dundee. Available online: https:\/\/www.star-dundee.com\/products\/pangu-planet-and-asteroid-natural-scene-generation-utility\/."},{"key":"ref_38","unstructured":"(2022, June 12). 1300-Class Platform | Commercial Spacecraft Platform. Available online: https:\/\/www.maxar.com\/products\/1300-class-platform."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1023\/B:VISI.0000025800.10423.1f","article-title":"SoftPOSIT: Simultaneous pose and correspondence determination","volume":"59","author":"David","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_41","unstructured":"(2022, May 30). 4 mm Silver and NIR II Coated, Corner Cube Prims | Edmund Optics. Available online: https:\/\/www.edmundoptics.com\/p\/254mm-silver-and-nir-ii-coated-corner-cube-prism\/41585\/."},{"key":"ref_42","unstructured":"(2022, May 30). BGR 25.4 Retroreflector. Available online: https:\/\/www.newport.com\/p\/BGR-25.4."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Howard, R.T., Cole, H.J., Jackson, J.L., Kamerman, G.W., and Fronek, D.K. (1997, January 21\u201325). Automatic rendezvous and docking system test and evaluation. Proceedings of the Laser Radar Technology and Applications II 1997, Orlando, FL, USA.","DOI":"10.1117\/12.281002"},{"key":"ref_44","unstructured":"Rank, P., M\u00fchlbauer, Q., Naumann, W., and Landzettel, K. (2011, January 1\u20138). The DEOS Automation and Robotics Payload. Proceedings of the 11th Symposium on Advanced Space Technologies in Robotics and Automation (ASTRA), Noordwijk, The Netherlands."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"100","DOI":"10.3389\/frobt.2018.00100","article-title":"Design and Operational Elements of the Robotic Subsystem for the e.deorbit Debris Removal Mission","volume":"5","author":"Jaekel","year":"2018","journal-title":"Front. Robot. AI"},{"key":"ref_46","unstructured":"Chabot, T., Kanani, K., Pollini, A., Chaumette, F., Marchand, E., and Forshaw, J. (June, January 29). Vision-based navigation experiment onboard the RemoveDebris mission. Proceedings of the 10th International ESA Conference on Guidance, Navigation & Control Systems, Salzburg, Austria."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1007\/BF03321512","article-title":"The HST SM4 Relative Navigation Sensor System: Overview and Preliminary Testing Results from the Flight Robotics Lab","volume":"57","author":"Naasz","year":"2009","journal-title":"J. Astronaut. Sci."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Liu, G., Xu, C., Zhu, Y., and Zhao, J. (2019). Monocular Vision-Based Pose Determination in Close Proximity for Low Impact Docking. Sensors, 19.","DOI":"10.3390\/s19153261"},{"key":"ref_49","unstructured":"Benn, M. (2010). Vision Based Navigation Sensors for Spacecraft Rendezvous and Docking. [Ph.D. Thesis, Danish Technical University]."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A Threshold Selection Method from Gray-Level Histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1137\/0111030","article-title":"An algorithm for least-squares estimation of nonlinear parameters","volume":"11","author":"Marquardt","year":"1963","journal-title":"J. Soc. Ind. Appl. Math."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1504\/IJSPACESE.2014.060600","article-title":"Pose estimation of an uncooperative spacecraft from actual space imagery","volume":"2","author":"Benn","year":"2014","journal-title":"Int. J. Space Sci. Eng."},{"key":"ref_53","unstructured":"Gavin, H.P. (2019). The Levenberg-Marquardt Algorithm for Nonlinear Least Squares Curve-Fitting Problems, Department of Civil and Environmental Engineering, Duke University."},{"key":"ref_54","unstructured":"(2022, June 17). Camera Calibration Toolbox for Matlab. Available online: http:\/\/robots.stanford.edu\/cs223b04\/JeanYvesCalib\/htmls\/parameters.html."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1080\/2151237X.2007.10129236","article-title":"Adaptive thresholding using the integral image","volume":"12","author":"Bradley","year":"2007","journal-title":"J. Graph. Tools"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"490","DOI":"10.1016\/j.ast.2007.02.009","article-title":"Accurate and autonomous navigation for the ATV","volume":"11","author":"Pinard","year":"2007","journal-title":"Aerosp. Sci. Technol."},{"key":"ref_57","unstructured":"Becker, C., Howard, R.T., and Rakoczy, J. (2013, January 10\u201315). Smartphone Video guidance sensor for small satellites. Proceedings of the 27th AIAA\/USU Conference on Small Satellites, Logan, UT, USA."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/18\/4483\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:27:43Z","timestamp":1760142463000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/18\/4483"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,8]]},"references-count":57,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["rs14184483"],"URL":"https:\/\/doi.org\/10.3390\/rs14184483","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,8]]}}}