{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,19]],"date-time":"2025-10-19T15:56:12Z","timestamp":1760889372444,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2017,3,31]],"date-time":"2017-03-31T00:00:00Z","timestamp":1490918400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Tracking a non-cooperative target is a challenge, because in unfamiliar environments most targets are unknown and unspecified. Stereovision is suited to deal with this issue, because it allows to passively scan large areas and estimate the relative position, velocity and shape of objects. This research is an experimental effort aimed at developing, implementing and evaluating a real-time non-cooperative target tracking methods using stereovision measurements only. A computer-vision feature detection and matching algorithm was developed in order to identify and locate the target in the captured images. Three different filters were designed for estimating the relative position and velocity, and their performance was compared. A line-of-sight control algorithm was used for the purpose of keeping the target within the field-of-view. Extensive analytical and numerical investigations were conducted on the multi-view stereo projection equations and their solutions, which were used to initialize the different filters. This research shows, using an experimental and numerical evaluation, the benefits of using the unscented Kalman filter and the total least squares technique in the stereovision-based tracking problem. These findings offer a general and more accurate method for solving the static and dynamic stereovision triangulation problems and the concomitant line-of-sight control.<\/jats:p>","DOI":"10.3390\/s17040735","type":"journal-article","created":{"date-parts":[[2017,3,31]],"date-time":"2017-03-31T10:35:49Z","timestamp":1490956549000},"page":"735","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Tracking a Non-Cooperative Target Using Real-Time Stereovision-Based Control: An Experimental Study"],"prefix":"10.3390","volume":"17","author":[{"given":"Tomer","family":"Shtark","sequence":"first","affiliation":[{"name":"Department of Aerospace Engineering, Technion\u2014Israel Institute of Technology, Haifa 32000, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pini","family":"Gurfil","sequence":"additional","affiliation":[{"name":"Department of Aerospace Engineering, Technion\u2014Israel Institute of Technology, Haifa 32000, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,3,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Fasano, G., Grassi, M., and Accardo, D. (2009, January 6\u20139). A stereo-vision based system for autonomous navigation of an in-orbit servicing platform. Proceedings of the AIAA Infotech@Aerospace Conference, Seattle, WA, USA.","DOI":"10.2514\/6.2009-1934"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1455","DOI":"10.2514\/1.28216","article-title":"Relative angles-only navigation and pose estimation for autonomous orbital rendezvous","volume":"30","author":"Woffinden","year":"2007","journal-title":"J. Guid. Control Dyn."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Terui, F., Kamimura, H., and Nishida, S. (2006, January 5\u20138). Motion estimation to a failed satellite on orbit using stereo vision and 3D model matching. Proceedings of the 2006 9th International Conference on Control, Automation, Robotics and Vision, ICARCV\u201906, Singapore.","DOI":"10.1109\/ICARCV.2006.345305"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Segal, S., Carmi, A., and Gurfil, P. (2011, January 5\u201312). Vision-based relative state estimation of non-cooperative spacecraft under modeling uncertainty. Proceedings of the IEEE Aerospace Conference, Big Sky, MT, USA.","DOI":"10.1109\/AERO.2011.5747479"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"568","DOI":"10.1109\/TCST.2013.2255288","article-title":"Stereovision-based estimation of relative dynamics between noncooperative satellites: Theory and experiments","volume":"22","author":"Segal","year":"2014","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"ref_6","unstructured":"Bar-Shalom, Y., Li, X.R., and Kirubarajan, T. (2004). Estimation with Applications to Tracking and Navigation: Theory Algorithms and Software, John Wiley & Sons."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lichter, M.D., and Dubowsky, S. (2003, January 27). Estimation of state, shape, and inertial parameters of space objects from sequences of range images. Proceedings of the Photonics Technologies for Robotics, Automation, and Manufacturing, Providence, RI, USA.","DOI":"10.1117\/12.514813"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Lichter, M.D., and Dubowsky, S. (May, January 26). State, shape, and parameter estimation of space objects from range images. Proceedings of the 2004 IEEE International Conference on Robotics and Automation (ICRA 2004), New Orleans, LA, USA.","DOI":"10.1109\/ROBOT.2004.1307513"},{"key":"ref_9","unstructured":"Sogo, T., Ishiguro, H., and Trivedi, M.M. (2000, January 12). Real-time target localization and tracking by n-ocular stereo. Proceedings of the IEEE Workshop on Omnidirectional Vision, Hilton Head, SC, USA."},{"key":"ref_10","unstructured":"Jigalin, A., and Gurfil, P. (2013). Vision-Based Relative State Estimation of Unknown Dynamic Target Using Multiple Stereo Rigs. [Master\u2019s Thesis, Technion\u2014Israel Institute of Technology]."},{"key":"ref_11","unstructured":"Wan, E., and Van Der Merwe, R. (2000, January 1\u20134). The unscented Kalman filter for nonlinear estimation. Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium 2000 (AS-SPCC), Lake Louise, AB, Canada."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Julier, S.J., and Uhlmann, J.K. (1997, January 20\u201325). New extension of the Kalman filter to nonlinear systems. Proceedings of the AeroSense\u201997. International Society for Optics and Photonics, Orlando, FL, USA.","DOI":"10.1117\/12.280797"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1109\/JPROC.2003.823141","article-title":"Unscented filtering and nonlinear estimation","volume":"92","author":"Julier","year":"2004","journal-title":"Proc. IEEE"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"32152","DOI":"10.3390\/s151229884","article-title":"A TSR visual servoing system based on a novel dynamic template matching method","volume":"15","author":"Cai","year":"2015","journal-title":"Sensors"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"571","DOI":"10.1016\/j.ast.2016.09.009","article-title":"A non-cooperative target grasping position prediction model for tethered space robot","volume":"58","author":"Chen","year":"2016","journal-title":"Aerosp. Sci. Technol."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Huang, P., Chen, L., Zhang, B., Meng, Z., and Liu, Z. (2017). Autonomous Rendezvous and Docking with Nonfull Field of View for Tethered Space Robot. Int. J. Aerosp. Eng., 2017.","DOI":"10.1155\/2017\/3162349"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Szeliski, R. (2010). Computer Vision: Algorithms and Applications, Springer Science & Business Media.","DOI":"10.1007\/978-1-84882-935-0"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-up robust features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Jigalin, A., and Gurfil, P. (2015). Investigation of multiple-baseline stereovision for state estimation of unknown dynamic space targets. Proc. Inst. Mech. Eng. Part G.","DOI":"10.1177\/0954410015590636"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1015","DOI":"10.1109\/7.220948","article-title":"Tracking with debiased consistent converted measurements versus EKF","volume":"29","author":"Lerro","year":"1993","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1109\/7.745708","article-title":"Explicit expressions for debiased statistics of 3D converted measurements","volume":"35","author":"Suchomski","year":"1999","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1023","DOI":"10.1109\/7.705921","article-title":"Unbiased converted measurements for tracking","volume":"34","author":"Xiaoquan","year":"1998","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Mei, W., and Bar-Shalom, Y. (2009, January 4). Unbiased Kalman filter using converted measurements: Revisit. Proceedings of SPIE Conference on Signal and Data Processing of Small Targets, San Diego, CA, USA.","DOI":"10.1117\/12.831218"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Gallup, D., Frahm, J.M., Mordohai, P., and Pollefeys, M. (2008, January 23\u201328). Variable baseline\/resolution stereo. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Anchorage, AK, USA.","DOI":"10.1109\/CVPR.2008.4587671"},{"key":"ref_28","unstructured":"Oh, J.H., Park, J., Lee, S.H., Lee, B.H., and Park, J.I. (February, January 30). Error modeling of depth measurement using FIR stereo camera systems. Proceedings of the Third International Conference on Digital Information Processing and Communications (ICDIPC2013). The Society of Digital Information and Wireless Communication, Dubai, United Arab Emirates."},{"key":"ref_29","first-page":"237","article-title":"An introduction to total least squares","volume":"14","year":"1996","journal-title":"Nieuw Arch. Wiskd."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Forss\u00e9n, P.E., and Lowe, D.G. (2007, January 14\u201321). Shape descriptors for maximally stable extremal regions. Proceedings of the IEEE 11th International Conference on Computer Vision, Rio de Janeiro, Brazil.","DOI":"10.1109\/ICCV.2007.4409025"},{"key":"ref_31","unstructured":"Rosten, E., and Drummond, T. (July, January 29). Fusing points and lines for high performance tracking. Proceedings of the IEEE 10th International Conference on Computer Vision, Bradford, UK."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the IEEE International Conference on Computer Vision, Providence, RI, USA.","DOI":"10.1109\/ICCV.2011.6126544"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/4\/735\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:31:44Z","timestamp":1760207504000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/4\/735"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,3,31]]},"references-count":32,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2017,4]]}},"alternative-id":["s17040735"],"URL":"https:\/\/doi.org\/10.3390\/s17040735","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2017,3,31]]}}}