{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T16:34:02Z","timestamp":1783701242296,"version":"3.55.0"},"reference-count":55,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2023,6,16]],"date-time":"2023-06-16T00:00:00Z","timestamp":1686873600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Space-based target surveillance is important for aerospace safety. However, with the increasing complexity of the space environment, the stellar target and strong noise interference pose difficulties for space target detection. Simultaneously, it is hard to balance real-time processing with computational performance for the onboard processing platform owing to resource limitations. The heterogeneous multi-core architecture has corresponding processing capabilities, providing a hardware implementation platform with real-time and computational performance for space-based applications. This paper first developed a multi-stage joint detection and tracking model (MJDTM) for space targets in optical image sequences. This model combined an improved local contrast method and the Kalman filter to detect and track the potential targets and use differences in movement status to suppress the stellar targets. Then, a heterogeneous multi-core processing system based on a field-programmable gate array (FPGA) and digital signal processor (DSP) was established as the space-based image processing system. Finally, MJDTM was optimized and implemented on the above image processing system. The experiments conducted with simulated and actual image sequences examine the accuracy and efficiency of the MJDTM, which has a 95% detection probability while the false alarm rate is 10\u22124. According to the experimental results, the algorithm hardware implementation can detect targets in an image with 1024 \u00d7 1024 pixels in just 22.064 ms, which satisfies the real-time requirements of space-based surveillance.<\/jats:p>","DOI":"10.3390\/rs15123156","type":"journal-article","created":{"date-parts":[[2023,6,19]],"date-time":"2023-06-19T01:59:51Z","timestamp":1687139991000},"page":"3156","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Implementation of Real-Time Space Target Detection and Tracking Algorithm for Space-Based Surveillance"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2387-3958","authenticated-orcid":false,"given":"Yueqi","family":"Su","sequence":"first","affiliation":[{"name":"Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China"},{"name":"Key Laboratory of Intelligent Infrared Perception, Chinese Academy of Sciences, Shanghai 200083, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xin","family":"Chen","sequence":"additional","affiliation":[{"name":"Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China"},{"name":"Key Laboratory of Intelligent Infrared Perception, Chinese Academy of Sciences, Shanghai 200083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gaorui","family":"Liu","sequence":"additional","affiliation":[{"name":"Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China"},{"name":"Key Laboratory of Intelligent Infrared Perception, Chinese Academy of Sciences, Shanghai 200083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chen","family":"Cang","sequence":"additional","affiliation":[{"name":"Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China"},{"name":"Key Laboratory of Intelligent Infrared Perception, Chinese Academy of Sciences, Shanghai 200083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peng","family":"Rao","sequence":"additional","affiliation":[{"name":"Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China"},{"name":"Key Laboratory of Intelligent Infrared Perception, Chinese Academy of Sciences, Shanghai 200083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,6,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"123658","DOI":"10.1109\/ACCESS.2019.2938454","article-title":"Space Target Detection in Complicated Situations for Wide-Field Surveillance","volume":"7","author":"Li","year":"2019","journal-title":"IEEE Access"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"11","DOI":"10.3390\/rs14010011","article-title":"Application and Development of Multi-source Information Fusion in Space Situational Awareness","volume":"42","author":"Wang","year":"2021","journal-title":"Spacecr. Recovery Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"319","DOI":"10.4028\/www.scientific.net\/AMM.738-739.319","article-title":"Design and Implementation of Space Target Detection Algorithm","volume":"738\u2013739","author":"Chen","year":"2015","journal-title":"Appl. Mech. Mater."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1109\/TAES.1985.310548","article-title":"Dynamic programming solution for detecting dim moving targets","volume":"AES-21","author":"Barniv","year":"1985","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"776","DOI":"10.1109\/TAES.1987.310914","article-title":"Dynamic programming solution for detecting dim moving targets part II: Analysis","volume":"AES-23","author":"Barniv","year":"1987","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1109\/78.905890","article-title":"Particle filters for state estimation of jump Markov linear systems","volume":"49","author":"Doucet","year":"2001","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Salmond, D., and Birch, H. (2001, January 25\u201327). A particle filter for track-before-detect. Proceedings of the 2001 American Control Conference (Cat. No. 01CH37148), Arlington, VA, USA.","DOI":"10.1109\/ACC.2001.946220"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"898","DOI":"10.1109\/TAES.1983.309401","article-title":"Application of three-dimensional filtering to moving target detection","volume":"AES-19","author":"Reed","year":"1983","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_9","first-page":"524","article-title":"Small target trace acquisition algorithm for sequence star images with moving background","volume":"16","author":"Zhang","year":"2008","journal-title":"Opt. Precision Eng."},{"key":"ref_10","first-page":"439","article-title":"Research of detecting algorithm for space object based on star map recognition","volume":"36","author":"Cheng","year":"2010","journal-title":"Opt. Tech."},{"key":"ref_11","unstructured":"Zhang, J., Ren, J.-C., and Cheng, S.-C. (2013). International Symposium on Photoelectronic Detection and Imaging 2013: Optical Storage and Display Technology, SPIE."},{"key":"ref_12","unstructured":"Xi, X.-L., Yu, Y., Zhou, X.-D., and Zhang, J. (2011). International Symposium on Photoelectronic Detection and Imaging 2011: Space Exploration Technologies and Applications, SPIE."},{"key":"ref_13","unstructured":"Boccignone, G., Chianese, A., and Picariello, A. (1998, January 20). Small target detection using wavelets. Proceedings of the Fourteenth International Conference on Pattern Recognition (Cat. No. 98EX170), Brisbane, QLD, Australia."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"024503","DOI":"10.1088\/1538-3873\/ac4c9d","article-title":"Automatic Space Debris Extraction Channel Based on Large Field of view Photoelectric Detection System","volume":"134","author":"Jiang","year":"2022","journal-title":"Publ. Astron. Soc. Pac."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1109\/TGRS.2013.2242477","article-title":"A local contrast method for small infrared target detection","volume":"52","author":"Chen","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"167651","DOI":"10.1016\/j.ijleo.2021.167651","article-title":"Infrared dim target detection method based on local feature contrast and energy concentration degree","volume":"248","author":"Chen","year":"2021","journal-title":"Optik"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.actaastro.2015.01.001","article-title":"Algorithms and applications for detecting faint space debris in GEO","volume":"110","author":"Sun","year":"2015","journal-title":"Acta Astronaut."},{"key":"ref_18","unstructured":"Deshpande, S.D., Er, M.H., Venkateswarlu, R., and Chan, P. (1999). Signal and Data Processing of Small Targets 1999, SPIE."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1193","DOI":"10.1016\/j.compeleceng.2010.05.008","article-title":"Infrared small target enhancement and detection based on modified top-hat transformations","volume":"36","author":"Bai","year":"2010","journal-title":"Comput. Electr. Eng."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1109\/LGRS.2018.2866154","article-title":"A method for weak target detection based on human visual contrast mechanism","volume":"16","author":"Lv","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1822","DOI":"10.1109\/LGRS.2019.2954578","article-title":"A local contrast method for infrared small-target detection utilizing a tri-layer window","volume":"17","author":"Han","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"103733","DOI":"10.1016\/j.dsp.2022.103733","article-title":"Infrared dim and small targets detection via self-attention mechanism and pipeline correlator","volume":"130","author":"Lan","year":"2022","journal-title":"Digit. Signal Process."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Shi, F., Qiu, F., Li, X., Tang, Y., Zhong, R., and Yang, C. (2020). A method to detect and track moving airplanes from a satellite video. Remote Sens., 12.","DOI":"10.3390\/rs12152390"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1007","DOI":"10.1016\/j.asr.2011.12.010","article-title":"A debris image tracking using optical flow algorithm","volume":"49","author":"Fujita","year":"2012","journal-title":"Adv. Space Res."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1115\/1.3662552","article-title":"A New Approach to Linear Filtering and Prediction Problems","volume":"82","author":"Kalman","year":"1960","journal-title":"J. Basic Eng."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"739","DOI":"10.1109\/78.489052","article-title":"Design of an extended Kalman filter frequency tracker","volume":"44","author":"Bitmead","year":"1996","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2107","DOI":"10.4304\/jcp.9.9.2107-2115","article-title":"Space Target Tracking by Variance Detection","volume":"9","author":"Huang","year":"2014","journal-title":"J. Comput."},{"key":"ref_28","first-page":"418","article-title":"A method of GEO targets recognition in wide-field opto-electronic telescope observation","volume":"44","author":"Hao","year":"2017","journal-title":"Opto-Electron. Eng."},{"key":"ref_29","first-page":"3440","article-title":"Small target detection method in drift-scanning image based on DBT","volume":"42","author":"Lin","year":"2013","journal-title":"Infrared Laser Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1109\/TAES.2018.2864431","article-title":"A rotation-invariant additive vector sequence based star pattern recognition","volume":"55","author":"Mehta","year":"2018","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"121102","DOI":"10.3788\/LOP51.121102","article-title":"Research on Detection and Recognition of Space Targets Based on Satellite Photoelectric Imaging System","volume":"51","author":"Yang","year":"2014","journal-title":"Laser Optoelectron. Prog."},{"key":"ref_32","unstructured":"Bo, M. (2016). Research on Aerial Infrared Small Target Detection and Hardware Acceleration. [Master\u2019s Thesis, Beijing University of Technology]."},{"key":"ref_33","unstructured":"Zhang, Q. (2019). Design and Implementation of Spaceborne Infrared Small Target Detection System Based on FPGA. [Master\u2019s Thesis, Huazhong University of Science and Technology]."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1151","DOI":"10.3788\/YJYXS20142906.1151","article-title":"Object tracking under complicated background based on DSP+FPGA platform","volume":"29","author":"Liu","year":"2014","journal-title":"Chin. J. Liq. Cryst. Disp."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1007\/s11554-021-01187-8","article-title":"Real-time optical flow processing on embedded GPU: An hardware-aware algorithm to implementation strategy","volume":"19","author":"Seznec","year":"2022","journal-title":"J. Real-Time Image Process."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1016\/j.actaastro.2018.02.009","article-title":"Efficient and automatic image reduction framework for space debris detection based on GPU technology","volume":"145","author":"Diprima","year":"2018","journal-title":"Acta Astronaut."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Tian, H., Guo, S., Zhao, P., Gong, M., and Shen, C. (2021). Design and Implementation of a Real-Time Multi-Beam Sonar System Based on FPGA and DSP. Sensors, 21.","DOI":"10.3390\/s21041425"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"012003","DOI":"10.1088\/1742-6596\/1335\/1\/012003","article-title":"Implementation of Real-time Detection Algorithm for Space Debris Based on Multi-core DSP","volume":"1335","author":"Sun","year":"2019","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1080\/10106049.2020.1713231","article-title":"A real-time FPGA accelerated stream processing for hyperspectral image classification","volume":"37","author":"Gyaneshwar","year":"2022","journal-title":"Geocarto Int."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Han, K., Pei, H., Huang, Z., Huang, T., and Qin, S. (2022, January 26\u201328). Non-cooperative Space Target High-Speed Tracking Measuring Method Based on FPGA. Proceedings of the 2022 7th International Conference on Image, Vision and Computing (ICIVC), Xi\u2019an, China.","DOI":"10.1109\/ICIVC55077.2022.9887187"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2950","DOI":"10.1109\/JSTARS.2015.2388797","article-title":"Dual-mode FPGA implementation of target and anomaly detection algorithms for real-time hyperspectral imaging","volume":"8","author":"Yang","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1047","DOI":"10.12733\/jics20102961","article-title":"Real-time detection algorithm for small space targets based on max-median filter","volume":"11","author":"Xu","year":"2014","journal-title":"J. Inf. Comput. Sci."},{"key":"ref_43","first-page":"122","article-title":"Research on the On-orbit Real-time Space Target Detection Algorithm","volume":"42","author":"Han","year":"2021","journal-title":"Spacecr. Recovery Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1440","DOI":"10.1016\/j.asr.2010.07.022","article-title":"Onboard orbit determination using GPS observations based on the unscented Kalman filter","volume":"46","author":"Choi","year":"2010","journal-title":"Adv. Space Res."},{"key":"ref_45","first-page":"101084","article-title":"FPGA implementation of multi-dimensional Kalman filter for object tracking and motion detection","volume":"33","author":"Babu","year":"2022","journal-title":"Eng. Sci. Technol. Int. J."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1024529","DOI":"10.1155\/2017\/1024529","article-title":"Space Object Detection in Video Satellite Images Using Motion Information","volume":"2017","author":"Zhang","year":"2017","journal-title":"Int. J. Aerosp. Eng."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Li, Q., Li, R., Ji, K., and Dai, W. (2015, January 1\u20133). Kalman filter and its application. Proceedings of the 2015 8th International Conference on Intelligent Networks and Intelligent Systems (ICINIS), Tianjin, China.","DOI":"10.1109\/ICINIS.2015.35"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1002\/nav.3800020109","article-title":"The Hungarian method for the assignment problem","volume":"2","author":"Kuhn","year":"1955","journal-title":"Nav. Res. Logist. Q."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1109\/TSMCA.2011.2159587","article-title":"Efficient role transfer based on Kuhn\u2013Munkres algorithm","volume":"42","author":"Zhu","year":"2011","journal-title":"IEEE Trans. Syst. Man Cybern. Part A Syst. Hum."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Mirzaeinia, A., and Hassanalian, M. (2019). Minimum-cost drone\u2013nest matching through the kuhn\u2013munkres algorithm in smart cities: Energy management and efficiency enhancement. Aerospace, 6.","DOI":"10.3390\/aerospace6110125"},{"key":"ref_51","unstructured":"Luetteke, F., Zhang, X., and Franke, J. (2012, January 21\u201322). Implementation of the hungarian method for object tracking on a camera monitored transportation system. Proceedings of the ROBOTIK 2012: 7th German Conference on Robotics, Munich Germany."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Kuipers, J.B. (1999). Quaternions and Rotation Sequences: A Primer with Applications to Orbits, Aerospace, and Virtual Reality, Princeton University Press.","DOI":"10.1515\/9780691211701"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"2694","DOI":"10.1109\/TIP.2017.2686001","article-title":"A precision analysis of camera distortion models","volume":"26","author":"Tang","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1109\/34.159901","article-title":"Camera calibration with distortion models and accuracy evaluation","volume":"14","author":"Weng","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1670","DOI":"10.1109\/LGRS.2020.3004978","article-title":"Infrared small target detection based on the weighted strengthened local contrast measure","volume":"18","author":"Han","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/12\/3156\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:56:53Z","timestamp":1760126213000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/12\/3156"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,16]]},"references-count":55,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["rs15123156"],"URL":"https:\/\/doi.org\/10.3390\/rs15123156","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,16]]}}}