{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T15:08:04Z","timestamp":1774451284910,"version":"3.50.1"},"reference-count":35,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,1,20]],"date-time":"2022-01-20T00:00:00Z","timestamp":1642636800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41874035"],"award-info":[{"award-number":["41874035"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"natural Science Foundation of Hubei province, China","award":["2020CFB396"],"award-info":[{"award-number":["2020CFB396"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Wide-area space surveillance sensors are the backbone to cataloging of Earth orbiting objects. Their core capability should be to efficiently detect as many space objects as possible over a large space domain. As such, the question of how to quantitively evaluate the object detection performance of the sensors is critical. The evaluation is traditionally performed by means of infield static tests and out-field calibration satellite tests. However, this simplified method is flawed in terms of its representativeness in spatial-temporal coverage and object types, because space objects vary greatly in orbit type, size, and shape, and thus the evaluation results may be overoptimistic. This paper proposes a practically implementable procedure to quickly and reliably evaluate the object detection performance of space surveillance sensors in which a catalog containing a vast number of on-orbit objects is used as a reference. It first constructs a unified model to estimate the size of objects from its radar cross section (RCS) data, then it presents a hierarchy scheme to efficiently compute object visibility, and finally, it makes the sensor performance evaluation through a data point matching technique. Experiments with two simulated sensors demonstrate that the realized performance is always inferior to the designed one, and in some cases the difference is significant and concerning. The presented approach could be routinely applied to evaluate the performance of any operational surveillance sensors and provide insight on how the sensor performance could be improved through refined design, manufacture, and operation.<\/jats:p>","DOI":"10.3390\/rs14030483","type":"journal-article","created":{"date-parts":[[2022,1,20]],"date-time":"2022-01-20T22:51:06Z","timestamp":1642719066000},"page":"483","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Towards Fast and Reliable Evaluation of Detection Performance of Space Surveillance Sensors"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4565-0045","authenticated-orcid":false,"given":"Jian","family":"Huang","sequence":"first","affiliation":[{"name":"Beijing Institute of Tracking and Telecommunications Technology, Beijing 100094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5671-5115","authenticated-orcid":false,"given":"Xiangxu","family":"Lei","sequence":"additional","affiliation":[{"name":"School of Civil and Architecture Engineering, Shandong University of Technology, Zibo 255000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bin","family":"Li","sequence":"additional","affiliation":[{"name":"School of Geodesy and Geomatics, Wuhan University, Wuhan 430072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jizhang","family":"Sang","sequence":"additional","affiliation":[{"name":"School of Geodesy and Geomatics, Wuhan University, Wuhan 430072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hongkang","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Geodesy and Geomatics, Wuhan University, Wuhan 430072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,20]]},"reference":[{"key":"ref_1","first-page":"88","article-title":"Us space surveillance network capabilities","volume":"Volume 3434","author":"Sridharan","year":"1998","journal-title":"Image Intensifiers and Applications, and Characteristics and Consequences of Space Debris and Near-Earth Objects: San Diego, CA, USA, 23 July 1998"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Yaglioglu, B., Utku, A., Yilmaz, O., and Ozdemir, B.G. (2013, January 12\u201314). Surveillance of space: An overview and a vision for Turkey\u2019s roadmap. Proceedings of the 2013 6th International Conference on Recent Advances in Space Technologies (RAST), Istanbul, Turkey.","DOI":"10.1109\/RAST.2013.6581156"},{"key":"ref_3","first-page":"1","article-title":"Space Fence IOC delayed seven months due to early schedule slips","volume":"28","author":"Albon","year":"2017","journal-title":"Inside Air Force"},{"key":"ref_4","unstructured":"Fonder, G., Hughes, M., Dickson, M., Schoenfeld, M., and Gardner, J. (2019, January 14\u201318). Space Fence Radar Overview. Proceedings of the 2019 International Applied Computational Electromagnetics Society Symposium (ACES), Miami, FL, USA."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1016\/j.icarus.2014.06.012","article-title":"Detecting small asteroids with the Space Surveillance Telescope","volume":"239","author":"Ruprecht","year":"2014","journal-title":"Icarus"},{"key":"ref_6","unstructured":"Richardson, D. (2010). USAF plans follow-on SBSS satellite. Jane\u2019s Missiles and Rockets, Jane\u2019s Information Group Ltd."},{"key":"ref_7","unstructured":"Punjani, S., Bogstie, H., Grady, J., Hogan, M., Moomey, E., Zaza, R., and Berenberg, L. (2022, January 10). ORS-5 System Acquisition Successes and Regrets. Available online: ORS-5SystemAcquisitionSuccessesRegrets-ShahnazPunjani.pdf."},{"key":"ref_8","unstructured":"Th, M., Eglizeaud, J., and Bouchard, J. (2005, January 18\u201320). GRAVES: The new French system for space surveillance. Proceedings of the 4th European Conference on Space Debris, Darmstadt, Germany."},{"key":"ref_9","unstructured":"Klinkrad, H. (2002). Monitoring Space\u2013Efforts Made by European Countries, International Colloquium on Europe and Space Debris."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1462","DOI":"10.1016\/j.asr.2012.07.020","article-title":"A novel signal processing approach for LEO space debris based on a fence-type space surveillance radar system","volume":"50","author":"Huang","year":"2012","journal-title":"Adv. Space Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/0270-0255(87)90473-8","article-title":"The analytic hierarchy process\u2014What it is and how it is used","volume":"9","author":"Saaty","year":"1987","journal-title":"Math. Model."},{"key":"ref_12","first-page":"93","article-title":"Models, methods, concepts and applications of the analytic hierarchy process","volume":"32","author":"Rodriguez","year":"2002","journal-title":"Interfaces"},{"key":"ref_13","unstructured":"Levis, A.H. (1986). Modeling and Measuring Effectiveness of C3 Systems, Massachusetts Inst of Tech Cambridge Lab for Information and Decision Systems. Technical Report."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/0169-7439(87)80084-9","article-title":"Principal component analysis","volume":"2","author":"Wold","year":"1987","journal-title":"Chemom. Intell. Lab. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"6652","DOI":"10.1109\/JSEN.2016.2588140","article-title":"On Real Time Performance Evaluation of the Inertial Sensors for INS\/GPS Integrated Systems","volume":"16","author":"Zhong","year":"2016","journal-title":"IEEE Sens. J."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2658","DOI":"10.1109\/JSEN.2020.3023427","article-title":"Performance Evaluation of Different Grade IMUs for Diagnosis Applications in Land Vehicular Multi-Sensor Architectures","volume":"21","author":"Otegui","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_17","first-page":"31","article-title":"Proposal for a European space surveillance system","volume":"Volume 587","author":"Donath","year":"2005","journal-title":"Proceedings of the 4th European Conference on Space Debris"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1378","DOI":"10.1016\/j.actaastro.2009.10.036","article-title":"Possible European systems for space situational awareness","volume":"66","author":"Donath","year":"2010","journal-title":"Acta Astronaut."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1226","DOI":"10.1016\/j.asr.2005.03.101","article-title":"Performance estimation for GEO space surveillance","volume":"35","author":"Flohrer","year":"2005","journal-title":"Adv. Space Res."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1010","DOI":"10.1016\/j.asr.2007.02.018","article-title":"Proposed strategies for optical observations in a future European Space Surveillance network","volume":"41","author":"Flohrer","year":"2008","journal-title":"Adv. Space Res."},{"key":"ref_21","unstructured":"Schildknecht, T., Flohrer, T., and Musci, R. (2005, January 22\u201326). Optical observations in a proposed European Space Surveillance network. Proceedings of the 6th US Russian Space Surveillance Workshop, Central Astronomical Observatory at Pulkovo of Russian Academy of Sciences, St. Petersburg, Russia."},{"key":"ref_22","unstructured":"Olmedo, E., Nomen, J., S\u00e1nchez-Ortiz, N., and Bell\u00f3-Mora, M. (2009, January 12\u201316). Cataloguing capability of objects in the GEO ring. Proceedings of the 60th International Astronautical Congress, Daejeon, Korea. Paper IAC-09-A6."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1111\/j.1365-2966.2009.15749.x","article-title":"Space debris cataloguing capabilities of some proposed architectures for the future European Space Situational Awareness System","volume":"403","author":"Olmedo","year":"2010","journal-title":"Mon. Not. R. Astron. Soc."},{"key":"ref_24","unstructured":"Fr\u00fch, C., Schildknecht, T., Hinze, A., and Reber, M. (2011, January 7\u20139). Optical observation campaign in the framework of the ESA space surveillance system precursor services. Proceedings of the European Space Surveillance Conference, Madrid, Spain."},{"key":"ref_25","unstructured":"Utzmann, J., Wagner, A., Blanchet, G., Ass\u00e9mat, F., Vial, S., Dehecq, B., S\u00e1nchez, J.F., Espinosa, J.R.G., Mat\u00e9, A.\u00c1., and Bartsch, G. (2013, January 22\u201325). Architectural design for a European SST system. Proceedings of the 6th European Conference on Space Debris, Darmstadt, Germany."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1504002","DOI":"10.3788\/AOS202040.1504002","article-title":"Simulation Analysis of Space Debris Observation Capability of Multi-Optoelectronic Equipment","volume":"40","author":"Hu","year":"2020","journal-title":"Acta Opt. Sin."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Butkus, A., Roe, K., Mitchell, B., and Payne, T. (2007, January 18\u201321). Space surveillance network and analysis model (SSNAM) performance improvements. Proceedings of the 2007 DoD High Performance Computing Modernization Program Users Group Conference, Pittsburgh, PA, USA.","DOI":"10.1109\/HPCMP-UGC.2007.67"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1016\/S0094-5765(00)00106-5","article-title":"PROOF\u2014The extension of esa\u2019s MASTER Model to predict debris detections","volume":"47","author":"Krag","year":"2000","journal-title":"Acta Astronaut."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Vallado, D., and Crawford, P. (2008, January 18\u201321). SGP4 orbit determination. Proceedings of the AIAA\/AAS Astrodynamics Specialist Conference and Exhibit, Honolulu, HI, USA.","DOI":"10.2514\/6.2008-6770"},{"key":"ref_30","unstructured":"Barton, D.K. (2004). Radar System Analysis and Modeling, Artech House."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1013","DOI":"10.1016\/j.asr.2003.02.043","article-title":"Assessment of orbital debris size estimation from radar cross-section measurements","volume":"34","author":"Lambour","year":"2004","journal-title":"Adv. Space Res."},{"key":"ref_32","unstructured":"Brent, R.P. (2013). Algorithms for Minimization without Derivatives, Courier Corporation."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1109\/TMTT.1969.1127005","article-title":"Optimization methods for computer-aided design","volume":"17","author":"Bandler","year":"1969","journal-title":"IEEE Trans. Microw. Theory Tech."},{"key":"ref_34","unstructured":"Venkataraman, P. (2009). Applied Optimization with MATLAB Programming, John Wiley & Sonsa."},{"key":"ref_35","unstructured":"Ender, J., Leushacke, L., Brenner, A., and Wilden, H. (, January 7\u20139). Radar techniques for space situational awareness. Proceedings of the 2011 12th International Radar Symposium (IRS), Leipzig, Germany."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/3\/483\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:04:42Z","timestamp":1760133882000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/3\/483"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,20]]},"references-count":35,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["rs14030483"],"URL":"https:\/\/doi.org\/10.3390\/rs14030483","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,20]]}}}