{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:18:16Z","timestamp":1760239096199,"version":"build-2065373602"},"reference-count":34,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2020,9,22]],"date-time":"2020-09-22T00:00:00Z","timestamp":1600732800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004602","name":"Program for New Century Excellent Talents in University","doi-asserted-by":"publisher","award":["Grant No.  NCET-09-0025"],"award-info":[{"award-number":["Grant No.  NCET-09-0025"]}],"id":[{"id":"10.13039\/501100004602","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["No.4692016YFB1200102"],"award-info":[{"award-number":["No.4692016YFB1200102"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Natural Science Foundation of China (","award":["rant Nos. 91638301, 91738301 and 91438206"],"award-info":[{"award-number":["rant Nos. 91638301, 91738301 and 91438206"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Due to the global coverage and real-time access advantages of the Tracking and Data Relay Satellite System (TDRSS), the demonstration platform based on TDRSS can satisfy the new technology verification and demonstration needs of the space information network (evolution from sensorweb). However, the comprehensive evaluation research of this demonstration platform faces many problems: complicated and diverse technical indicators in various areas, coupling redundancy between indicators, difficulty in establishing the number of indicator system layers, and evaluation errors causing by subjective scoring. Concerning the difficulties, this paper gives a method to construct this special index system, and improves the consistency of evaluation results with Analytic Hierarchy Process in Group Decision-Making (AHP-GDM). A comprehensive evaluation index system including five criterions, 11 elements, more than 30 indicators is constructed according to the three-step strategy of initial set classification, hierarchical optimization, and de-redundancy. For the inconsistent scoring of AHP-GDM, a high-speed convergence consistency improvement strategy is proposed in this paper. Moreover, a method for generating a comprehensive judgment matrix (the aggregation of each judgment matrix) aggregation coefficient is provided. Numerical experiments show that this strategy effectively improves the consistency of the comprehensive judgment matrix. Finally, taking the evaluation of TDRSS development as an example, the versatility and feasibility of the new evaluation strategy are demonstrated.<\/jats:p>","DOI":"10.3390\/s20185437","type":"journal-article","created":{"date-parts":[[2020,9,22]],"date-time":"2020-09-22T09:40:56Z","timestamp":1600767656000},"page":"5437","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Comprehensive Evaluation on Space Information Network Demonstration Platform Based on Tracking and Data Relay Satellite System"],"prefix":"10.3390","volume":"20","author":[{"given":"Feng","family":"Liu","sequence":"first","affiliation":[{"name":"Department of Electronic and Information Engineering, Beihang University, Beijing 100191, China"}]},{"given":"Dingyuan","family":"Shi","sequence":"additional","affiliation":[{"name":"Department of Electronic and Information Engineering, Beihang University, Beijing 100191, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4719-0484","authenticated-orcid":false,"given":"Yunlu","family":"Xiao","sequence":"additional","affiliation":[{"name":"Department of Electronic and Information Engineering, Beihang University, Beijing 100191, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9725-0185","authenticated-orcid":false,"given":"Tao","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Electronic and Information Engineering, Beihang University, Beijing 100191, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1631-7841","authenticated-orcid":false,"given":"Jie","family":"Sun","sequence":"additional","affiliation":[{"name":"Department of Electronic and Information Engineering, Beihang University, Beijing 100191, China"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1038\/440402a","article-title":"Everything, everywhere","volume":"440","author":"Butler","year":"2006","journal-title":"Nature"},{"key":"ref_2","first-page":"708","article-title":"On \u201cInternet +\u201d Space-based Information Service","volume":"20","author":"Li","year":"2016","journal-title":"J. Remote Sens."},{"key":"ref_3","first-page":"711","article-title":"On construction of china\u2019s space information network","volume":"40","author":"Li","year":"2015","journal-title":"J. Wuhan Univ. (Nat. Sci. Ed.)"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1109\/MWC.2016.7422411","article-title":"Virtual multi-beamforming for distributed satellite clusters in space information networks","volume":"23","author":"Yu","year":"2016","journal-title":"IEEE Wirel. Commun."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"27677","DOI":"10.1109\/ACCESS.2019.2902134","article-title":"Architecture and Network Model of Time-Space Uninterrupted Space Information Network","volume":"7","author":"Qu","year":"2019","journal-title":"IEEE Access"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Sobchak, T., Shinners, D.W., and Shaw, H. (June, January 28). NASA Space Network Project Operations Management: Past, Present and Future for the Tracking and Data Relay Satellite Constellation. Proceedings of the 2018 SpaceOps Conference, Marseille, France.","DOI":"10.2514\/6.2018-2358"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"052025","DOI":"10.1088\/1742-6596\/1187\/5\/052025","article-title":"Research on the Integration Demonstration System of Space Information Network Based on TDRSS","volume":"1187","author":"Fan","year":"2018","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_8","unstructured":"Su, W. (2000). Research on the Theory and Methodology of Multi-Index Comprehensive Evaluation. [Ph.D. Thesis, Xiamen University]. (In Chinese)."},{"key":"ref_9","unstructured":"Canright, S., and Grabowski, B. (1995). Indicator Systems and Evaluation, NASA Technical Reports 19970006524."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1016\/j.rser.2016.11.168","article-title":"Comprehensive evaluation index system for wind power utilization levels in wind farms in China","volume":"69","author":"Shi","year":"2017","journal-title":"Renew. Sustain. Energy Rev."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"97401","DOI":"10.1109\/ACCESS.2019.2929235","article-title":"Research on the Search and Rescue System-of-Systems Capability Evaluation Index System Construction Method Based on Weighted Super network","volume":"7","author":"Jia","year":"2019","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Yu, H., Li, L., Zhang, Z., and Jin, M. (2019, January 15\u201317). Screening of Effectiveness Evaluation Index and Construction of Network Index System of Command and Control System. Proceedings of the 2019 IEEE 3rd Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), Chengdu, China.","DOI":"10.1109\/ITNEC.2019.8729361"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Elhady, A.M. (2014, January 1\u20138). Remote sensing satellite system overall effectiveness analysis and modeling. Proceedings of the Aerospace Conference, Big Sky, MT, USA.","DOI":"10.1109\/AERO.2014.6836497"},{"key":"ref_14","first-page":"98","article-title":"A multi-index assessment method for evaluating coverage effectiveness of remote sensing satellite","volume":"10","author":"Li","year":"2018","journal-title":"Chin. J. Aeronaut."},{"key":"ref_15","unstructured":"(2020, September 21). A Series Document of the IP Performance Metrics (IPPM)\u20146248\/7312\/7679\/7680. Available online: https:\/\/datatracker.ietf.org\/wg\/ippm\/documents\/."},{"key":"ref_16","first-page":"2","article-title":"Research on IP Network Performance Index System","volume":"23","author":"Yang","year":"2003","journal-title":"J. Commun. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Xie, T., Xie, D., Guo, C., and Gao, M. (2017, January 15\u201316). The Study on Effectiveness Evaluation Indicator System of Wireless Access System. Proceedings of the International Conference on Robots and Intelligent System-IEEE Computer Society, Huai\u2019an, China.","DOI":"10.1109\/ICRIS.2017.96"},{"key":"ref_18","first-page":"61","article-title":"Study on Performance Evaluation Method of Satellite Communication Network","volume":"3","author":"Zhang","year":"2010","journal-title":"Digit. Commun. World"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/0096-3003(87)90043-9","article-title":"Derivatives of the Perron root of a positive reciprocal matrix: With application to the analytic hierarchy process","volume":"22","author":"Harker","year":"1987","journal-title":"Appl. Math. Comput."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/S0377-2217(02)00227-8","article-title":"Decision-making with the AHP: Why is the principal eigenvector necessary","volume":"145","author":"Saaty","year":"2003","journal-title":"Eur. J. Oper. Res."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1016\/j.apm.2015.04.047","article-title":"Estimating the missing values for the incomplete decision matrix and consistency optimization in emergency management","volume":"40","author":"Ergu","year":"2016","journal-title":"Appl. Math. Model."},{"key":"ref_22","first-page":"576","article-title":"Reducing Inconsistency measured by the Geometric Consistency Index in the Analytic Hierarchy Process","volume":"288","author":"Escobar","year":"2020","journal-title":"Eur. J. Oper. Res."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Lin, C., Kou, G., Peng, Y., and Alsaadi, F.E. (2020). Aggregation of the nearest consistency matrices with the acceptable consensus in AHP-GDM. Eur. J. Oper. Res., 1\u201317.","DOI":"10.1007\/s10479-020-03572-1"},{"key":"ref_24","unstructured":"Zhang, Z. (2014). Research on Evaluation Method for Credibility of Simulation System. [Ph.D. Thesis, Harbin Institute of Technology]."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1007\/s10726-007-9072-z","article-title":"The Core of Consistency in AHP-Group Decision Making","volume":"17","author":"Escobar","year":"2008","journal-title":"Group Decis. Negot."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1007\/s10479-014-1576-8","article-title":"The precise consistency consensus matrix in a local AHP-group decision making context","volume":"245","author":"Escobar","year":"2016","journal-title":"Ann. Oper. Res."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Aguar\u00f3n, J., Escobar, M.T., Moreno-Jim\u00e9nez, J.M., and Tur\u00f3n, A. (2019). AHP-Group Decision Making Based on Consistency. Mathematics, 7.","DOI":"10.3390\/math7030242"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"147","DOI":"10.31181\/dmame1901147j","article-title":"Methods for assigning weights to decision makers in group AHP decision-making","volume":"2","year":"2019","journal-title":"Decis. Mak. Appl. Manag. Eng."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"105317","DOI":"10.1016\/j.knosys.2019.105317","article-title":"Consensus analysis for AHP multiplicative preference relations based on consistency control: A heuristic approach","volume":"191","author":"Wu","year":"2020","journal-title":"Knowl.-Based Syst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Joint Chiefs of Staff (2006). Joint Publication 3-13: Information Operations.","DOI":"10.21236\/ADA464648"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Shi, D., Liu, F., Fei, L., and Nie, K. (2018, January 25\u201329). Comprehensive Evaluation of Space Information Network Simulation System Based on GEO Satellite. Proceedings of the 2018 14th International Wireless Communications and Mobile Computing Conference (IWCMC), Limassol, Cyprus.","DOI":"10.1109\/IWCMC.2018.8450456"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1385","DOI":"10.1057\/palgrave.jors.2601471","article-title":"Characteristics of positive reciprocal matrices in the analytic hierarchy process","volume":"53","author":"Gass","year":"2002","journal-title":"J. Oper. Res. Soc."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"962","DOI":"10.1016\/j.mcm.2007.03.022","article-title":"On the invalidity of fuzzifying numerical judgments in the Analytic Hierarchy Process","volume":"46","author":"Saaty","year":"2007","journal-title":"Math. Comput. Model."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"25600","DOI":"10.1109\/ACCESS.2018.2829024","article-title":"Consistency in Positive Reciprocal Matrices: An Improvement in Measurement Methods","volume":"6","author":"Vargas","year":"2018","journal-title":"IEEE Access"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/18\/5437\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:12:29Z","timestamp":1760177549000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/18\/5437"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,22]]},"references-count":34,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["s20185437"],"URL":"https:\/\/doi.org\/10.3390\/s20185437","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,9,22]]}}}