{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:27:30Z","timestamp":1760232450132,"version":"build-2065373602"},"reference-count":34,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2022,11,8]],"date-time":"2022-11-08T00:00:00Z","timestamp":1667865600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U21B2008","D030312","2018YFA0703800"],"award-info":[{"award-number":["U21B2008","D030312","2018YFA0703800"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Civil Aerospace Research Project of China","award":["U21B2008","D030312","2018YFA0703800"],"award-info":[{"award-number":["U21B2008","D030312","2018YFA0703800"]}]},{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["U21B2008","D030312","2018YFA0703800"],"award-info":[{"award-number":["U21B2008","D030312","2018YFA0703800"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Aiming at multiple quantities and types of targets, multi-class multi-target tracking usually faces not only cardinality errors, but also mis-classification problems. Considering its performance evaluation, the traditional optimal subpattern assignment (OSPA) method tends to calculate a separate metric for each class of targets, or introduce other indexes such as the classification error rate, which decreases the value of OSPA as a comprehensive single metric. This paper proposed a hierarchical multi-level class label for multi-class multi-target tracking under hierarchical multilevel classification, which can synthetically measure the state errors, cardinality error, and mis-classification. The hierarchical multi-level class label is introduced as an attached label to finite sets based on the hierarchical tree-structured categorization. A Wasserstein distance type metric then can be defined among the distribution represented by any two labels. The proposed label metric is a mathematic metric, and its advantages are illustrated by examples in several cases.<\/jats:p>","DOI":"10.3390\/s22228613","type":"journal-article","created":{"date-parts":[[2022,11,8]],"date-time":"2022-11-08T10:55:32Z","timestamp":1667904932000},"page":"8613","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Label Metric for Multi-Class Multi-Target Tracking under Hierarchical Multilevel Classification"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9229-9449","authenticated-orcid":false,"given":"Jingdong","family":"Diao","sequence":"first","affiliation":[{"name":"Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology, Beijing 100094, China"}]},{"given":"Qingrui","family":"Zhou","sequence":"additional","affiliation":[{"name":"Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology, Beijing 100094, China"}]},{"given":"Hui","family":"Wang","sequence":"additional","affiliation":[{"name":"Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology, Beijing 100094, China"}]},{"given":"Ying","family":"Yang","sequence":"additional","affiliation":[{"name":"Qian Xuesen Laboratory of Space Technology, China Academy of Space Technology, Beijing 100094, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,11,8]]},"reference":[{"key":"ref_1","unstructured":"Rezatofighi, H., Nguyen, T.T.D., Vo, B.N., Vo, B.T., Savarese, S., and Reid, I. (2020). How trustworthy are the existing performance evaluations for basic vision tasks?. arXiv."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Crouse, D.F., Willett, P., Guerriero, M., and Svensson, L. (2011, January 22\u201327). An approximate minimum MOSPA estimator. Proceedings of the International Conference on Acoustics, Speech and Signal Processing, Prague, Czech Republic.","DOI":"10.1109\/ICASSP.2011.5947140"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"6366","DOI":"10.1109\/TSP.2014.2364013","article-title":"Bayesian sequential track formation","volume":"62","author":"Morelande","year":"2014","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1109\/TSP.2014.2370946","article-title":"An efficient, variational approximation of the best fitting multi-Bernoulli filter","volume":"63","author":"Williams","year":"2014","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1511","DOI":"10.1109\/LSP.2015.2410217","article-title":"On Wasserstein barycenters and MMOSPA estimation","volume":"22","author":"Baum","year":"2015","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1109\/TSMCA.2004.824848","article-title":"Multitarget miss distance via optimal assignment","volume":"34","author":"Hoffman","year":"2004","journal-title":"IEEE Trans. Syst. Man, Cybern.\u2014Part A Syst. Humans"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Garc\u00eda-Fern\u00e1ndez, \u00c1.F., Hernandez, M., and Maskell, S. (2021, January 1\u20134). An analysis on metric-driven multi-target sensor management: GOSPA versus OSPA. Proceedings of the 24th International Conference on Information Fusion, Sun City, South Africa.","DOI":"10.23919\/FUSION49465.2021.9626837"},{"key":"ref_8","unstructured":"Yianilos, P.N. (1993, January 25\u201327). Data structures and algorithms for nearest neighbor search in general metric spaces. Proceedings of the 4th Annual ACM-SIAM Symposium on Discrete Algorithms, Austin, TX, USA."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ganti, V., Ramakrishnan, R., Gehrke, J., Powell, A., and French, J. (1999, January 23\u201326). Clustering large datasets in arbitrary metric spaces. Proceedings of the 15th International Conference on Data Engineering, Sydney, Australia.","DOI":"10.1109\/ICDE.1999.754966"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"616","DOI":"10.1145\/585265.585268","article-title":"Approximation algorithms for classification problems with pairwise relationships: Metric labeling and Markov random fields","volume":"49","author":"Kleinberg","year":"2002","journal-title":"J. ACM"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3447","DOI":"10.1109\/TSP.2008.920469","article-title":"A consistent metric for performance evaluation of multi-object filters","volume":"56","author":"Schuhmacher","year":"2008","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Rahmathullah, A.S., Garc\u00eda-Fern\u00e1ndez, \u00c1.F., and Svensson, L. (2017, January 10\u201313). Generalized optimal sub-pattern assignment metric. Proceedings of the 20th International Conference on Information Fusion, Xi\u2019an, China.","DOI":"10.23919\/ICIF.2017.8009645"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"246309","DOI":"10.1155\/2008\/246309","article-title":"Evaluating multiple object tracking performance: The CLEAR MOT metrics","volume":"2008","author":"Bernardin","year":"2008","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"548","DOI":"10.1007\/s11263-020-01375-2","article-title":"HOTA: A higher order metric for evaluating multi-object tracking","volume":"129","author":"Luiten","year":"2021","journal-title":"Int. J. Comput. Vis."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1689","DOI":"10.1109\/LSP.2021.3103488","article-title":"An uncertainty-aware performance measure for multi-object tracking","volume":"28","author":"Pinto","year":"2021","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Vu, T. (2020, January 6\u20139). A complete optimal subpattern assignment (COSPA) metric. Proceedings of the 23rd International Conference on Information Fusion, Rustenburg, South Africa.","DOI":"10.23919\/FUSION45008.2020.9190582"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Garc\u00eda-Fem\u00e1ndez, \u00c1.F., and Svensson, L. (2019, January 2\u20135). Spooky effect in optimal OSPA estimation and how GOSPA solves it. Proceedings of the 22th International Conference on Information Fusion, Ottawa, ON, Canada.","DOI":"10.23919\/FUSION43075.2019.9011259"},{"key":"ref_18","unstructured":"Nagappa, S., Clark, D.E., and Mahler, R. (2011, January 5\u20138). Incorporating track uncertainty into the OSPA metric. Proceedings of the 14th International Conference on Information Fusion, Chicago, IL, USA."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1109\/TAES.2013.6404124","article-title":"A track quality based metric for evaluating performance of multitarget filters","volume":"49","author":"He","year":"2013","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Legrand, L., Giremus, A., Grivel, \u00c9., Ratton, L., and Joseph, B. (2018, January 15\u201320). Generative model and associated metric for coordinated-motion target groups. Proceedings of the International Conference on Acoustics, Speech and Signal Processing, Calgary, AB, Canada.","DOI":"10.1109\/ICASSP.2018.8461851"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3452","DOI":"10.1109\/TSP.2011.2140111","article-title":"A metric for performance evaluation of multi-target tracking algorithms","volume":"59","author":"Ristic","year":"2011","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_22","unstructured":"Vu, T., and Evans, R. (2014, January 7\u201310). A new performance metric for multiple target tracking based on optimal subpattern assignment. Proceedings of the 17th International Conference on Information Fusion, Salamanca, Spain."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2754","DOI":"10.1109\/TSP.2020.2986136","article-title":"A solution for large-scale multi-object tracking","volume":"68","author":"Beard","year":"2020","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3917","DOI":"10.1109\/TSP.2020.3005309","article-title":"A metric on the space of finite sets of trajectories for evaluation of multi-target tracking algorithms","volume":"68","author":"Rahmathullah","year":"2020","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1109\/TRO.2016.2627027","article-title":"Metrics for evaluating feature-based mapping performance","volume":"33","author":"Barrios","year":"2016","journal-title":"IEEE Trans. Robot."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Magnant, C., Kemkemian, S., and Zimmer, L. (2018, January 23\u201327). Joint tracking and classification for extended targets in maritime surveillance. Proceedings of the IEEE Radar Conference, Oklahoma City, OK, USA.","DOI":"10.1109\/RADAR.2018.8378718"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Wei, S., Zhang, B., and Yi, W. (2021, January 1\u20134). Multi-target joint tracking and classification using the trajectory PHD filter. Proceedings of the 24th International Conference on Information Fusion, Sun City, South Africa.","DOI":"10.23919\/FUSION49465.2021.9626914"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1149","DOI":"10.1109\/TSMC.2019.2895870","article-title":"Performance evaluation of joint tracking and classification","volume":"51","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Syst. Man, Cybern. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Mahler, R.P.S. (2007). Statistical Multisource-Multitarget Information Fusion, Artech House.","DOI":"10.1201\/9781420053098.ch16"},{"key":"ref_30","unstructured":"Hugh, D.G., Christopher, B., and David, A. (2014). Stimson\u2019s Introduction to Airborne Radar, SciTech Publishing."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wu, F., Zhang, J., and Honavar, V. (2005, January 26\u201329). Learning classifiers using hierarchically structured class taxonomies. Proceedings of the International Symposium on Abstraction, Reformulation, and Approximation, Airth Castle, UK.","DOI":"10.1007\/11527862_24"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1007\/s10618-010-0175-9","article-title":"A survey of hierarchical classification across different application domains","volume":"22","author":"Silla","year":"2011","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"6622","DOI":"10.1007\/s10489-020-02103-6","article-title":"Learn class hierarchy using convolutional neural networks","volume":"51","author":"Gallo","year":"2021","journal-title":"Appl. Intell."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Peyr\u00e9, G., and Cuturi, M. (2018). Computational Optimal Transport. arXiv.","DOI":"10.1561\/9781680835519"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/22\/8613\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:12:39Z","timestamp":1760145159000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/22\/8613"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,8]]},"references-count":34,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2022,11]]}},"alternative-id":["s22228613"],"URL":"https:\/\/doi.org\/10.3390\/s22228613","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,11,8]]}}}