{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,15]],"date-time":"2026-06-15T01:25:22Z","timestamp":1781486722436,"version":"3.54.1"},"reference-count":51,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2020,10,10]],"date-time":"2020-10-10T00:00:00Z","timestamp":1602288000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Science Foundation of China","doi-asserted-by":"publisher","award":["61302157"],"award-info":[{"award-number":["61302157"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Science Foundation of China","doi-asserted-by":"publisher","award":["61363075"],"award-info":[{"award-number":["61363075"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Multi-label classification (MLC) is a supervised learning problem where an object is naturally associated with multiple concepts because it can be described from various dimensions. How to exploit the resulting label correlations is the key issue in MLC problems. The classifier chain (CC) is a well-known MLC approach that can learn complex coupling relationships between labels. CC suffers from two obvious drawbacks: (1) label ordering is decided at random although it usually has a strong effect on predictive performance; (2) all the labels are inserted into the chain, although some of them may carry irrelevant information that discriminates against the others. In this work, we propose a partial classifier chain method with feature selection (PCC-FS) that exploits the label correlation between label and feature spaces and thus solves the two previously mentioned problems simultaneously. In the PCC-FS algorithm, feature selection is performed by learning the covariance between feature set and label set, thus eliminating the irrelevant features that can diminish classification performance. Couplings in the label set are extracted, and the coupled labels of each label are inserted simultaneously into the chain structure to execute the training and prediction activities. The experimental results from five metrics demonstrate that, in comparison to eight state-of-the-art MLC algorithms, the proposed method is a significant improvement on existing multi-label classification.<\/jats:p>","DOI":"10.3390\/e22101143","type":"journal-article","created":{"date-parts":[[2020,10,12]],"date-time":"2020-10-12T10:18:00Z","timestamp":1602497880000},"page":"1143","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Partial Classifier Chains with Feature Selection by Exploiting Label Correlation in Multi-Label Classification"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8620-4623","authenticated-orcid":false,"given":"Zhenwu","family":"Wang","sequence":"first","affiliation":[{"name":"Department of Computer Science and Technology, China University of Mining and Technology, Beijing 100083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tielin","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, China University of Mining and Technology, Beijing 100083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benting","family":"Wan","sequence":"additional","affiliation":[{"name":"School of Software and IoT Engineering, Jiangxi University of Finance &amp; Economics, Nanchang 330013, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4212-8582","authenticated-orcid":false,"given":"Mengjie","family":"Han","sequence":"additional","affiliation":[{"name":"School of Technology and Business Studies, Dalarna University, 79188 Falun, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,10,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1023\/A:1007649029923","article-title":"BoosTexter: A Boosting-based System for Text Categorization","volume":"39","author":"Schapire","year":"2000","journal-title":"Mach. Learn."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"5431","DOI":"10.1016\/j.eswa.2014.02.017","article-title":"Efficient classification of multi-labeled text streams by clashing","volume":"41","author":"Flaounas","year":"2014","journal-title":"Expert Syst. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.knosys.2018.02.028","article-title":"Community aware random walk for network embedding","volume":"148","author":"Keikha","year":"2018","journal-title":"Knowl. Based Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"717","DOI":"10.3233\/IDA-140665","article-title":"Hierarchical multi-label classification with SVMs: A case study in gene function prediction","volume":"18","author":"Vateekul","year":"2014","journal-title":"Intell. Data Anal."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1631","DOI":"10.1109\/TCSVT.2018.2848458","article-title":"Implicit and Explicit Concept Relations in Deep Neural Networks for Multi-Label Video\/Image Annotation","volume":"29","author":"Markatopoulou","year":"2019","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Czach\u00f3rski, T., Gelenbe, E., and Lent, R. (2014). A Graphical Model Approach for Multi-Label Classification. Information Sciences and Systems 2014, Proceedings of the 29th International Symposium on Computer and Information Sciences, Krakow, Poland, 27\u201328 October 2014, Springer.","DOI":"10.1007\/978-3-319-09465-6"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1819","DOI":"10.1109\/TKDE.2013.39","article-title":"A Review on Multi-Label Learning Algorithms","volume":"26","author":"Zhang","year":"2013","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1109\/TNNLS.2014.2325872","article-title":"Coupled Attribute Similarity Learning on Categorical Data","volume":"26","author":"Wang","year":"2014","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Wang, C., Cao, L., Wang, M., Li, J., Wei, W., and Ou, Y. (2011, January 24). Coupled nominal similarity in unsupervised learning. Proceedings of the 20th ACM international conference on Multimedia\u2014MM\u201912, Glasgow, Scotland.","DOI":"10.1145\/2063576.2063715"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3230967","article-title":"Coupled Clustering Ensemble by Exploring Data Interdependence","volume":"12","author":"Wang","year":"2018","journal-title":"ACM Trans. Knowl. Discov. Data"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Pang, G., Cao, L., Chen, L., and Liu, H. (2016, January 12\u201315). Unsupervised Feature Selection for Outlier Detection by Modelling Hierarchical Value-Feature Couplings. Proceedings of the 2016 IEEE 16th International Conference on Data Mining (ICDM); Institute of Electrical and Electronics Engineers, Barcelona, Spain.","DOI":"10.1109\/ICDM.2016.0052"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/MIS.2014.60","article-title":"Behavior Informatics: A New Perspective","volume":"29","author":"Cao","year":"2014","journal-title":"IEEE Intell. Syst."},{"key":"ref_13","first-page":"254","article-title":"Classifier Chains for Multi-label Classification","volume":"Volume 85","author":"Buntine","year":"2009","journal-title":"Machine Learning and Knowledge Discovery in Databases"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Senge, R., Del Coz, J.J., and H\u00fcllermeier, E. (2013). On the Problem of Error Propagation in Classifier Chains for Multi-label Classification. Data Analysis, Machine Learning and Knowledge Discovery, Proceedings of the 36th Annual Conference of the German Classification Society, Hildesheim, Germany, 1\u20133 August 2012, Springer.","DOI":"10.1007\/978-3-319-01595-8_18"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1007\/s10462-016-9516-4","article-title":"Categorizing feature selection methods for multi-label classification","volume":"49","author":"Pereira","year":"2016","journal-title":"Artif. Intell. Rev."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/widm.1240","article-title":"Multilabel feature selection: A comprehensive review and guiding experiments","volume":"8","author":"Kashef","year":"2018","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Li, Y., and Cheng, Y. (2019). Streaming Feature Selection for Multi-Label Data with Dynamic Sliding Windows and Feature Repulsion Loss. Entropy, 21.","DOI":"10.3390\/e21121151"},{"key":"ref_18","unstructured":"Gustafsson, R. (2017). Ordering Classifier Chains Using Filter Model Feature Selection Techniques. [Master\u2019s Thesis, Blekinge Institute of Technology]."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1007\/s10994-011-5256-5","article-title":"Classifier chains for multi-label classification","volume":"85","author":"Read","year":"2011","journal-title":"Mach. Learn."},{"key":"ref_20","first-page":"725","article-title":"A classifier chain method for multi-label learning based on kernel alignment","volume":"54","author":"Chen","year":"2018","journal-title":"J. Nanjing Univ. Nat. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Read, J., Martino, L., and Luengo, D. (2013, January 26\u201331). Efficient Monte Carlo optimization for multi-label classifier chains. Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, Vancouver, BC, Canada.","DOI":"10.1109\/ICASSP.2013.6638300"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Goncalves, E.C., Plastino, A., and Freitas, A.A. (2013, January 4\u20136). A Genetic Algorithm for Optimizing the Label Ordering in Multi-label Classifier Chains. Proceedings of the 2013 IEEE 25th International Conference on Tools with Artificial Intelligence, Herndon, VA, USA.","DOI":"10.1109\/ICTAI.2013.76"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Gon\u00e7alves, E.C., Plastion, A., and Freitas, A.A. (2015, January 11\u201315). Simpler is Better: A Novel Genetic Algorithm to Induce Compact Multi-Label Chain Classifiers. Proceedings of the 17th Genetic and Evolutionary Computation Conference (GECCO), Madrid, Spain.","DOI":"10.1145\/2739480.2754650"},{"key":"ref_24","first-page":"567","article-title":"Classifier Chain Algorithm Based on Multi-label Importance Rank","volume":"29","author":"Li","year":"2016","journal-title":"PR AI"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.patrec.2013.11.007","article-title":"Multi-label classification with Bayesian network-based chain classifiers","volume":"41","author":"Sucar","year":"2014","journal-title":"Pattern Recognit. Lett."},{"key":"ref_26","first-page":"189","article-title":"Ensemble multi-label classification algorithm based on tree-Bayesian network","volume":"45","author":"Zhang","year":"2018","journal-title":"Comput. Sci."},{"key":"ref_27","first-page":"573","article-title":"A Multi-label classification method based on tree structure of label dependency","volume":"25","author":"Fu","year":"2012","journal-title":"PR AI"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.ins.2016.02.037","article-title":"An approach for multi-label classification by directed acyclic graph with label correlation maximization","volume":"351","author":"Lee","year":"2016","journal-title":"Inf. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1016\/j.ijar.2015.06.006","article-title":"Decision functions for chain classifiers based on Bayesian networks for multi-label classification","volume":"68","author":"Varando","year":"2016","journal-title":"Int. J. Approx. Reason."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Chen, B., Li, W., Zhang, Y., and Hu, J. (2016, January 24\u201329). Enhancing multi-label classification based on local label constraints and classifier chains. Proceedings of the 2016 International Joint Conference on Neural Networks (IJCNN), Vancouver, BC, Canada.","DOI":"10.1109\/IJCNN.2016.7727370"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"972","DOI":"10.1126\/science.1136800","article-title":"Clustering by Passing Messages Between Data Points","volume":"315","author":"Frey","year":"2007","journal-title":"Science"},{"key":"ref_32","unstructured":"Huang, J., Li, G., Wang, S., Zhang, W., and Huang, Q. (July, January 29). Group sensitive Classifier Chains for multi-label classification. Proceedings of the IEEE International Conference on Multimedia and Expo (ICME), Turin, Italy."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1029","DOI":"10.1007\/s10044-018-0711-6","article-title":"Multi-label classification by polytree-augmented classifier chains with label-dependent features","volume":"22","author":"Sun","year":"2018","journal-title":"Pattern Anal. Appl."},{"key":"ref_34","first-page":"665","article-title":"Learning and Inference in Probabilistic Classifier Chains with Beam Search","volume":"Volume 7523","author":"Flach","year":"2012","journal-title":"Machine Learning and Knowledge Discovery in Databases"},{"key":"ref_35","unstructured":"Dembczy\u0144ski, K., Cheng, W., and H\u00fcllermeier, E. (2010, January 21\u201324). Bayes optimal multilabel classification via probabilistic classifier chains. Proceedings of the 27th International Conference on Machine Learning, Haifa, Israel."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2096","DOI":"10.1016\/j.patcog.2015.01.004","article-title":"Scalable multi-output label prediction: From classifier chains to classifier trellises","volume":"48","author":"Read","year":"2015","journal-title":"Pattern Recognit."},{"key":"ref_37","first-page":"2811","article-title":"Classifier Circle Method for Multi-Label Learning","volume":"26","author":"Wang","year":"2015","journal-title":"J. Softw."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/j.neucom.2019.01.039","article-title":"Conditional entropy based classifier chains for multi-label classification","volume":"335","author":"Jun","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.neucom.2017.01.004","article-title":"CCnet: Joint multi-label classification and feature selection using classifier chains and elastic net regularization","volume":"235","author":"Teisseyre","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1016\/j.patcog.2018.09.012","article-title":"Cost-sensitive classifier chains: Selecting low-cost features in multi-label classification","volume":"86","author":"Teisseyre","year":"2019","journal-title":"Pattern Recognit."},{"key":"ref_41","unstructured":"Tsoumakas, G., Katakis, I., and Vlahavas, I. (2008). Effective and Efficient Multilabel Classification in Domains with Large Number of Labels. ECML\/PKDD 2008 Workshop on Mining Multidimensional Data (MMD\u201908), Springer."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Read, J., Pfahringer, B., and Holmes, G. (2008, January 15\u201319). Multi-label Classification Using Ensembles of Pruned Sets. Proceedings of the 2008 Eighth IEEE International Conference on Data Mining, Pisa, Italy.","DOI":"10.1109\/ICDM.2008.74"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1079","DOI":"10.1109\/TKDE.2010.164","article-title":"Random k-Labelsets for Multilabel Classification","volume":"23","author":"Tsoumakas","year":"2010","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Elisseeff, A., and Weston, J. (2001, January 3\u20138). A kernel method for multi-labelled classification. Proceedings of the 14th International Conference on Neural Information Processing Systems: Natural and Synthetic (NIPS), Vancouver, BC, Canada.","DOI":"10.7551\/mitpress\/1120.003.0092"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1338","DOI":"10.1109\/TKDE.2006.162","article-title":"Multi-label neural networks with applications to functional genomics and text categorization","volume":"18","author":"Zhang","year":"2006","journal-title":"IEEE T. Knowl. Data En."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"3309","DOI":"10.1109\/TKDE.2016.2608339","article-title":"Learning Label-Specific Features and Class-Dependent Labels for Multi-Label Classification","volume":"28","author":"Huang","year":"2016","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.trac.2009.09.009","article-title":"Sum of ranking differences compares methods or models fairly","volume":"29","year":"2010","journal-title":"TrAC Trends Anal. Chem."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/j.chemolab.2013.06.007","article-title":"Method and model comparison by sum of ranking differences in cases of repeated observations (ties)","volume":"127","year":"2013","journal-title":"Chemom. Intell. Lab. Syst."},{"key":"ref_49","first-page":"1","article-title":"Post-Pareto Optimality Analysis with Sum of Ranking Differences","volume":"54","author":"Lebensztajn","year":"2018","journal-title":"IEEE Trans. Magn."},{"key":"ref_50","first-page":"1","article-title":"Statistical comparisons of classifiers over multiple data sets","volume":"7","author":"Demsar","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"R\u00e1cz, A., Bajusz, D., and H\u00e9berger, K. (2019). Multi-Level Comparison of Machine Learning Classifiers and Their Performance Metrics. Molecules, 24.","DOI":"10.3390\/molecules24152811"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/10\/1143\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:19:10Z","timestamp":1760177950000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/10\/1143"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,10]]},"references-count":51,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2020,10]]}},"alternative-id":["e22101143"],"URL":"https:\/\/doi.org\/10.3390\/e22101143","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,10]]}}}