{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T04:30:02Z","timestamp":1777696202203,"version":"3.51.4"},"reference-count":32,"publisher":"SAGE Publications","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IDA"],"published-print":{"date-parts":[[2022,7,11]]},"abstract":"<jats:p>High-dimensional multi-label data is widespread in practical applications, which brings great challenges to the research field of pattern recognition and machine learning. Many feature selection algorithms have been proposed in recent years, among which the filtering feature selection algorithm is the most popular one because of its simplicity. Therefore, filtering feature selection has become a hot research topic, especially the multi-label feature selection algorithm based on mutual information. In the algorithm, the computation cost of high dimensional mutual information is expensive. How to approximate high order mutual information based on low order mutual information has become a major research direction. To our best knowledge, all existing feature selection algorithms that consider the label correlation will increase the computational cost greatly. Therefore, this paper proposes an approximation method of three-dimensional interaction information, which is applied to the calculation of correlation and redundancy. It can take the correlation of labels into account and don\u2019t increase the computation cost significantly at the same time. Experiments analysis results show that the proposed method is effective.<\/jats:p>","DOI":"10.3233\/ida-215985","type":"journal-article","created":{"date-parts":[[2022,7,12]],"date-time":"2022-07-12T11:43:00Z","timestamp":1657626180000},"page":"823-840","source":"Crossref","is-referenced-by-count":6,"title":["A multi-label feature selection method based on an approximation of interaction information"],"prefix":"10.1177","volume":"26","author":[{"given":"Minlan","family":"Pan","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhanquan","family":"Sun","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chaoli","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gaoyu","family":"Cao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"issue":"2","key":"10.3233\/IDA-215985_ref1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/widm.1240","article-title":"Multilabel feature selection: A comprehensive review and guiding experiments","volume":"8","author":"Kashef","year":"2018","journal-title":"Wiley Interdisciplinary Reviews-Data Mining and Knowledge Discovery"},{"key":"10.3233\/IDA-215985_ref2","first-page":"361","article-title":"RCV1: A new benchmark collection for text categorization research","volume":"5","author":"Lewis","year":"2004","journal-title":"Journal of Machine Learning Research"},{"issue":"9","key":"10.3233\/IDA-215985_ref3","doi-asserted-by":"crossref","first-page":"1757","DOI":"10.1016\/j.patcog.2004.03.009","article-title":"Learning multi-label scene classification","volume":"37","author":"Boutell","year":"2004","journal-title":"Pattern Recognition"},{"key":"10.3233\/IDA-215985_ref4","doi-asserted-by":"crossref","unstructured":"A. Elisseeff and J. Weston, A kernel method for multi-labelled classification, in: International Conference on Neural Information Processing Systems: Naturaland Synthetic, 2002, pp. 681\u2013687.","DOI":"10.7551\/mitpress\/1120.003.0092"},{"key":"10.3233\/IDA-215985_ref5","doi-asserted-by":"crossref","unstructured":"D. Turnbull, L. Barrington, D. Torres and G. Lanckriet, Semantic annotation and retrieval of music and sound effects, IEEE Transactions on Audio, Speech and Language Processing 16(2) (2008), 467\u2013476.","DOI":"10.1109\/TASL.2007.913750"},{"issue":"C","key":"10.3233\/IDA-215985_ref6","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.neucom.2015.07.118","article-title":"A systematic review of multi-label feature selection and a new method based on label construction","volume":"180","author":"Spola\u00f4r","year":"2016","journal-title":"Neurocomputing"},{"key":"10.3233\/IDA-215985_ref7","doi-asserted-by":"crossref","first-page":"105285","DOI":"10.1016\/j.knosys.2019.105285","article-title":"MLACO: A multi-label feature selection algorithm based on ant colony optimization","volume":"192","author":"Paniri","year":"2020","journal-title":"Knowledge-Based Systems"},{"issue":"15","key":"10.3233\/IDA-215985_ref8","doi-asserted-by":"crossref","first-page":"929","DOI":"10.1049\/el.2012.1600","article-title":"Approximating mutual information for multi-label feature selection","volume":"48","author":"Lee","year":"2012","journal-title":"Electronics Letters"},{"key":"10.3233\/IDA-215985_ref9","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/j.neucom.2015.06.010","article-title":"Multi-label feature selection based on max-dependency and min-redundancy","volume":"168","author":"Lin","year":"2015","journal-title":"Neurocomputing"},{"issue":"7","key":"10.3233\/IDA-215985_ref10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3390\/e22070797","article-title":"Multi-label feature selection based on high-order label correlation assumption","volume":"22","author":"Zhang","year":"2020","journal-title":"Entropy"},{"key":"10.3233\/IDA-215985_ref11","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1016\/j.patcog.2017.01.014","article-title":"SCLS: Multi-label feature selection based on scalable criterion for large label set","volume":"66","author":"Lee","year":"2017","journal-title":"Pattern Recognition"},{"issue":"3","key":"10.3233\/IDA-215985_ref12","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1016\/j.patrec.2012.10.005","article-title":"Feature selection for multi-label classification using multivariate mutual information","volume":"34","author":"Lee","year":"2013","journal-title":"Pattern Recognition Letters"},{"issue":"4","key":"10.3233\/IDA-215985_ref13","doi-asserted-by":"crossref","first-page":"2013","DOI":"10.1016\/j.eswa.2014.09.063","article-title":"Mutual Information-based multi-label feature selection using interaction information","volume":"42","author":"Lee","year":"2015","journal-title":"Expert Systems with Applications"},{"key":"10.3233\/IDA-215985_ref14","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1016\/j.neucom.2015.02.045","article-title":"Scalable extensions of the ReliefF algorithm for weighting and selecting features on the multi-label learning context","volume":"161","author":"Reyes","year":"2015","journal-title":"Neurocomputing"},{"key":"10.3233\/IDA-215985_ref15","doi-asserted-by":"crossref","unstructured":"S. Kashef, H. Nezamabadi-pour and B. Nikpour, FCBF3Rules: A Feature Selection Method for Multi-Label Datasets, in: 2018 3rd Conference on Swarm Intelligence and Evolutionary Computation (CSIEC), 2018, pp. 1\u20135.","DOI":"10.1109\/CSIEC.2018.8405419"},{"key":"10.3233\/IDA-215985_ref16","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.patcog.2019.06.004","article-title":"Distinguishing two types of labels for multi-label feature selection","volume":"95","author":"Zhang","year":"2019","journal-title":"Pattern Recognition"},{"issue":"4","key":"10.3233\/IDA-215985_ref17","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1002\/j.1538-7305.1948.tb00917.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell System Technical Journal"},{"issue":"8","key":"10.3233\/IDA-215985_ref18","doi-asserted-by":"crossref","first-page":"1819","DOI":"10.1109\/TKDE.2013.39","article-title":"A review on multi-label learning algorithms","volume":"26","author":"Zhang","year":"2014","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"issue":"7","key":"10.3233\/IDA-215985_ref19","doi-asserted-by":"crossref","first-page":"2038","DOI":"10.1016\/j.patcog.2006.12.019","article-title":"ML-KNN: A lazy learning approach to multi-label learning","volume":"40","author":"Zhang","year":"2007","journal-title":"Pattern Recognition"},{"issue":"2","key":"10.3233\/IDA-215985_ref20","first-page":"424","article-title":"Learning instance correlation functions for multilabel classification","volume":"1","author":"Wang","year":"2018","journal-title":"IEEE Transactions on Cybernetics"},{"key":"10.3233\/IDA-215985_ref21","doi-asserted-by":"crossref","unstructured":"J. Read, B. Pfahringer, G. Holmes and E. Frank, Classifier chains for multi-label classification, in: Proceedings of The European Conference on Machine Learning, 2009, pp. 254\u2013269.","DOI":"10.1007\/978-3-642-04174-7_17"},{"key":"10.3233\/IDA-215985_ref22","doi-asserted-by":"crossref","unstructured":"J. Read, B. Pfahringer and G. Holmes, Multi-label classification using ensembles of pruned sets, in: Proceedings of IEEE International Conference on Data Mining, 2008, pp. 995\u20131000.","DOI":"10.1109\/ICDM.2008.74"},{"issue":"19","key":"10.3233\/IDA-215985_ref23","doi-asserted-by":"crossref","first-page":"3218","DOI":"10.1016\/j.ins.2009.06.010","article-title":"Feature selection for multi-label naive Bayes classification","volume":"179","author":"Zhang","year":"2009","journal-title":"Information Sciences"},{"issue":"1","key":"10.3233\/IDA-215985_ref24","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1109\/TPAMI.2014.2339815","article-title":"LIFT: Multi-label learning with label-specific features","volume":"37","author":"Zhang","year":"2015","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"4","key":"10.3233\/IDA-215985_ref25","doi-asserted-by":"crossref","first-page":"1021","DOI":"10.1109\/TMM.2012.2187179","article-title":"Web image annotation via subspace-sparsity collaborated feature selection","volume":"14","author":"Ma","year":"2012","journal-title":"IEEE Transactions on Multimedia"},{"key":"10.3233\/IDA-215985_ref26","unstructured":"L. Jian, J. Li, K. Shu and H. Liu, Multi-label informed feature selection, in: IJCAI International Joint Conference on Artificial Intelligence, 2016, pp. 1627\u20131633."},{"issue":"3","key":"10.3233\/IDA-215985_ref27","doi-asserted-by":"crossref","first-page":"876","DOI":"10.1109\/TCYB.2017.2663838","article-title":"Joint feature selection and classification for multilabel learning","volume":"48","author":"Huang","year":"2018","journal-title":"IEEE Transactions on Cybernetics"},{"issue":"1","key":"10.3233\/IDA-215985_ref28","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/0097-3165(86)90019-1","article-title":"Some intersection theorems for ordered sets and graphs","volume":"43","author":"Chung","year":"1986","journal-title":"Journal of Combinatorial Theory, Series A"},{"issue":"8","key":"10.3233\/IDA-215985_ref29","doi-asserted-by":"crossref","first-page":"1226","DOI":"10.1109\/TPAMI.2005.159","article-title":"Feature selection based on mutual information: Criteria of max-dependency, max-relevance, and min-redundancy","volume":"27","author":"Hanchuan Peng","year":"2005","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"10.3233\/IDA-215985_ref30","doi-asserted-by":"crossref","first-page":"122854","DOI":"10.1109\/ACCESS.2019.2927400","article-title":"Generalized information-theoretic criterion for multi-label feature selection","volume":"7","author":"Seo","year":"2019","journal-title":"IEEE Access"},{"issue":"1","key":"10.3233\/IDA-215985_ref31","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1109\/72.977291","article-title":"Input feature selection for classification problems","volume":"13","author":"Kwak","year":"2002","journal-title":"IEEE Transactions on Neural Networks"},{"key":"10.3233\/IDA-215985_ref32","first-page":"2411","article-title":"MULAN: A Java library for multi-label learning","volume":"12","author":"Tsoumakas","year":"2011","journal-title":"Journal of Machine Learning Research"}],"container-title":["Intelligent Data Analysis"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/IDA-215985","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:19:32Z","timestamp":1777454372000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/IDA-215985"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,11]]},"references-count":32,"journal-issue":{"issue":"4"},"URL":"https:\/\/doi.org\/10.3233\/ida-215985","relation":{},"ISSN":["1088-467X","1571-4128"],"issn-type":[{"value":"1088-467X","type":"print"},{"value":"1571-4128","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,11]]}}}