{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:32:56Z","timestamp":1760149976739,"version":"build-2065373602"},"reference-count":24,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T00:00:00Z","timestamp":1695859200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Feature selection is crucial in classification tasks as it helps to extract relevant information while reducing redundancy. This paper presents a novel method that considers both instance and label correlation. By employing the least squares method, we calculate the linear relationship between each feature and the target variable, resulting in correlation coefficients. Features with high correlation coefficients are selected. Compared to traditional methods, our approach offers two advantages. Firstly, it effectively selects features highly correlated with the target variable from a large feature set, reducing data dimensionality and improving analysis and modeling efficiency. Secondly, our method considers label correlation between features, enhancing the accuracy of selected features and subsequent model performance. Experimental results on three datasets demonstrate the effectiveness of our method in selecting features with high correlation coefficients, leading to superior model performance. Notably, our approach achieves a minimum accuracy improvement of 3.2% for the advanced classifier, lightGBM, surpassing other feature selection methods. In summary, our proposed method, based on instance and label correlation, presents a suitable solution for classification problems.<\/jats:p>","DOI":"10.3390\/info14100532","type":"journal-article","created":{"date-parts":[[2023,9,29]],"date-time":"2023-09-29T05:48:13Z","timestamp":1695966493000},"page":"532","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["An Instance- and Label-Based Feature Selection Method in Classification Tasks"],"prefix":"10.3390","volume":"14","author":[{"given":"Qingcheng","family":"Fan","sequence":"first","affiliation":[{"name":"College of Information Engineering, Northwest A&F University, 3 Taicheng Road, Yangling, Xianyang 712100, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sicong","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Information Engineering, Northwest A&F University, 3 Taicheng Road, Yangling, Xianyang 712100, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chunjiang","family":"Zhao","sequence":"additional","affiliation":[{"name":"College of Information Engineering, Northwest A&F University, 3 Taicheng Road, Yangling, Xianyang 712100, China"},{"name":"Research Center of Information Technology, Beijing Academy of Agriculture and Forestry Sciences, Beijing 100097, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shuqin","family":"Li","sequence":"additional","affiliation":[{"name":"College of Information Engineering, Northwest A&F University, 3 Taicheng Road, Yangling, Xianyang 712100, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Sidey-Gibbons, J.A.M., and Sidey-Gibbons, C.J. (2019). Machine learning in medicine: A practical introduction. BMC Med. Res. Methodol., 19.","DOI":"10.1186\/s12874-019-0681-4"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"106157","DOI":"10.1016\/j.atmosres.2022.106157","article-title":"Machine learning regression and classification methods for fog events prediction","volume":"272","author":"Ghimire","year":"2022","journal-title":"Atmos. Res."},{"key":"ref_3","unstructured":"Shlens, J. (2014). A Tutorial on Principal Component Analysis. arXiv."},{"key":"ref_4","unstructured":"Meesad, P., Boonrawd, P., and Nuipian, V. (2011, January 28\u201329). A Chi-Square-Test for Word Importance Differentiation in Text Classification. Proceedings of the International Conference on Information and Electronics Engineering, Bangkok, Thailand."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"205520762091477","DOI":"10.1177\/2055207620914777","article-title":"Exploring feature selection and classification methods for predicting heart disease","volume":"6","author":"Spencer","year":"2020","journal-title":"Digit. Health"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/j.ymssp.2014.09.002","article-title":"Detection of weak transient signals based on wavelet packet transform and manifold learning for rolling element bearing fault diagnosis","volume":"54-55","author":"Wang","year":"2015","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1007\/s00041-021-09879-2","article-title":"Manifold Learning with Arbitrary Norms","volume":"27","author":"Kileel","year":"2021","journal-title":"J. Fourier Anal. Appl."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Ni, Y., Koniusz, P., Hartley, R., and Nock, R. (2022, January 18\u201324). Manifold Learning Benefits GANs. Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.01098"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.renene.2013.06.025","article-title":"Fault diagnosis for a wind turbine transmission system based on manifold learning and Shannon wavelet support vector machine","volume":"62","author":"Tang","year":"2014","journal-title":"Renew. Energy"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"109112","DOI":"10.1016\/j.patcog.2022.109112","article-title":"A label distribution manifold learning algorithm","volume":"135","author":"Tan","year":"2023","journal-title":"Pattern Recognit."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1016\/S0045-7825(97)00192-8","article-title":"On the least-squares method","volume":"152","author":"Jiang","year":"1998","journal-title":"Comput. Methods Appl. Mech. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Boyd, S., Parikh, N., and Chu, E., and Peleato, B. (2011). and Eckstein J. Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers.","DOI":"10.1561\/9781601984616"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1038\/nmeth.4346","article-title":"Principal component analysis","volume":"14","author":"Lever","year":"2017","journal-title":"Nat. Methods"},{"key":"ref_14","first-page":"462","article-title":"Intrusion detection model using fusion of chi-square feature selection and multi class SVM","volume":"29","year":"2017","journal-title":"J. King Saud Univ.\u2014Comput. Inf. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1016\/j.patrec.2012.10.005","article-title":"Feature selection for multi-label classification using multivariate mutual information","volume":"34","author":"Lee","year":"2013","journal-title":"Pattern Recognit. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2761","DOI":"10.1016\/j.patcog.2015.04.009","article-title":"Fast multi-label feature selection based on information-theoretic feature ranking","volume":"48","author":"Lee","year":"2015","journal-title":"Pattern Recognit."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.patrec.2018.08.021","article-title":"Manifold-based constraint Laplacian score for multi-label feature selection","volume":"112","author":"Huang","year":"2018","journal-title":"Pattern Recognit. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1016\/j.patcog.2019.06.003","article-title":"Manifold regularized discriminative feature selection for multi-label learning","volume":"95","author":"Zhang","year":"2019","journal-title":"Pattern Recognit."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"276","DOI":"10.11613\/BM.2012.031","article-title":"Interrater reliability: The kappa statistic","volume":"22","author":"McHugh","year":"2012","journal-title":"Biochem. Medica"},{"key":"ref_20","first-page":"406","article-title":"Random k-Labelsets: An Ensemble Method for Multilabel Classification","volume":"Volume 4701","author":"Kok","year":"2007","journal-title":"Machine Learning: ECML 2007"},{"key":"ref_21","unstructured":"Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., Ma, W., Ye, Q., and Liu, T.Y. (2017, January 4\u20139). LightGBM: A Highly Efficient Gradient Boosting Decision Tree. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13\u201317). XGBoost: A Scalable Tree Boosting System. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.","DOI":"10.1145\/2939672.2939785"},{"key":"ref_23","unstructured":"Appel, R., Fuchs, T., Doll\u00e1r, P., and Perona, P. (2013, January 17\u201319). Quickly Boosting Decision Trees\u2014Pruning Underachieving Features Early. Proceedings of the 30th International Conference on Machine Learning, Atlanta, GA, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1214\/aos\/1013203451","article-title":"Greedy Function Approximation: A Gradient Boosting Machine","volume":"29","author":"Friedman","year":"2001","journal-title":"Ann. Stat."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/10\/532\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:01:20Z","timestamp":1760130080000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/10\/532"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,28]]},"references-count":24,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["info14100532"],"URL":"https:\/\/doi.org\/10.3390\/info14100532","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2023,9,28]]}}}