{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T18:13:49Z","timestamp":1772907229415,"version":"3.50.1"},"reference-count":55,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2019,2,7]],"date-time":"2019-02-07T00:00:00Z","timestamp":1549497600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61772176"],"award-info":[{"award-number":["61772176"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61402153"],"award-info":[{"award-number":["61402153"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61370169"],"award-info":[{"award-number":["61370169"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"publisher","award":["2016M602247"],"award-info":[{"award-number":["2016M602247"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100018607","name":"Plan for Scientific Innovation Talent of Henan Province","doi-asserted-by":"publisher","award":["184100510003"],"award-info":[{"award-number":["184100510003"]}],"id":[{"id":"10.13039\/501100018607","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Key Scientific and Technological Project of Henan Province","award":["182102210078"],"award-info":[{"award-number":["182102210078"]}]},{"name":"Key Scientific and Technological Project of Henan Province","award":["182102210362"],"award-info":[{"award-number":["182102210362"]}]},{"name":"Young Scholar Program of Henan Province","award":["2017GGJS041"],"award-info":[{"award-number":["2017GGJS041"]}]},{"name":"Key Scientific and Technological Project of Xinxiang City","award":["CXGG17002"],"award-info":[{"award-number":["CXGG17002"]}]},{"DOI":"10.13039\/501100006407","name":"Natural Science Foundation of Henan Province","doi-asserted-by":"publisher","award":["182300410130"],"award-info":[{"award-number":["182300410130"]}],"id":[{"id":"10.13039\/501100006407","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006407","name":"Natural Science Foundation of Henan Province","doi-asserted-by":"publisher","award":["182300410368"],"award-info":[{"award-number":["182300410368"]}],"id":[{"id":"10.13039\/501100006407","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Ph.D. Research Foundation of Henan Normal University","award":["qd15132"],"award-info":[{"award-number":["qd15132"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Attribute reduction as an important preprocessing step for data mining, and has become a hot research topic in rough set theory. Neighborhood rough set theory can overcome the shortcoming that classical rough set theory may lose some useful information in the process of discretization for continuous-valued data sets. In this paper, to improve the classification performance of complex data, a novel attribute reduction method using neighborhood entropy measures, combining algebra view with information view, in neighborhood rough sets is proposed, which has the ability of dealing with continuous data whilst maintaining the classification information of original attributes. First, to efficiently analyze the uncertainty of knowledge in neighborhood rough sets, by combining neighborhood approximate precision with neighborhood entropy, a new average neighborhood entropy, based on the strong complementarity between the algebra definition of attribute significance and the definition of information view, is presented. Then, a concept of decision neighborhood entropy is investigated for handling the uncertainty and noisiness of neighborhood decision systems, which integrates the credibility degree with the coverage degree of neighborhood decision systems to fully reflect the decision ability of attributes. Moreover, some of their properties are derived and the relationships among these measures are established, which helps to understand the essence of knowledge content and the uncertainty of neighborhood decision systems. Finally, a heuristic attribute reduction algorithm is proposed to improve the classification performance of complex data sets. The experimental results under an instance and several public data sets demonstrate that the proposed method is very effective for selecting the most relevant attributes with great classification performance.<\/jats:p>","DOI":"10.3390\/e21020155","type":"journal-article","created":{"date-parts":[[2019,2,7]],"date-time":"2019-02-07T11:50:33Z","timestamp":1549540233000},"page":"155","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":32,"title":["An Attribute Reduction Method Using Neighborhood Entropy Measures in Neighborhood Rough Sets"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4917-7651","authenticated-orcid":false,"given":"Lin","family":"Sun","sequence":"first","affiliation":[{"name":"College of Computer and Information Engineering, Henan Normal University, Xinxiang 453007, China"},{"name":"Engineering Technology Research Center for Computing Intelligence and Data Mining, Henan 453007, China"}]},{"given":"Xiaoyu","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Computer and Information Engineering, Henan Normal University, Xinxiang 453007, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1518-3623","authenticated-orcid":false,"given":"Jiucheng","family":"Xu","sequence":"additional","affiliation":[{"name":"College of Computer and Information Engineering, Henan Normal University, Xinxiang 453007, China"},{"name":"Engineering Technology Research Center for Computing Intelligence and Data Mining, Henan 453007, China"}]},{"given":"Shiguang","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Computer and Information Engineering, Henan Normal University, Xinxiang 453007, China"},{"name":"Engineering Technology Research Center for Computing Intelligence and Data Mining, Henan 453007, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,2,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1007\/s10489-014-0561-x","article-title":"MapReduce based parallel gene selection method","volume":"42","author":"Islam","year":"2015","journal-title":"Appl. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1016\/j.knosys.2012.06.010","article-title":"Feature selection using rough entropy-based uncertainty measures in incomplete decision systems","volume":"36","author":"Sun","year":"2012","journal-title":"Knowl. Based Syst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"68892","DOI":"10.1109\/ACCESS.2018.2880271","article-title":"An affinity propagation clustering method using hybrid kernel function with LLE","volume":"6","author":"Sun","year":"2018","journal-title":"IEEE Access"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Sun, L., Meng, X.C., Xu, J.C., and Zhang, S.G. (2018). An image segmentation method based on improved regularized level set model. Appl. Sci., 8.","DOI":"10.3390\/app8122393"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1016\/j.ins.2018.07.001","article-title":"An incremental attribute reduction method for dynamic data mining","volume":"465","author":"Jing","year":"2018","journal-title":"Inf. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Sun, L., Meng, X.C., Xu, J.C., and Tian, Y. (2018). An image segmentation method using an active contour model based on improved SPF and LIF. Appl. Sci., 8.","DOI":"10.3390\/app8122576"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Sun, L., Wang, L.Y., Xu, J.C., and Zhang, S.G. (2019). A neighborhood rough sets-based attribute reduction method using Lebesgue and entropy measures. Entropy, 21.","DOI":"10.3390\/e21020138"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.ijar.2018.11.003","article-title":"Cost-sensitive approximate attribute reduction with three-way decisions","volume":"104","author":"Fang","year":"2019","journal-title":"Int. J. Approx. Reason."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1941","DOI":"10.1007\/s13042-017-0729-x","article-title":"Decision-theoretic rough set model of multi-source decision systems","volume":"9","author":"Sang","year":"2018","journal-title":"Int. J. Mach. Learn. Cybern."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1016\/j.ins.2003.07.004","article-title":"Approaches to knowledge reduction based on variable precision rough set model","volume":"159","author":"Mi","year":"2004","journal-title":"Inf. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"271","DOI":"10.3233\/FI-2017-1541","article-title":"Neighborhood systems and variable precision generalized rough sets","volume":"153","author":"Syau","year":"2017","journal-title":"Fundam. Inform."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"The mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/j.knosys.2017.12.014","article-title":"Maximum decision entropy-based attribute reduction in decision-theoretic rough set model","volume":"143","author":"Gao","year":"2018","journal-title":"Knowl. Based Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"919","DOI":"10.1631\/FITEE.1500447","article-title":"Attribute reduction in interval-valued information systems based on information entropies","volume":"17","author":"Dai","year":"2016","journal-title":"Front. Inf. Technol. Electron. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1002\/int.10109","article-title":"Rough reduction in algebra view and information view","volume":"18","author":"Wang","year":"2003","journal-title":"Int. J. Intell. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1109\/TFUZZ.2016.2574918","article-title":"A fitting model for feature selection with fuzzy rough sets","volume":"25","author":"Wang","year":"2017","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1973","DOI":"10.12785\/amis\/080456","article-title":"Information entropy and mutual information-based uncertainty measures in rough set theory","volume":"8","author":"Sun","year":"2014","journal-title":"Appl. Math. Inf. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3577","DOI":"10.1016\/j.ins.2008.05.024","article-title":"Neighborhood rough set based heterogeneous feature subset selection","volume":"178","author":"Hu","year":"2008","journal-title":"Inf. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2174","DOI":"10.1109\/TFUZZ.2017.2768044","article-title":"Maximal discernibility pair based approach to attribute reduction in fuzzy rough sets","volume":"26","author":"Dai","year":"2018","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.ins.2017.11.004","article-title":"Incremental rough set approach for hierarchical multicriteria classification","volume":"429","author":"Luo","year":"2018","journal-title":"Inf. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.knosys.2018.04.004","article-title":"Attribute reduction for multi-label learning with fuzzy rough set","volume":"152","author":"Lin","year":"2018","journal-title":"Knowl. Based Syst."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.knosys.2018.03.031","article-title":"A fuzzy rough set-based feature selection method using representative instances","volume":"151","author":"Zhang","year":"2018","journal-title":"Knowl. Based Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1016\/j.ins.2012.01.023","article-title":"Tolerance spaces: Origins, theoretical aspects and applications","volume":"195","author":"Peters","year":"2012","journal-title":"Inf. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1109\/69.842271","article-title":"A generalized definition of rough approximations based on similarity","volume":"12","author":"Slowinski","year":"2000","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_25","unstructured":"Yue, X.D., Chen, Y.F., Miao, D.Q., and Fujita, H. (2018). Fuzzy neighborhood covering for three-way classification. Inf. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"5737","DOI":"10.1002\/mma.4610","article-title":"Granular information retrieval using neighborhood systems","volume":"41","author":"Salama","year":"2018","journal-title":"Math. Methods Appl. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.knosys.2018.04.023","article-title":"Local neighborhood rough set","volume":"153","author":"Wang","year":"2018","journal-title":"Knowl. Based Syst."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1016\/j.knosys.2018.03.015","article-title":"Attribute reduction based on max-decision neighborhood rough set model","volume":"151","author":"Fan","year":"2018","journal-title":"Knowl. Based Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1016\/j.ins.2016.09.012","article-title":"Parallel attribute reduction in dominance-based neighborhood rough set","volume":"373","author":"Chen","year":"2016","journal-title":"Inf. Sci."},{"key":"ref_30","unstructured":"Wang, G.Y. (2001). Rough Set Theory and Knowledge Acquisition, Xi\u2019an Jiaotong University Press."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Tsumoto, S. (2002, January 14\u201316). Accuracy and coverage in rough set rule induction. Proceedings of the International Conference on Rough Sets and Current Trends in Computing, Malvern, PA, USA.","DOI":"10.1007\/3-540-45813-1_49"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1769","DOI":"10.4304\/jcp.7.7.1769-1779","article-title":"Decision degree-based decision tree technology for rule extraction","volume":"7","author":"Sun","year":"2012","journal-title":"J. Comput."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.jbi.2017.02.007","article-title":"Gene selection for tumor classification using neighborhood rough sets and entropy measures","volume":"67","author":"Chen","year":"2017","journal-title":"J. Biomed. Inform."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1007\/BF01001956","article-title":"Rough sets","volume":"11","author":"Pawlak","year":"1982","journal-title":"Int. J. Comput. Inf. Sci."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2073","DOI":"10.12785\/amis\/080466","article-title":"Information entropy and information granulation-based uncertainty measures in incomplete information systems","volume":"8","author":"Sun","year":"2014","journal-title":"Appl. Math. Inf. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.knosys.2017.10.028","article-title":"Differential evolution for filter feature selection based on information theory and feature ranking","volume":"140","author":"Hancer","year":"2018","journal-title":"Knowl. Based Syst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1007\/s13042-010-0008-6","article-title":"An efficient gene selection technique for cancer recognition based on neighborhood mutual information","volume":"1","author":"Hu","year":"2010","journal-title":"Int. J. Mach. Learn. Cybern."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1214\/aoms\/1177731944","article-title":"A comparison of alternative tests of significance for the problem of m rankings","volume":"11","author":"Friedman","year":"1940","journal-title":"Ann. Math. Stat."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1080\/21655979.2017.1403678","article-title":"A gene selection approach based on the fisher linear discriminant and the neighborhood rough set","volume":"9","author":"Sun","year":"2018","journal-title":"Bioengineered"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"15038990","DOI":"10.4238\/gmr.15038990","article-title":"Locally linear embedding and neighborhood rough set-based gene selection for gene expression data classification","volume":"15","author":"Sun","year":"2016","journal-title":"Genet. Mol. Res."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/j.jbi.2018.07.014","article-title":"Relief-based feature selection: Introduction and review","volume":"85","author":"Urbanowicz","year":"2018","journal-title":"J. Biomed. Inform."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Sun, L., Zhang, X.Y., Qian, Y.H., Xu, J.C., Zhang, S.G., and Tian, Y. (2018). Joint neighborhood entropy-based gene selection method with fisher score for tumor classification. Appl. Intell.","DOI":"10.1007\/s10489-018-1320-1"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"594","DOI":"10.1007\/s10489-017-0992-2","article-title":"Feature clustering based support vector machine recursive feature elimination for gene selection","volume":"48","author":"Huang","year":"2018","journal-title":"Appl. Intell."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"5490513","DOI":"10.1155\/2018\/5490513","article-title":"Feature genes selection using supervised locally linear embedding and correlation coefficient for microarray classification","volume":"2018","author":"Xu","year":"2018","journal-title":"Comput. Math. Methods Med."},{"key":"ref_45","first-page":"2986","article-title":"Feature selection based on neighborhood discrimination index","volume":"29","author":"Wang","year":"2018","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/j.asoc.2017.12.048","article-title":"A novel hybrid genetic algorithm with granular information for feature selection and optimization","volume":"65","author":"Dong","year":"2018","journal-title":"Appl. Soft Comput."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1016\/j.knosys.2016.07.035","article-title":"Global feature selection from microarray data using Lagrange multipliers","volume":"110","author":"Sun","year":"2016","journal-title":"Knowl. Based Syst."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"6567","DOI":"10.1073\/pnas.082099299","article-title":"Diagnosis of multiple cancer types by shrunken centroids of gene expression","volume":"99","author":"Tibshirani","year":"2002","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"858","DOI":"10.1016\/j.knosys.2011.03.007","article-title":"Neighborhood systems-based rough sets in incomplete information system","volume":"24","author":"Yang","year":"2011","journal-title":"Knowl. Based Syst."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1010","DOI":"10.1016\/j.camwa.2008.10.027","article-title":"Fuzzy-rough attribute reduction via mutual information with an application to cancer classification","volume":"57","author":"Xu","year":"2009","journal-title":"Comput. Math. Appl."},{"key":"ref_51","first-page":"1371","article-title":"Overfitting in making comparisons between variable selection methods","volume":"3","author":"Reunanen","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1080\/10618600.2012.681250","article-title":"A sparse-group lasso","volume":"22","author":"Simon","year":"2013","journal-title":"J. Comput. Graph. Stat."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Li, J.T., Dong, W.P., and Meng, D.Y. (2017). Grouped gene selection of cancer via adaptive sparse group lasso based on conditional mutual information. IEEE\/ACM Trans. Comput. Biol. Bioinform.","DOI":"10.1109\/TCBB.2017.2761871"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1080\/01621459.1961.10482090","article-title":"Multiple comparisons among means","volume":"56","author":"Dunn","year":"1961","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_55","first-page":"1","article-title":"Statistical comparison of classifiers over multiple data sets","volume":"7","author":"Demsar","year":"2006","journal-title":"J. Mach. Learn. Res."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/2\/155\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:31:31Z","timestamp":1760185891000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/2\/155"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,2,7]]},"references-count":55,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2019,2]]}},"alternative-id":["e21020155"],"URL":"https:\/\/doi.org\/10.3390\/e21020155","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,2,7]]}}}