{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:26:38Z","timestamp":1760235998281,"version":"build-2065373602"},"reference-count":41,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2021,10,12]],"date-time":"2021-10-12T00:00:00Z","timestamp":1633996800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["60473125,61701213"],"award-info":[{"award-number":["60473125,61701213"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"science and technology planning projects of Karamay","award":["2020CGZH0009"],"award-info":[{"award-number":["2020CGZH0009"]}]},{"name":"Scientific Research Foundation of Karamay Campus of China University of Petroleum (Beijing)","award":["RCYJ2016B-03-001"],"award-info":[{"award-number":["RCYJ2016B-03-001"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>This paper investigates the nested Monte Carlo tree search (NMCTS) for feature selection on regression tasks. NMCTS starts out with an empty subset and uses search results of lower nesting level simulation. Level 0 is based on random moves until the path reaches the leaf node. In order to accomplish feature selection on the regression task, the Gamma test is introduced to play the role of the reward function at the end of the simulation. The concept Vratio of the Gamma test is also combined with the original UCT-tuned1 and the design of stopping conditions in the selection and simulation phases. The proposed GNMCTS method was tested on seven numeric datasets and compared with six other feature selection methods. It shows better performance than the vanilla MCTS framework and maintains the relevant information in the original feature space. The experimental results demonstrate that GNMCTS is a robust and effective tool for feature selection. It can accomplish the task well in a reasonable computation budget.<\/jats:p>","DOI":"10.3390\/e23101331","type":"journal-article","created":{"date-parts":[[2021,10,12]],"date-time":"2021-10-12T08:09:32Z","timestamp":1634026172000},"page":"1331","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Feature Selection for Regression Based on Gamma Test Nested Monte Carlo Tree Search"],"prefix":"10.3390","volume":"23","author":[{"given":"Ying","family":"Li","sequence":"first","affiliation":[{"name":"Beijing Key Lab of Petroleum Data Mining, Department of Geophysics, China University of Petroleum, Beijing 102249, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guohe","family":"Li","sequence":"additional","affiliation":[{"name":"Beijing Key Lab of Petroleum Data Mining, Department of Geophysics, China University of Petroleum, Beijing 102249, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lingun","family":"Guo","sequence":"additional","affiliation":[{"name":"Beijing Key Lab of Petroleum Data Mining, Department of Geophysics, China University of Petroleum, Beijing 102249, China"},{"name":"College of Software, Henan Normal University, Xinxiang 453007, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,10,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Fu, M.C. (2016, January 11\u201314). AlphaGo and Monte Carlo tree search: The simulation optimization perspective. Proceedings of the 2016 Winter Simulation Conference (WSC), Arlington, VA, USA.","DOI":"10.1109\/WSC.2016.7822130"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Gelly, S., and Silver, D. (2007, January 20\u201324). Combining online and offline knowledge in UCT. Proceedings of the International Conference of Machine Learning, Corvallis, OR, USA.","DOI":"10.1145\/1273496.1273531"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.knosys.2011.08.008","article-title":"Single-player Monte-Carlo tree search for SameGame","volume":"34","author":"Schadd","year":"2012","journal-title":"Knowl. Based Syst."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Chaudhry, M.U., and Lee, J.-H. (2018). MOTiFS: Monte Carlo tree search based feature selection. Entropy, 20.","DOI":"10.3390\/e20050385"},{"key":"ref_5","unstructured":"Gaudel, R., and Sebag, M. (2010, January 21\u201324). Feature selection as a one-player game. Proceedings of the International Conference on Machine Learning, Haifa, Israel."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Fard, S.M.H., Hamzeh, A., and Hashemi, S. (2012, January 29\u201331). A game theoretic framework for feature selection. Proceedings of the 9th International Conference on Fuzzy Systems and Knowledge Discovery, Chongqing, China.","DOI":"10.1109\/FSKD.2012.6234170"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1007\/s10287-003-0006-1","article-title":"New tools in non-linear modelling and prediction","volume":"1","author":"Jones","year":"2004","journal-title":"Comput. Manag. Sci."},{"key":"ref_8","first-page":"67","article-title":"A tutorial on the gamma test","volume":"6","author":"Kemp","year":"2004","journal-title":"Int. J. Simul."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2759","DOI":"10.1098\/rspa.2002.1010","article-title":"A proof of the Gamma test","volume":"458","author":"Evans","year":"2002","journal-title":"Proc. R. Soc. A Math. Phys. Eng. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2839","DOI":"10.1098\/rspa.2002.1011","article-title":"Asymptotic moments of near\u2013neighbour distance distributions","volume":"458","author":"Evans","year":"2002","journal-title":"Proc. R. Soc. A Math. Phys. Eng. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Baier, H., and Winands, M. (2012, January 27\u201331). Nested Monte-Carlo tree search for online planning in large MDPs. Proceedings of the 20th European Conference on Artificial Intelligence, Montpellier, France.","DOI":"10.1109\/CIG.2012.6374160"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"594","DOI":"10.1007\/s10489-017-0992-2","article-title":"Feature clustering based support vector machine recursive feature elimination for gene selection","volume":"48","author":"Huang","year":"2018","journal-title":"Appl. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"482","DOI":"10.1016\/j.asoc.2017.07.003","article-title":"Occupancy estimation from environmental parameters using wrapper and hybrid feature selection","volume":"60","author":"Masood","year":"2017","journal-title":"Appl. Soft Comput."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"106839","DOI":"10.1016\/j.csda.2019.106839","article-title":"Benchmark for filter methods for feature selection in high-dimensional classification data","volume":"143","author":"Bommert","year":"2020","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_15","first-page":"3","article-title":"A Review of feature selection and its methods","volume":"19","author":"Venkatesh","year":"2019","journal-title":"Cybern. Inf. Technol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"100663","DOI":"10.1016\/j.swevo.2020.100663","article-title":"A survey on swarm intelligence approaches to feature selection in data mining","volume":"54","author":"Nguyen","year":"2020","journal-title":"Swarm Evol. Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1103","DOI":"10.1007\/s11831-020-09412-6","article-title":"A comprehensive analysis of nature-inspired meta-heuristic techniques for feature selection problem","volume":"28","author":"Sharma","year":"2020","journal-title":"Arch. Comput. Methods Eng."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Fan, W., Liu, K., Liu, H., Wang, P., Ge, Y., and Fu, Y. (2020, January 30\u201331). AutoFS: Automated Feature selection via diversity-aware interactive reinforcement learning. Proceedings of the IEEE International Conference on Data Mining (ICDM), Istanbul, Turkey.","DOI":"10.1109\/ICDM50108.2020.00117"},{"key":"ref_19","unstructured":"Rimmel, A. (2009). Improvements and Evaluation of the Monte Carlo Tree Search Algorithm. [Ph.D. Thesis, Universit\u00e9 Paris Sud]."},{"key":"ref_20","unstructured":"Marchenko, O.I., and Marchenko, O.O. (June, January 29). Monte-Carlo tree search with tree shape control. Proceedings of the IEEE First Ukraine Conference on Electrical and Computer Engineering (UKRCON), Kyiv, Ukraine."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TCIAIG.2012.2186810","article-title":"A survey of Monte Carlo tree search methods","volume":"4","author":"Browne","year":"2012","journal-title":"Trans. Comput. Intell. AI Games"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Hogan, S., Jarvis, P., and Wilson, I. (2011, January 13\u201315). Using the gamma test in the analysis of classification models for time-series events in urodynamics investigation. Proceedings of the International Conference on Innovative Techniques and Applications of Artificial Intelligence, Cambridge, UK.","DOI":"10.1007\/978-1-4471-2318-7_23"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"238","DOI":"10.1016\/j.jngse.2013.07.002","article-title":"Forecasting natural gas spot prices with nonlinear modeling using Gamma test analysis","volume":"14","author":"Narges","year":"2013","journal-title":"J. Nat. Gas Sci. Eng."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jappgeo.2011.10.012","article-title":"Smooth regression to estimate effective porosity using seismic attributes","volume":"76","year":"2012","journal-title":"J. Appl. Geophys."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"767","DOI":"10.1016\/j.jenvman.2009.10.007","article-title":"Evaluation of PCA and Gamma test techniques on ANN operation for weekly solid waste prediction","volume":"91","author":"Noori","year":"2010","journal-title":"J. Environ. Manag."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1061\/(ASCE)HE.1943-5584.0000403","article-title":"Variable Selection using the gamma test forward and backward selections","volume":"17","author":"Jaafar","year":"2012","journal-title":"J. Hydrol. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Akiyama, H., Komiya, K., and Kotani, Y. (2010, January 18\u201320). Nested Monte-Carlo search with AMAF heuristic. Proceedings of the International Conference on Technologies and Applications of Artificial Intelligence, Hsinchu, Taiwan.","DOI":"10.1109\/TAAI.2010.37"},{"key":"ref_28","first-page":"132","article-title":"Self-adaptive monte-carlo tree search in general game playing","volume":"1","author":"Sironi","year":"2018","journal-title":"Trans. Games"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Rimmel, A., Teytaud, F., and Cazenave, T. (2011, January 27\u201329). Optimization of the nested Monte-Carlo algorithm on the traveling salesman problem with time windows. Proceedings of the International Conference on Applications of Evolutionary Computation, Torino, Italy.","DOI":"10.1007\/978-3-642-20520-0_51"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1109\/TCIAIG.2010.2088123","article-title":"Combining UCT and nested Monte-Carlo search for single-player general game playing","volume":"2","author":"Mehat","year":"2011","journal-title":"Trans. Comput. Intell. AI Games"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1016\/j.patcog.2017.05.008","article-title":"Feature selection for regression problems based on the morisita estimator of intrinsic dimension","volume":"70","author":"Golay","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"4070","DOI":"10.1016\/j.patcog.2015.06.010","article-title":"A new estimator of intrinsic dimension based on the multipoint morisita index","volume":"48","author":"Golay","year":"2015","journal-title":"Pattern Recognit."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"323","DOI":"10.3390\/e14020323","article-title":"Filter-type variable selection based on information measures for regression tasks","volume":"14","author":"Carmona","year":"2012","journal-title":"Entropy"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"884","DOI":"10.1109\/TBME.2009.2036000","article-title":"Accurate telemonitoring of Parkinson\u2019s disease progression by non-invasive speech tests","volume":"57","author":"Tsanas","year":"2009","journal-title":"Trans. Biomed. Eng."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.knosys.2014.03.015","article-title":"Binary PSO with mutation operator for feature selection using decision tree applied to spam detection","volume":"64","author":"Zhang","year":"2014","journal-title":"Knowl. Based Syst."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Sadeg, S., Hamdad, L., and Remache, A.R. (2019, January 12\u201314). QBSO-FS: A Reinforcement learning based bee swarm optimization metaheuristic for feature selection. Proceedings of the International Work-Conference on Artificial Neural Networks Proceedings Part 2, Gran Canaria, Spain.","DOI":"10.1007\/978-3-030-20518-8_65"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Sadeg, S., Hamdad, L., and Benatchba, K. (2015, January 10\u201312). BSO-FS: Bee Swarm optimization for feature selection in classification. Proceedings of the International Work-Conference on Artificial Neural Networks Proceedings Part 1, Palma de Mallorca, Spain.","DOI":"10.1007\/978-3-319-19258-1_33"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1080\/21642583.2019.1661312","article-title":"An improved relief feature selection algorithm based on Monte-Carlo tree search","volume":"7","author":"Zheng","year":"2019","journal-title":"Syst. Sci. Control. Eng."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1892","DOI":"10.1016\/j.camwa.2013.06.031","article-title":"Using reinforcement learning to find an optimal set of features","volume":"66","author":"Fard","year":"2013","journal-title":"Comput. Math. Appl."},{"key":"ref_40","unstructured":"Sali, R., Sodiq, A., and Akakpo, A. (2021). Feature selection using reinforcement learning. arXiv."},{"key":"ref_41","unstructured":"Amato, F., Guignard, F., and Jacquet, P. (2020). On Feature selection using anisotropic general regression neural network. arXiv."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/10\/1331\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:12:03Z","timestamp":1760166723000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/10\/1331"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,12]]},"references-count":41,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,10]]}},"alternative-id":["e23101331"],"URL":"https:\/\/doi.org\/10.3390\/e23101331","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2021,10,12]]}}}