{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T04:28:02Z","timestamp":1777696082120,"version":"3.51.4"},"reference-count":42,"publisher":"SAGE Publications","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IDA"],"published-print":{"date-parts":[[2021,10,29]]},"abstract":"<jats:p>A tree model with low time complexity can support the application of artificial intelligence to industrial systems. Variable selection based tree learning algorithms are more time efficient than existing Classification and Regression Tree (CART) algorithms. To our best knowledge, there is no attempt to deal with categorical input variable in variable selection based multi-output tree learning. Also, in the case of multi-output regression tree, a conventional variable selection based algorithm is not suitable to large datasets. We propose a mutual information-based multi-output tree learning algorithm that consists of variable selection and split optimization. The proposed method discretizes each variable based on k-means into 2\u20134 clusters and selects the variable for splitting based on the discretized variables using mutual information. This variable selection component has relatively low time complexity and can be applied regardless of output dimension and types. The proposed split optimization component is more efficient than an exhaustive search. The performance of the proposed tree learning algorithm is similar to or better than that of a multi-output version of CART algorithm on a specific dataset. In addition, with a large dataset, the time complexity of the proposed algorithm is significantly reduced compared to a CART algorithm.<\/jats:p>","DOI":"10.3233\/ida-205367","type":"journal-article","created":{"date-parts":[[2021,11,2]],"date-time":"2021-11-02T16:02:33Z","timestamp":1635868953000},"page":"1525-1545","source":"Crossref","is-referenced-by-count":0,"title":["Mutual information-based multi-output tree learning algorithm"],"prefix":"10.1177","volume":"25","author":[{"given":"Hyun-Seok","family":"Kang","sequence":"first","affiliation":[{"name":"Technical Research Laboratories, POSCO, Pohang, Korea"},{"name":"Graduate Institute of Ferrous Technology, Pohang University of Science and Technology (POSTECH), Pohang, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chi-Hyuck","family":"Jun","sequence":"additional","affiliation":[{"name":"Department of Industrial and Management Engineering, Pohang University of Science and Technology (POSTECH), Pohang, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"key":"10.3233\/IDA-205367_ref1","doi-asserted-by":"crossref","unstructured":"A. Clare and R.D. King, Knowledge discovery in multi-label phenotype data, in: 5th European Conf. on Principles of Data Mining and Knowledge Discovery, 2001, pp. 42\u201353.","DOI":"10.1007\/3-540-44794-6_4"},{"key":"10.3233\/IDA-205367_ref2","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.eswa.2016.10.021","article-title":"Regression trees for multivalued numerical response variables","volume":"69","author":"D\u2019Ambrosio","year":"2017","journal-title":"Expert Syst Appl"},{"key":"10.3233\/IDA-205367_ref3","doi-asserted-by":"crossref","first-page":"560","DOI":"10.1016\/j.enbuild.2012.03.003","article-title":"Accurate quantitative estimation of energy performance of residential buildings using statistical machine learning tools","volume":"49","author":"Tsanas","year":"2012","journal-title":"Energy and Build"},{"issue":"2","key":"10.3233\/IDA-205367_ref5","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1111\/j.0006-341X.2004.00202.x","article-title":"Multivariate regression trees for analysis of abundance data","volume":"60","author":"Larsen","year":"2004","journal-title":"Biometrics"},{"issue":"8","key":"10.3233\/IDA-205367_ref6","doi-asserted-by":"crossref","first-page":"832","DOI":"10.3390\/electronics8080832","article-title":"Machine learning interpretability: A survey on methods and metrics","volume":"8","author":"Carvalho","year":"2019","journal-title":"Electron"},{"issue":"1","key":"10.3233\/IDA-205367_ref7","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1007\/s10994-016-5546-z","article-title":"Multi-target regression vis input space expansion: Treating targets as inputs","volume":"104","author":"Spyromitros-Xioufis","year":"2016","journal-title":"Mach Learn"},{"key":"10.3233\/IDA-205367_ref8","unstructured":"F. Briggs, Y. Huang, R. Raich et al., The 9th annual MLSP competition: New methods for acoustic classification of multiple simultaneous bird species in a noisy environment, in: Proc. 2013 IEEE International Workshop on Machine Learning for Signal Processing (MLSP), 2013, Southampton, UK."},{"issue":"2","key":"10.3233\/IDA-205367_ref9","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1016\/j.ejor.2018.10.024","article-title":"Deep learning models for bankruptcy prediction using textual disclosures","volume":"274","author":"Mai","year":"2019","journal-title":"Eur J Oper Res"},{"issue":"4","key":"10.3233\/IDA-205367_ref10","first-page":"1105","article-title":"Multivariate regression trees: A new technique for modeling species-environment relationships","volume":"83","author":"De\u2019ath","year":"2002","journal-title":"Ecology"},{"key":"10.3233\/IDA-205367_ref11","first-page":"186","article-title":"The data model concept in statistical mapping","volume":"7","author":"Jenks","year":"1967","journal-title":"International Yearbook of Cartography"},{"issue":"2","key":"10.3233\/IDA-205367_ref12","doi-asserted-by":"crossref","first-page":"119","DOI":"10.2307\/2986296","article-title":"An exploratory technique for investigating large quantities of categorical data","volume":"29","author":"Kass","year":"1980","journal-title":"Ann Appl Stat"},{"issue":"5","key":"10.3233\/IDA-205367_ref13","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1002\/widm.1157","article-title":"A survey on multi-output regression","volume":"5","author":"Borchani","year":"2015","journal-title":"WIREs Data Min Knowl Discov"},{"issue":"454","key":"10.3233\/IDA-205367_ref14","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1198\/016214501753168271","article-title":"Classification trees with unbiased multiway splits","volume":"96","author":"Kim","year":"2001","journal-title":"J Amer Statist Assoc"},{"issue":"9","key":"10.3233\/IDA-205367_ref15","doi-asserted-by":"crossref","first-page":"1582","DOI":"10.2355\/isijinternational.ISIJINT-2018-770","article-title":"A mill set-up model using a multi-output regression tree for a tandem cold mill producing stainless steel","volume":"59","author":"Kang","year":"2019","journal-title":"ISIJ Int"},{"issue":"6","key":"10.3233\/IDA-205367_ref16","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1016\/j.cemconcomp.2007.02.001","article-title":"Modeling slump flow of concrete using second-order regressions and artificial neural networks","volume":"29","author":"Yeh","year":"2007","journal-title":"Cem Concr Compos"},{"key":"10.3233\/IDA-205367_ref17","doi-asserted-by":"crossref","unstructured":"J. Dougherty, R. Kohavi and M. Sahami, Supervised and unsupervised discretization of continuous features, in: Proceedings of the Twelfth International Conference on Machine Learning, 1995, pp. 194\u2013202.","DOI":"10.1016\/B978-1-55860-377-6.50032-3"},{"issue":"1","key":"10.3233\/IDA-205367_ref18","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1016\/j.ejor.2018.05.018","article-title":"Robust identification of email tracking: A machine learning approach","volume":"271","author":"Haupt","year":"2018","journal-title":"Eur J Oper Res"},{"key":"10.3233\/IDA-205367_ref19","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.patcog.2017.04.005","article-title":"Adjusted weight voting algorithm for random forests in handling missing values","volume":"69","author":"Xia","year":"2017","journal-title":"Pattern Recognit"},{"issue":"302","key":"10.3233\/IDA-205367_ref20","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1080\/01621459.1963.10500855","article-title":"Problems in the analysis of survey data, and a proposal","volume":"58","author":"Morgan","year":"1963","journal-title":"J Amer Statist Assoc"},{"issue":"1","key":"10.3233\/IDA-205367_ref22","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/BF00116251","article-title":"Induction of decision trees","volume":"1","author":"Quinlan","year":"1986","journal-title":"Mach Learn"},{"key":"10.3233\/IDA-205367_ref23","unstructured":"J.R. Quinlan, Learning with continuous classes, in: Proceedings of the 5th Australian Joint Conference on Artificial Intelligence, 1992, pp. 343\u2013348."},{"issue":"2","key":"10.3233\/IDA-205367_ref24","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/BF00058655","article-title":"Bagging predictors","volume":"24","author":"Breiman","year":"1996","journal-title":"Mach Learn"},{"issue":"1","key":"10.3233\/IDA-205367_ref26","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach Learn"},{"issue":"1","key":"10.3233\/IDA-205367_ref27","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1023\/B:AMAI.0000018580.96245.c6","article-title":"Theoretical comparison between the Gini index and information gain criteria","volume":"41","author":"Raileanu","year":"2004","journal-title":"Ann Math Artif Intell"},{"issue":"1","key":"10.3233\/IDA-205367_ref28","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1177\/0962280212460442","article-title":"Tree-based identification of subgroups for time-varying covariate survival data","volume":"25","author":"Bertolet","year":"2016","journal-title":"Stat Methods Med Res"},{"issue":"9","key":"10.3233\/IDA-205367_ref29","doi-asserted-by":"crossref","first-page":"1757","DOI":"10.1016\/j.patcog.2004.03.009","article-title":"Learning multi-label scene classification","volume":"37","author":"Boutell","year":"2004","journal-title":"Pattern Recognit"},{"issue":"418","key":"10.3233\/IDA-205367_ref30","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1080\/01621459.1992.10475220","article-title":"Tree structured methods for longitudinal data","volume":"87","author":"Segal","year":"1992","journal-title":"J Amer Statist Assoc"},{"issue":"1","key":"10.3233\/IDA-205367_ref31","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/TSMC.1979.4310076","article-title":"A threshold selection method from gray-level histograms","volume":"9","author":"Otsu","year":"1979","journal-title":"IEEE Trans Sys Man Cyber"},{"issue":"12","key":"10.3233\/IDA-205367_ref33","doi-asserted-by":"crossref","first-page":"9641","DOI":"10.1109\/TIE.2019.2896165","article-title":"A smart monitoring system for automatic welding defect detection","volume":"66","author":"Sassi","year":"2019","journal-title":"IEEE Trans Ind Electron"},{"issue":"340","key":"10.3233\/IDA-205367_ref34","first-page":"768","article-title":"A modal search technique for predictive nominal scale multivariate analysis","volume":"67","author":"Messenger","year":"1972","journal-title":"J Amer Statist Assoc"},{"issue":"1","key":"10.3233\/IDA-205367_ref36","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1023\/A:1008323212047","article-title":"Predicting chemical parameters of river water quality from bioindicator data","volume":"13","author":"Dzeroski","year":"2000","journal-title":"Appl Intell"},{"issue":"4","key":"10.3233\/IDA-205367_ref37","doi-asserted-by":"crossref","first-page":"1105","DOI":"10.1016\/j.csda.2004.07.003","article-title":"On generalized multivariate decision tree by using GEE","volume":"49","author":"Lee","year":"2005","journal-title":"Comput Stat Data Anal"},{"issue":"3","key":"10.3233\/IDA-205367_ref38","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/j.spl.2006.08.014","article-title":"Splitting variable selection for multivariate regression trees","volume":"77","author":"Hsiao","journal-title":"Stat Probab Lett"},{"issue":"3","key":"10.3233\/IDA-205367_ref39","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1111\/insr.12016","article-title":"Fifty years of classification and regression trees","volume":"82","author":"Loh","year":"2014","journal-title":"Int Stat Rev"},{"issue":"26","key":"10.3233\/IDA-205367_ref40","doi-asserted-by":"crossref","first-page":"4837","DOI":"10.1002\/sim.7020","article-title":"Identification of subgroups with differential treatment effects for longitudinal and multiresponse variables","volume":"35","author":"Loh","year":"2016","journal-title":"Stat Med"},{"issue":"4","key":"10.3233\/IDA-205367_ref41","doi-asserted-by":"crossref","first-page":"1710","DOI":"10.1214\/09-AOAS260","article-title":"Improving the precision of classification trees","volume":"3","author":"Loh","year":"2009","journal-title":"Ann Appl Stat"},{"issue":"4","key":"10.3233\/IDA-205367_ref42","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1002\/sim.7677","article-title":"Subgroups from regression trees with adjustment for prognostic effects and post-selection inference","volume":"38","author":"Loh","year":"2019","journal-title":"Stat Med"},{"issue":"403","key":"10.3233\/IDA-205367_ref43","doi-asserted-by":"crossref","first-page":"715","DOI":"10.1080\/01621459.1988.10478652","article-title":"Tree-structured classification via generalized discriminant analysis (with discussion)","volume":"83","author":"Loh","year":"1988","journal-title":"J Amer Statist Assoc"},{"issue":"2","key":"10.3233\/IDA-205367_ref44","first-page":"361","article-title":"Regression trees with unbiased variable selection and interaction detection","volume":"12","author":"Loh","year":"2002","journal-title":"Stat Sinica"},{"issue":"1","key":"10.3233\/IDA-205367_ref45","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1214\/12-AOAS596","article-title":"Regression trees for longitudinal and multiresponse data","volume":"7","author":"Loh","year":"2013","journal-title":"Ann Appl Stat"},{"issue":"4","key":"10.3233\/IDA-205367_ref46","first-page":"815","article-title":"Split selection methods for classification trees","volume":"7","author":"Loh","year":"1997","journal-title":"Stat Sinica"},{"issue":"3","key":"10.3233\/IDA-205367_ref47","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1023\/A:1009769707641","article-title":"Extensions to the k-modes algorithm for clustering large data sets with categorical values","volume":"2","author":"Huang","year":"1998","journal-title":"Data Min Knowl Discov"}],"container-title":["Intelligent Data Analysis"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/IDA-205367","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:19:13Z","timestamp":1777454353000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/IDA-205367"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,29]]},"references-count":42,"journal-issue":{"issue":"6"},"URL":"https:\/\/doi.org\/10.3233\/ida-205367","relation":{},"ISSN":["1088-467X","1571-4128"],"issn-type":[{"value":"1088-467X","type":"print"},{"value":"1571-4128","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,29]]}}}