{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T04:43:07Z","timestamp":1778647387609,"version":"3.51.4"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"9","license":[{"start":{"date-parts":[[2025,7,10]],"date-time":"2025-07-10T00:00:00Z","timestamp":1752105600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,7,10]],"date-time":"2025-07-10T00:00:00Z","timestamp":1752105600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["F53C22000760007"],"award-info":[{"award-number":["F53C22000760007"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["F53C22000760007"],"award-info":[{"award-number":["F53C22000760007"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"publisher","award":["F53C22000430001"],"award-info":[{"award-number":["F53C22000430001"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Comput Stat"],"published-print":{"date-parts":[[2025,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>This work presents a new approach to learning oblique decision trees for regression tasks. Oblique decision trees are a type of supervised statistical learning technique in which a linear combination of a set of predictors is used to find the hyperplane that partitions the features\u2019 space at each node. Our novel algorithm, called Tree Oblique for Regression with weighted Support vector machine (TORS), at each node, first applies a feature selection method based on the predictors\u2019 correlation with the dependent variable, and then dichotomizes the continuous dependent variable and applies a weighted support vector machine classifier with linear kernel to discover the oblique hyperplane that minimizes the deviance. We evaluate the performance of TORS on a set of different types of simulated data, and we find out that TORS performs well in any type of dataset. Moreover, we assess its performance by comparing the prediction power in terms of root mean squared error with respect to that obtained by other oblique tree models and standard decision tree, using both simulated and real data. Based on empirical evidence, TORS outperforms the other oblique decision trees and has the additional advantage of being easier to interpret.<\/jats:p>","DOI":"10.1007\/s00180-025-01647-w","type":"journal-article","created":{"date-parts":[[2025,7,10]],"date-time":"2025-07-10T10:11:52Z","timestamp":1752142312000},"page":"5257-5291","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Tree oblique for regression with weighted support vector machine"],"prefix":"10.1007","volume":"40","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4077-1822","authenticated-orcid":false,"given":"Andrea","family":"Carta","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luca","family":"Frigau","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,7,10]]},"reference":[{"issue":"7549","key":"1647_CR1","doi-asserted-by":"publisher","first-page":"1080","DOI":"10.1136\/bmj.332.7549.1080","volume":"332","author":"DG Altman","year":"2006","unstructured":"Altman DG, Royston P (2006) The cost of dichotomising continuous variables. BMJ 332(7549):1080","journal-title":"BMJ"},{"key":"1647_CR2","doi-asserted-by":"crossref","unstructured":"Ang JC, Haron H, Hamed HNA (2015) Semi-supervised svm-based feature selection for cancer classification using microarray gene expression data. In: International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems. Springer, pp 468\u2013477","DOI":"10.1007\/978-3-319-19066-2_45"},{"key":"1647_CR3","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.neucom.2013.01.067","volume":"135","author":"RC Barros","year":"2014","unstructured":"Barros RC, Jaskowiak PA, Cerri R, Carvalho AC (2014) A framework for bottom-up induction of oblique decision trees. Neurocomputing 135:3\u201312","journal-title":"Neurocomputing"},{"key":"1647_CR4","doi-asserted-by":"publisher","unstructured":"Bennett KP, Blue JA (1998) A support vector machine approach to decision trees. In: 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227), vol. 3, pp 2396\u20132401. IEEE, Anchorage, AK, USA. https:\/\/doi.org\/10.1109\/IJCNN.1998.687237. http:\/\/ieeexplore.ieee.org\/document\/687237\/ Accessed 2023-12-05","DOI":"10.1109\/IJCNN.1998.687237"},{"issue":"1","key":"1647_CR5","first-page":"126","volume":"17","author":"R Blaser","year":"2016","unstructured":"Blaser R, Fryzlewicz P (2016) Random rotation ensembles. J Mach Learn Res 17(1):126\u2013151","journal-title":"J Mach Learn Res"},{"issue":"5","key":"1647_CR6","doi-asserted-by":"publisher","first-page":"2203","DOI":"10.1007\/s00180-022-01195-7","volume":"37","author":"F Bollwein","year":"2022","unstructured":"Bollwein F, Westphal S (2022) Oblique decision tree induction by cross-entropy optimization based on the von mises-fisher distribution. Comput Stat 37(5):2203\u20132229","journal-title":"Comput Stat"},{"key":"1647_CR7","volume-title":"Classification and regression trees","author":"L Breiman","year":"1984","unstructured":"Breiman L, Friedman JH, Olshen RA, Stone CJ (1984) Classification and regression trees. Chapman & Hall, New York"},{"issue":"1","key":"1647_CR8","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1109\/TEVC.2002.806857","volume":"7","author":"E Cant\u00fa-Paz","year":"2003","unstructured":"Cant\u00fa-Paz E, Kamath C (2003) Inducing oblique decision trees with evolutionary algorithms. IEEE Trans Evol Comput 7(1):54\u201368","journal-title":"IEEE Trans Evol Comput"},{"key":"1647_CR9","unstructured":"Cant\u00fa-Paz E, Kamath C (2000) Using evolutionary algorithms to induce oblique decision trees. In: Proceedings of the 2nd Annual Conference on Genetic and Evolutionary Computation, pp 1053\u20131060"},{"key":"1647_CR10","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1016\/j.neucom.2019.10.118","volume":"408","author":"J Cervantes","year":"2020","unstructured":"Cervantes J, Garcia-Lamont F, Rodr\u00edguez-Mazahua L, Lopez A (2020) A comprehensive survey on support vector machine classification: applications, challenges and trends. Neurocomputing 408:189\u2013215","journal-title":"Neurocomputing"},{"key":"1647_CR11","doi-asserted-by":"crossref","unstructured":"Chaturvedi S, Patil S (2013) Oblique decision tree learning approaches-a critical review. Int J Comput Appl 82(13)","DOI":"10.5120\/14174-2023"},{"key":"1647_CR12","first-page":"2004","volume":"2010","author":"Z Chen","year":"2004","unstructured":"Chen Z, Yang Y (2004) Assessing forecast accuracy measures. Preprint Ser 2010:2004\u201310","journal-title":"Preprint Ser"},{"key":"1647_CR13","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1023\/A:1022627411411","volume":"20","author":"C Cortes","year":"1995","unstructured":"Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20:273\u2013297","journal-title":"Mach Learn"},{"key":"1647_CR14","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2019.113072","volume":"143","author":"M Ganaie","year":"2020","unstructured":"Ganaie M, Tanveer M, Suganthan PN (2020) Oblique decision tree ensemble via twin bounded svm. Expert Syst Appl 143:113072","journal-title":"Expert Syst Appl"},{"issue":"1","key":"1647_CR15","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1186\/s40537-020-00305-w","volume":"7","author":"JT Hancock","year":"2020","unstructured":"Hancock JT, Khoshgoftaar TM (2020) Survey on categorical data for neural networks. J Big Data 7(1):28","journal-title":"J Big Data"},{"issue":"1","key":"1647_CR16","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1016\/0020-0190(76)90095-8","volume":"5","author":"L Hyafil","year":"1976","unstructured":"Hyafil L, Rivest RL (1976) Constructing optimal binary decision trees is NP-complete. Inf Process Lett 5(1):15\u201317. https:\/\/doi.org\/10.1016\/0020-0190(76)90095-8","journal-title":"Inf Process Lett"},{"key":"1647_CR17","doi-asserted-by":"crossref","unstructured":"Jaeger BC, Welden S, Lenoir K, Speiser JL, Segar MW, Pandey A, Pajewski NM (2023) Accelerated and interpretable oblique random survival forests. J Comput Graph Stat 1\u201316","DOI":"10.1080\/10618600.2023.2231048"},{"key":"1647_CR18","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2023.120449","volume":"229","author":"T Jung","year":"2023","unstructured":"Jung T, Kim J (2023) A new support vector machine for categorical features. Expert Syst Appl 229:120449. https:\/\/doi.org\/10.1016\/j.eswa.2023.120449","journal-title":"Expert Syst Appl"},{"key":"1647_CR19","doi-asserted-by":"publisher","DOI":"10.1201\/9781315108230","volume-title":"Feature engineering and selection: a practical approach for predictive models","author":"M Kuhn","year":"2019","unstructured":"Kuhn M, Johnson K (2019) Feature engineering and selection: a practical approach for predictive models. Chapman and Hall\/CRC"},{"issue":"1","key":"1647_CR20","doi-asserted-by":"publisher","first-page":"1369","DOI":"10.1214\/13-EJS810","volume":"7","author":"YD Lee","year":"2013","unstructured":"Lee YD, Cook D, Park J-w, Lee E-K (2013) PPtree: projection pursuit classification tree. Electron J Statist 7(1):1369\u20131386. https:\/\/doi.org\/10.1214\/13-EJS810","journal-title":"Electron J Statist"},{"issue":"2","key":"1647_CR21","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1109\/TSMCA.2002.806499","volume":"33","author":"X-B Li","year":"2003","unstructured":"Li X-B, Sweigart JR, Teng JT, Donohue JM, Thombs LA, Wang SM (2003) Multivariate decision trees using linear discriminants and tabu search. IEEE Trans Syst Man Cybern Part A 33(2):194\u2013205","journal-title":"IEEE Trans Syst Man Cybern Part A"},{"key":"1647_CR22","unstructured":"Loh W-Y, Shih Y-S (1997) Split selection methods for classification trees. Statistica sinica, 815\u2013840"},{"issue":"403","key":"1647_CR23","doi-asserted-by":"publisher","first-page":"715","DOI":"10.1080\/01621459.1988.10478652","volume":"83","author":"W-Y Loh","year":"1988","unstructured":"Loh W-Y, Vanichsetakul N (1988) Tree-structured classification via generalized discriminant analysis. J Am Stat Assoc 83(403):715\u2013725","journal-title":"J Am Stat Assoc"},{"key":"1647_CR24","doi-asserted-by":"publisher","unstructured":"Monta\u00f1ana R, G\u00e1mez JA, Puerta JM (2021) STree: a single multi-class oblique decision tree based on support vector machines. In: Alba E, Luque G, Chicano F, Cotta C, Camacho D, Ojeda-Aciego M, Montes S, Troncoso A, Riquelme J, Gil-Merino R (eds) Advances in artificial intelligence. Lecture Notes in Computer Science. Springer, Cham, pp 54\u201364. https:\/\/doi.org\/10.1007\/978-3-030-85713-4_6","DOI":"10.1007\/978-3-030-85713-4_6"},{"key":"1647_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1613\/jair.63","volume":"2","author":"SK Murthy","year":"1994","unstructured":"Murthy SK, Kasif S, Salzberg S (1994) A system for induction of oblique decision trees. J Artif Intell Res 2:1\u201332","journal-title":"J Artif Intell Res"},{"key":"1647_CR26","unstructured":"Norouzi M, Collins MD, Fleet DJ, Kohli P (2015) Co2 forest: improved random forest by continuous optimization of oblique splits. arXiv preprint arXiv:1506.06155"},{"issue":"36","key":"1647_CR27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13040-017-0154-4","volume":"10","author":"RS Olson","year":"2017","unstructured":"Olson RS, La Cava W, Orzechowski P, Urbanowicz RJ, Moore JH (2017) Pmlb: a large benchmark suite for machine learning evaluation and comparison. BioData Mining 10(36):1\u201313. https:\/\/doi.org\/10.1186\/s13040-017-0154-4","journal-title":"BioData Mining"},{"issue":"5","key":"1647_CR28","doi-asserted-by":"publisher","first-page":"2671","DOI":"10.1007\/s00180-022-01207-6","volume":"37","author":"F Pargent","year":"2022","unstructured":"Pargent F, Pfisterer F, Thomas J, Bischl B (2022) Regularized target encoding outperforms traditional methods in supervised machine learning with high cardinality features. Comput Stat 37(5):2671\u20132692","journal-title":"Comput Stat"},{"key":"1647_CR29","doi-asserted-by":"publisher","first-page":"855","DOI":"10.1134\/S1054661817040228","volume":"27","author":"Z Qiao","year":"2017","unstructured":"Qiao Z, Kewen X, Panpan W, Wang H (2017) Lung nodule classification using curvelet transform, lda algorithm and bat-svm algorithm. Pattern Recognit Image Anal 27:855\u2013862","journal-title":"Pattern Recognit Image Anal"},{"key":"1647_CR30","unstructured":"Quinlan JR (1993) C 4.5: Programs for machine learning. The Morgan Kaufmann Series in Machine Learning"},{"key":"1647_CR31","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1023\/A:1022643204877","volume":"1","author":"JR Quinlan","year":"1986","unstructured":"Quinlan JR (1986) Induction of decision trees. Mach Learn 1:81\u2013106","journal-title":"Mach Learn"},{"issue":"2","key":"1647_CR32","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1007\/s10589-013-9560-9","volume":"56","author":"BL Robertson","year":"2013","unstructured":"Robertson BL, Price CJ, Reale M (2013) Cartopt: a random search method for nonsmooth unconstrained optimization. Comput Optim Appl 56(2):291\u2013315","journal-title":"Comput Optim Appl"},{"issue":"10","key":"1647_CR33","doi-asserted-by":"publisher","first-page":"1619","DOI":"10.1109\/TPAMI.2006.211","volume":"28","author":"JJ Rodriguez","year":"2006","unstructured":"Rodriguez JJ, Kuncheva LI, Alonso CJ (2006) Rotation forest: a new classifier ensemble method. IEEE Trans Pattern Anal Mach Intell 28(10):1619\u20131630","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"24","key":"1647_CR34","first-page":"171","volume":"24","author":"MV Shcherbakov","year":"2013","unstructured":"Shcherbakov MV, Brebels A, Shcherbakova NL, Tyukov AP, Janovsky TA, Kamaev VA et al (2013) A survey of forecast error measures. World Appl Sci J 24(24):171\u2013176","journal-title":"World Appl Sci J"},{"key":"1647_CR35","unstructured":"Therneau T, Atkinson B, Ripley B, Ripley MB (2015) Package \u2018rpart\u2019. Available online: cran.ma.ic.ac.uk\/web\/packages\/rpart\/rpart.pdf (accessed on 20 April 2016)"},{"issue":"1","key":"1647_CR36","first-page":"4193","volume":"21","author":"TM Tomita","year":"2020","unstructured":"Tomita TM, Browne J, Shen C, Chung J, Patsolic JL, Falk B, Priebe CE, Yim J, Burns R, Maggioni M et al (2020) Sparse projection oblique randomer forests. J Mach Learn Res 21(1):4193\u20134231","journal-title":"J Mach Learn Res"},{"key":"1647_CR37","unstructured":"Truong A (2009) Fast growing and interpretable oblique trees via logistic regression models. PhD thesis, Oxford University, UK"},{"key":"1647_CR38","unstructured":"Ushey K, Allaire J, Tang Y (2023) Reticulate: interface to \u2019Python\u2019. R package version 1.34.0. https:\/\/CRAN.R-project.org\/package=reticulate"},{"key":"1647_CR39","volume-title":"Python 3 reference manual","author":"G Van Rossum","year":"2009","unstructured":"Van Rossum G, Drake FL (2009) Python 3 reference manual. CreateSpace, Scotts Valley"},{"key":"1647_CR40","unstructured":"Vapnik V, Golowich S, Smola A (1996) Support vector method for function approximation, regression estimation and signal processing. Adv Neural Inf Process Syst 9"},{"key":"1647_CR41","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.csda.2015.11.006","volume":"96","author":"DC Wickramarachchi","year":"2016","unstructured":"Wickramarachchi DC, Robertson BL, Reale M, Price CJ, Brown J (2016) Hhcart: an oblique decision tree. Comput Stat Data Anal 96:12\u201323. https:\/\/doi.org\/10.1016\/j.csda.2015.11.006","journal-title":"Comput Stat Data Anal"},{"issue":"05","key":"1647_CR42","doi-asserted-by":"publisher","first-page":"961","DOI":"10.1142\/S0218001407005703","volume":"21","author":"X Yang","year":"2007","unstructured":"Yang X, Song Q, Wang Y (2007) A weighted support vector machine for data classification. Int J Pattern Recognit Artif Intell 21(05):961\u2013976","journal-title":"Int J Pattern Recognit Artif Intell"},{"key":"1647_CR43","unstructured":"Zhan H, Liu Y, Xia Y (2022) Consistency of the oblique decision tree and its random forest. arXiv preprint arXiv:2211.12653"},{"issue":"1","key":"1647_CR44","first-page":"1","volume":"20","author":"A Zheng","year":"2021","unstructured":"Zheng A, Casari A, Taylor J (2021) A survey of encoding techniques for categorical variables in machine learning. Data Sci J 20(1):1\u201317","journal-title":"Data Sci J"}],"container-title":["Computational Statistics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00180-025-01647-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00180-025-01647-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00180-025-01647-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,17]],"date-time":"2025-11-17T08:40:53Z","timestamp":1763368853000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00180-025-01647-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,10]]},"references-count":44,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2025,12]]}},"alternative-id":["1647"],"URL":"https:\/\/doi.org\/10.1007\/s00180-025-01647-w","relation":{},"ISSN":["0943-4062","1613-9658"],"issn-type":[{"value":"0943-4062","type":"print"},{"value":"1613-9658","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,10]]},"assertion":[{"value":"23 December 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 May 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 July 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}