{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T03:04:37Z","timestamp":1783998277633,"version":"3.55.0"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T00:00:00Z","timestamp":1772582400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T00:00:00Z","timestamp":1772582400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["HO 6422\/1-3"],"award-info":[{"award-number":["HO 6422\/1-3"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["447467169"],"award-info":[{"award-number":["447467169"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005722","name":"Ludwig-Maximilians-Universit\u00e4t M\u00fcnchen","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005722","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Classif"],"published-print":{"date-parts":[[2026,7]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>In multi-class prediction tasks with interpretative goals, covariates that help distinguish individual classes, termed \u201cclass-related covariates,\u201d can be of particular interest. Conventional variable importance measures (VIMs) from random forests, such as permutation and Gini importance, rank covariates by overall predictive contribution and thus also assign high importance to covariates that differentiate between groups of classes. We propose a novel VIM, the class-focused VIM, which ranks covariates by their ability to distinguish individual outcome classes. It evaluates covariates using hypothetical multi-way class-based partitions at each node, without altering tree construction. As a complement, we introduce the discriminatory VIM, which measures general covariate influence based on the actual node splits. Simulations show that, unlike conventional VIMs, the class-focused VIM specifically ranks class-related covariates high. Real data examples illustrate how both suggested VIMs behave on real datasets and how their results can be interpreted.<\/jats:p>","DOI":"10.1007\/s00357-026-09545-6","type":"journal-article","created":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T13:51:09Z","timestamp":1772632269000},"page":"433-457","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Class-Focused Variable Importance in Random Forests for Multi-Class Outcomes"],"prefix":"10.1007","volume":"43","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6036-1495","authenticated-orcid":false,"given":"Roman","family":"Hornung","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6765-6352","authenticated-orcid":false,"given":"Alexander","family":"Hapfelmeier","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,3,4]]},"reference":[{"issue":"22","key":"9545_CR1","doi-asserted-by":"publisher","first-page":"19751","DOI":"10.1007\/s00521-022-07705-4","volume":"34","author":"OO Akinola","year":"2022","unstructured":"Akinola, O. O., Ezugwu, A. E., Agushaka, J. O., Zitar, R. A., & Abualigah, L. (2022). Multiclass feature selection with metaheuristic optimization algorithms: A review. Neural Computing and Applications, 34(22), 19751\u201319790.","journal-title":"Neural Computing and Applications"},{"key":"9545_CR2","unstructured":"Anguita, D., Ghio, A., Oneto, L., Parra, X., & Reyes-Ortiz, J. L. (2013). A public domain dataset for human activity recognition using smartphones. In Proceedings of the 21st European symposium on artificial neural networks, computational intelligence and machine learning (ESANN) (pp. 437\u2013442). Bruges, Belgium."},{"key":"9545_CR3","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman, L. (2001a). Random forests. Machine Learning, 45, 5\u201332.","journal-title":"Machine Learning"},{"key":"9545_CR4","doi-asserted-by":"crossref","unstructured":"Breiman, L. (2001b). Statistical modeling: The two cultures (with comments and a rejoinder by the author). Statistical Science,16(3), 199\u2013231.","DOI":"10.1214\/ss\/1009213726"},{"key":"9545_CR5","unstructured":"Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984). Classification and regression trees, Boca Raton, Florida: Chapman and Hall\/CRC (1st edn)."},{"issue":"2","key":"9545_CR6","doi-asserted-by":"publisher","first-page":"20190063","DOI":"10.1515\/ijb-2019-0063","volume":"16","author":"M Buri","year":"2020","unstructured":"Buri, M., & Hothorn, T. (2020). Model-based random forests for ordinal regression. The International Journal of Biostatistics, 16(2), 20190063.","journal-title":"The International Journal of Biostatistics"},{"key":"9545_CR7","doi-asserted-by":"crossref","unstructured":"Chen, X. w., Zeng, X., & Van Alphen, D. (2006). Multi-class feature selection for texture classification. Pattern Recognition Letters,27(14), 1685\u20131691.","DOI":"10.1016\/j.patrec.2006.03.013"},{"key":"9545_CR8","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1023\/A:1009869804967","volume":"3","author":"D Coppersmith","year":"1999","unstructured":"Coppersmith, D., Hong, S. J., & Hosking, J. R. (1999). Partitioning nominal attributes in decision trees. Data Mining and Knowledge Discovery, 3, 197\u2013217.","journal-title":"Data Mining and Knowledge Discovery"},{"key":"9545_CR9","doi-asserted-by":"crossref","unstructured":"Forman, G. (2004). A pitfall and solution in multi-class feature selection for text classification. In Proceedings of the twenty-first international conference on Machine learning (p. 38).","DOI":"10.1145\/1015330.1015356"},{"key":"9545_CR10","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/s10994-006-6226-1","volume":"63","author":"P Geurts","year":"2006","unstructured":"Geurts, P., Ernst, D., & Wehenkel, L. (2006). Extremely randomized trees. Machine Learning, 63, 3\u201342.","journal-title":"Machine Learning"},{"key":"9545_CR11","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1007\/s11222-021-10057-z","volume":"31","author":"G Hooker","year":"2021","unstructured":"Hooker, G., Mentch, L., & Zhou, S. (2021). Unrestricted permutation forces extrapolation: Variable importance requires at least one more model, or there is no free variable importance. Statistics and Computing, 31, 82.","journal-title":"Statistics and Computing"},{"issue":"1","key":"9545_CR12","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1007\/s00357-018-9302-x","volume":"37","author":"R Hornung","year":"2020","unstructured":"Hornung, R. (2020). Ordinal forests. Journal of Classification, 37(1), 4\u201317.","journal-title":"Journal of Classification"},{"key":"9545_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s42979-021-00920-1","volume":"3","author":"R Hornung","year":"2022","unstructured":"Hornung, R. (2022). Diversity forests: Using split sampling to enable innovative complex split procedures in random forests. SN Computer Science, 3, 1\u201316.","journal-title":"SN Computer Science"},{"key":"9545_CR14","unstructured":"Hornung, R. & Wright, M. N. (2025). diversityForest: Innovative complex split procedures in random forests through candidate split sampling, R package version 0.6.0."},{"key":"9545_CR15","doi-asserted-by":"publisher","first-page":"107460","DOI":"10.1016\/j.csda.2022.107460","volume":"171","author":"R Hornung","year":"2022","unstructured":"Hornung, R., & Boulesteix, A. L. (2022). Interaction forests: Identifying and exploiting interpretable quantitative and qualitative interaction effects. Computational Statistics & Data Analysis, 171, 107460.","journal-title":"Computational Statistics & Data Analysis"},{"key":"9545_CR16","unstructured":"Hornung, R., & Hapfelmeier, A. (2024). Multi forests: Variable importance for multi-class outcomes, arXiv:2409.08925v1"},{"issue":"3","key":"9545_CR17","doi-asserted-by":"publisher","first-page":"651","DOI":"10.1198\/106186006X133933","volume":"15","author":"T Hothorn","year":"2006","unstructured":"Hothorn, T., Hornik, K., & Zeileis, A. (2006). Unbiased recursive partitioning: A conditional inference framework. Journal of Computational and Graphical Statistics, 15(3), 651\u2013674.","journal-title":"Journal of Computational and Graphical Statistics"},{"key":"9545_CR18","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1186\/1471-2105-14-119","volume":"14","author":"S Janitza","year":"2013","unstructured":"Janitza, S., Strobl, C., & Boulesteix, A. L. (2013). An AUC-based permutation variable importance measure for random forests. BMC Bioinformatics, 14, 119.","journal-title":"BMC Bioinformatics"},{"key":"9545_CR19","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1016\/j.csda.2015.10.005","volume":"96","author":"S Janitza","year":"2016","unstructured":"Janitza, S., Tutz, G., & Boulesteix, A. L. (2016). Random forest for ordinal responses: Prediction and variable selection. Computational Statistics & Data Analysis, 96, 57\u201373.","journal-title":"Computational Statistics & Data Analysis"},{"key":"9545_CR20","unstructured":"Kelly, M., Longjohn, R., & Nottingham, K. (2024). The UCI machine learning repository [online], Available at https:\/\/archive.ics.uci.edu."},{"issue":"1\u20132","key":"9545_CR21","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1002\/nav.3800020109","volume":"2","author":"HW Kuhn","year":"1955","unstructured":"Kuhn, H. W. (1955). The Hungarian method for the assignment problem. Naval Research Logistics Quarterly, 2(1\u20132), 83\u201397.","journal-title":"Naval Research Logistics Quarterly"},{"key":"9545_CR22","first-page":"8049","volume":"32","author":"X Li","year":"2019","unstructured":"Li, X., Wang, Y., Basu, S., Kumbier, K., & Yu, B. (2019). A debiased MDI feature importance measure for random forests. Advances in Neural Information Processing Systems, 32, 8049\u20138059.","journal-title":"Advances in Neural Information Processing Systems"},{"issue":"5","key":"9545_CR23","doi-asserted-by":"publisher","first-page":"1413","DOI":"10.1080\/03610926.2020.1764042","volume":"51","author":"M Loecher","year":"2020","unstructured":"Loecher, M. (2020). Unbiased variable importance for random forests. Communications in Statistics - Theory and Methods, 51(5), 1413\u20131425.","journal-title":"Communications in Statistics - Theory and Methods"},{"key":"9545_CR24","first-page":"431","volume":"26","author":"G Louppe","year":"2013","unstructured":"Louppe, G., Wehenkel, L., Sutera, A., & Geurts, P. (2013). Understanding variable importances in forests of randomized trees. Advances in Neural Information Processing Systems, 26, 431\u2013439.","journal-title":"Advances in Neural Information Processing Systems"},{"issue":"3","key":"9545_CR25","doi-asserted-by":"publisher","first-page":"607","DOI":"10.1007\/s10618-019-00617-3","volume":"33","author":"B Lucas","year":"2019","unstructured":"Lucas, B., Shifaz, A., Pelletier, C., O\u2019Neill, L., Zaidi, N., Goethals, B., Petitjean, F., & Webb, G. I. (2019). Proximity forest: An effective and scalable distance-based classifier for time series. Data Mining and Knowledge Discovery, 33(3), 607\u2013635.","journal-title":"Data Mining and Knowledge Discovery"},{"key":"9545_CR26","doi-asserted-by":"crossref","unstructured":"Molnar, C., Casalicchio, G., & Bischl, B. (2020). Interpretable machine learning - A brief history, state-of-the-art and challenges. In I. Koprinska, et al. (Eds.), ECML PKDD 2020 Workshops. ECML PKDD 2020. Communications in Computer and Information Science (vol. 1323, pp. 417\u2013431).","DOI":"10.1007\/978-3-030-65965-3_28"},{"issue":"21","key":"9545_CR27","doi-asserted-by":"publisher","first-page":"3711","DOI":"10.1093\/bioinformatics\/bty373","volume":"34","author":"S Nembrini","year":"2018","unstructured":"Nembrini, S., K\u00f6nig, I. R., & Wright, M. N. (2018). The revival of the Gini importance? Bioinformatics, 34(21), 3711\u20133718.","journal-title":"Bioinformatics"},{"key":"9545_CR28","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1214\/09-SS057","volume":"3","author":"J Pearl","year":"2009","unstructured":"Pearl, J. (2009). Causal inference in statistics: An overview. Statistics Surveys, 3, 96\u2013146.","journal-title":"Statistics Surveys"},{"issue":"53","key":"9545_CR29","first-page":"1","volume":"20","author":"P Probst","year":"2019","unstructured":"Probst, P., Boulesteix, A. L., & Bischl, B. (2019). Tunability: Importance of hyperparameters of machine learning algorithms. Journal of Machine Learning Research, 20(53), 1\u201332.","journal-title":"Journal of Machine Learning Research"},{"key":"9545_CR30","unstructured":"R Core Team. (2024). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing."},{"key":"9545_CR31","first-page":"22305","volume":"33","author":"G Smith","year":"2020","unstructured":"Smith, G., Mansilla, R., & Goulding, J. (2020). Model class reliance for random forests. Advances in Neural Information Processing Systems, 33, 22305\u201322315.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"9545_CR32","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1016\/j.eswa.2017.02.049","volume":"81","author":"Q Song","year":"2017","unstructured":"Song, Q., Jiang, H., & Liu, J. (2017). Feature selection based on FDA and F-score for multi-class classification. Expert Systems with Applications, 81, 22\u201327.","journal-title":"Expert Systems with Applications"},{"key":"9545_CR33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2105-9-307","volume":"9","author":"C Strobl","year":"2008","unstructured":"Strobl, C., Boulesteix, A. L., Kneib, T., Augustin, T., & Zeileis, A. (2008). Conditional variable importance for random forests. BMC Bioinformatics, 9, 1\u201311.","journal-title":"BMC Bioinformatics"},{"key":"9545_CR34","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1186\/1471-2105-8-25","volume":"8","author":"C Strobl","year":"2007","unstructured":"Strobl, C., Boulesteix, A. L., Zeileis, A., & Hothorn, T. (2007). Bias in random forest variable importance measures: Illustrations, sources and a solution. BMC Bioinformatics, 8, 25.","journal-title":"BMC Bioinformatics"},{"issue":"14","key":"9545_CR35","doi-asserted-by":"publisher","first-page":"1986","DOI":"10.1093\/bioinformatics\/btr300","volume":"27","author":"L Tolo\u015fi","year":"2011","unstructured":"Tolo\u015fi, L., & Lengauer, T. (2011). Classification with correlated features: Unreliability of feature ranking and solutions. Bioinformatics, 27(14), 1986\u20131994.","journal-title":"Bioinformatics"},{"issue":"2","key":"9545_CR36","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1145\/2641190.2641198","volume":"15","author":"J Vanschoren","year":"2013","unstructured":"Vanschoren, J., van Rijn, J. N., Bischl, B., & Torgo, L. (2013). OpenML: Networked science in machine learning. SIGKDD Explorations, 15(2), 49\u201360.","journal-title":"SIGKDD Explorations"},{"key":"9545_CR37","doi-asserted-by":"publisher","first-page":"e6339","DOI":"10.7717\/peerj.6339","volume":"7","author":"MN Wright","year":"2019","unstructured":"Wright, M. N., & K\u00f6nig, I. R. (2019). Splitting on categorical predictors in random forests. PeerJ, 7, e6339.","journal-title":"PeerJ"},{"key":"9545_CR38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v077.i01","volume":"77","author":"MN Wright","year":"2017","unstructured":"Wright, M. N., & Ziegler, A. (2017). ranger: A fast implementation of random forests for high dimensional data in C++ and R. Journal of Statistical Software, 77, 1\u201317.","journal-title":"Journal of Statistical Software"},{"issue":"1","key":"9545_CR39","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1111\/j.1467-9868.2005.00532.x","volume":"68","author":"M Yuan","year":"2006","unstructured":"Yuan, M., & Lin, Y. (2006). Model selection and estimation in regression with grouped variables, Journal of the Royal Statistical Society. Series B (Statistical Methodology), 68(1), 49\u201367.","journal-title":"Series B (Statistical Methodology)"},{"issue":"2","key":"9545_CR40","first-page":"1","volume":"15","author":"Z Zhou","year":"2021","unstructured":"Zhou, Z., & Hooker, G. (2021). Unbiased measurement of feature importance in tree-based methods. ACM Transactions on Knowledge Discovery from Data, 15(2), 1\u201321.","journal-title":"ACM Transactions on Knowledge Discovery from Data"},{"key":"9545_CR41","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1016\/j.patrec.2014.07.004","volume":"55","author":"L Zini","year":"2015","unstructured":"Zini, L., Noceti, N., Fusco, G., & Odone, F. (2015). Structured multi-class feature selection with an application to face recognition. Pattern Recognition Letters, 55, 35\u201341.","journal-title":"Pattern Recognition Letters"}],"container-title":["Journal of Classification"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00357-026-09545-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00357-026-09545-6","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00357-026-09545-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T02:18:47Z","timestamp":1783995527000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00357-026-09545-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,4]]},"references-count":41,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2026,7]]}},"alternative-id":["9545"],"URL":"https:\/\/doi.org\/10.1007\/s00357-026-09545-6","relation":{},"ISSN":["0176-4268","1432-1343"],"issn-type":[{"value":"0176-4268","type":"print"},{"value":"1432-1343","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,4]]},"assertion":[{"value":"4 June 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 February 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 March 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Approval"}},{"value":"The authors declare no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}}]}}