{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T14:45:46Z","timestamp":1767969946878,"version":"3.49.0"},"reference-count":24,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,2,12]],"date-time":"2020-02-12T00:00:00Z","timestamp":1581465600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2020,2,12]],"date-time":"2020-02-12T00:00:00Z","timestamp":1581465600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Res Notes"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Objective<\/jats:title>\n                <jats:p>Because it is impossible to know which statistical learning algorithm performs best on a prediction task, it is common to use stacking methods to ensemble individual learners into a more powerful single learner. Stacking algorithms are usually based on linear models, which may run into problems, especially when predictions are highly correlated. In this study, we develop a greedy algorithm for model stacking that overcomes this issue while still being very fast and easy to interpret. We evaluate our greedy algorithm on 7 different data sets from various biomedical disciplines and compare it to linear stacking, genetic algorithm stacking and a brute force approach in different prediction settings. We further apply this algorithm on a task to optimize the weighting of the single domains (e.g., income, education) that build the German Index of Multiple Deprivation (GIMD) to be highly correlated with mortality.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The greedy stacking algorithm provides good ensemble weights and outperforms the linear stacker in many tasks. Still, the brute force approach is slightly superior, but is computationally expensive. The greedy weighting algorithm has a variety of possible applications and is fast and efficient. A python implementation is provided.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s13104-020-4931-7","type":"journal-article","created":{"date-parts":[[2020,2,12]],"date-time":"2020-02-12T17:02:43Z","timestamp":1581526963000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["A greedy stacking algorithm for model ensembling and domain weighting"],"prefix":"10.1186","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9498-8002","authenticated-orcid":false,"given":"Christoph F.","family":"Kurz","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Werner","family":"Maier","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christian","family":"Rink","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,2,12]]},"reference":[{"issue":"2","key":"4931_CR1","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1016\/S0893-6080(05)80023-1","volume":"5","author":"DH Wolpert","year":"1992","unstructured":"Wolpert DH. Stacked generalization. Neural Netw. 1992;5(2):241\u201359.","journal-title":"Neural Netw"},{"issue":"1","key":"4931_CR2","first-page":"49","volume":"24","author":"L Breiman","year":"1996","unstructured":"Breiman L. Stacked regressions. Mach Learn. 1996;24(1):49\u201364.","journal-title":"Mach Learn"},{"issue":"1","key":"4931_CR3","first-page":"7","volume":"6","author":"MJ Van der Laan","year":"2007","unstructured":"Van der Laan MJ, Polley EC, Hubbard AE. Super learner. Stat Appl Genet Mol. 2007;6(1):7.","journal-title":"Stat Appl Genet Mol"},{"issue":"5","key":"4931_CR4","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1093\/aje\/kws241","volume":"177","author":"S Rose","year":"2013","unstructured":"Rose S. Mortality risk score prediction in an elderly population using machine learning. Am J Epidemiol. 2013;177(5):443\u201352.","journal-title":"Am J Epidemiol"},{"issue":"1","key":"4931_CR5","first-page":"1","volume":"23","author":"R Sikora","year":"2014","unstructured":"Sikora R, Hmoud Al-laymoun O. A modified stacking ensemble machine learning algorithm using genetic algorithms. J Int Tech Inform Manag. 2014;23(1):1.","journal-title":"J Int Tech Inform Manag"},{"key":"4931_CR6","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1016\/j.engappai.2014.08.005","volume":"37","author":"H Parvin","year":"2015","unstructured":"Parvin H, MirnabiBaboli M, Alinejad-Rokny H. Proposing a classifier ensemble framework based on classifier selection and decision tree. Eng Appl Art Int. 2015;37:34\u201342.","journal-title":"Eng Appl Art Int"},{"key":"4931_CR7","volume-title":"Dictionary of algorithms and data structures","author":"PE Black","year":"2004","unstructured":"Black PE. Dictionary of algorithms and data structures. Gaithersburg: National Institute of Standards and Technology; 2004."},{"key":"4931_CR8","volume-title":"Introduction to algorithms","author":"TH Cormen","year":"2009","unstructured":"Cormen TH, Leiserson CE, Rivest RL, Stein C. Introduction to algorithms. 3rd ed. Cambridge: The MIT Press; 2009.","edition":"3"},{"issue":"3","key":"4931_CR9","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1111\/dme.12062","volume":"30","author":"W Maier","year":"2013","unstructured":"Maier W, Holle R, Hunger M, Peters A, Meisinger C, Greiser K, Kluttig A, V\u00f6lzke H, Schipf S, Moebus S, et al. The impact of regional deprivation and individual socio-economic status on the prevalence of type 2 diabetes in Germany. A pooled analysis of five population-based studies. Diabetic Med. 2013;30(3):78\u201386.","journal-title":"Diabetic Med"},{"issue":"2","key":"4931_CR10","doi-asserted-by":"publisher","first-page":"89661","DOI":"10.1371\/journal.pone.0089661","volume":"9","author":"W Maier","year":"2014","unstructured":"Maier W, Scheidt-Nave C, Holle R, Kroll LE, Lampert T, Du Y, Heidemann C, Mielck A. Area level deprivation is an independent determinant of prevalent type 2 diabetes and obesity at the national level in Germany. Results from the national telephone health interview surveys \u2018german health update\u2019 geda 2009 and 2010. PloS ONE. 2014;9(2):89661.","journal-title":"PloS ONE"},{"issue":"1","key":"4931_CR11","first-page":"42","volume":"78","author":"C Hofmeister","year":"2016","unstructured":"Hofmeister C, Maier W, Mielck A, Stahl L, Breckenkamp J, Razum O. Regional deprivation in germany: Nation-wide analysis of its association with mortality using the german index of multiple deprivation (GIMD). Gesundheitswesen. 2016;78(1):42\u20138.","journal-title":"Gesundheitswesen"},{"issue":"5","key":"4931_CR12","doi-asserted-by":"publisher","first-page":"432","DOI":"10.1136\/jech-2014-204312","volume":"69","author":"M Mar\u00ed-Dell\u2019Olmo","year":"2015","unstructured":"Mar\u00ed-Dell\u2019Olmo M, Gotsens M, Pal\u00e8ncia L, Burstr\u00f6m B, Corman D, Costa G, Deboosere P, D\u00edez \u00c8, Dom\u00ednguez-Berj\u00f3n F, Dz\u00farov\u00e1 D, et al. Socioeconomic inequalities in cause-specific mortality in 15 European cities. J Epidemiol Commun H. 2015;69(5):432\u201341.","journal-title":"J Epidemiol Commun H"},{"key":"4931_CR13","unstructured":"Lichman, M. UCI machine learning repository. 2013. http:\/\/archive.ics.uci.edu\/ml"},{"issue":"1","key":"4931_CR14","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1016\/j.compeleceng.2011.09.001","volume":"38","author":"O Er","year":"2012","unstructured":"Er O, Tanrikulu AC, Abakay A, Temurtas F. An approach based on probabilistic neural network for diagnosis of mesothelioma\u2019s disease. Comput Electr Eng. 2012;38(1):75\u201381.","journal-title":"Comput Electr Eng"},{"issue":"4","key":"4931_CR15","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1016\/0031-3203(91)90074-F","volume":"24","author":"Z-Q Hong","year":"1991","unstructured":"Hong Z-Q, Yang J-Y. Optimal discriminant plane for a small number of samples and design method of classifier on the plane. Pattern Recogn. 1991;24(4):317\u201324.","journal-title":"Pattern Recogn"},{"issue":"6","key":"4931_CR16","doi-asserted-by":"publisher","first-page":"770","DOI":"10.1109\/TKDE.2004.11","volume":"16","author":"Z-H Zhou","year":"2004","unstructured":"Zhou Z-H, Jiang Y. Nec4.5: neural ensemble based c4.5. IEEE T Knowl Data Eng. 2004;16(6):770\u20133.","journal-title":"IEEE T Knowl Data Eng"},{"key":"4931_CR17","unstructured":"Waugh SG. Extending and benchmarking cascade-correlation: extensions to the cascade-correlation architecture and benchmarking of feed-forward supervised artificial neural networks. Ph.D. thesis, University of Tasmania 1995"},{"issue":"6","key":"4931_CR18","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1377\/hlthaff.23.6.107","volume":"23","author":"JP Newhouse","year":"2004","unstructured":"Newhouse JP. Consumer-directed health plans and the rand health insurance experiment. Health Affair. 2004;23(6):107\u201313.","journal-title":"Health Affair"},{"key":"4931_CR19","unstructured":"Smith JW, Everhart J, Dickson W, Knowler W, Johannes R. Using the adap learning algorithm to forecast the onset of diabetes mellitus. In: Proceedings of Annual Symposium on Computer Applications in Medical Care. American Medical Informatics Association; 1988, p. 261."},{"key":"4931_CR20","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E. Scikit-learn: machine learning in Python. J Mach Learn Res. 2011;12:2825\u201330.","journal-title":"J Mach Learn Res"},{"key":"4931_CR21","volume-title":"Numerical optimization","author":"J Nocedal","year":"2006","unstructured":"Nocedal J, Wright S. Numerical optimization. Berlin: Springer; 2006."},{"issue":"1","key":"4931_CR22","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1068\/a37168","volume":"38","author":"M Noble","year":"2006","unstructured":"Noble M, Wright G, Smith G, Dibben C. Measuring multiple deprivation at the small-area level. Environ Plann A. 2006;38(1):169\u201385.","journal-title":"Environ Plann A"},{"issue":"7","key":"4931_CR23","doi-asserted-by":"publisher","first-page":"416","DOI":"10.1055\/s-0031-1280846","volume":"74","author":"W Maier","year":"2012","unstructured":"Maier W, Fairburn J, Mielck A. Regional deprivation and mortality in Bavaria. Development of a community-based index of multiple deprivation. Gesundheitswesen. 2012;74(7):416\u201325.","journal-title":"Gesundheitswesen"},{"key":"4931_CR24","unstructured":"https:\/\/github.com\/krz\/greedy-weighting. Accessed 4 Nov 2018."}],"container-title":["BMC Research Notes"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13104-020-4931-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s13104-020-4931-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13104-020-4931-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,2,11]],"date-time":"2021-02-11T09:49:32Z","timestamp":1613036972000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcresnotes.biomedcentral.com\/articles\/10.1186\/s13104-020-4931-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,12]]},"references-count":24,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["4931"],"URL":"https:\/\/doi.org\/10.1186\/s13104-020-4931-7","relation":{},"ISSN":["1756-0500"],"issn-type":[{"value":"1756-0500","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,12]]},"assertion":[{"value":"22 January 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 January 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 February 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"70"}}