{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T20:19:58Z","timestamp":1771705198563,"version":"3.50.1"},"reference-count":39,"publisher":"Oxford University Press (OUP)","issue":"15","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2008,8,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Motivation: In the context of clinical bioinformatics methods are needed for assessing the additional predictive value of microarray data compared to simple clinical parameters alone. Such methods should also provide an optimal prediction rule making use of all potentialities of both types of data: they should ideally be able to catch subtypes which are not identified by clinical parameters alone. Moreover, they should address the question of the additional predictive value of microarray data in a fair framework.<\/jats:p><jats:p>Results: We propose a novel but simple two-step approach based on random forests and partial least squares (PLS) dimension reduction embedding the idea of pre-validation suggested by Tibshirani and colleagues, which is based on an internal cross-validation for avoiding overfitting. Our approach is fast, flexible and can be used both for assessing the overall additional significance of the microarray data and for building optimal hybrid classification rules. Its efficiency is demonstrated through simulations and an application to breast cancer and colorectal cancer data.<\/jats:p><jats:p>Availability: Our method is implemented in the freely available R package \u2018MAclinical\u2019 which can be downloaded from http:\/\/www.stat.uni-muenchen.de\/~socher\/MAclinical<\/jats:p><jats:p>Contact: \u00a0boulesteix@slcmsr.org<\/jats:p>","DOI":"10.1093\/bioinformatics\/btn262","type":"journal-article","created":{"date-parts":[[2008,6,11]],"date-time":"2008-06-11T00:13:53Z","timestamp":1213143233000},"page":"1698-1706","source":"Crossref","is-referenced-by-count":67,"title":["Microarray-based classification and clinical predictors: on combined classifiers and additional predictive value"],"prefix":"10.1093","volume":"24","author":[{"given":"Anne-Laure","family":"Boulesteix","sequence":"first","affiliation":[{"name":"1 Sylvia Lawry Centre for MS Research, Hohenlindenerstr. 1, D-81677 Munich, 2Department of Statistics, Ludwig-Maximilians-University of Munich, Ludwigstr. 33, D-80539 Munich and 3Institute of Medical Biometry and Medical Informatics, University Hospital Freiburg, Stefan-Meier-Str. 26, D-79104 Freiburg, Germany"},{"name":"1 Sylvia Lawry Centre for MS Research, Hohenlindenerstr. 1, D-81677 Munich, 2Department of Statistics, Ludwig-Maximilians-University of Munich, Ludwigstr. 33, D-80539 Munich and 3Institute of Medical Biometry and Medical Informatics, University Hospital Freiburg, Stefan-Meier-Str. 26, D-79104 Freiburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christine","family":"Porzelius","sequence":"additional","affiliation":[{"name":"1 Sylvia Lawry Centre for MS Research, Hohenlindenerstr. 1, D-81677 Munich, 2Department of Statistics, Ludwig-Maximilians-University of Munich, Ludwigstr. 33, D-80539 Munich and 3Institute of Medical Biometry and Medical Informatics, University Hospital Freiburg, Stefan-Meier-Str. 26, D-79104 Freiburg, Germany"},{"name":"1 Sylvia Lawry Centre for MS Research, Hohenlindenerstr. 1, D-81677 Munich, 2Department of Statistics, Ludwig-Maximilians-University of Munich, Ludwigstr. 33, D-80539 Munich and 3Institute of Medical Biometry and Medical Informatics, University Hospital Freiburg, Stefan-Meier-Str. 26, D-79104 Freiburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martin","family":"Daumer","sequence":"additional","affiliation":[{"name":"1 Sylvia Lawry Centre for MS Research, Hohenlindenerstr. 1, D-81677 Munich, 2Department of Statistics, Ludwig-Maximilians-University of Munich, Ludwigstr. 33, D-80539 Munich and 3Institute of Medical Biometry and Medical Informatics, University Hospital Freiburg, Stefan-Meier-Str. 26, D-79104 Freiburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2008,6,9]]},"reference":[{"key":"2023020210482857700_B1","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1002\/cem.785","article-title":"Partial least squares for discrimination.","volume":"17","author":"Barker","year":"2003","journal-title":"J. Chemometr"},{"key":"2023020210482857700_B2","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1186\/1471-2105-9-14","article-title":"Allowing for mandatory covariates in boosting estimation of sparse high-dimensional survival models","volume":"9","author":"Binder","year":"2008","journal-title":"BMC Bioinformatics"},{"key":"2023020210482857700_B3","doi-asserted-by":"crossref","first-page":"2191","DOI":"10.1093\/hmg\/ddg221","article-title":"Gene expression profile in multiple sclerosis patients and healthy controls: identifying pathways relevant to disease","volume":"12","author":"Bomprezzi","year":"2003","journal-title":"Hum. Mol. Genet"},{"key":"2023020210482857700_B4","doi-asserted-by":"crossref","first-page":"33","DOI":"10.2202\/1544-6115.1075","article-title":"PLS dimension reduction for classification with microarray data","volume":"3","author":"Boulesteix","year":"2004","journal-title":"Stat. Appl. Genet. Mol. Biol."},{"key":"2023020210482857700_B5","doi-asserted-by":"crossref","first-page":"16","DOI":"10.2202\/1544-6115.1226","article-title":"Reader's reaction to \u2018Dimension reduction for classification with gene expression microarray data\u2019 by Dai et al. (2006)","volume":"5","author":"Boulesteix","year":"2006","journal-title":"Stat. Appl. Genet. Mol. Biol."},{"key":"2023020210482857700_B6","doi-asserted-by":"crossref","first-page":"1702","DOI":"10.1093\/bioinformatics\/btm162","article-title":"WilcoxCV: an efficient R package for variable selection in cross-validation","volume":"23","author":"Boulesteix","year":"2007","journal-title":"Bioinformatics"},{"key":"2023020210482857700_B7","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1093\/bib\/bbl016","article-title":"Partial least squares: a versatile tool for the analysis of high-dimensional genomic data","volume":"8","author":"Boulesteix","year":"2007","journal-title":"Brief. Bioinform"},{"key":"2023020210482857700_B8","doi-asserted-by":"crossref","first-page":"77","DOI":"10.4137\/CIN.S408","article-title":"Evaluating microarray-based classifiers: an overview.","volume":"6","author":"Boulesteix","year":"2008","journal-title":"Cancer Informat"},{"key":"2023020210482857700_B9","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/BF00058655","article-title":"Bagging predictors.","volume":"24","author":"Breiman","year":"1996","journal-title":"Mach. Learn"},{"key":"2023020210482857700_B10","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests.","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn"},{"key":"2023020210482857700_B11","doi-asserted-by":"crossref","first-page":"6","DOI":"10.2202\/1544-6115.1147","article-title":"Dimension reduction for classification with gene expression data","volume":"5","author":"Dai","year":"2006","journal-title":"Stat. Appl. Genet. Mol. Biol"},{"key":"2023020210482857700_B12","first-page":"S46","article-title":"The additional predictive value of magnetic resonance imaging for the prediction of future relapses if relapse history is available.","volume":"12","author":"Daumer","year":"2006","journal-title":"Mult. Scler"},{"key":"2023020210482857700_B13","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/0169-7439(93)85002-X","article-title":"SIMPLS: an alternative approach to partial least squares regression","volume":"18","author":"de Jong","year":"1993","journal-title":"Chemomet. Intell. Lab. Syst"},{"key":"2023020210482857700_B14","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1016\/j.jmva.2004.02.012","article-title":"Finding predictive gene groups from microarray data.","volume":"90","author":"Dettling","year":"2004","journal-title":"J. Multivariate Anal"},{"key":"2023020210482857700_B15","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1186\/1471-2105-7-3","article-title":"Gene selection and classification of microarray data using random forests","volume":"7","author":"Diaz-Uriarte","year":"2006","journal-title":"BMC Bioinformatics"},{"key":"2023020210482857700_B16","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1093\/jnci\/djk018","article-title":"Critical review of published microarray studies for cancer outcome and guidelines on statistical analysis and reporting.","volume":"99","author":"Dupuy","year":"2007","journal-title":"J. Natl Cancer I"},{"key":"2023020210482857700_B17","doi-asserted-by":"crossref","first-page":"1837","DOI":"10.1016\/j.ejca.2004.02.025","article-title":"\u2018Good old\u2019 clinical markers have similar power in breast cancer prognosis as microarray gene expression profilers","volume":"40","author":"Eden","year":"2004","journal-title":"Eur. J. Cancer"},{"key":"2023020210482857700_B18","unstructured":"Fridlyand J \u00a0YangJYH DENMARKLAB R package Advanced microarray data analysis: class discovery and class prediction 2004 last accessed date 30 June 2008 Available at http:\/\/genome.cbs.dtu.dk\/courses\/norfa2004\/Extras\/DENMARKLAB.zip"},{"key":"2023020210482857700_B19","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1080\/01621459.1994.10476452","article-title":"An interpretation of partial least squares.","volume":"89","author":"Garthwaite","year":"1994","journal-title":"J. Am. Stat. Assoc"},{"key":"2023020210482857700_B20","doi-asserted-by":"crossref","first-page":"e184","DOI":"10.1093\/bioinformatics\/btl230","article-title":"Predicting the prognosis of breast cancer by integrating clinical and microarray data with Bayesian networks","volume":"22","author":"Gevaert","year":"2006","journal-title":"Bioinformatics"},{"key":"2023020210482857700_B21","doi-asserted-by":"crossref","DOI":"10.1214\/07-AOAS152","article-title":"A study of pre-validation","author":"H\u00f6fling","year":"2008","journal-title":"Ann. Appl. Stat"},{"key":"2023020210482857700_B22","doi-asserted-by":"crossref","first-page":"651","DOI":"10.1198\/106186006X133933","article-title":"Unbiased recursive partitioning: a conditional inference framework.","volume":"15","author":"Hothorn","year":"2006","journal-title":"J. Comput. Graph. Stat"},{"key":"2023020210482857700_B23","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1056\/NEJMp0708162","article-title":"Letting the genome out of the bottle \u2013 Will we get our wish?","volume":"358","author":"Hunter","year":"2008","journal-title":"New England J. Med"},{"key":"2023020210482857700_B24","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1016\/S0140-6736(05)17878-7","article-title":"Microarrays and molecular research: noise discovery?","volume":"365","author":"Ioannidis","year":"2005","journal-title":"The Lancet"},{"key":"2023020210482857700_B25","doi-asserted-by":"crossref","first-page":"498","DOI":"10.1158\/1078-0432.CCR-05-2734","article-title":"Multiple gene expression classifiers from different array platforms predict poor prognosis of colorectal cancer.","volume":"13","author":"Lin","year":"2007","journal-title":"Clin. Cancer Res"},{"key":"2023020210482857700_B26","doi-asserted-by":"crossref","first-page":"1065","DOI":"10.1081\/BIP-200035491","article-title":"Evaluating methods for classifying expression data.","volume":"14","author":"Man","year":"2004","journal-title":"J. Biopharm. Stat"},{"key":"2023020210482857700_B27","article-title":"Multivariate Calibration","author":"Martens","year":"1989"},{"key":"2023020210482857700_B28","doi-asserted-by":"crossref","first-page":"3301","DOI":"10.1093\/bioinformatics\/bti499","article-title":"Prediction error estimation: a comparison of resampling methods.","volume":"21","author":"Molinaro","year":"2005","journal-title":"Bioinformatics"},{"key":"2023020210482857700_B29","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1093\/bioinformatics\/18.1.39","article-title":"Tumor classification by partial least squares using microarray gene expression data.","volume":"18","author":"Nguyen","year":"2002","journal-title":"Bioinformatics"},{"key":"2023020210482857700_B30","doi-asserted-by":"crossref","first-page":"1439","DOI":"10.1016\/S0140-6736(03)14686-7","article-title":"Predictive ability of DNA microarrays for cancer outcomes and correlates: an empirical assessment","volume":"362","author":"Ntzani","year":"2003","journal-title":"The Lancet"},{"key":"2023020210482857700_B31","doi-asserted-by":"crossref","first-page":"R953","DOI":"10.1186\/bcr1325","article-title":"Gene expression profiling spares early breast cancer patients from adjuvant therapy: derived and validated in two population-based cohorts.","volume":"7","author":"Pawitan","year":"2005","journal-title":"Breast Cancer Res"},{"key":"2023020210482857700_B32","doi-asserted-by":"crossref","first-page":"631","DOI":"10.1093\/bioinformatics\/bti033","article-title":"A comprehensive evaluation of multicategory classification methods for microarray gene expression cancer diagnosis.","volume":"21","author":"Statnikov","year":"2005","journal-title":"Bioinformatics"},{"key":"2023020210482857700_B33","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1111\/j.2517-6161.1990.tb01786.x","article-title":"Continuum regression: cross-validated sequentially constructed prediction embracing ordinary least squares, partial least squares and principal component regression.","volume":"52","author":"Stone","year":"1990","journal-title":"J. R. Stat. Soc. B"},{"key":"2023020210482857700_B34","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1186\/1471-2105-8-25","article-title":"Bias in random forest variable importance measures: illustrations, sources and a solution","volume":"8","author":"Strobl","year":"2007","journal-title":"BMC Bioinformatics"},{"key":"2023020210482857700_B35","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1093\/bioinformatics\/btl543","article-title":"Improved breast cancer prognosis through the combination of clinical and genetic markers.","volume":"23","author":"Sun","year":"2007","journal-title":"Bioinformatics"},{"key":"2023020210482857700_B36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2202\/1544-6115.1000","article-title":"Pre-validation and inference in microarrays","volume":"1","author":"Tibshirani","year":"2002","journal-title":"Stat. Appl. Genet. Mol. Biol"},{"key":"2023020210482857700_B37","doi-asserted-by":"crossref","first-page":"6044","DOI":"10.1016\/j.csda.2006.11.041","article-title":"Boosting ridge regression.","volume":"51","author":"Tutz","year":"2007","journal-title":"Comput. Statist. Data Anal"},{"key":"2023020210482857700_B38","doi-asserted-by":"crossref","first-page":"530","DOI":"10.1038\/415530a","article-title":"Gene expression profiling predicts clinical outcome of breast cancer.","volume":"415","author":"van't Veer","year":"2002","journal-title":"Nature"},{"key":"2023020210482857700_B39","article-title":"Estimation of principal components and related models by iterative least squares. In","author":"Wold","year":"1966","journal-title":"Multivariate Analysis"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/24\/15\/1698\/49048473\/bioinformatics_24_15_1698.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/24\/15\/1698\/49048473\/bioinformatics_24_15_1698.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,30]],"date-time":"2025-01-30T17:27:32Z","timestamp":1738258052000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/24\/15\/1698\/265007"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,6,9]]},"references-count":39,"journal-issue":{"issue":"15","published-print":{"date-parts":[[2008,8,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btn262","relation":{},"ISSN":["1367-4811","1367-4803"],"issn-type":[{"value":"1367-4811","type":"electronic"},{"value":"1367-4803","type":"print"}],"subject":[],"published-other":{"date-parts":[[2008,8,1]]},"published":{"date-parts":[[2008,6,9]]}}}