{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T22:32:27Z","timestamp":1777415547757,"version":"3.51.4"},"reference-count":60,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2009,8,4]],"date-time":"2009-08-04T00:00:00Z","timestamp":1249344000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2009,9,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>Many contemporary classifiers are constructed to provide good performance for very high dimensional data. However, an issue that is at least as important as good classification is determining which of the many potential variables provide key information for good decisions. Responding to this issue can help us to determine which aspects of the datagenerating mechanism (e.g. which genes in a genomic study) are of greatest importance in terms of distinguishing between populations. We introduce tilting methods for addressing this problem. We apply weights to the components of data vectors, rather than to the data vectors themselves (as is commonly the case in related work). In addition we tilt in a way that is governed by L2-distance between weight vectors, rather than by the more commonly used Kullback\u2013Leibler distance. It is shown that this approach, together with the added constraint that the weights should be non-negative, produces an algorithm which eliminates vector components that have little influence on the classification decision. In particular, use of the L2-distance in this problem produces properties that are reminiscent of those that arise when L1-penalties are employed to eliminate explanatory variables in very high dimensional prediction problems, e.g. those involving the lasso. We introduce techniques that can be implemented very rapidly, and we show how to use bootstrap methods to assess the accuracy of our variable ranking and variable elimination procedures.<\/jats:p>","DOI":"10.1111\/j.1467-9868.2009.00701.x","type":"journal-article","created":{"date-parts":[[2009,8,4]],"date-time":"2009-08-04T10:20:53Z","timestamp":1249381253000},"page":"783-803","source":"Crossref","is-referenced-by-count":28,"title":["Tilting Methods for Assessing the Influence of Components in a Classifier"],"prefix":"10.1093","volume":"71","author":[{"given":"Peter","family":"Hall","sequence":"first","affiliation":[{"name":"University of Melbourne , Australia , and , UK"},{"name":"University of Glasgow , Australia , and , UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"D. M.","family":"Titterington","sequence":"additional","affiliation":[{"name":"University of Glasgow , UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jing-Hao","family":"Xue","sequence":"additional","affiliation":[{"name":"University of Melbourne , Australia , and , UK"},{"name":"University of Glasgow , Australia , and , UK"},{"name":"University College London , Australia , and , UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2009,8,4]]},"reference":[{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"6745","DOI":"10.1073\/pnas.96.12.6745","article-title":"Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays","volume":"96","author":"Alon","year":"1999","journal-title":"Proc. Natn. Acad. Sci. USA"},{"key":"2023032921301871800_","first-page":"5","article-title":"Limit theorems for the probabilities of moderate deviations","volume":"3","author":"Amosova","year":"1972","journal-title":"Vest. Leningrad Univ. Mat. Meh. Astron."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1093\/bioinformatics\/17.6.509","article-title":"A Bayesian framework for the analysis of microarray expression data: regularized t-test and statistical inferences of gene changes","volume":"17","author":"Baldi","year":"2001","journal-title":"Bioinformatics"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"989","DOI":"10.3150\/bj\/1106314847","article-title":"Some theory of Fisher\u2019s linear discriminant function, \u2018naive Bayes\u2019, and some alternatives when there are many more variables than observations","volume":"10","author":"Bickel","year":"2004","journal-title":"Bernoulli"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","DOI":"10.1214\/08-AOS620","article-title":"Simultaneous analysis of lasso and Dantzig selector","author":"Bickel","year":"2009","journal-title":"Ann. Statist."},{"key":"2023032921301871800_","volume-title":"Pattern Recognition and Machine Learning","author":"Bishop","year":"2006"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1214\/009053606000000092","article-title":"Boosting for high-dimensional linear models","volume":"34","author":"B\u00fchlmann","year":"2006","journal-title":"Ann. Statist."},{"key":"2023032921301871800_","first-page":"2313","article-title":"The Dantzig selector: statistical estimation when p is much larger than n","volume":"35","author":"Candes","year":"2007","journal-title":"Ann. Statist."},{"key":"2023032921301871800_","article-title":"Sparse multinomial logistic regression via Bayesian L1 regularisation","volume":"19","author":"Cawley","year":"2007","journal-title":"Adv. Neur. Inform. Process. Syst."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"556","DOI":"10.1016\/j.jeconom.2005.08.008","article-title":"Interval estimation of value-at-risk based on GARCH models with heavy-tailed innovations","volume":"137","author":"Chan","year":"2007","journal-title":"J. Econometr."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1137\/S1064827596304010","article-title":"Atomic decomposition by basis pursuit","volume":"20","author":"Chen","year":"1998","journal-title":"SIAM J. Sci. Comput."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1111\/1467-9868.00287","article-title":"Influence analysis based on the case sensitivity function","volume":"63","author":"Critchley","year":"2001","journal-title":"J. R. Statist. Soc. B"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1093\/biomet\/91.1.125","article-title":"Data-informed influence analysis","volume":"91","author":"Critchley","year":"2004","journal-title":"Biometrika"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"R210","DOI":"10.1186\/gb-2003-4-4-210","article-title":"Statistical test for differential expression in cDNA microarray experiments","volume":"4","author":"Cui","year":"2003","journal-title":"Genome Biol."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1093\/biostatistics\/kxh018","article-title":"Improved statistical tests for differential gene expression by shrinking variance components estimates","volume":"6","author":"Cui","year":"2005","journal-title":"Biostatistics"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"4148","DOI":"10.1093\/bioinformatics\/bti681","article-title":"Classification of microarrays to nearest centroids","volume":"21","author":"Dabney","year":"2005","journal-title":"Bioinformatics"},{"key":"2023032921301871800_","volume-title":"Optimal feature selection for nearest centroid classifiers, with applications to gene expression microarrays","author":"Dabney","year":"2005"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0001002","article-title":"Optimality driven nearest centroid classification from genomic data","volume":"2","author":"Dabney","year":"2007","journal-title":"PLoS One"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1198\/016214502753479248","article-title":"Comparison of discrimination methods for the classification of tumors using gene expression data","volume":"97","author":"Dudoit","year":"2002","journal-title":"J. Am. Statist. Ass."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","DOI":"10.1137\/1.9781611970319","volume-title":"The Jackknife, the Bootstrap and Other Resampling Plans","author":"Efron","year":"1982"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"1151","DOI":"10.1198\/016214501753382129","article-title":"Empirical Bayes analysis of a microarray experiment","volume":"96","author":"Efron","year":"2001","journal-title":"J. Am. Statist. Ass."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"2605","DOI":"10.1214\/07-AOS504","article-title":"High dimensional classification using features annealed independence rules","volume":"36","author":"Fan","year":"2008","journal-title":"Ann. Statist."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"1348","DOI":"10.1198\/016214501753382273","article-title":"Variable selection via nonconcave penalized likelihood and its oracle properties","volume":"96","author":"Fan","year":"2001","journal-title":"J. Am. Statist. Ass."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1111\/j.1467-9868.2008.00674.x","article-title":"Sure independence screening for ultrahigh dimensional feature space (with discussion)","volume":"70","author":"Fan","year":"2008","journal-title":"J. R. Statist. Soc. B"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","DOI":"10.1186\/1471-2105-7-126","article-title":"A two-sample Bayesian t-test for microarray data","volume":"7","author":"Fox","year":"2006","journal-title":"BMC Bioinform."},{"key":"2023032921301871800_","first-page":"457","article-title":"Optimal smoothing in kernel discriminant analysis","volume":"14","author":"Ghosh","year":"2004","journal-title":"Statist. Sin."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1126\/science.286.5439.531","article-title":"Molecular classification of cancer: class discovery and class prediction by gene expression monitoring","volume":"286","author":"Golub","year":"1999","journal-title":"Science"},{"key":"2023032921301871800_","first-page":"4963","article-title":"Translation of microarray data into clinically relevant cancer diagnostic tests using gene expression ratios in lung cancer and mesothelioma","volume":"62","author":"Gordon","year":"2002","journal-title":"Cancer Res."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","DOI":"10.1198\/jcgs.2009.08041","article-title":"Using generalised correlation to effect variable selection in very high dimensional problems","author":"Hall","year":"2009","journal-title":"J. Computnl Graph. Statist."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"661","DOI":"10.1111\/1467-9868.00199","article-title":"Biased bootstrap methods for reducing the effects of contamination","volume":"61","author":"Hall","year":"1999","journal-title":"J. R. Statist. Soc. B"},{"key":"2023032921301871800_","article-title":"Median-based classifiers for high-dimensional data","author":"Hall","year":"2009","journal-title":"Manuscript"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1111\/1467-9868.00394","article-title":"Data tilting for time series","volume":"65","author":"Hall","year":"2003","journal-title":"J. R. Statist. Soc. B"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"3057","DOI":"10.1016\/j.csda.2006.02.002","article-title":"Reweighted kernel density estimation","volume":"51","author":"Hazelton","year":"2007","journal-title":"Comput. Statist. Data Anal."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"805","DOI":"10.1089\/10665270050514945","article-title":"Testing for differentially expressed genes by maximum likelihood analysis of microarray data","volume":"7","author":"Ideker","year":"2000","journal-title":"J. Computnl Biol."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"923","DOI":"10.1016\/S0140-6736(03)12775-4","article-title":"Oligonucleotide microarray for prediction of early intrahepatic recurrence of hepato cellular carcinoma after curative resection","volume":"361","author":"Iizuka","year":"2003","journal-title":"Lancet"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"283","DOI":"10.2307\/2530018","article-title":"Maximum entropy constrained balance randomization for clinical trials","volume":"34","author":"Klotz","year":"1978","journal-title":"Biometrics"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1198\/016214504000000098","article-title":"Multicategory support vector machines: theory and application to the classification of microarray data and satellite radiance data","volume":"99","author":"Lee","year":"2004","journal-title":"J. Am. Statist. Ass."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1093\/biomet\/90.2.393","article-title":"Prepivoting by weighted bootstrap iteration","volume":"90","author":"Lee","year":"2003","journal-title":"Biometrika"},{"key":"2023032921301871800_","first-page":"31","article-title":"Replicated microarray data","volume":"12","author":"L\u00f6nnstedt","year":"2002","journal-title":"Statist. Sin."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1088\/0954-898X_6_3_011","article-title":"Probable networks and plausible predictions\u2014a review of practical Bayesian methods for supervised neural networks","volume":"6","author":"Mackay","year":"1995","journal-title":"Computn Neur. Syst."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4612-0745-0","volume-title":"Bayesian Learning for Neural Systems","author":"Neal","year":"1996"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1089\/106652701300099074","article-title":"On differential variability of expression ratios: improving statistical inference about gene expression changes from microarray data","volume":"8","author":"Newton","year":"2001","journal-title":"J. Computnl Biol."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","DOI":"10.2202\/1544-6115.1252","article-title":"Accurate ranking of differentially expressed genes by a distribution-free shrinkage approach","volume":"6","author":"Opgen-Rhein","year":"2007","journal-title":"Statist. Appl. Genet. Molec. Biol."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1093\/biomet\/75.2.237","article-title":"Empirical likelihood ratio confidence intervals for a single functional","volume":"75","author":"Owen","year":"1988","journal-title":"Biometrika"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1214\/aos\/1176347494","article-title":"Empirical likelihood ratio confidence regions","volume":"18","author":"Owen","year":"1990","journal-title":"Ann. Statist."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"1964","DOI":"10.1214\/009053606000000416","article-title":"Confidence regions for high quantiles of a heavy tailed distribution","volume":"34","author":"Peng","year":"2006","journal-title":"Ann. Statist."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4612-4578-0","volume-title":"Goodness-of-fit Statistics for Discrete Multivariate Data","author":"Read","year":"1988"},{"key":"2023032921301871800_","first-page":"325","article-title":"Probabilities of moderate deviations","volume":"27","author":"Rubin","year":"1965","journal-title":"Sankhya A"},{"key":"2023032921301871800_","first-page":"759","article-title":"Bayesian inference and optimal design for the sparse linear model","volume":"9","author":"Seeger","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","DOI":"10.2202\/1544-6115.1027","article-title":"Linear models and empirical Bayes methods for assessing differential expression in microarray experiments","volume":"3","author":"Smyth","year":"2004","journal-title":"Statist. Appl. Genet. Molec. Biol."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1111\/j.2517-6161.1996.tb02080.x","article-title":"Regression shrinkage and selection via the lasso","volume":"58","author":"Tibshirani","year":"1996","journal-title":"J. R. Statist. Soc. B"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"6567","DOI":"10.1073\/pnas.082099299","article-title":"Diagnosis of multiple cancer types by shrunken centroids of gene expression","volume":"99","author":"Tibshirani","year":"2002","journal-title":"Proc. Natn. Acad. Sci. USA"},{"key":"2023032921301871800_","first-page":"211","article-title":"Sparse Bayesian learning and the Relevance Vector Machine","volume":"1","author":"Tipping","year":"2001","journal-title":"J. Mach. Learn. Res."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"1083","DOI":"10.2307\/2531342","article-title":"On constrained balance randomization for clinical trials","volume":"39","author":"Titterington","year":"1983","journal-title":"Biometrics"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"5116","DOI":"10.1073\/pnas.091062498","article-title":"Significance analysis of microarrays applied to the ionizing radiation response","volume":"98","author":"Tusher","year":"2001","journal-title":"Proc. Natn. Acad. Sci. USA"},{"key":"2023032921301871800_","first-page":"351","article-title":"Oracle inequalities for multi-fold cross validation","volume":"24","author":"Van der Vaart","year":"2006","journal-title":"Statist. Decsns"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"972","DOI":"10.1093\/bioinformatics\/btm046","article-title":"Improved centroids estimation for the nearest shrunken centroid classifier","volume":"23","author":"Wang","year":"2007","journal-title":"Bioinformatics"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"3704","DOI":"10.1109\/TSP.2007.894265","article-title":"An empirical Bayesian strategy for solving the simultaneous sparse approximation problem","volume":"55","author":"Wipf","year":"2007","journal-title":"IEEE Trans. Signal Process."},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"2448","DOI":"10.1093\/bioinformatics\/btg345","article-title":"A random variance model for detection of differential gene expression in small microarray experiments","volume":"19","author":"Wright","year":"2003","journal-title":"Bioinformatics"},{"key":"2023032921301871800_","doi-asserted-by":"crossref","first-page":"1565","DOI":"10.1093\/bioinformatics\/bti217","article-title":"Differential gene expression detection using penalized linear regression models: the improved SAM statistic","volume":"21","author":"Wu","year":"2005","journal-title":"Bioinformatics"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fj.1467-9868.2009.00701.x","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/71\/4\/783\/49684328\/jrsssb_71_4_783.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/71\/4\/783\/49684328\/jrsssb_71_4_783.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,11]],"date-time":"2025-02-11T16:34:18Z","timestamp":1739291658000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/71\/4\/783\/7092840"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,8,4]]},"references-count":60,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2009,8,4]]},"published-print":{"date-parts":[[2009,9,1]]}},"URL":"https:\/\/doi.org\/10.1111\/j.1467-9868.2009.00701.x","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2009,9]]},"published":{"date-parts":[[2009,8,4]]}}}