{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,7]],"date-time":"2026-07-07T09:51:06Z","timestamp":1783417866087,"version":"3.54.6"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2005,3,23]],"date-time":"2005-03-23T00:00:00Z","timestamp":1111536000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/2.0\/"},{"start":{"date-parts":[[2005,3,23]],"date-time":"2005-03-23T00:00:00Z","timestamp":1111536000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/2.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                        <jats:title>Background<\/jats:title>\n                        <jats:p>The use of mass spectrometry as a proteomics tool is poised to revolutionize early disease diagnosis and biomarker identification. Unfortunately, before standard supervised classification algorithms can be employed, the \"curse of dimensionality\" needs to be solved. Due to the sheer amount of information contained within the mass spectra, most standard machine learning techniques cannot be directly applied. Instead, feature selection techniques are used to first reduce the dimensionality of the input space and thus enable the subsequent use of classification algorithms. This paper examines feature selection techniques for proteomic mass spectrometry.<\/jats:p>\n                     <\/jats:sec><jats:sec>\n                        <jats:title>Results<\/jats:title>\n                        <jats:p>This study examines the performance of the nearest centroid classifier coupled with the following feature selection algorithms. Student-t test, Kolmogorov-Smirnov test, and the P-test are univariate statistics used for filter-based feature ranking. From the wrapper approaches we tested sequential forward selection and a modified version of sequential backward selection. Embedded approaches included shrunken nearest centroid and a novel version of boosting based feature selection we developed. In addition, we tested several dimensionality reduction approaches, namely principal component analysis and principal component analysis coupled with linear discriminant analysis. To fairly assess each algorithm, evaluation was done using stratified cross validation with an internal leave-one-out cross-validation loop for automated feature selection. Comprehensive experiments, conducted on five popular cancer data sets, revealed that the less advocated sequential forward selection and boosted feature selection algorithms produce the most consistent results across all data sets. In contrast, the state-of-the-art performance reported on isolated data sets for several of the studied algorithms, does not hold across all data sets.<\/jats:p>\n                     <\/jats:sec><jats:sec>\n                        <jats:title>Conclusion<\/jats:title>\n                        <jats:p>This study tested a number of popular feature selection methods using the nearest centroid classifier and found that several reportedly state-of-the-art algorithms in fact perform rather poorly when tested via stratified cross-validation. The revealed inconsistencies provide clear evidence that algorithm evaluation should be performed on several data sets using a consistent (i.e., non-randomized, stratified) cross-validation procedure in order for the conclusions to be statistically sound.<\/jats:p>\n                     <\/jats:sec>","DOI":"10.1186\/1471-2105-6-68","type":"journal-article","created":{"date-parts":[[2005,3,24]],"date-time":"2005-03-24T07:16:10Z","timestamp":1111648570000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":110,"title":["Feature selection and nearest centroid classification for protein mass spectrometry"],"prefix":"10.1186","volume":"6","author":[{"given":"Ilya","family":"Levner","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2005,3,23]]},"reference":[{"issue":"13","key":"393_CR1","first-page":"3609","volume":"62","author":"B Adam","year":"2002","unstructured":"Adam B, Qu Y, Davis JW, Ward MD, Clements MA, Cazares LH, Semmes OJ, Schellhammer PF, Yasui Y, Feng Z, Wright GL Jr: Serum protein fingerprinting coupled with a pattern-matching algorithm distinguishes prostate cancer from benign prostate hyperplasia and healthy men. Cancer Research 2002, 62(13):3609\u20133614.","journal-title":"Cancer Research"},{"key":"393_CR2","volume-title":"Bio Informatics","author":"KA Baggerly","year":"2004","unstructured":"Baggerly KA, Morris JS, Coombes KR: Reproducibility of seldi-tof protein patterns in serum: Comparing data sets from different experiments. Bio Informatics 2004., 4(20):"},{"key":"393_CR3","doi-asserted-by":"publisher","first-page":"1667","DOI":"10.1002\/pmic.200300522","volume":"3","author":"Baggerly A Keith","year":"2003","unstructured":"Keith BaggerlyA, Jeffrey MorrisS, Jing Wang , David Gold , Lian-Chun Xiao , Kevin CoombesR: A comprehensive approach to the analysis of matrix-assisted laser desorption\/ionization-time of flight proteomics spectra from serum samples. Proteomics 2003, 3: 1667\u20131672. 10.1002\/pmic.200300522","journal-title":"Proteomics"},{"issue":"4","key":"393_CR4","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1586\/14737159.3.4.411","volume":"3","author":"TP Conrads","year":"2003","unstructured":"Conrads TP, Zhou M, Petricoin EF III, Liotta L, Veenstra TD: Cancer diagnosis using proteomic patterns. Expert Reviews in Molecular Diagnostics 2003, 3(4):411\u2013420. 10.1586\/14737159.3.4.411","journal-title":"Expert Reviews in Molecular Diagnostics"},{"key":"393_CR5","volume-title":"Time-of-Flight Mass Spectrometry","author":"RJ Cotter","year":"1994","unstructured":"Cotter RJ: Time-of-Flight Mass Spectrometry. American Chemical Society, Washington, DC; 1994."},{"issue":"8","key":"393_CR6","doi-asserted-by":"publisher","first-page":"1272","DOI":"10.1373\/49.8.1272","volume":"48","author":"E Diamandis","year":"2003","unstructured":"Diamandis E: Proteomic patterns in biological fluinds: Do they represent the future of cancer diagnostics. Clinical Chemistry (Point\/CounterPoint) 2003, 48(8):1272\u20131278. 10.1373\/49.8.1272","journal-title":"Clinical Chemistry (Point\/CounterPoint)"},{"issue":"7","key":"393_CR7","doi-asserted-by":"publisher","first-page":"1895","DOI":"10.1162\/089976698300017197","volume":"10","author":"G Thomas","year":"1998","unstructured":"Thomas G: Dietterich. Approximate statistical test for comparing supervised classification learning algorithms. Neural Computation 1998, 10(7):1895\u20131923. 10.1162\/089976698300017197","journal-title":"Neural Computation"},{"key":"393_CR8","volume-title":"Pattern Classification and Scene Analysis","author":"R Duda","year":"1973","unstructured":"Duda R, Hart P: Pattern Classification and Scene Analysis. John Wiley & Sons, New York; 1973."},{"key":"393_CR9","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1006\/jcss.1997.1504","volume":"55","author":"Y Freund","year":"1997","unstructured":"Freund Y, Schapire R: A decision-theoretical generalization of on-line learning and an application to boosting. Computer System Science 1997, 55: 119\u2013139. 10.1006\/jcss.1997.1504","journal-title":"Computer System Science"},{"key":"393_CR10","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-21606-5","volume-title":"The Elements of Statistical Learning. Springer Series in Statistics","author":"T Hastie","year":"2001","unstructured":"Hastie T, Tibshirani R, Friedman J: The Elements of Statistical Learning. Springer Series in Statistics. Springer Verlag, New York; 2001."},{"key":"393_CR11","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1016\/j.artmed.2004.01.007","volume":"31","author":"I Inza","year":"2004","unstructured":"Inza I, Larranaga P, Blanco R, Cerrolaza AJ: Filter versus wrapper gene selection approaches in dna microarray domains. Artificial Intelligence in Medicine 2004, 31: 91\u2013103. 10.1016\/j.artmed.2004.01.007","journal-title":"Artificial Intelligence in Medicine"},{"key":"393_CR12","volume-title":"BMC Bioinformatics","author":"NO Jeffries","year":"2004","unstructured":"Jeffries NO: Performance of a genetic algorithm for mass spectrometry proteomics. BMC Bioinformatics 2004., 5(180):"},{"key":"393_CR13","volume-title":"Clinical proteomics program databank. Technical report, National Cancer Institute, Center for Cancer Research, NCI-FDA Clinical Proteomics Program","author":"D Johann","year":"2003","unstructured":"Johann D: Clinical proteomics program databank. Technical report, National Cancer Institute, Center for Cancer Research, NCI-FDA Clinical Proteomics Program.2003. [http:\/\/ncifdaproteomics.com\/ppatterns.php]"},{"key":"393_CR14","volume-title":"Geometric Data Analysis: An Empirical Approach to Dimensionality Reduction and the Study of Patterns","author":"Kirby Michael","year":"2001","unstructured":"Michael Kirby: Geometric Data Analysis: An Empirical Approach to Dimensionality Reduction and the Study of Patterns. John Wiley & Sons, New York; 2001."},{"key":"393_CR15","volume-title":"Technical report, University of Alberta, No: TR04-10","author":"I Levner","year":"2004","unstructured":"Levner I: Proteomic pattern recognition. Technical report, University of Alberta, No: TR04\u201310 2004."},{"key":"393_CR16","volume-title":"Feature Extraction, Foundations and Applications","author":"I Levner","year":"2005","unstructured":"Levner I, Bulitko V, Lin G: Feature extraction for classification of proteomic mass spectra: A comparative study. In Feature Extraction, Foundations and Applications. Edited by: Isabelle Guyon, Steve Gunn, Masoud Nikravesh, Lofti Zadeh. Springer; 2005:in press."},{"key":"393_CR17","volume-title":"Computational Biology","author":"RH Lilien","year":"2003","unstructured":"Lilien RH, Farid H, Donald BR: Probabilistic disease classification of expression-dependent proteomic data from mass spectrometry of human serum. Computational Biology 2003., 10(6):"},{"issue":"2","key":"393_CR18","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1023\/A:1026039313770","volume":"43","author":"H Park","year":"2003","unstructured":"Park H, Jeon M, Rosen JB: Lower dimensional representation of text data based on centroids and least squares. BIT 2003, 43(2):1\u201322. 10.1023\/A:1026039313770","journal-title":"BIT"},{"issue":"9306","key":"393_CR19","doi-asserted-by":"publisher","first-page":"572","DOI":"10.1016\/S0140-6736(02)07746-2","volume":"359","author":"EF Petricoin","year":"2002","unstructured":"Petricoin EF, Ardekani AM, Hitt BA, Levine PJ, Fusaro VA, Steinberg SM, Mills GB, Simone C, Fishman DA, Kohn EC, Liotta LA: Use of proteomic patterns in serum to identify ovarian cancer. The Lancet 2002, 359(9306):572\u2013577. 10.1016\/S0140-6736(02)07746-2","journal-title":"The Lancet"},{"issue":"20","key":"393_CR20","doi-asserted-by":"publisher","first-page":"1576","DOI":"10.1093\/jnci\/94.20.1576","volume":"94","author":"EF Petricoin","year":"2002","unstructured":"Petricoin EF, Ornstein DK, Paweletz CP, Ardekani A, Hackett PS, Hitt BA, Velassco A, Trucco C, Wiegand L, Wood K, Simone C, Levine PJ, Linehan WM, Emmert-Buck MR, Steinberg SM, Kohn EC, Liotta LA: Serum preteomic patterns for detection of prostate cancer. Journal of the National Cancer Institute 2002, 94(20):1576\u20131578.","journal-title":"Journal of the National Cancer Institute"},{"key":"393_CR21","volume-title":"Numerical Recipes in C: The Art of Scientifi Computing","author":"WH Press","year":"2002","unstructured":"Press WH, Teukolsky SA, Vetterling WT, Flannery BP: Numerical Recipes in C: The Art of Scientifi Computing. Second edition. Cambridge University Press; 2002.","edition":"Second"},{"issue":"10","key":"393_CR22","doi-asserted-by":"crossref","first-page":"1835","DOI":"10.1093\/clinchem\/48.10.1835","volume":"48","author":"Y Qu","year":"2002","unstructured":"Qu Y, Adam B, Yasui Y, Ward MD, Cazares LH, Schellhammer PF, Feng Z, Semmes OJ, Wright GL Jr: Boosted decision tree analysis of surface-enhanced laser desorption\/ionization mass spectral serum profiles discriminates prostate cancer from noncancer patients. Clinical Chemistry 2002, 48(10):1835\u20131843.","journal-title":"Clinical Chemistry"},{"key":"393_CR23","first-page":"1401","volume-title":"IJCAI","author":"Schapire E Robert","year":"1999","unstructured":"Robert SchapireE: A brief introduction to boosting. IJCAI 1999, 1401\u20131406."},{"key":"393_CR24","volume-title":"BioInformatics","author":"J Sorace","year":"2003","unstructured":"Sorace J, Zhan M: A data review and re-assessment of ovarian cancer serum proteomic profiling. BioInformatics 2003., 4(24):"},{"issue":"1","key":"393_CR25","doi-asserted-by":"publisher","first-page":"104","DOI":"10.1214\/ss\/1056397488","volume":"18","author":"R Tibshirani","year":"2003","unstructured":"Tibshirani R, Hastie T, Narasimhan B, Chu G: Class prediction by nearest shrunken centroids, with applications to dna microarrays. Statistical Science 2003, 18(1):104\u2013117. 10.1214\/ss\/1056397488","journal-title":"Statistical Science"},{"key":"393_CR26","volume-title":"BioInformatics","author":"R Tibshirani","year":"2004","unstructured":"Tibshirani R, Hastiey T, Narasimhanz B, Soltys S, Shi G, Koong A, Le Q: Sample classifcation from protein mass spectrometry by 'peak probability contrasts'. BioInformatics 2004."},{"key":"393_CR27","volume-title":"International Journal of Computer Vision","author":"Viola Paul","year":"2003","unstructured":"Paul Viola, Michael Jones: Robust real-time object detection. International Journal of Computer Vision 2003."},{"issue":"7","key":"393_CR28","doi-asserted-by":"publisher","first-page":"1491","DOI":"10.1016\/S0031-3203(01)00131-5","volume":"35","author":"CK Keung","year":"2002","unstructured":"Keung CK, Lam W, Ling CX: Learning good prototypes for classification using filtering and abstraction of instances. Pattern Recognition 2002, 35(7):1491\u20131506. 10.1016\/S0031-3203(01)00131-5","journal-title":"Pattern Recognition"},{"key":"393_CR29","volume-title":"BMC Bioinformatics","author":"Michael Wagner","year":"2004","unstructured":"Michael Wagner, Naik DN, Kasukurti S, Pothen A, Devineni RR, Adam BL, Semmes OJ, Wright GL Jr: Computational protein biomarker prediction: a case study for prostate cancer. BMC Bioinformatics 2004., 5(26):"},{"key":"393_CR30","volume-title":"BioInformatics","author":"B Wu","year":"2003","unstructured":"Wu B, Abbott T, Fishman D, McMurray W, Mor G, Stone K, Ward D, Williams K, Zhao H: Comparison of statistical methods for classifcation of ovarian cancer using mass spectrometry data. BioInformatics 2003., 19(13):"},{"key":"393_CR31","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1038\/nrc1043","volume":"3","author":"JD Wulfkuhle","year":"2003","unstructured":"Wulfkuhle JD, Liotta LA, Petricoin EF: Proteomic applications for the early detection of cancer. Nature Reviews 2003, 3: 267\u2013275. 10.1038\/nrc1043","journal-title":"Nature Reviews"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1471-2105-6-68.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/1471-2105-6-68\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1471-2105-6-68.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,7]],"date-time":"2024-10-07T12:08:54Z","timestamp":1728302934000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/1471-2105-6-68"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2005,3,23]]},"references-count":31,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2005,12]]}},"alternative-id":["393"],"URL":"https:\/\/doi.org\/10.1186\/1471-2105-6-68","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2005,3,23]]},"assertion":[{"value":"9 December 2004","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 March 2005","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 March 2005","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"68"}}