{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,2]],"date-time":"2025-11-02T10:19:47Z","timestamp":1762078787093},"reference-count":25,"publisher":"Springer Science and Business Media LLC","issue":"1","content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2006,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Background<\/jats:title>\n            <jats:p>Overfitting the data is a salient issue for classifier design in small-sample settings. This is why selecting a classifier from a constrained family of classifiers, ones that do not possess the potential to too finely partition the feature space, is typically preferable. But overfitting is not merely a consequence of the classifier family; it is highly dependent on the classification rule used to design a classifier from the sample data. Thus, it is possible to consider families that are rather complex but for which there are classification rules that perform well for small samples. Such classification rules can be advantageous because they facilitate satisfactory classification when the class-conditional distributions are not easily separated and the sample is not large. Here we consider neural networks, from the perspectives of classical design based solely on the sample data and from noise-injection-based design.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>This paper provides an extensive simulation-based comparative study of noise-injected neural-network design. It considers a number of different feature-label models across various small sample sizes using varying amounts of noise injection. Besides comparing noise-injected neural-network design to classical neural-network design, the paper compares it to a number of other classification rules. Our particular interest is with the use of microarray data for expression-based classification for diagnosis and prognosis. To that end, we consider noise-injected neural-network design as it relates to a study of survivability of breast cancer patients.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusion<\/jats:title>\n            <jats:p>The conclusion is that in many instances noise-injected neural network design is superior to the other tested methods, and in almost all cases it does not perform substantially worse than the best of the other methods. Since the amount of noise injected is consequential, the effect of differing amounts of injected noise must be considered.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1186\/1471-2105-7-274","type":"journal-article","created":{"date-parts":[[2006,6,1]],"date-time":"2006-06-01T09:01:39Z","timestamp":1149152499000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Noise-injected neural networks show promise for use on small-sample expression data"],"prefix":"10.1186","volume":"7","author":[{"given":"Jianping","family":"Hua","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James","family":"Lowey","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zixiang","family":"Xiong","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Edward R","family":"Dougherty","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2006,5,31]]},"reference":[{"key":"1013_CR1","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1002\/cfg.62","volume":"2","author":"ER Dougherty","year":"2001","unstructured":"Dougherty ER: Small sample issues for microarray-based classification. Comparative and Functional Genomics 2001, 2: 28\u201334. 10.1002\/cfg.62","journal-title":"Comparative and Functional Genomics"},{"key":"1013_CR2","doi-asserted-by":"publisher","first-page":"1509","DOI":"10.1093\/bioinformatics\/bti171","volume":"21","author":"J Hua","year":"2005","unstructured":"Hua J, Xiong Z, Lowey J, Suh E, Dougherty ER: Optimal number of features as a function of sample size for various classification rules. Bioinformatics 2005, 21: 1509\u20131515. 10.1093\/bioinformatics\/bti171","journal-title":"Bioinformatics"},{"key":"1013_CR3","doi-asserted-by":"publisher","first-page":"264","DOI":"10.1137\/1116025","volume":"16","author":"V Vapnik","year":"1971","unstructured":"Vapnik V, Chervonenkis A: On the uniform convergence of relative frequencies of events to their probabilities. Theor Prob Appl 1971, 16: 264\u2013280. 10.1137\/1116025","journal-title":"Theor Prob Appl"},{"key":"1013_CR4","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-0711-5","volume-title":"A Probabilistic Theory of Pattern Recognition","author":"L Devroye","year":"1996","unstructured":"Devroye L, Gy\u00f6rfi L, Lugosi G: A Probabilistic Theory of Pattern Recognition. New York, Springer Verlag; 1996."},{"key":"1013_CR5","doi-asserted-by":"publisher","first-page":"1641","DOI":"10.1016\/j.patcog.2003.10.013","volume":"37","author":"SN Attoor","year":"2004","unstructured":"Attoor SN, Dougherty ER: Classifier performance as a function of distributional complexity. Pattern Recognition 2004, 37: 1641\u20131651. 10.1016\/j.patcog.2003.10.013","journal-title":"Pattern Recognition"},{"key":"1013_CR6","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1016\/0893-6080(91)90033-2","volume":"4","author":"J Sietsma","year":"1991","unstructured":"Sietsma J, Dow RJF: Creating artificial neural networks that generalize. Neural Networks 1991, 4: 67\u201379. 10.1016\/0893-6080(91)90033-2","journal-title":"Neural Networks"},{"key":"1013_CR7","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1109\/72.105415","volume":"3","author":"L Holmstr\u00e4om","year":"1992","unstructured":"Holmstr\u00e4om L, Koistinen P: Using additive noise in back-propagation training. IEEE Trans Neural Networks 1992, 3: 24\u201338. 10.1109\/72.105415","journal-title":"IEEE Trans Neural Networks"},{"key":"1013_CR8","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1109\/21.155944","volume":"22","author":"K Matsuoka","year":"1992","unstructured":"Matsuoka K: Noise injection into inputs in back-propagation learning. IEEE Trans Syst Man and Cybern 1992, 22: 436\u2013440. 10.1109\/21.155944","journal-title":"IEEE Trans Syst Man and Cybern"},{"key":"1013_CR9","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1162\/neco.1995.7.1.108","volume":"7","author":"CM Bishop","year":"1995","unstructured":"Bishop CM: Training with noise is equivalent to Tikhonov regularization. Neural Computation 1995, 7: 108\u2013116.","journal-title":"Neural Computation"},{"key":"1013_CR10","doi-asserted-by":"publisher","first-page":"643","DOI":"10.1162\/neco.1996.8.3.643","volume":"8","author":"G An","year":"1996","unstructured":"An G: The effects of adding noise during backpropagation traning on a generalization performance. Neural Computation 1996, 8: 643\u2013674.","journal-title":"Neural Computation"},{"key":"1013_CR11","doi-asserted-by":"publisher","first-page":"678","DOI":"10.1109\/21.370200","volume":"25","author":"Y Grandvalet","year":"1995","unstructured":"Grandvalet Y, Canu S: Comments on \"Noise injection into inputs in back-propagation learning\". IEEE Trans Syst Man and Cybern 1995, 25: 678\u2013681. 10.1109\/21.370200","journal-title":"IEEE Trans Syst Man and Cybern"},{"key":"1013_CR12","doi-asserted-by":"publisher","first-page":"1093","DOI":"10.1162\/neco.1997.9.5.1093","volume":"9","author":"Y Grandvalet","year":"1997","unstructured":"Grandvalet Y, Canu S, Boucheron S: Noise injection: theoretical prospects. Neural Computation 1997, 9: 1093\u20131108. 10.1162\/neco.1997.9.5.1093","journal-title":"Neural Computation"},{"key":"1013_CR13","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1109\/72.377960","volume":"6","author":"R Reed","year":"1995","unstructured":"Reed R, Marks RJ II, Oh S: Similarities of error regularization, sigmoid gain scaling, target smoothing, and training with jitter. IEEE Trans Neural Networks 1995, 6: 529\u2013538. 10.1109\/72.377960","journal-title":"IEEE Trans Neural Networks"},{"key":"1013_CR14","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1023\/A:1007965819848","volume":"21","author":"NC Hammadi","year":"1998","unstructured":"Hammadi NC, Ito H: Improving the performance of feedforward neural networks by noise injection into hidden neurons. J Intell Robot Syst 1998, 21: 103\u2013115. 10.1023\/A:1007965819848","journal-title":"J Intell Robot Syst"},{"key":"1013_CR15","doi-asserted-by":"publisher","first-page":"1201","DOI":"10.1109\/72.883393","volume":"11","author":"Y Grandvalet","year":"2000","unstructured":"Grandvalet Y: Anisotropic noise injection for input variables relevance determination. IEEE Trans Neural Networks 2000, 11: 1201\u20131212. 10.1109\/72.883393","journal-title":"IEEE Trans Neural Networks"},{"key":"1013_CR16","doi-asserted-by":"publisher","first-page":"504","DOI":"10.1109\/72.839019","volume":"11","author":"M Skurichina","year":"2002","unstructured":"Skurichina M, Raudys S, Duin RPW: K-Nearest neighbors directed noise injection in multilayer perceptron training. IEEE Trans Neural Networks 2002, 11: 504\u2013411. 10.1109\/72.839019","journal-title":"IEEE Trans Neural Networks"},{"key":"1013_CR17","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1007\/s00521-004-0411-6","volume":"13","author":"A Seghouane","year":"2004","unstructured":"Seghouane A, Moudden Y, Fleury G: Regularizing the effect of input noise injection in feedforward neural networks training. Neural Comput & Applic 2004, 13: 248\u2013254. 10.1007\/s00521-004-0411-6","journal-title":"Neural Comput & Applic"},{"key":"1013_CR18","first-page":"61","volume":"11","author":"T Kohonen","year":"2001","unstructured":"Kohonen T, Barna G, Chrisley R: Statistical pattern recognition with neural networks: Bechmarking studies. San Diego:Proc IEEE Int Conf Neural Networks 2001, 11: 61\u201368.","journal-title":"San Diego:Proc IEEE Int Conf Neural Networks"},{"key":"1013_CR19","doi-asserted-by":"publisher","first-page":"1999","DOI":"10.1056\/NEJMoa021967","volume":"347","author":"MJ van de Vijver","year":"2002","unstructured":"van de Vijver MJ, He YD, van't Veer LJ, Dai H, Hart AAM, Voskuil DW, Schreiber GJ, Peterse JL, Roberts C, Marton MJ, Parrish M, Atsma D, Witteveen A, Delahaye L, van der Velde T, Bartelink H, Rodenhuis S, Rutgers ET, Friend SH, Bernards R: A gene-expression signature as a predictor of survival in breast cancer. New Eng J Med 2002, 347: 1999\u20132009. 10.1056\/NEJMoa021967","journal-title":"New Eng J Med"},{"key":"1013_CR20","doi-asserted-by":"publisher","first-page":"530","DOI":"10.1038\/415530a","volume":"415","author":"LJ van't Veer","year":"2002","unstructured":"van't Veer LJ, Dai H, van de Vijver MJ, He YD, Hart AAM, Mao M, Peterse HL, van der Kooy K, Marton MJ, Witteveen AT, Schreiber GJ, Kerkhoven RM, Roberts C, Linsley PS, Bernards R, Friend SH: Gene expression profiling predicts clinical outcome of breast cancer. Nature 2002, 415: 530\u2013536. 10.1038\/415530a","journal-title":"Nature"},{"key":"1013_CR21","volume-title":"Pattern Classification","author":"R Duda","year":"2001","unstructured":"Duda R, Hart P, Stork DG: Pattern Classification. 2nd edition. New York, Wiley; 2001.","edition":"2"},{"key":"1013_CR22","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1089\/10665270252833226","volume":"9","author":"S Kim","year":"2002","unstructured":"Kim S, Dougherty ER, Barrera J, Chen Y, Bittner ML, Trent JM: Strong feature sets from small samples. Journal of Computational Biology 2002, 9: 127\u2013146. 10.1089\/10665270252833226","journal-title":"Journal of Computational Biology"},{"key":"1013_CR23","volume-title":"Numerical Recipes in C","author":"WH Press","year":"2002","unstructured":"Press WH, Teukolsky SA, Vetterling WT, Flannery BP: Numerical Recipes in C. 2nd edition. New York, Cambridge University Press; 2002.","edition":"2"},{"key":"1013_CR24","doi-asserted-by":"publisher","first-page":"531","DOI":"10.1126\/science.286.5439.531","volume":"286","author":"TR Golub","year":"1999","unstructured":"Golub TR, Slonim DK, Tamayo P, Huard C, Gaasenbeek M, Mesirov JP, Coller H, Loh ML, Downing JR, Caligiuri MA, Bloomfield CD, Lander ES: Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring. Science 1999, 286: 531\u2013537. 10.1126\/science.286.5439.531","journal-title":"Science"},{"key":"1013_CR25","doi-asserted-by":"publisher","first-page":"374","DOI":"10.1093\/bioinformatics\/btg419","volume":"20","author":"U Braga-Neto","year":"2004","unstructured":"Braga-Neto U, Dougherty ER: Is cross-validation valid for small-sample microarray classification? Bioinformatics 2004, 20: 374\u2013380. 10.1093\/bioinformatics\/btg419","journal-title":"Bioinformatics"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1471-2105-7-274.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T03:20:11Z","timestamp":1630466411000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/1471-2105-7-274"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,5,31]]},"references-count":25,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2006,12]]}},"alternative-id":["1013"],"URL":"https:\/\/doi.org\/10.1186\/1471-2105-7-274","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2006,5,31]]},"assertion":[{"value":"3 January 2006","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 May 2006","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 May 2006","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"274"}}