{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T20:12:29Z","timestamp":1783627949331,"version":"3.55.0"},"reference-count":93,"publisher":"Springer Science and Business Media LLC","issue":"1","content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2009,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Background<\/jats:title>\n            <jats:p>The breadth of biological databases and their information content continues to increase exponentially. Unfortunately, our ability to query such sources is still often suboptimal. Here, we introduce and apply community voting, database-driven text classification, and visual aids as a means to incorporate distributed expert knowledge, to automatically classify database entries and to efficiently retrieve them.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>Using a previously developed peptide database as an example, we compared several machine learning algorithms in their ability to classify abstracts of published literature results into categories relevant to peptide research, such as related or not related to cancer, angiogenesis, molecular imaging, etc. Ensembles of bagged decision trees met the requirements of our application best. No other algorithm consistently performed better in comparative testing. Moreover, we show that the algorithm produces meaningful class probability estimates, which can be used to visualize the confidence of automatic classification during the retrieval process. To allow viewing long lists of search results enriched by automatic classifications, we added a dynamic heat map to the web interface. We take advantage of community knowledge by enabling users to cast votes in Web 2.0 style in order to correct automated classification errors, which triggers reclassification of all entries. We used a novel framework in which the database \"drives\" the entire vote aggregation and reclassification process to increase speed while conserving computational resources and keeping the method scalable. In our experiments, we simulate community voting by adding various levels of noise to nearly perfectly labelled instances, and show that, under such conditions, classification can be improved significantly.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusion<\/jats:title>\n            <jats:p>Using PepBank as a model database, we show how to build a classification-aided retrieval system that gathers training data from the community, is completely controlled by the database, scales well with concurrent change events, and can be adapted to add text classification capability to other biomedical databases.<\/jats:p>\n            <jats:p>The system can be accessed at <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"http:\/\/pepbank.mgh.harvard.edu\" ext-link-type=\"uri\">http:\/\/pepbank.mgh.harvard.edu<\/jats:ext-link>.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1186\/1471-2105-10-317","type":"journal-article","created":{"date-parts":[[2009,10,3]],"date-time":"2009-10-03T16:50:51Z","timestamp":1254588651000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["Enhancing navigation in biomedical databases by community voting and database-driven text classification"],"prefix":"10.1186","volume":"10","author":[{"given":"Timo","family":"Duchrow","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Timur","family":"Shtatland","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Guettler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Misha","family":"Pivovarov","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefan","family":"Kramer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ralph","family":"Weissleder","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2009,10,3]]},"reference":[{"key":"3047_CR1","doi-asserted-by":"publisher","first-page":"280","DOI":"10.1186\/1471-2105-8-280","volume":"8","author":"T Shtatland","year":"2007","unstructured":"Shtatland T, Guettler D, Kossodo M, Pivovarov M, Weissleder R: PepBank - a database of peptides based on sequence text mining and public peptide data sources. BMC Bioinformatics 2007, 8: 280. 10.1186\/1471-2105-8-280","journal-title":"BMC Bioinformatics"},{"issue":"4","key":"3047_CR2","doi-asserted-by":"publisher","first-page":"905","DOI":"10.1021\/bc060035+","volume":"17","author":"X Montet","year":"2006","unstructured":"Montet X, Weissleder R, Josephson L: Imaging pancreatic cancer with a peptide-nanoparticle conjugate targeted to normal pancreas. Bioconjug Chem 2006, 17(4):905\u2013911. 10.1021\/bc060035+","journal-title":"Bioconjug Chem"},{"issue":"1","key":"3047_CR3","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1021\/mp0499048","volume":"2","author":"CH Tung","year":"2005","unstructured":"Tung CH, Quinti L, Jaffer FA, Weissleder R: A branched fluorescent peptide probe for imaging of activated platelets. Mol Pharm 2005, 2(1):92\u201395. 10.1021\/mp0499048","journal-title":"Mol Pharm"},{"issue":"4","key":"3047_CR4","doi-asserted-by":"publisher","first-page":"751","DOI":"10.1002\/mrm.10110","volume":"47","author":"A Moore","year":"2002","unstructured":"Moore A, Sun PZ, Cory D, H\u00f6gemann D, Weissleder R, Lipes MA: MRI of insulitis in autoimmune diabetes. Magnetic Resonance in Medicine 2002, 47(4):751\u2013758. 10.1002\/mrm.10110","journal-title":"Magnetic Resonance in Medicine"},{"issue":"5","key":"3047_CR5","doi-asserted-by":"publisher","first-page":"438","DOI":"10.1038\/sj.neo.7900044","volume":"1","author":"A Bogdanov","year":"1999","unstructured":"Bogdanov A, Marecos E, Cheng HC, Chandrasekaran L, Krutzsch HC, Roberts DD, Weissleder R: Treatment of experimental brain tumors with trombospondin-1 derived peptides: an in vivo imaging study. Neoplasia 1999, 1(5):438\u2013445. 10.1038\/sj.neo.7900044","journal-title":"Neoplasia"},{"issue":"4","key":"3047_CR6","doi-asserted-by":"publisher","first-page":"458","DOI":"10.1002\/cmdc.200500036","volume":"1","author":"Y Choi","year":"2006","unstructured":"Choi Y, McCarthy JR, Weissleder R, Tung CH: Conjugation of a photosensitizer to an oligoarginine-based cell-penetrating peptide increases the efficacy of photodynamic therapy. Chem Med Chem 2006, 1(4):458\u2013463.","journal-title":"Chem Med Chem"},{"issue":"3","key":"3047_CR7","doi-asserted-by":"publisher","first-page":"554","DOI":"10.1021\/bc015555d","volume":"13","author":"L Josephson","year":"2002","unstructured":"Josephson L, Kircher M, Mahmood U, Tang Y, Weissleder Y: Near-infrared fluorescent nanoparticles as combined MR\/optical imaging probes. Bioconjug Chem 2002, 13(3):554\u2013560. 10.1021\/bc015555d","journal-title":"Bioconjug Chem"},{"issue":"20","key":"3047_CR8","doi-asserted-by":"publisher","first-page":"6087","DOI":"10.1021\/jm060515m","volume":"49","author":"X Montet","year":"2006","unstructured":"Montet X, Funovics M, Montet-Abou K, Weissleder R, Josephson L: Multivalent effects of RGD peptides obtained by nanoparticle display. J Med Chem 2006, 49(20):6087\u20136093. 10.1021\/jm060515m","journal-title":"J Med Chem"},{"issue":"5298","key":"3047_CR9","doi-asserted-by":"publisher","first-page":"343","DOI":"10.1126\/science.275.5298.343","volume":"275","author":"J Weinstein","year":"1997","unstructured":"Weinstein J, Myers T, O'Connor P, Friend S, Fornace A, Kohn K, Fojo T, Bates S, Rubinstein L, Anderson N, et al.: An information-intensive approach to the molecular pharmacology of cancer. Science 1997, 275(5298):343\u2013349. 10.1126\/science.275.5298.343","journal-title":"Science"},{"key":"3047_CR10","doi-asserted-by":"publisher","first-page":"620","DOI":"10.1007\/978-3-540-30132-5_86","volume":"3212","author":"WA Arentz","year":"2004","unstructured":"Arentz WA, \u00d8hrn A: Multidimensional Visualization and Navigation in Search Results. Lecture Notes in Computer Science 2004, 3212: 620\u2013629.","journal-title":"Lecture Notes in Computer Science"},{"key":"3047_CR11","unstructured":"What Is Web 2.0: Design Patterns and Business Models for the Next Generation of Software[http:\/\/www.oreillynet.com\/pub\/a\/oreilly\/tim\/news\/2005\/09\/30\/what-is-web-20.html]"},{"key":"3047_CR12","unstructured":"Wikipedia[http:\/\/www.wikipedia.org]"},{"key":"3047_CR13","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1145\/985692.985765","volume-title":"Proceedings of the SIGCHI conference on Human factors in computing systems","author":"FB Vi\u00e9gas","year":"2004","unstructured":"Vi\u00e9gas FB, Wattenberg M, Dave K: Studying cooperation and conflict between authors with history flow visualizations. Proceedings of the SIGCHI conference on Human factors in computing systems 2004, 575\u2013582."},{"key":"3047_CR14","unstructured":"Peer to Patent, Community Patent Review[http:\/\/www.peertopatent.org]"},{"issue":"1","key":"3047_CR15","first-page":"123","volume":"20","author":"BS Noveck","year":"2006","unstructured":"Noveck BS: \"Peer to Patent\": Collective Intelligence, Open Review, and Patent Reform. Harvard Journal of Law & Technology 2006, 20(1):123\u2013162.","journal-title":"Harvard Journal of Law & Technology"},{"key":"3047_CR16","doi-asserted-by":"publisher","first-page":"e59","DOI":"10.1371\/journal.pone.0000059","volume":"1","author":"RH Nilsson","year":"2006","unstructured":"Nilsson RH, Ryberg M, Kristiansson E, Abarenkov K, Larsson KH, Koljalg U: Taxonomic reliability of DNA sequences in public sequence databases: a fungal perspective. PLoS ONE 2006, 1: e59.","journal-title":"PLoS ONE"},{"issue":"5870","key":"3047_CR17","doi-asserted-by":"publisher","first-page":"1616","DOI":"10.1126\/science.319.5870.1616a","volume":"319","author":"MI Bidartondo","year":"2008","unstructured":"Bidartondo MI: Preserving accuracy in GenBank. Science 2008, 319(5870):1616.","journal-title":"Science"},{"issue":"12","key":"3047_CR18","doi-asserted-by":"publisher","first-page":"1641","DOI":"10.1093\/bioinformatics\/18.12.1641","volume":"18","author":"WR Gilks","year":"2002","unstructured":"Gilks WR, Audit B, De Angelis D, Tsoka S, Ouzounis CA: Modeling the percolation of annotation errors in a database of protein sequences. Bioinformatics 2002, 18(12):1641\u20131649. [http:\/\/bioinformatics.oxfordjournals.org\/cgi\/content\/abstract\/18\/12\/1641]","journal-title":"Bioinformatics"},{"key":"3047_CR19","doi-asserted-by":"crossref","unstructured":"Maglott D, Ostell J, Pruitt KD, Tatusova T: Entrez Gene: gene-centered information at NCBI. Nucleic Acids Res 2007, (35 Database):D26\u201331.","DOI":"10.1093\/nar\/gkl993"},{"issue":"7","key":"3047_CR20","doi-asserted-by":"publisher","first-page":"e175","DOI":"10.1371\/journal.pbio.0060175","volume":"6","author":"J Huss","year":"2008","unstructured":"Huss J, Orozco C, Goodale J, Wu C, Batalov S, Vickers T, Valafar F, Su A: A Gene Wiki for Community Annotation of Gene Function. Plos Biol 2008, 6(7):e175.","journal-title":"Plos Biol"},{"issue":"12","key":"3047_CR21","doi-asserted-by":"publisher","first-page":"2462","DOI":"10.1261\/rna.1200508","volume":"14","author":"J Daub","year":"2008","unstructured":"Daub J, Gardner P, Tate J, Ramskold D, Manske M, Scott W, Weinberg Z, Griffiths-Jones S, Bateman A: The RNA WikiProject: Community annotation of RNA families. RNA 2008, 14(12):2462\u20132464.","journal-title":"RNA"},{"issue":"5","key":"3047_CR22","doi-asserted-by":"publisher","first-page":"R89","DOI":"10.1186\/gb-2008-9-5-r89","volume":"9","author":"B Mons","year":"2008","unstructured":"Mons B, Ashburner M, Chichester C, Van Mulligen E, Weeber M, Den Dunnen J, Van Ommen G, Musen M, Cockerill M, Hermjakob H, et al.: Calling on a million minds for community annotation in WikiProteins. Genome Biol 2008, 9(5):R89.","journal-title":"Genome Biol"},{"key":"3047_CR23","series-title":"Nucleic Acids Res","volume-title":"IDBD: Infectious Disease Biomarker Database","author":"I Yang","year":"2007","unstructured":"Yang I, Ryu C, Cho K, Kim J, Ong S, Mitchell W, Kim B, Oh H, Kim K: IDBD: Infectious Disease Biomarker Database. Nucleic Acids Res 2007, (36 Database):D455-D460."},{"key":"3047_CR24","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1142\/9781860948732_0038","volume":"6","author":"C Baral","year":"2007","unstructured":"Baral C, Gonzalez G, Gitter A, Teegarden C, Zeigler A, Joshi-Top\u00e9 G: CBioC: beyond a prototype for collaborative annotation of molecular interactions from the literature. Computational systems bioinformatics\/Life Sciences Society Computational Systems Bioinformatics Conference 2007, 6: 381\u2013384.","journal-title":"Computational systems bioinformatics\/Life Sciences Society Computational Systems Bioinformatics Conference"},{"issue":"1","key":"3047_CR25","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1093\/bioinformatics\/btn501","volume":"25","author":"J Gao","year":"2008","unstructured":"Gao J, Ade AS, Tarcea VG, Weymouth TE, Mirel BR, Jagadish HV, States DJ: Integrating and Annotating the Interactome using the MiMI plugin for Cytoscape. Bioinformatics 2008, 25(1):137\u2013138.","journal-title":"Bioinformatics"},{"key":"3047_CR26","unstructured":"PLoS ONE[http:\/\/www.plosone.org]"},{"key":"3047_CR27","unstructured":"CiteULike[http:\/\/www.citeulike.org]"},{"key":"3047_CR28","unstructured":"SciVee[http:\/\/www.scivee.tv]"},{"key":"3047_CR29","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1186\/1471-2105-8-269","volume":"8","author":"P Wang","year":"2007","unstructured":"Wang P, Morgan AA, Zhang Q, Sette A, Peters B: Automating document classification for the Immune Epitope Database. BMC Bioinformatics 2007, 8: 269.","journal-title":"BMC Bioinformatics"},{"key":"3047_CR30","first-page":"918","volume-title":"Proc AMIA Symp","author":"WJ Wilbur","year":"2000","unstructured":"Wilbur WJ: Boosting naive Bayesian learning on a large subset of MEDLINE. Proc AMIA Symp 2000, 918\u2013922."},{"issue":"4","key":"3047_CR31","doi-asserted-by":"publisher","first-page":"330","DOI":"10.1197\/jamia.M1157","volume":"10","author":"AB Wilcox","year":"2003","unstructured":"Wilcox AB, Hripcsak G: The Role of Domain Knowledge in Automating Medical Text Report Classification. Journal of the American Medical Informatics Association 2003, 10(4):330.","journal-title":"Journal of the American Medical Informatics Association"},{"key":"3047_CR32","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1136\/jamia.1999.0060393","volume":"6","author":"DB Aronow","year":"1999","unstructured":"Aronow DB, Fangfang F, Croft WB: Ad Hoc Classification of Radiology Reports. J Am Med Inform Assoc 1999, 6: 393\u2013411.","journal-title":"J Am Med Inform Assoc"},{"key":"3047_CR33","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1186\/1471-2105-4-11","volume":"4","author":"I Donaldson","year":"2003","unstructured":"Donaldson I, Martin J, de Bruijn B, Wolting C, Lay V, Tuekam B, Zhang S, Baskin B, Bader GD, Michalickova K, et al.: PreBIND and Textomy-mining the biomedical literature for protein-protein interactions using a support vector machine. BMC Bioinformatics 2003, 4: 11.","journal-title":"BMC Bioinformatics"},{"key":"3047_CR34","doi-asserted-by":"publisher","first-page":"370","DOI":"10.1186\/1471-2105-7-370","volume":"7","author":"D Chen","year":"2006","unstructured":"Chen D, M\u00fcller H-M, Sternberg PW: Automatic document classification of biological literature. BMC Bioinformatics 2006, 7: 370.","journal-title":"BMC Bioinformatics"},{"issue":"2","key":"3047_CR35","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1145\/772862.772873","volume":"4","author":"A Yeh","year":"2002","unstructured":"Yeh A, Hirschman L, Morgan A: Background and overview for KDD Cup 2002 task 1: information extraction from biomedical articles. ACM SIGKDD Explorations Newsletter 2002, 4(2):87\u201389.","journal-title":"ACM SIGKDD Explorations Newsletter"},{"key":"3047_CR36","doi-asserted-by":"publisher","first-page":"i331","DOI":"10.1093\/bioinformatics\/btg1046","volume":"19 Suppl 1","author":"AS Yeh","year":"2003","unstructured":"Yeh AS, Hirschman L, Morgan AA: Evaluation of text data mining for database curation: lessons learned from the KDD Challenge Cup. Bioinformatics 2003, 19 Suppl 1: i331-i339.","journal-title":"Bioinformatics"},{"issue":"1","key":"3047_CR37","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1093\/nar\/gkg094","volume":"31","author":"FlyBase Consortium","year":"2003","unstructured":"FlyBase Consortium: The FlyBase database of the Drosophila genome projects and community literature. Nucleic Acids Research 2003, 31(1):172\u2013175.","journal-title":"Nucleic Acids Research"},{"issue":"1","key":"3047_CR38","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1186\/1747-5333-1-4","volume":"1","author":"AM Cohen","year":"2006","unstructured":"Cohen AM, Hersh WR: The TREC 2004 genomics track categorization task: classifying full text biomedical documents. Journal of Biomedical Discovery and Collaboration 2006, 1(1):4.","journal-title":"Journal of Biomedical Discovery and Collaboration"},{"issue":"1","key":"3047_CR39","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1093\/bib\/6.1.57","volume":"6","author":"AM Cohen","year":"2005","unstructured":"Cohen AM, Hersh WR: A survey of current work in biomedical text mining. Brief Bioinformatics 2005, 6(1):57\u201371.","journal-title":"Brief Bioinformatics"},{"issue":"Suppl 2","key":"3047_CR40","doi-asserted-by":"publisher","first-page":"S4","DOI":"10.1186\/gb-2008-9-s2-s4","volume":"9","author":"M Krallinger","year":"2008","unstructured":"Krallinger M, Leitner F, Rodriguez-Penagos C, Valencia A: Overview of the protein-protein interaction annotation extraction task of BioCreative II. Genome Biol 2008, 9(Suppl 2):S4.","journal-title":"Genome Biol"},{"key":"3047_CR41","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1186\/1471-2105-4-11","volume":"4","author":"I Donaldson","year":"2003","unstructured":"Donaldson I, Martin J, de Bruijn B, Wolting C, Lay V, Tuekam B, Zhang S, Baskin B, Bader GD, Michalickova K, et al.: PreBIND and Textomy - mining the biomedical literature for protein-protein interactions using a support vector machine. BMC Bioinformatics 2003, 4: 11.","journal-title":"BMC Bioinformatics"},{"issue":"90001","key":"3047_CR42","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1093\/bioinformatics\/btg1011","volume":"19","author":"P Dobrokhotov","year":"2003","unstructured":"Dobrokhotov P, Goutte C, Veuthey A, Gaussier E: Combining NLP and probabilistic categorisation for document and term selection for Swiss-Prot medical annotation. Bioinformatics 2003, 19(90001):91\u201394.","journal-title":"Bioinformatics"},{"issue":"2","key":"3047_CR43","first-page":"32","volume":"16","author":"O Miotto","year":"2005","unstructured":"Miotto O, Tan TW, Brusic V: Supporting the curation of biological databases with reusable text mining. Genome informatics International Conference on Genome Informatics 2005, 16(2):32\u201344.","journal-title":"Genome informatics International Conference on Genome Informatics"},{"issue":"5","key":"3047_CR44","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1016\/j.molcel.2006.02.012","volume":"21","author":"L Hunter","year":"2006","unstructured":"Hunter L, Cohen K: Biomedical language processing: what's beyond PubMed? Molecular Cell 2006, 21(5):589\u2013594.","journal-title":"Molecular Cell"},{"issue":"7","key":"3047_CR45","doi-asserted-by":"publisher","first-page":"224","DOI":"10.1186\/gb-2005-6-7-224","volume":"6","author":"M Krallinger","year":"2005","unstructured":"Krallinger M, Valencia A: Text-mining and information-retrieval services for molecular biology. Genome Biol 2005, 6(7):224.","journal-title":"Genome Biol"},{"issue":"Suppl 2","key":"3047_CR46","doi-asserted-by":"publisher","first-page":"S7","DOI":"10.1186\/gb-2008-9-s2-s7","volume":"9","author":"R Altman","year":"2008","unstructured":"Altman R, Bergman C, Blake J, Blaschke C, Cohen A, Gannon F, Grivell L, Hahn U, Hersh W, Hirschman L, et al.: Text mining for biology - the way forward: opinions from leading scientists. Genome Biol 2008, 9(Suppl 2):S7.","journal-title":"Genome Biol"},{"issue":"17","key":"3047_CR47","doi-asserted-by":"publisher","first-page":"3389","DOI":"10.1093\/nar\/25.17.3389","volume":"25","author":"S Altschul","year":"1997","unstructured":"Altschul S, Madden T, Schaffer A, Zhang J, Zhang Z, Miller W, Lipman D: Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic Acids Research 1997, 25(17):3389\u20133402.","journal-title":"Nucleic Acids Research"},{"issue":"3","key":"3047_CR48","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1016\/S0022-2836(05)80360-2","volume":"215","author":"SF Altschul","year":"1990","unstructured":"Altschul SF, Gish W, Miller W, Myers EW, Lipman DJ: Basic local alignment search tool. J Mol Biol 1990, 215(3):403\u2013410.","journal-title":"J Mol Biol"},{"issue":"3","key":"3047_CR49","doi-asserted-by":"publisher","first-page":"635","DOI":"10.1016\/0888-7543(91)90071-L","volume":"11","author":"W Pearson","year":"1991","unstructured":"Pearson W: Searching protein sequence libraries: comparison of the sensitivity and selectivity of the Smith-Waterman and FASTA algorithms. Genomics 1991, 11(3):635\u2013650.","journal-title":"Genomics"},{"key":"3047_CR50","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1016\/0022-2836(81)90087-5","volume":"147","author":"T Smith","year":"1981","unstructured":"Smith T, Waterman M: Identification of Common Molecular Subsequences. J Mol Biol 1981, 147: 195\u2013197.","journal-title":"J Mol Biol"},{"key":"3047_CR51","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/3897.001.0001","volume-title":"An Introduction to Computational Learning Theory","author":"MJ Kearns","year":"1994","unstructured":"Kearns MJ, Vazirani UV: An Introduction to Computational Learning Theory. MIT Press; 1994."},{"key":"3047_CR52","volume-title":"Learning Theory and Natural Learning Systems","author":"MJ Kearns","year":"1993","unstructured":"Kearns MJ, Schapire RE: Efficient Distribution-free Learning of Probabilistic Concepts. In Learning Theory and Natural Learning Systems. Volume I. Edited by: Hanson SJ, Drastal GA, Rivest RL. Constraints and Prospect: Bradford\/MIT Press; 1993."},{"key":"3047_CR53","first-page":"22","volume":"11","author":"JB Lovins","year":"1968","unstructured":"Lovins JB: Development of a Stemming Algorithm. Mechanical Translation and Computational Linguistics 1968, 11: 22\u201331.","journal-title":"Mechanical Translation and Computational Linguistics"},{"issue":"3","key":"3047_CR54","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1023\/A:1024068626366","volume":"52","author":"C Nadeau","year":"2003","unstructured":"Nadeau C, Bengio Y: Inference for the Generalization Error. Machine Learning 2003, 52(3):239\u2013281.","journal-title":"Machine Learning"},{"key":"3047_CR55","volume-title":"ROC graphs: notes and practical considerations for researchers","author":"T Fawcett","year":"2003","unstructured":"Fawcett T: Technical Report HPL-2003\u20134. ROC graphs: notes and practical considerations for researchers Palo Alto, CA HP Labs; 2003. [http:\/\/www.hpl.hp.com\/techreports\/2003\/HPL-2003\u20134.html]"},{"key":"3047_CR56","volume-title":"Advances in Large Margin Classifiers","author":"JC Platt","year":"1999","unstructured":"Platt JC: Probabilistic Outputs for Support Vector Machines and Comparisons to Regularized Likelihood Methods. In Advances in Large Margin Classifiers. MIT Press; 1999."},{"issue":"2","key":"3047_CR57","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1145\/772862.772871","volume":"4","author":"L De Raedt","year":"2002","unstructured":"De Raedt L: A perspective on inductive databases. ACM SIGKDD Explorations Newsletter 2002, 4(2):69\u201377.","journal-title":"ACM SIGKDD Explorations Newsletter"},{"key":"3047_CR58","first-page":"853","volume-title":"Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence (IJCAI-01)","author":"L De Raedt","year":"2001","unstructured":"De Raedt L, Kramer S: The levelwise version space algorithm and its application to molecular fragment finding. Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence (IJCAI-01) 2001, 853\u2013862."},{"issue":"11","key":"3047_CR59","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1145\/240455.240472","volume":"39","author":"T Imielinski","year":"1996","unstructured":"Imielinski T, Mannila H: A database perspective on knowledge discovery. Communications of the ACM 1996, 39(11):58\u201364.","journal-title":"Communications of the ACM"},{"key":"3047_CR60","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1007\/978-3-662-04599-2_4","volume-title":"Relational Data Mining table of contents","author":"S Wrobel","year":"2001","unstructured":"Wrobel S: Inductive logic programming for knowedge discovery in databases. Relational Data Mining table of contents 2001, 74\u201399."},{"key":"3047_CR61","doi-asserted-by":"publisher","first-page":"124","DOI":"10.1007\/11733492_8","volume":"3933","author":"S Kramer","year":"2006","unstructured":"Kramer S, Aufschild V, Hapfelmeier A, Jarasch A, Kessler K, Reckow S, Wicker J, Richter L: Inductive Databases in the Relational Model: The Data as the Bridge. Lecture Notes in Computer Science 2006, 3933: 124.","journal-title":"Lecture Notes in Computer Science"},{"key":"3047_CR62","unstructured":"Oracle 11 g Text[http:\/\/www.oracle.com\/technology\/products\/text\/]"},{"key":"3047_CR63","first-page":"200","volume-title":"Proceedings of the Sixteenth International Conference on Machine Learning","author":"T Joachims","year":"1999","unstructured":"Joachims T: Transductive inference for text classification using support vector machines. Proceedings of the Sixteenth International Conference on Machine Learning 1999, 200\u2013209."},{"key":"3047_CR64","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1007\/11731139_10","volume":"3918","author":"K Driessens","year":"2006","unstructured":"Driessens K, Reutemann P, Pfahringer B, Leschi C: Using Weighted Nearest Neighbor to Benefit from Unlabeled Data. Lecture Notes in Computer Science 2006, 3918: 60.","journal-title":"Lecture Notes in Computer Science"},{"key":"3047_CR65","volume-title":"ICML-03, 20th International Conference on Machine Learning","author":"X Zhu","year":"2003","unstructured":"Zhu X, Ghahramani Z, Lafferty J: Semi-supervised learning using Gaussian fields and harmonic functions. ICML-03, 20th International Conference on Machine Learning 2003."},{"key":"3047_CR66","first-page":"321","volume":"16","author":"D Zhou","year":"2004","unstructured":"Zhou D, Bousquet O, Lal TN, Weston J, Sch\u00f6lkopf B: Learning with local and global consistency. Advances in Neural Information Processing Systems 2004, 16: 321\u2013328.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"3047_CR67","volume-title":"Online Algorithms: The State of the Art","author":"A Blum","year":"1998","unstructured":"Blum A: On-Line Algorithms in Machine Learning (a survey). In Online Algorithms: The State of the Art. Edited by: Fiat A, Woeginger G. Springer; 1998."},{"issue":"17","key":"3047_CR68","doi-asserted-by":"publisher","first-page":"2136","DOI":"10.1093\/bioinformatics\/btl350","volume":"22","author":"B Han","year":"2006","unstructured":"Han B, Obradovic Z, Hu Z-Z, Wu CH, Vucetic S: Substring selection for biomedical document classification. Bioinformatics 2006, 22(17):2136\u20132142.","journal-title":"Bioinformatics"},{"key":"3047_CR69","first-page":"18","volume":"41","author":"JDM Rennie","year":"2003","unstructured":"Rennie JDM, Shih L, Teevan J, Karger DR: Tackling the Poor Assumptions of Naive Bayes Text Classifiers. Proceedings of the Twentieth International Conference on Machine Learning 2003, 41: 18.","journal-title":"Proceedings of the Twentieth International Conference on Machine Learning"},{"key":"3047_CR70","first-page":"488","volume":"3339","author":"AM Kibriya","year":"2004","unstructured":"Kibriya AM, Frank E, Pfahringer B, Holmes G: Multinomial naive bayes for text categorization revisited. Proceedings of AI 17th Australian Joint Conference on Artificial Intelligence LNAI 2004, 3339: 488\u2013499.","journal-title":"Proceedings of AI 17th Australian Joint Conference on Artificial Intelligence LNAI"},{"issue":"3","key":"3047_CR71","first-page":"161","volume":"12","author":"DE Appelt","year":"1999","unstructured":"Appelt DE: Introduction to information extraction. AI Communications 1999, 12(3):161\u2013172.","journal-title":"AI Communications"},{"key":"3047_CR72","volume-title":"Morgan Kaufmann","author":"IH Witten","year":"1999","unstructured":"Witten IH, Frank E: Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations. Morgan Kaufmann 1999."},{"key":"3047_CR73","unstructured":"MySQL 5.0[http:\/\/www.mysql.com]"},{"key":"3047_CR74","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1023\/A:1009752403260","volume":"1","author":"SL Salzberg","year":"1997","unstructured":"Salzberg SL: On Comparing Classifiers: A Critique of Current Research and Methods. Data Mining and Knowledge Discovery 1997, 1: 317\u2013327.","journal-title":"Data Mining and Knowledge Discovery"},{"key":"3047_CR75","unstructured":"R: A Language and Environment for Statistical Computing[http:\/\/www.r-project.org]"},{"key":"3047_CR76","unstructured":"RWeka: An R Interface to Weka[http:\/\/cran.r-project.org]"},{"issue":"20","key":"3047_CR77","doi-asserted-by":"publisher","first-page":"3940","DOI":"10.1093\/bioinformatics\/bti623","volume":"21","author":"T Sing","year":"2005","unstructured":"Sing T, Sander O, Beerenwinkel N, Lengauer T: ROCR: visualizing classifier performance in R. Bioinformatics 2005, 21(20):3940\u20133941.","journal-title":"Bioinformatics"},{"key":"3047_CR78","volume-title":"Morgan Kaufmann Publishers Inc","author":"JR Quinlan","year":"1993","unstructured":"Quinlan JR: C4.5: programs for machine learning. In Morgan Kaufmann Publishers Inc. San Francisco, CA, USA; 1993."},{"issue":"2","key":"3047_CR79","first-page":"123","volume":"24","author":"L Breiman","year":"1996","unstructured":"Breiman L: Bagging Predictors. Machine Learning 1996, 24(2):123\u2013140.","journal-title":"Machine Learning"},{"key":"3047_CR80","first-page":"730","volume":"725","author":"JR Quinlan","year":"1996","unstructured":"Quinlan JR: Bagging, boosting, and C4. 5. Proceedings of the Thirteenth National Conference on Artificial Intelligence 1996, 725: 730.","journal-title":"Proceedings of the Thirteenth National Conference on Artificial Intelligence"},{"key":"3047_CR81","volume-title":"Proceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence","author":"GH John","year":"1995","unstructured":"John GH, Langley P: Estimating Continuous Distributions in Bayesian Classifiers. In Proceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence. Morgan Kaufmann; 1995."},{"key":"3047_CR82","volume-title":"Machine Learning","author":"DW Aha","year":"1991","unstructured":"Aha DW, Kibler D, Albert MK: Instance-based learning algorithms. Machine Learning 1991."},{"key":"3047_CR83","volume-title":"Advances in Kernel Methods - Support Vector Learning","author":"J Platt","year":"1998","unstructured":"Platt J: Fast Training of Support Vector Machines using Sequential Minimal Optimization. In Advances in Kernel Methods - Support Vector Learning. Edited by: Sch\u00f6lkopf B, Burges C, Smola A. MIT Press; 1998."},{"issue":"3","key":"3047_CR84","doi-asserted-by":"publisher","first-page":"637","DOI":"10.1162\/089976601300014493","volume":"13","author":"SS Keerthi","year":"2001","unstructured":"Keerthi SS, Shevade SK, Bhattacharyya C, Murthy KRK: Improvements to Platt's SMO Algorithm for SVM Classifier Design. Neural Computation 2001, 13(3):637\u2013649.","journal-title":"Neural Computation"},{"key":"3047_CR85","volume-title":"Springer","author":"V Vapnik","year":"1995","unstructured":"Vapnik V: The Nature of Statistical Learning Theory. Springer 1995."},{"key":"3047_CR86","volume-title":"Machine Learning: Proceedings of the Fifteenth International Conference","author":"E Frank","year":"1998","unstructured":"Frank E, Witten IH: Generating Accurate Rule Sets Without Global Optimization. In Machine Learning: Proceedings of the Fifteenth International Conference. Morgan Kaufmann Publishers; 1998."},{"key":"3047_CR87","volume-title":"STOC '84: Proceedings of the sixteenth annual ACM symposium on Theory of computing","author":"LG Valiant","year":"1984","unstructured":"Valiant LG: A theory of the learnable. STOC '84: Proceedings of the sixteenth annual ACM symposium on Theory of computing 1984."},{"key":"3047_CR88","first-page":"148","volume-title":"Machine Learning: Proceedings of the Thirteenth International Conference","author":"Y Freund","year":"1996","unstructured":"Freund Y, Schapire RE: Experiments with a new boosting algorithm. Machine Learning: Proceedings of the Thirteenth International Conference 1996, 148\u2013156."},{"key":"3047_CR89","doi-asserted-by":"publisher","first-page":"552","DOI":"10.1007\/978-0-387-21606-5","volume-title":"The Elements of Statistical Learning: Data Mining, Inference, and Prediction","author":"T Hastie","year":"2001","unstructured":"Hastie T, Tibshirani R, Friedman J: The Elements of Statistical Learning: Data Mining, Inference, and Prediction. 2001, 552."},{"issue":"2","key":"3047_CR90","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1023\/A:1007659514849","volume":"40","author":"GI Webb","year":"2000","unstructured":"Webb GI: MultiBoosting: A Technique for Combining Boosting and Wagging. Machine Learning 2000, 40(2):159\u2013196.","journal-title":"Machine Learning"},{"issue":"1","key":"3047_CR91","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1023\/A:1007515423169","volume":"36","author":"E Bauer","year":"1999","unstructured":"Bauer E, Kohavi R: An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants. Machine Learning 1999, 36(1):105\u2013139.","journal-title":"Machine Learning"},{"key":"3047_CR92","unstructured":"The Apache Commons Project. Daemon: Java based daemons or services[http:\/\/commons.apache.org\/daemon\/]"},{"issue":"Database issue","key":"3047_CR93","first-page":"D107","volume":"36","author":"OL Griffith","year":"2008","unstructured":"Griffith OL, Montgomery SB, Bernier B, Chu B, Kasaian K, Aerts S, Mahony S, Sleumer MC, Bilenky M, Haeussler M, et al.: ORegAnno: an open-access community-driven resource for regulatory annotation. Nucleic Acids Research 2008, 36(Database issue):D107.","journal-title":"Nucleic Acids Research"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1471-2105-10-317.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,31]],"date-time":"2021-08-31T21:35:00Z","timestamp":1630445700000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/1471-2105-10-317"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,10,3]]},"references-count":93,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2009,12]]}},"alternative-id":["3047"],"URL":"https:\/\/doi.org\/10.1186\/1471-2105-10-317","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,10,3]]},"assertion":[{"value":"2 March 2009","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 October 2009","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 October 2009","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"317"}}