{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T12:38:33Z","timestamp":1775911113027,"version":"3.50.1"},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"1","content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2009,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Background<\/jats:title>\n            <jats:p>Manual curation of experimental data from the biomedical literature is an expensive and time-consuming endeavor. Nevertheless, most biological knowledge bases still rely heavily on manual curation for data extraction and entry. Text mining software that can semi- or fully automate information retrieval from the literature would thus provide a significant boost to manual curation efforts.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>We employ the Textpresso category-based information retrieval and extraction system <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"http:\/\/www.textpresso.org\" ext-link-type=\"uri\">http:\/\/www.textpresso.org<\/jats:ext-link>, developed by WormBase to explore how Textpresso might improve the efficiency with which we manually curate <jats:italic>C. elegans<\/jats:italic> proteins to the Gene Ontology's Cellular Component Ontology. Using a training set of sentences that describe results of localization experiments in the published literature, we generated three new curation task-specific categories (Cellular Components, Assay Terms, and Verbs) containing words and phrases associated with reports of experimentally determined subcellular localization. We compared the results of manual curation to that of Textpresso queries that searched the full text of articles for sentences containing terms from each of the three new categories plus the name of a previously uncurated <jats:italic>C. elegans<\/jats:italic> protein, and found that Textpresso searches identified curatable papers with recall and precision rates of 79.1% and 61.8%, respectively (F-score of 69.5%), when compared to manual curation. Within those documents, Textpresso identified relevant sentences with recall and precision rates of 30.3% and 80.1% (F-score of 44.0%). From returned sentences, curators were able to make 66.2% of all possible experimentally supported GO Cellular Component annotations with 97.3% precision (F-score of 78.8%). Measuring the relative efficiencies of Textpresso-based versus manual curation we find that Textpresso has the potential to increase curation efficiency by at least 8-fold, and perhaps as much as 15-fold, given differences in individual curatorial speed.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusion<\/jats:title>\n            <jats:p>Textpresso is an effective tool for improving the efficiency of manual, experimentally based curation. Incorporating a Textpresso-based Cellular Component curation pipeline at WormBase has allowed us to transition from strictly manual curation of this data type to a more efficient pipeline of computer-assisted validation. Continued development of curation task-specific Textpresso categories will provide an invaluable resource for genomics databases that rely heavily on manual curation.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1186\/1471-2105-10-228","type":"journal-article","created":{"date-parts":[[2009,7,21]],"date-time":"2009-07-21T18:29:37Z","timestamp":1248200977000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":48,"title":["Semi-automated curation of protein subcellular localization: a text mining-based approach to Gene Ontology (GO) Cellular Component curation"],"prefix":"10.1186","volume":"10","author":[{"given":"Kimberly","family":"Van Auken","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joshua","family":"Jaffery","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Juancarlos","family":"Chan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hans-Michael","family":"M\u00fcller","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paul W","family":"Sternberg","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2009,7,21]]},"reference":[{"key":"2958_CR1","series-title":"Nucleic Acids Research","first-page":"D612","volume-title":"WormBase 2007","author":"A Rogers","year":"2008","unstructured":"Rogers A, Antoshechkin I, Bieri T, Blasiar D, Bastiani C, Canaran P, Chan J, Chen WJ, Davis P, Fernandes J, et al.: WormBase 2007. Nucleic Acids Research 2008, (36 Database):D612\u2013617."},{"key":"2958_CR2","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1007\/978-1-59745-515-2_5","volume":"396","author":"N Mulder","year":"2007","unstructured":"Mulder N, Apweiler R: InterPro and InterProScan: tools for protein sequence classification and comparison. Methods in Molecular Biology (Clifton, NJ) 2007, 396: 59\u201370.","journal-title":"Methods in Molecular Biology (Clifton, NJ)"},{"issue":"6","key":"2958_CR3","doi-asserted-by":"publisher","first-page":"e246","DOI":"10.1371\/journal.pntd.0000246","volume":"2","author":"CQ Huang","year":"2008","unstructured":"Huang CQ, Gasser RB, Cantacessi C, Nisbet AJ, Zhong W, Sternberg PW, Loukas A, Mulvenna J, Lin RQ, Chen N, et al.: Genomic-Bioinformatic Analysis of Transcripts Enriched in the Third-Stage Larva of the Parasitic Nematode Ascaris suum. PLoS Neglected Tropical Diseases 2008, 2(6):e246.","journal-title":"PLoS Neglected Tropical Diseases"},{"issue":"Suppl 1","key":"2958_CR4","doi-asserted-by":"publisher","first-page":"S8","DOI":"10.1186\/1471-2180-9-S1-S8","volume":"9","author":"S Meng","year":"2009","unstructured":"Meng S, Brown DE, Ebbole DJ, Torto-Alalibo T, Oh YY, Deng J, Mitchell TK, Dean RA: Gene Ontology annotation of the rice blast fungus, Magnaporthe oryzae. BMC Microbiology 2009, 9(Suppl 1):S8.","journal-title":"BMC Microbiology"},{"key":"2958_CR5","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1186\/1471-2164-10-219","volume":"10","author":"E Meyer","year":"2009","unstructured":"Meyer E, Aglyamova GV, Wang S, Buchanan-Carter J, Abrego D, Colbourne JK, Willis BL, Matz MV: Sequencing and de novo analysis of a coral larval transcriptome using 454 GSFlx. BMC Genomics 2009, 10: 219.","journal-title":"BMC Genomics"},{"issue":"13","key":"2958_CR6","doi-asserted-by":"publisher","first-page":"i41","DOI":"10.1093\/bioinformatics\/btm229","volume":"23","author":"WA Baumgartner Jr","year":"2007","unstructured":"Baumgartner WA Jr, Cohen KB, Fox LM, Acquaah-Mensah G, Hunter L: Manual curation is not sufficient for annotation of genomic databases. Bioinformatics (Oxford, England) 2007, 23(13):i41\u201348.","journal-title":"Bioinformatics (Oxford, England)"},{"issue":"1","key":"2958_CR7","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1038\/75556","volume":"25","author":"M Ashburner","year":"2000","unstructured":"Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT, et al.: Gene ontology: tool for the unification of biology. The Gene Ontology Consortium. Nature Genetics 2000, 25(1):25\u201329.","journal-title":"Nature Genetics"},{"issue":"1","key":"2958_CR8","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1101\/gr.199701","volume":"12","author":"S Raychaudhuri","year":"2002","unstructured":"Raychaudhuri S, Chang JT, Sutphin PD, Altman RB: Associating genes with gene ontology codes using a maximum entropy analysis of biomedical literature. Genome Research 2002, 12(1):203\u2013214.","journal-title":"Genome Research"},{"issue":"11","key":"2958_CR9","doi-asserted-by":"publisher","first-page":"1417","DOI":"10.1093\/bioinformatics\/btg160","volume":"19","author":"JH Chiang","year":"2003","unstructured":"Chiang JH, Yu HC: MeKE: discovering the functions of gene products from biomedical literature via sentence alignment. Bioinformatics (Oxford, England) 2003, 19(11):1417\u20131422.","journal-title":"Bioinformatics (Oxford, England)"},{"issue":"Suppl 1","key":"2958_CR10","doi-asserted-by":"publisher","first-page":"S16","DOI":"10.1186\/1471-2105-6-S1-S16","volume":"6","author":"C Blaschke","year":"2005","unstructured":"Blaschke C, Leon EA, Krallinger M, Valencia A: Evaluation of BioCreAtIvE assessment of task 2. BMC Bioinformatics 2005, 6(Suppl 1):S16.","journal-title":"BMC Bioinformatics"},{"issue":"7","key":"2958_CR11","doi-asserted-by":"publisher","first-page":"1227","DOI":"10.1093\/bioinformatics\/bti084","volume":"21","author":"A Koike","year":"2005","unstructured":"Koike A, Niwa Y, Takagi T: Automatic extraction of gene\/protein biological functions from biomedical text. Bioinformatics (Oxford, England) 2005, 21(7):1227\u20131236.","journal-title":"Bioinformatics (Oxford, England)"},{"key":"2958_CR12","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1186\/1747-5333-1-19","volume":"1","author":"FM Couto","year":"2006","unstructured":"Couto FM, Silva MJ, Lee V, Dimmer E, Camon E, Apweiler R, Kirsch H, Rebholz-Schuhmann D: GOAnnotator: linking protein GO annotations to evidence text. Journal of Biomedical Discovery and Collaboration 2006, 1: 19.","journal-title":"Journal of Biomedical Discovery and Collaboration"},{"issue":"23","key":"2958_CR13","doi-asserted-by":"publisher","first-page":"3232","DOI":"10.1093\/bioinformatics\/btm495","volume":"23","author":"CE Crangle","year":"2007","unstructured":"Crangle CE, Cherry JM, Hong EL, Zbyslaw A: Mining experimental evidence of molecular function claims from the literature. Bioinformatics (Oxford, England) 2007, 23(23):3232\u20133240.","journal-title":"Bioinformatics (Oxford, England)"},{"key":"2958_CR14","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1186\/1471-2105-8-243","volume":"8","author":"N Daraselia","year":"2007","unstructured":"Daraselia N, Yuryev A, Egorov S, Mazo I, Ispolatov I: Automatic extraction of gene ontology annotation and its correlation with clusters in protein networks. BMC Bioinformatics 2007, 8: 243.","journal-title":"BMC Bioinformatics"},{"key":"2958_CR15","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1186\/1471-2105-9-143","volume":"9","author":"A Cakmak","year":"2008","unstructured":"Cakmak A, Ozsoyoglu G: Discovering gene annotations in biomedical text databases. BMC Bioinformatics 2008, 9: 143.","journal-title":"BMC Bioinformatics"},{"issue":"Suppl 8","key":"2958_CR16","doi-asserted-by":"publisher","first-page":"S2","DOI":"10.1186\/1471-2105-9-S8-S2","volume":"9","author":"S Jaeger","year":"2008","unstructured":"Jaeger S, Gaudan S, Leser U, Rebholz-Schuhmann D: Integrating protein-protein interactions and text mining for protein function prediction. BMC Bioinformatics 2008, 9(Suppl 8):S2.","journal-title":"BMC Bioinformatics"},{"issue":"11","key":"2958_CR17","doi-asserted-by":"publisher","first-page":"e309","DOI":"10.1371\/journal.pbio.0020309","volume":"2","author":"HM Muller","year":"2004","unstructured":"Muller HM, Kenny EE, Sternberg PW: Textpresso: an ontology-based information retrieval and extraction system for biological literature. PLoS Biology 2004, 2(11):e309.","journal-title":"PLoS Biology"},{"issue":"3","key":"2958_CR18","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1007\/s12021-008-9031-0","volume":"6","author":"HM Muller","year":"2008","unstructured":"Muller HM, Rangarajan A, Teal TK, Sternberg PW: Textpresso for neuroscience: searching the full text of thousands of neuroscience research papers. Neuroinformatics 2008, 6(3):195\u2013204.","journal-title":"Neuroinformatics"},{"issue":"9","key":"2958_CR19","doi-asserted-by":"crossref","first-page":"2579","DOI":"10.1242\/dev.122.9.2579","volume":"122","author":"M Labouesse","year":"1996","unstructured":"Labouesse M, Hartwieg E, Horvitz HR: The Caenorhabditis elegans LIN-26 protein is required to specify and\/or maintain all non-neuronal ectodermal cell fates. Development (Cambridge, England) 1996, 122(9):2579\u20132588.","journal-title":"Development (Cambridge, England)"},{"issue":"9","key":"2958_CR20","doi-asserted-by":"publisher","first-page":"3832","DOI":"10.1091\/mbc.E06-02-0144","volume":"17","author":"KB Mercer","year":"2006","unstructured":"Mercer KB, Miller RK, Tinley TL, Sheth S, Qadota H, Benian GM: Caenorhabditis elegans UNC-96 is a new component of M-lines that interacts with UNC-98 and paramyosin and is required in adult muscle for assembly and\/or maintenance of thick filaments. Molecular Biology of the Cell 2006, 17(9):3832\u20133847.","journal-title":"Molecular Biology of the Cell"},{"issue":"6","key":"2958_CR21","doi-asserted-by":"publisher","first-page":"2087","DOI":"10.1091\/mbc.10.6.2087","volume":"10","author":"CW Whitfield","year":"1999","unstructured":"Whitfield CW, Benard C, Barnes T, Hekimi S, Kim SK: Basolateral localization of the Caenorhabditis elegans epidermal growth factor receptor in epithelial cells by the PDZ protein LIN-10. Molecular Biology of the Cell 1999, 10(6):2087\u20132100.","journal-title":"Molecular Biology of the Cell"},{"key":"2958_CR22","volume-title":"Foundations of Statistical Natural Language Processing","author":"CD Manning","year":"1999","unstructured":"Manning CD, Sch\u00fctze H: Foundations of Statistical Natural Language Processing. 1st edition. Cambridge: The MIT Press; 1999.","edition":"1"},{"issue":"6","key":"2958_CR23","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1016\/j.jbi.2004.08.012","volume":"37","author":"KJ Lee","year":"2004","unstructured":"Lee KJ, Hwang YS, Kim S, Rim HC: Biomedical named entity recognition using two-phase model based on SVMs. Journal of Biomedical Informatics 2004, 37(6):436\u2013447.","journal-title":"Journal of Biomedical Informatics"},{"issue":"Suppl 1","key":"2958_CR24","doi-asserted-by":"publisher","first-page":"S6","DOI":"10.1186\/1471-2105-6-S1-S6","volume":"6","author":"R McDonald","year":"2005","unstructured":"McDonald R, Pereira F: Identifying gene and protein mentions in text using conditional random fields. BMC Bioinformatics 2005, 6(Suppl 1):S6.","journal-title":"BMC Bioinformatics"},{"key":"2958_CR25","doi-asserted-by":"publisher","first-page":"492","DOI":"10.1186\/1471-2105-7-492","volume":"7","author":"Y Jin","year":"2006","unstructured":"Jin Y, McDonald RT, Lerman K, Mandel MA, Carroll S, Liberman MY, Pereira FC, Winters RS, White PS: Automated recognition of malignancy mentions in biomedical literature. BMC Bioinformatics 2006, 7: 492.","journal-title":"BMC Bioinformatics"},{"issue":"7","key":"2958_CR26","doi-asserted-by":"publisher","first-page":"e1000431","DOI":"10.1371\/journal.pcbi.1000431","volume":"5","author":"Reference Genome Group of the Gene Ontology Consortium","year":"2009","unstructured":"Reference Genome Group of the Gene Ontology Consortium: The Gene Ontology's Reference Genome Project: a unified framework for functional annotation across species. PLoS Computational Biology 2009, 5(7):e1000431.","journal-title":"PLoS Computational Biology"},{"issue":"6","key":"2958_CR27","doi-asserted-by":"publisher","first-page":"815","DOI":"10.1016\/j.devcel.2004.10.015","volume":"7","author":"A Dammermann","year":"2004","unstructured":"Dammermann A, Muller-Reichert T, Pelletier L, Habermann B, Desai A, Oegema K: Centriole assembly requires both centriolar and pericentriolar material proteins. Developmental Cell 2004, 7(6):815\u2013829.","journal-title":"Developmental Cell"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1471-2105-10-228.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,31]],"date-time":"2021-08-31T21:38:19Z","timestamp":1630445899000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/1471-2105-10-228"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,7,21]]},"references-count":27,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2009,12]]}},"alternative-id":["2958"],"URL":"https:\/\/doi.org\/10.1186\/1471-2105-10-228","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,7,21]]},"assertion":[{"value":"29 January 2009","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 July 2009","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 July 2009","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"228"}}