{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T09:58:17Z","timestamp":1773655097709,"version":"3.50.1"},"reference-count":25,"publisher":"Oxford University Press (OUP)","issue":"11","license":[{"start":{"date-parts":[[2016,10,2]],"date-time":"2016-10-02T00:00:00Z","timestamp":1475366400000},"content-version":"vor","delay-in-days":2725,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/2.0\/uk\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2009,6,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Motivation: Controlled vocabularies such as the Medical Subject Headings (MeSH) thesaurus and the Gene Ontology (GO) provide an efficient way of accessing and organizing biomedical information by reducing the ambiguity inherent to free-text data. Different methods of automating the assignment of MeSH concepts have been proposed to replace manual annotation, but they are either limited to a small subset of MeSH or have only been compared with a limited number of other systems.<\/jats:p><jats:p>Results: We compare the performance of six MeSH classification systems [MetaMap, EAGL, a language and a vector space model-based approach, a K-Nearest Neighbor (KNN) approach and MTI] in terms of reproducing and complementing manual MeSH annotations. A KNN system clearly outperforms the other published approaches and scales well with large amounts of text using the full MeSH thesaurus. Our measurements demonstrate to what extent manual MeSH annotations can be reproduced and how they can be complemented by automatic annotations. We also show that a statistically significant improvement can be obtained in information retrieval (IR) when the text of a user's query is automatically annotated with MeSH concepts, compared to using the original textual query alone.<\/jats:p><jats:p>Conclusions: The annotation of biomedical texts using controlled vocabularies such as MeSH can be automated to improve text-only IR. Furthermore, the automatic MeSH annotation system we propose is highly scalable and it generates improvements in IR comparable with those observed for manual annotations.<\/jats:p><jats:p>Contact: \u00a0trieschn@ewi.utwente.nl<\/jats:p><jats:p>Supplementary information: \u00a0Supplementary data are available at Bioinformatics online.<\/jats:p>","DOI":"10.1093\/bioinformatics\/btp249","type":"journal-article","created":{"date-parts":[[2009,4,18]],"date-time":"2009-04-18T00:34:24Z","timestamp":1240014864000},"page":"1412-1418","source":"Crossref","is-referenced-by-count":74,"title":["MeSH Up: effective MeSH text classification for improved document retrieval"],"prefix":"10.1093","volume":"25","author":[{"given":"Dolf","family":"Trieschnigg","sequence":"first","affiliation":[{"name":"1 European Bioinformatics Institute, Hinxton, UK, 2HMI, University of Twente, Enschede and 3TNO ICT, Delft, The Netherlands"},{"name":"1 European Bioinformatics Institute, Hinxton, UK, 2HMI, University of Twente, Enschede and 3TNO ICT, Delft, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Piotr","family":"Pezik","sequence":"additional","affiliation":[{"name":"1 European Bioinformatics Institute, Hinxton, UK, 2HMI, University of Twente, Enschede and 3TNO ICT, Delft, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vivian","family":"Lee","sequence":"additional","affiliation":[{"name":"1 European Bioinformatics Institute, Hinxton, UK, 2HMI, University of Twente, Enschede and 3TNO ICT, Delft, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Franciska","family":"de Jong","sequence":"additional","affiliation":[{"name":"1 European Bioinformatics Institute, Hinxton, UK, 2HMI, University of Twente, Enschede and 3TNO ICT, Delft, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wessel","family":"Kraaij","sequence":"additional","affiliation":[{"name":"1 European Bioinformatics Institute, Hinxton, UK, 2HMI, University of Twente, Enschede and 3TNO ICT, Delft, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dietrich","family":"Rebholz-Schuhmann","sequence":"additional","affiliation":[{"name":"1 European Bioinformatics Institute, Hinxton, UK, 2HMI, University of Twente, Enschede and 3TNO ICT, Delft, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2009,4,17]]},"reference":[{"key":"2023013111500418600_B1","first-page":"17","article-title":"Effective mapping of biomedical text to the UMLS metathesaurus: the MetaMap program","volume-title":"Proceedings of AMIA Symp.","author":"Aronson","year":"2001"},{"key":"2023013111500418600_B2","first-page":"268","article-title":"The NLM Indexing Initiative's Medical Text Indexer","volume-title":"Proceedings of MEDINFO 2004.","author":"Aronson","year":"2004"},{"key":"2023013111500418600_B3","article-title":"On combining MeSH and text searches to improve the retrieval of Medline documents","volume-title":"Proceedings of the Third Conference en Recherche d'Informations et Applications (CORIA).","author":"Camous","year":"2006"},{"key":"2023013111500418600_B4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2008\/342746","article-title":"Combining evidence, specificity, and proximity towards the normalization of gene ontology terms in text","volume":"8","author":"Gaudan","year":"2008","journal-title":"EURASIP J. Bioinform. Syst. Biol."},{"key":"2023013111500418600_B5","first-page":"192","article-title":"OHSUMED: an interactive retrieval evaluation and new large test collection for research","volume-title":"Proceedings of the 17th Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval (SIGIR '94).","author":"Hersh","year":"1994"},{"key":"2023013111500418600_B6","doi-asserted-by":"crossref","DOI":"10.6028\/NIST.SP.500-261.genomics-overview","article-title":"TREC 2004 genomics track overview","volume-title":"Proceedings of the Thirteenth Text Retrieval Conference (TREC 2004).","author":"Hersh","year":"2004"},{"key":"2023013111500418600_B7","first-page":"227","article-title":"Twenty-One at TREC-7: ad-hoc and cross-language track","volume-title":"Proceedings of the Seventh Text Retrieval Conference (TREC '7).","author":"Hiemstra","year":"1999"},{"key":"2023013111500418600_B8","first-page":"319","article-title":"Automatic MeSH term assignment and quality assessment","volume-title":"Proceedings of AMIA Symp.","author":"Kim","year":"2001"},{"key":"2023013111500418600_B9","first-page":"81","article-title":"Using a generalized instance set for automatic text categorization","volume-title":"Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '98).","author":"Lam","year":"1998"},{"key":"2023013111500418600_B10","doi-asserted-by":"crossref","first-page":"865","DOI":"10.1109\/69.824599","article-title":"Automatic text categorization and its application to text retrieval","volume":"11","author":"Lam","year":"1999","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"2023013111500418600_B11","first-page":"175","article-title":"Cross-lingual relevance models","volume-title":"Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '02).","author":"Lavrenko","year":"2002"},{"key":"2023013111500418600_B12","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1007\/BFb0026666","article-title":"Naive (Bayes) at forty: The independence assumption in information retrieval","volume-title":"Proceedings of Machine Learning: ECML-98, 10th European Conference on Machine Learning (ECML '98).","author":"Lewis","year":"1998"},{"key":"2023013111500418600_B13","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1186\/1471-2105-8-423","article-title":"Pubmed related articles: a probabilistic topic-based model for content similarity","volume":"8","author":"Lin","year":"2007","journal-title":"BMC Bioinformatics"},{"key":"2023013111500418600_B14","doi-asserted-by":"crossref","first-page":"e109","DOI":"10.1093\/nar\/gkn434","article-title":"A probabilistic generative model for go enrichment analysis","volume":"36","author":"Lu","year":"2008","journal-title":"Nucleic Acids Res."},{"key":"2023013111500418600_B15","first-page":"247","article-title":"Mining biomedical abstracts: what is in a term?","volume-title":"Proceedings of International Joint Conference on NLP.","author":"Nenadic","year":"2004"},{"key":"2023013111500418600_B16","doi-asserted-by":"crossref","first-page":"D868","DOI":"10.1093\/nar\/gkn889","article-title":"Arrayexpress update\u2013from an archive of functional genomics experiments to the atlas of gene expression","volume":"37","author":"Parkinson","year":"2009","journal-title":"Nucleic Acids Res."},{"key":"2023013111500418600_B17","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1109\/MEMB.2007.335581","article-title":"Multilabel associative classification categorization of MEDLINE articles into MeSH keywords","volume":"26","author":"Rak","year":"2007","journal-title":"IEEE Eng. Med. Biol. Mag."},{"key":"2023013111500418600_B18","article-title":"Okapi at TREC-4","volume-title":"Proceedings of the Fourth Text Retrieval Conference (TREC-4 1995).","author":"Robertson","year":"1996"},{"key":"2023013111500418600_B19","doi-asserted-by":"crossref","first-page":"658","DOI":"10.1093\/bioinformatics\/bti783","article-title":"Automatic assignment of biomedical categories: toward a generic approach","volume":"22","author":"Ruch","year":"2006","journal-title":"Bioinformatics"},{"key":"2023013111500418600_B20","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1023\/A:1012782908347","article-title":"Hierarchical text categorization using neural networks","volume":"5","author":"Ruiz","year":"2002","journal-title":"Inf. Retr."},{"key":"2023013111500418600_B21","article-title":"Cross language information retrieval for biomedical literature","volume-title":"Proceddings of the Sixteenth Text Retrieval Conference (TREC'07).","author":"Schuemie","year":"2007"},{"key":"2023013111500418600_B22","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1145\/1321440.1321528","article-title":"A comparison of statistical significance tests for information retrieval evaluation","volume-title":"Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, Lisbon, Portugal (CIKM '07).","author":"Smucker","year":"2007"},{"key":"2023013111500418600_B23","doi-asserted-by":"crossref","first-page":"546","DOI":"10.1197\/jamia.M2431","article-title":"Optimal training sets for bayesian prediction of MeSH assignment","volume":"15","author":"Sohn","year":"2008","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"2023013111500418600_B24","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1136\/jamia.1996.96236284","article-title":"Retrieval feedback in medline","volume":"3","author":"Srinivasan","year":"1996","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"2023013111500418600_B25","doi-asserted-by":"crossref","first-page":"i119","DOI":"10.1093\/bioinformatics\/btn291","article-title":"Comparison of vocabularies, representations and ranking algorithms for gene prioritization by text mining","volume":"24","author":"Yu","year":"2008","journal-title":"Bioinformatics"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/25\/11\/1412\/48988093\/bioinformatics_25_11_1412.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/25\/11\/1412\/48988093\/bioinformatics_25_11_1412.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,9]],"date-time":"2025-02-09T01:51:43Z","timestamp":1739065903000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/25\/11\/1412\/333120"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,4,17]]},"references-count":25,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2009,6,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btp249","relation":{},"ISSN":["1367-4811","1367-4803"],"issn-type":[{"value":"1367-4811","type":"electronic"},{"value":"1367-4803","type":"print"}],"subject":[],"published-other":{"date-parts":[[2009,6,1]]},"published":{"date-parts":[[2009,4,17]]}}}