{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T12:16:38Z","timestamp":1767183398428,"version":"3.41.2"},"reference-count":26,"publisher":"Oxford University Press (OUP)","license":[{"start":{"date-parts":[[2020,1,11]],"date-time":"2020-01-11T00:00:00Z","timestamp":1578700800000},"content-version":"vor","delay-in-days":10,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000062","name":"NIDDK","doi-asserted-by":"publisher","award":["U24DK097771"],"award-info":[{"award-number":["U24DK097771"]}],"id":[{"id":"10.13039\/100000062","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,1,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>The ever accelerating pace of biomedical research results in corresponding acceleration in the volume of biomedical literature created. Since new research builds upon existing knowledge, the rate of increase in the available knowledge encoded in biomedical literature makes the easy access to that implicit knowledge more vital over time. Toward the goal of making implicit knowledge in the biomedical literature easily accessible to biomedical researchers, we introduce a question answering system called Bio-AnswerFinder. Bio-AnswerFinder uses a weighted-relaxed word mover's distance based similarity on word\/phrase embeddings learned from PubMed abstracts to rank answers after question focus entity type filtering. Our approach retrieves relevant documents iteratively via enhanced keyword queries from a traditional search engine. To improve document retrieval performance, we introduced a supervised long short term memory neural network to select keywords from the question to facilitate iterative keyword search. Our unsupervised baseline system achieves a mean reciprocal rank score of 0.46 and Precision@1 of 0.32 on 936 questions from BioASQ. The answer sentences are further ranked by a fine-tuned bidirectional encoder representation from transformers (BERT) classifier trained using 100 answer candidate sentences per question for 492 BioASQ questions. To test ranking performance, we report a blind test on 100 questions that three independent annotators scored. These experts preferred BERT based reranking with 7% improvement on MRR and 13% improvement on Precision@1 scores on average.<\/jats:p>","DOI":"10.1093\/database\/baz137","type":"journal-article","created":{"date-parts":[[2019,11,12]],"date-time":"2019-11-12T20:09:29Z","timestamp":1573589369000},"source":"Crossref","is-referenced-by-count":12,"title":["Bio-AnswerFinder: a system to find answers to questions from biomedical texts"],"prefix":"10.1093","volume":"2020","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3944-1893","authenticated-orcid":false,"given":"Ibrahim Burak","family":"Ozyurt","sequence":"first","affiliation":[{"name":"Center for Research in Biological Systems, University of California, San Diego, 9500 Gilman Drive, M\/C 0608, La Jolla, CA 92093-0608"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anita","family":"Bandrowski","sequence":"first","affiliation":[{"name":"Center for Research in Biological Systems, University of California, San Diego, 9500 Gilman Drive, M\/C 0608, La Jolla, CA 92093-0608"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeffrey S","family":"Grethe","sequence":"first","affiliation":[{"name":"Center for Research in Biological Systems, University of California, San Diego, 9500 Gilman Drive, M\/C 0608, La Jolla, CA 92093-0608"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2020,1,10]]},"reference":[{"key":"2020052419094893300_ref1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cmpb.2009.10.003","article-title":"Biomedical question answering: a survey","volume":"99","author":"Athenikos","year":"2010","journal-title":"Comput. Methods Prog. Biomed."},{"key":"2020052419094893300_ref2","doi-asserted-by":"crossref","DOI":"10.1186\/s12859-015-0564-6","article-title":"An overview of the BIOASQ large-scale biomedical semantic indexing and question answering competition","volume":"16","author":"Tsatsaronis","year":"2015","journal-title":"BMC Bioinformatics"},{"key":"2020052419094893300_ref3","first-page":"957","volume-title":"Procedings of the 32nd International Conference on Machine Learning (ICML)","author":"Kusner","year":"2015"},{"volume-title":"Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Qatar. ACL","year":"2014","author":"Pennington","key":"2020052419094893300_ref4"},{"volume-title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","year":"2018","author":"Devlin","key":"2020052419094893300_ref5"},{"key":"2020052419094893300_ref6","doi-asserted-by":"crossref","first-page":"109","DOI":"10.18653\/v1\/W18-2312","volume-title":"Proceedings of the BioNLP 2018 Workshop","author":"Sharma","year":"2018"},{"key":"2020052419094893300_ref7","doi-asserted-by":"crossref","first-page":"66","DOI":"10.18653\/v1\/W18-5308","volume-title":"Proceedings of the 2018 EMNLP Workshop BioASQ: Large-scale Biomedical Semantic Indexing and Question Answering","author":"Bhandwaldar","year":"2018"},{"key":"2020052419094893300_ref8","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/W17-2309","volume-title":"Neural Question Answering at Bioasq 5b","author":"Wiese","year":"2017"},{"key":"2020052419094893300_ref9","doi-asserted-by":"crossref","first-page":"2383","DOI":"10.18653\/v1\/D16-1264","volume-title":"Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing","author":"Rajpurkar","year":"2016"},{"key":"2020052419094893300_ref10","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/W16-2915","article-title":"Using Centroids of Word Embeddings and Word Mover\u2019s Distance for Biomedical Document Retrieval in Question Answering.","volume-title":"CoRR","author":"Brokos","year":"2016"},{"key":"2020052419094893300_ref11","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1007\/978-3-642-04417-5_37","volume-title":"Advances in Information Retrieval Theory","author":"Forst","year":"2009"},{"volume-title":"BioBERT: A Pre-trained Biomedical Language Representation Model for Biomedical Text Mining","year":"2019","author":"Lee","key":"2020052419094893300_ref12"},{"key":"2020052419094893300_ref13","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"2020052419094893300_ref14","doi-asserted-by":"crossref","DOI":"10.1093\/database\/bay130","article-title":"Foundry: a message-oriented, horizontally scalable ETL system for scientific data integration and enhancement","author":"Ozyurt","year":"2018","journal-title":"Database"},{"volume-title":"Efficient Estimation of Word Representations in Vector Space","year":"2013","author":"Tomas","key":"2020052419094893300_ref15"},{"key":"2020052419094893300_ref16","doi-asserted-by":"crossref","first-page":"2:1","DOI":"10.1147\/JRD.2012.2184637","article-title":"Question analysis: how Watson reads a clue","volume":"56","author":"Lally","year":"2012","journal-title":"IBM J. Res. Dev."},{"key":"2020052419094893300_ref17","doi-asserted-by":"crossref","first-page":"55","DOI":"10.3115\/v1\/P14-5010","volume-title":"Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations","author":"Manning","year":"2014"},{"volume-title":"Open-Domain Question Answering from Large Text Collections","year":"2003","author":"Pasca","key":"2020052419094893300_ref18"},{"key":"2020052419094893300_ref19","first-page":"187","volume-title":"Proceedings of the 8th EURALEX International Congress","author":"Macleod","year":"1998"},{"key":"2020052419094893300_ref20","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/B978-0-12-388408-4.00003-4","article-title":"A survey of the neuroscience resource landscape: perspectives from the neuroscience information framework","volume":"103","author":"Cachat","year":"2012","journal-title":"Int. Rev. Neurobiol."},{"volume-title":"Attention is All You Need","year":"2017","author":"Vaswani","key":"2020052419094893300_ref21"},{"key":"2020052419094893300_ref22","doi-asserted-by":"crossref","DOI":"10.18653\/v1\/K17-1029","volume-title":"Neural Domain Adaptation for Biomedical Question Answering","author":"Wiese","year":"2017"},{"key":"2020052419094893300_ref23","first-page":"1","article-title":"A survey of answer extraction techniques in factoid question answering","volume":"1","author":"Wang","year":"2006","journal-title":"Comput. Linguist."},{"key":"2020052419094893300_ref24","first-page":"533","volume-title":"Proceedings of the 15th International Conference on eScience","author":"Ozyurt","year":"2019"},{"volume-title":"Google\u2019s Neural Machine Translation System: Bridging the gap Between Human and Machine Translation","year":"2016","author":"Wu","key":"2020052419094893300_ref25"},{"key":"2020052419094893300_ref26","first-page":"4129","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Hewitt","year":"2019"}],"container-title":["Database"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/database\/article-pdf\/doi\/10.1093\/database\/baz137\/33292116\/baz137.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/database\/article-pdf\/doi\/10.1093\/database\/baz137\/33292116\/baz137.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,5,24]],"date-time":"2020-05-24T23:10:04Z","timestamp":1590361804000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/database\/article\/doi\/10.1093\/database\/baz137\/5700339"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,1]]},"references-count":26,"URL":"https:\/\/doi.org\/10.1093\/database\/baz137","relation":{},"ISSN":["1758-0463"],"issn-type":[{"type":"electronic","value":"1758-0463"}],"subject":[],"published-other":{"date-parts":[[2020]]},"published":{"date-parts":[[2020,1,1]]},"article-number":"baz137"}}