{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T16:39:41Z","timestamp":1783787981908,"version":"3.55.0"},"reference-count":64,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,10,22]],"date-time":"2019-10-22T00:00:00Z","timestamp":1571702400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2019,10,22]],"date-time":"2019-10-22T00:00:00Z","timestamp":1571702400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>One of the challenges in large-scale information retrieval (IR) is developing fine-grained and domain-specific methods to answer natural language questions. Despite the availability of numerous sources and datasets for answer retrieval, Question Answering (QA) remains a challenging problem due to the difficulty of the question understanding and answer extraction tasks. One of the promising tracks investigated in QA is mapping new questions to formerly answered questions that are \u201csimilar\u201d.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We propose a novel QA approach based on Recognizing Question Entailment (RQE) and we describe the QA system and resources that we built and evaluated on real medical questions. First, we compare logistic regression and deep learning methods for RQE using different kinds of datasets including textual inference, question similarity, and entailment in both the open and clinical domains. Second, we combine IR models with the best RQE method to select entailed questions and rank the retrieved answers. To study the end-to-end QA approach, we built the MedQuAD collection of 47,457 question-answer pairs from trusted medical sources which we introduce and share in the scope of this paper. Following the evaluation process used in TREC 2017 LiveQA, we find that our approach exceeds the best results of the medical task with a 29.8% increase over the best official score.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>The evaluation results support the relevance of question entailment for QA and highlight the effectiveness of combining IR and RQE for future QA efforts. Our findings also show that relying on a restricted set of reliable answer sources can bring a substantial improvement in medical QA.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s12859-019-3119-4","type":"journal-article","created":{"date-parts":[[2019,10,23]],"date-time":"2019-10-23T04:29:57Z","timestamp":1571804997000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":125,"title":["A question-entailment approach to question answering"],"prefix":"10.1186","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6312-9387","authenticated-orcid":false,"given":"Asma","family":"Ben Abacha","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dina","family":"Demner-Fushman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2019,10,22]]},"reference":[{"issue":"4","key":"3119_CR1","doi-asserted-by":"publisher","first-page":"e33","DOI":"10.2196\/medinform.7680","volume":"5","author":"Tony Russell-Rose","year":"2017","unstructured":"Russell-Rose T, Chamberlain J. Expert Search Strategies: The Information Retrieval Practices of Healthcare Information Professionals. JMIR Med Inform. 2017; 5(4):e33. Available from: http:\/\/medinform.jmir.org\/2017\/4\/e33\/ . Accessed 15 Oct 2019.","journal-title":"JMIR Medical Informatics"},{"key":"3119_CR2","unstructured":"Ben Abacha A, Demner-Fushman D. Recognizing Question Entailment for Medical Question Answering. In: AMIA 2016, American Medical Informatics Association Annual Symposium, Chicago, IL, USA, November 12-16, 2016: 2016. Available from: http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC5333286 . Accessed 15 Oct 2019."},{"issue":"2","key":"3119_CR3","doi-asserted-by":"publisher","first-page":"e43","DOI":"10.2196\/jmir.3388","volume":"17","author":"Jake Luo","year":"2015","unstructured":"Luo J, Zhang GQ, Wentz S, Cui L, Xu R. SimQ: Real-Time Retrieval of Similar Consumer Health Questions. J Med Internet Res. 2015; 17(2):e43. Available from: https:\/\/doi.org\/10.2196\/jmir.3388 .","journal-title":"Journal of Medical Internet Research"},{"key":"3119_CR4","doi-asserted-by":"crossref","unstructured":"Nakov P, M\u00e0rquez L, Moschitti A, Magdy W, Mubarak H, Freihat AA, et al.SemEval-2016 Task 3: Community Question Answering; 2016. pp. 525\u201345. Available from: http:\/\/aclweb.org\/anthology\/S\/S16\/S16-1083.pdf . Accessed 15 Oct 2019.","DOI":"10.18653\/v1\/S16-1083"},{"key":"3119_CR5","doi-asserted-by":"publisher","unstructured":"Nakov P, Hoogeveen D, M\u00e0rquez L, Moschitti A, Mubarak H, Baldwin T, et al.SemEval-2017 Task 3: Community Question Answering. In: Proceedings of the 11th International Workshop on Semantic Evaluation SemEval \u201917. Vancouver, Canada: Association for Computational Linguistics: 2017. https:\/\/doi.org\/10.18653\/v1\/s17-2003 .","DOI":"10.18653\/v1\/s17-2003"},{"key":"3119_CR6","doi-asserted-by":"crossref","unstructured":"dos Santos CN, Barbosa L, Bogdanova D, Zadrozny B. Learning Hybrid Representations to Retrieve Semantically Equivalent Questions. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, ACL 2015, July 26-31, 2015, Beijing, China, Volume 2: Short Papers: 2015. p. 694\u20139. Available from: http:\/\/aclweb.org\/anthology\/P\/P15\/P15-2114.pdf . Accessed 15 Oct 2019.","DOI":"10.3115\/v1\/P15-2114"},{"key":"3119_CR7","unstructured":"Romeo S, Martino GDS, Barr\u00f3n-Cede\u00f1o A, Moschitti A, Belinkov Y, Hsu W, et al.Neural Attention for Learning to Rank Questions in Community Question Answering. In: COLING 2016, 26th International Conference on Computational Linguistics, Proceedings of the Conference: Technical Papers, Osaka, Japan, December 11-16, 2016: 2016. p. 1734\u201345. Available from: http:\/\/aclweb.org\/anthology\/C\/C16\/C16-1163.pdf . Accessed 15 Oct 2019."},{"key":"3119_CR8","unstructured":"Lei T, Joshi H, Barzilay R, Jaakkola TS, Tymoshenko K, Moschitti A, et al.Semi-supervised Question Retrieval with Gated Convolutions. In: NAACL HLT 2016, The 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego California, USA, June 12-17, 2016: 2016. p. 1279\u201389. Available from: http:\/\/aclweb.org\/anthology\/N\/N16\/N16-1153.pdf . Accessed 15 Oct 2019."},{"key":"3119_CR9","doi-asserted-by":"crossref","unstructured":"Harabagiu SM, Hickl A. Methods for Using Textual Entailment in Open-Domain Question Answering. In: ACL 2006, 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, Sydney, Australia, 17-21 July 2006: 2006. Available from: http:\/\/aclweb.org\/anthology\/P06-1114 . Accessed 15 Oct 2019.","DOI":"10.3115\/1220175.1220289"},{"key":"3119_CR10","unstructured":"Negri M, Kouylekov M. Question Answering over Structured Data: an Entailment-Based Approach to Question Analysis. In: Proceedings of the International Conference RANLP-2009. Association for Computational Linguistics: 2009. p. 305\u201311. Available from: http:\/\/www.aclweb.org\/anthology\/R09-1056 . Accessed 15 Oct 2019."},{"key":"3119_CR11","doi-asserted-by":"crossref","unstructured":"\u00c7elikyilmaz A, Thint M, Huang Z. A Graph-based Semi-Supervised Learning for Question-Answering. In: ACL 2009, Proceedings of the 47th Annual Meeting of the Association for Computational Linguistics and the 4th International Joint Conference on Natural Language Processing of the AFNLP, 2-7 August 2009, Singapore: 2009. p. 719\u201327. Available from: http:\/\/www.aclweb.org\/anthology\/P09-1081 . Accessed 15 Oct 2019.","DOI":"10.3115\/1690219.1690247"},{"key":"3119_CR12","doi-asserted-by":"crossref","unstructured":"Ben Abacha A, Agichtein E, Pinter Y, Demner-Fushman D. Overview of the Medical Question Answering Task at TREC 2017 LiveQA. In: Proceedings of The Twenty-Sixth Text REtrieval Conference, TREC 2017, Gaithersburg, Maryland, USA, November 15-17, 2017: 2017. Available from: https:\/\/trec.nist.gov\/pubs\/trec26\/papers\/Overview-QA.pdf . Accessed 15 Oct 2019.","DOI":"10.6028\/NIST.SP.500-324.qa-overview"},{"issue":"4","key":"3119_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.2200\/S00509ED1V01Y201305HLT023","volume":"6","author":"Ido Dagan","year":"2013","unstructured":"Dagan I, Roth D, Sammons M, Zanzotto FM. Recognizing Textual Entailment: Models and Applications. Synthesis Lectures on Human Language Technologies: Morgan & Claypool Publishers; 2013. https:\/\/doi.org\/10.2200\/s00509ed1v01y201305hlt023 .","journal-title":"Synthesis Lectures on Human Language Technologies"},{"key":"3119_CR14","doi-asserted-by":"publisher","unstructured":"Bowman SR, Angeli G, Potts C, Manning CD. A large annotated corpus for learning natural language inference. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics: 2015. https:\/\/doi.org\/10.18653\/v1\/d15-1075 .","DOI":"10.18653\/v1\/d15-1075"},{"key":"3119_CR15","doi-asserted-by":"crossref","unstructured":"Williams A, Nangia N, Bowman SR. A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2018, New Orleans, Louisiana, USA, June 1-6, 2018, Volume 1 (Long Papers): 2018. p. 1112\u201322. Available from: https:\/\/www.aclweb.org\/anthology\/N18-1101.pdf . Accessed 15 Oct 2019.","DOI":"10.18653\/v1\/N18-1101"},{"key":"3119_CR16","doi-asserted-by":"crossref","unstructured":"Nangia N, Williams A, Lazaridou A, Bowman S. The RepEval 2017 Shared Task: Multi-Genre Natural Language Inference with Sentence Representations. Association for Computational Linguistics. 2017. Available from: http:\/\/www.aclweb.org\/anthology\/W17-5301 . Accessed 15 Oct 2019.","DOI":"10.18653\/v1\/W17-5301"},{"key":"3119_CR17","doi-asserted-by":"crossref","unstructured":"Dai Z, Li L, Xu W. CFO: Conditional Focused Neural Question Answering with Large-scale Knowledge Bases. In: Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016, August 7-12, 2016, Berlin, Germany, Volume 1: Long Papers: 2016. Available from: http:\/\/aclweb.org\/anthology\/P\/P16\/P16-1076.pdf . Accessed 15 Oct 2019.","DOI":"10.18653\/v1\/P16-1076"},{"issue":"6","key":"3119_CR18","doi-asserted-by":"publisher","first-page":"895","DOI":"10.3233\/SW-160247","volume":"8","author":"Konrad H\u00f6ffner","year":"2017","unstructured":"H\u00f6ffner K, Walter S, Marx E, Usbeck R, Lehmann J, Ngomo AN. Survey on challenges of Question Answering in the Semantic Web. Semantic Web. 2017; 8(6):895\u2013920. Available from: http:\/\/doi.org\/10.3233\/SW-160247 .","journal-title":"Semantic Web"},{"issue":"1","key":"3119_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.cmpb.2009.10.003","volume":"99","author":"Sofia J. Athenikos","year":"2010","unstructured":"Athenikos SJ, Han H. Biomedical Question Answering: A Survey. Comput Methods Prog Biomed. 2010; 99(1):1\u201324. Available from: http:\/\/dx.doi.org\/10.1016\/j.cmpb.2009.10.003 .","journal-title":"Computer Methods and Programs in Biomedicine"},{"issue":"5","key":"3119_CR20","doi-asserted-by":"publisher","first-page":"570","DOI":"10.1016\/j.ipm.2015.04.006","volume":"51","author":"Asma Ben Abacha","year":"2015","unstructured":"Ben Abacha A, Zweigenbaum P. MEANS: A medical question-answering system combining NLP techniques and semantic Web technologies. Inf Process Manag J. 2015; 51(5):570\u201394. Available from: http:\/\/doi.org\/10.1016\/j.ipm.2015.04.006 .","journal-title":"Information Processing & Management"},{"key":"3119_CR21","unstructured":"Yang Y, Yu J, Hu Y, Xu X, Nyberg E. CMU LiveMedQA at TREC 2017 LiveQA: A Consumer Health Question Answering System. In: Proceedings of The Twenty-Sixth Text REtrieval Conference, TREC 2017, Gaithersburg, Maryland, USA: 2017. https:\/\/arxiv.org\/pdf\/1711.05789.pdf ."},{"issue":"3.4","key":"3119_CR22","doi-asserted-by":"publisher","first-page":"2:1-2:14","DOI":"10.1147\/JRD.2012.2184637","volume":"56","author":"A. Lally","year":"2012","unstructured":"Lally A, Prager JM, McCord MC, Boguraev B, Patwardhan S, Fan J, et al.Question analysis: How Watson reads a clue. IBM J Res Dev. 2012; 56(3):2. Available from: http:\/\/doi.org\/10.1147\/JRD.2012.2184637 .","journal-title":"IBM Journal of Research and Development"},{"key":"3119_CR23","doi-asserted-by":"crossref","unstructured":"Ben Abacha A, Zweigenbaum P. Medical question answering: translating medical questions into sparql queries. In: ACM International Health Informatics Symposium, IHI \u201912, Miami, FL, USA, January 28-30, 2012: 2012. p. 41\u201350. Available from: http:\/\/doi.acm.org\/10.1145\/2110363.2110372 .","DOI":"10.1145\/2110363.2110372"},{"key":"3119_CR24","unstructured":"Mrabet Y, Kilicoglu H, Roberts K, Demner-Fushman D. Combining Open-domain and Biomedical Knowledge for Topic Recognition in Consumer Health Questions. In: AMIA 2016, American Medical Informatics Association Annual Symposium, Chicago, IL, USA, November 12-16, 2016: 2016. Available from: http:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC5333243 . Accessed 15 Oct 2019."},{"issue":"3","key":"3119_CR25","doi-asserted-by":"publisher","first-page":"380","DOI":"10.1016\/j.ipm.2018.01.001","volume":"54","author":"Saeedeh Momtazi","year":"2018","unstructured":"Momtazi S. Unsupervised Latent Dirichlet Allocation for supervised question classification. Inf Process Manag. 2018; 54(3):380\u201393. Available from: http:\/\/www.sciencedirect.com\/science\/article\/pii\/S0306457318300153 . Accessed 15 Oct 2019.","journal-title":"Information Processing & Management"},{"key":"3119_CR26","unstructured":"Wang M, Smith NA, Mitamura T. What is the Jeopardy Model? A Quasi-Synchronous Grammar for QA. In: EMNLP-CoNLL 2007, Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, June 28-30, 2007, Prague, Czech Republic: 2007. p. 22\u201332. Available from: http:\/\/www.aclweb.org\/anthology\/D07-1003 . Accessed 15 Oct 2019."},{"issue":"2","key":"3119_CR27","doi-asserted-by":"publisher","first-page":"351","DOI":"10.1162\/COLI_a_00051","volume":"37","author":"Mihai Surdeanu","year":"2011","unstructured":"Surdeanu M, Ciaramita M, Zaragoza H. Learning to Rank Answers to Non-Factoid Questions from Web Collections. Comput Linguist. 2011; 37(2):351\u201383. Available from: http:\/\/doi.org\/10.1162\/COLI_a_00051 .","journal-title":"Computational Linguistics"},{"key":"3119_CR28","doi-asserted-by":"crossref","unstructured":"Tymoshenko K, Moschitti A. Assessing the Impact of Syntactic and Semantic Structures for Answer Passages Reranking. In: Proceedings of the 24th ACM International Conference on Information and Knowledge Management, CIKM 2015, Melbourne, VIC, Australia, October 19 - 23, 2015: 2015. p. 1451\u201360. Available from: http:\/\/doi.acm.org\/10.1145\/2806416.280649 .","DOI":"10.1145\/2806416.2806490"},{"key":"3119_CR29","doi-asserted-by":"publisher","unstructured":"Severyn A, Moschitti A. Learning to Rank Short Text Pairs with Convolutional Deep Neural Networks. In: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, Santiago, Chile, August 9-13, 2015: 2015. p. 373\u201382. Available from: https:\/\/doi.org\/10.1145\/2766462.2767738 .","DOI":"10.1145\/2766462.2767738"},{"key":"3119_CR30","doi-asserted-by":"publisher","unstructured":"Zhang H, Rao J, Lin JJ, Smucker MD. Automatically Extracting High-Quality Negative Examples for Answer Selection in Question Answering. In: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Shinjuku, Tokyo, Japan, August 7-11, 2017: 2017. p. 797\u2013800. Available from: https:\/\/doi.org\/10.1145\/3077136.3080645 .","DOI":"10.1145\/3077136.3080645"},{"key":"3119_CR31","doi-asserted-by":"crossref","unstructured":"Jijkoun V, de Rijke M. Retrieving answers from frequently asked questions pages on the web. In: Proceedings of the 2005 ACM CIKM International Conference on Information and Knowledge Management, Bremen, Germany, October 31 - November 5, 2005: 2005. p. 76\u201383. Available from: http:\/\/doi.acm.org\/10.1145\/1099554.1099571 .","DOI":"10.1145\/1099554.1099571"},{"key":"3119_CR32","doi-asserted-by":"crossref","unstructured":"Wang K, Ming Z, Chua T. A syntactic tree matching approach to finding similar questions in community-based qa services. In: Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, Boston, MA, USA, July 19-23, 2009: 2009. p. 187\u201394. Available from: http:\/\/doi.acm.org\/10.1145\/1571941.1571975 .","DOI":"10.1145\/1571941.1571975"},{"issue":"2","key":"3119_CR33","first-page":"57","volume":"18","author":"RD Burke","year":"1997","unstructured":"Burke RD, Hammond KJ, Kulyukin V, Lytinen SL, Tomuro N, Schoenberg S. Question answering from frequently asked question files: Experiences with the faq finder system. AI Mag. 1997; 18(2):57.","journal-title":"AI Mag"},{"key":"3119_CR34","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1055\/s-0038-1634945","volume":"32","author":"DA Lindberg","year":"1993","unstructured":"Lindberg DA, Humphreys BL, McCray AT. The Unified Medical Language System. Methods Inf Med. 1993; 32:281\u201391.","journal-title":"Methods Inf Med"},{"key":"3119_CR35","doi-asserted-by":"crossref","unstructured":"Wang D, Nyberg E. CMU OAQA at TREC 2017 LiveQA: A Neural Dual Entailment Approach for Question Paraphrase Identification. In: Proceedings of The Twenty-Sixth Text REtrieval Conference, TREC 2017, Gaithersburg, Maryland, USA, November 15-17, 2017: 2017. Available from: https:\/\/trec.nist.gov\/pubs\/trec26\/papers\/CMU-OAQA-QA.pdf . Accessed 15 Oct 2019.","DOI":"10.6028\/NIST.SP.500-324.qa-CMU-OAQA"},{"key":"3119_CR36","doi-asserted-by":"crossref","unstructured":"Datla VV, Arora TR, Liu J, Adduru V, Hasan SA, Lee K, et al.Open domain real-time question answering based on asynchronous multiperspective context-driven retrieval and neural paraphrasing. In: Proceedings of The Twenty-Sixth Text REtrieval Conference, TREC 2017, Gaithersburg, Maryland, USA, November 15-17, 2017: 2017. Available from: https:\/\/trec.nist.gov\/pubs\/trec26\/papers\/prna-QA.pdf . Accessed 15 Oct 2019.","DOI":"10.6028\/NIST.SP.500-324.qa-prna"},{"key":"3119_CR37","doi-asserted-by":"crossref","unstructured":"Rajpurkar P, Zhang J, Lopyrev K, Liang P. SQuAD: 100, 000+ Questions for Machine Comprehension of Text. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP 2016, Austin, Texas, USA, November 1-4, 2016: 2016. p. 2383\u201392. Available from: http:\/\/aclweb.org\/anthology\/D\/D16\/D16-1264.pdf . Accessed 15 Oct 2019.","DOI":"10.18653\/v1\/D16-1264"},{"key":"3119_CR38","doi-asserted-by":"publisher","unstructured":"Wiese G, Weissenborn D, Neves ML. Neural Question Answering at BioASQ 5B. In: BioNLP 2017, Vancouver, Canada, August 4, 2017: 2017. p. 76\u20139. Available from: https:\/\/doi.org\/10.18653\/v1\/W17-2309 .","DOI":"10.18653\/v1\/W17-2309"},{"key":"3119_CR39","unstructured":"An W, Chen Q, Tao W, Zhang J, Yu J, Yang Y, et al.ECNU at 2017 LiveQA Track: Learning Question Similarity with Adapted Long Short-Term Memory Networks. In: Proceedings of The Twenty-Sixth Text REtrieval Conference, TREC 2017, Gaithersburg, Maryland, USA, November 15-17, 2017: 2017."},{"key":"3119_CR40","doi-asserted-by":"crossref","unstructured":"Jeon J, Croft WB, Lee JH. Finding Similar Questions in Large Question and Answer Archives. In: Proceedings of the 14th ACM International Conference on Information and Knowledge Management. CIKM \u201905. New York: ACM: 2005. p. 84\u201390. Available from: http:\/\/doi.acm.org\/10.1145\/1099554.1099572 .","DOI":"10.1145\/1099554.1099572"},{"key":"3119_CR41","unstructured":"Duan H, Cao Y, Lin C, Yu Y. Searching Questions by Identifying Question Topic and Question Focus. In: ACL 2008, Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics, June 15-20, 2008, Columbus, Ohio, USA: 2008. p. 156\u201364. Available from: http:\/\/www.aclweb.org\/anthology\/P08-1019 . Accessed 15 Oct 2019."},{"key":"3119_CR42","doi-asserted-by":"crossref","unstructured":"Charlet D, Damnati G. SimBow at SemEval-2017 Task 3: Soft-Cosine Semantic Similarity between Questions for Community Question Answering. In: Proceedings of the 11th International Workshop on Semantic Evaluation, SemEvalACL 2017, Vancouver, Canada, August 3-4, 2017: 2017. p. 315\u20139. Available from: http:\/\/doi.org\/10.18653\/v1\/S17-2051 .","DOI":"10.18653\/v1\/S17-2051"},{"key":"3119_CR43","doi-asserted-by":"crossref","unstructured":"Goyal N. LearningToQuestion at SemEval 2017 Task 3: Ranking Similar Questions by Learning to Rank Using Rich Features. In: Proceedings of the 11th International Workshop on Semantic Evaluation, SemEval@ACL 2017, Vancouver, Canada, August 3-4, 2017: 2017. p. 310\u20134. Available from: http:\/\/doi.org\/10.18653\/v1\/S17-2050 .","DOI":"10.18653\/v1\/S17-2050"},{"key":"3119_CR44","unstructured":"Kim S, Hong JH, Kang I, Kwak N. Semantic Sentence Matching with Densely-connected Recurrent and Co-attentive Information. CoRR. 2018. Available from: http:\/\/arxiv.org\/pdf\/1805.11360.pdf ."},{"key":"3119_CR45","doi-asserted-by":"crossref","unstructured":"Chen Q, Zhu X, Ling ZH, Inkpen D, Wei S. Neural Natural Language Inference Models Enhanced with External Knowledge. CoRR. 2018. Available from: http:\/\/arxiv.org\/pdf\/1711.04289.pdf .","DOI":"10.18653\/v1\/P18-1224"},{"key":"3119_CR46","doi-asserted-by":"crossref","unstructured":"Ghaeini R, Hasan SA, Datla V, Liu J, Lee K, Qadir A, et al.DR-BiLSTM: Dependent Reading Bidirectional LSTM for Natural Language Inference: 2018. Available from: http:\/\/arxiv.org\/pdf\/1802.05577.pdf .","DOI":"10.18653\/v1\/N18-1132"},{"key":"3119_CR47","unstructured":"Pennington J, Socher R, Manning CD. GloVe: Global Vectors for Word Representation. In: Empirical Methods in Natural Language Processing (EMNLP): 2014. p. 1532\u201343. Available from: http:\/\/www.aclweb.org\/anthology\/D14-1162 . Accessed 15 Oct 2019."},{"issue":"3","key":"3119_CR48","doi-asserted-by":"publisher","first-page":"130","DOI":"10.1108\/eb046814","volume":"14","author":"M Porter","year":"1980","unstructured":"Porter M. An Algorithm for Suffix Stripping. Program. 1980; 14(3):130\u20137.","journal-title":"Program"},{"key":"3119_CR49","unstructured":"Schmid H. Probabilistic Part-of-Speech Tagging Using Decision Trees. In: Proceedings of the International Conference on New Methods in Language Processing. Manchester: 1994. https:\/\/www.cis.uni-muenchen.de\/~schmid\/tools\/TreeTagger\/data\/tree-tagger1.pdf ."},{"key":"3119_CR50","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1136\/bmj.321.7258.429","volume":"321","author":"JW Ely","year":"2000","unstructured":"Ely JW, Osheroff JA, Gorman PN, Ebell MH, Chambliss ML, Pifer EA, et al.A taxonomy of generic clinical questions: classification study. Br Med J. 2000; 321:429\u201332.","journal-title":"Br Med J"},{"key":"3119_CR51","unstructured":"Kilicoglu H, Ben Abacha A, Mrabet Y, Roberts K, Rodriguez L, Shooshan SE, et al.Annotating Named Entities in Consumer Health Questions. In: Proceedings of the Tenth International Conference on Language Resources and Evaluation LREC 2016, Portoro\u017e, Slovenia, May 23-28: 2016. Available from: http:\/\/www.lrec-conf.org\/proceedings\/lrec2016\/summaries\/727.html . Accessed 15 Oct 2019."},{"key":"3119_CR52","doi-asserted-by":"publisher","unstructured":"Kilicoglu H, Ben Abacha A, Mrabet Y, Shooshan SE, Rodriguez L, Masterton K, et al.Semantic annotation of consumer health questions. BMC Bioinformatics. 2018; 19(1):34:1\u201334:28. Available from: https:\/\/doi.org\/10.1186\/s12859-018-2045-1 .","DOI":"10.1186\/s12859-018-2045-1"},{"key":"3119_CR53","unstructured":"Conneau A, Kiela D, Schwenk H, Barrault L, Bordes A. Supervised Learning of Universal Sentence Representations from Natural Language Inference Data. In: Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, EMNLP 2017, Copenhagen, Denmark, September 9-11, 2017: 2017. p. 670\u201380. Available from: https:\/\/www.aclweb.org\/anthology\/D17-1070.pdf . Accessed 15 Oct 2019."},{"key":"3119_CR54","unstructured":"Devlin J, Chang M, Lee K, Toutanova K. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2-7, 2019, Volume 1 (Long and Short Papers): 2019. p. 4171\u201386. Available from: https:\/\/aclweb.org\/anthology\/papers\/N\/N19\/N19-1423\/ . Accessed 15 Oct 2019."},{"key":"3119_CR55","unstructured":"Radford A, Narasimhan K, Salimans T, Sutskever I. Improving Language Understanding by Generative Pre-Training. 2018. Available from: https:\/\/s3-us-west-2.amazonaws.com\/openai-assets\/research-covers\/language-unsupervised\/language_understanding_paper.pdf . Accessed 15 Oct 2019."},{"key":"3119_CR56","doi-asserted-by":"publisher","unstructured":"Chiu B, Crichton GKO, Korhonen A, Pyysalo S. How to Train good Word Embeddings for Biomedical NLP. In: Proceedings of the 15th Workshop on Biomedical Natural Language Processing BioNLP@ACL 2016, Berlin, Germany, August 12, 2016: 2016. p. 166\u2013174. https:\/\/doi.org\/10.18653\/v1\/W16-2922 .","DOI":"10.18653\/v1\/W16-2922"},{"key":"3119_CR57","unstructured":"Arora S, Liang Y, Ma T. A Simple but Tough-to-Beat Baseline for Sentence Embeddings. In: 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings: 2017. Available from: https:\/\/openreview.net\/forum?id=SyK00v5xx . Accessed 15 Oct 2019."},{"key":"3119_CR58","unstructured":"Wieting J, Bansal M, Gimpel K, Livescu K. Towards Universal Paraphrastic Sentence Embeddings. In: 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico, May 2-4, 2016, Conference Track Proceedings: 2016. Available from: http:\/\/arxiv.org\/abs\/1511.08198."},{"issue":"4","key":"3119_CR59","doi-asserted-by":"publisher","first-page":"802","DOI":"10.1093\/jamia\/ocw024","volume":"23","author":"Kirk Roberts","year":"2016","unstructured":"Roberts K, Demner-Fushman D. Interactive use of online health resources: a comparison of consumer and professional questions. JAMIA. 2016; 23(4):802\u201311. Available from: http:\/\/dx.doi.org\/10.1093\/jamia\/ocw024 .","journal-title":"Journal of the American Medical Informatics Association"},{"key":"3119_CR60","doi-asserted-by":"publisher","unstructured":"Demner-Fushman D, Rogers WJ, Aronson AR. MetaMap Lite: an evaluation of a new Java implementation of MetaMap. JAMIA. 2017; 24(4):841\u20134. Available from: https:\/\/doi.org\/10.1093\/jamia\/ocw177 .","DOI":"10.1093\/jamia\/ocw177"},{"key":"3119_CR61","first-page":"517","volume-title":"Lecture Notes in Computer Science","author":"Iadh Ounis","year":"2005","unstructured":"Ounis I, Amati G, Plachouras V, He B, Macdonald C, Johnson D. Terrier Information Retrieval Platform; 2005. pp. 517\u20139. Available from: http:\/\/doi.org\/10.1007\/978-3-540-31865-1_37 ."},{"key":"3119_CR62","doi-asserted-by":"crossref","unstructured":"Agichtein E, Carmel D, Pelleg D, Pinter Y, Harman D. Overview of the TREC 2015 LiveQA Track. In: Proceedings of The Twenty-Fourth Text REtrieval Conference, TREC 2015, Gaithersburg, Maryland, USA, November 17-20, 2015: 2015. Available from: http:\/\/trec.nist.gov\/pubs\/trec24\/papers\/Overview-QA.pdf . Accessed 15 Oct 2019.","DOI":"10.6028\/NIST.SP.500-319.qa-overview"},{"key":"3119_CR63","doi-asserted-by":"crossref","unstructured":"Ben Abacha A, Shivade C, Demner-Fushman D. Overview of the MEDIQA 2019 Shared Task on Textual Inference, Question Entailment and Question Answering. In: Proceedings of ACL-BioNLP 2019, Florence, Italy, August 1: 2019. https:\/\/www.aclweb.org\/anthology\/W19-5039.pdf .","DOI":"10.18653\/v1\/W19-5039"},{"key":"3119_CR64","doi-asserted-by":"crossref","unstructured":"Demner-Fushman D, Mrabet Y, Ben Abacha A. Consumer Health Information and Question Answering: Helping consumers find answers to their health-related information needs. J Am Med Inform Assoc (JAMIA). 2019.","DOI":"10.1093\/jamia\/ocz152"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-019-3119-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12859-019-3119-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-019-3119-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,25]],"date-time":"2024-07-25T12:57:55Z","timestamp":1721912275000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-019-3119-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,22]]},"references-count":64,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["3119"],"URL":"https:\/\/doi.org\/10.1186\/s12859-019-3119-4","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,22]]},"assertion":[{"value":"13 March 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 October 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 October 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"511"}}