{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T22:26:27Z","timestamp":1777501587782,"version":"3.51.4"},"reference-count":127,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2024,2,16]],"date-time":"2024-02-16T00:00:00Z","timestamp":1708041600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000092","name":"National Library of Medicine","doi-asserted-by":"publisher","award":["R01-LM012086-01A1"],"award-info":[{"award-number":["R01-LM012086-01A1"]}],"id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Semi-Automating Data Extraction for Systematic Reviews"},{"name":"King\u2019s College London and Metadvice Ltd"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,4,3]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objectives<\/jats:title>\n                  <jats:p>Question answering (QA) systems have the potential to improve the quality of clinical care by providing health professionals with the latest and most relevant evidence. However, QA systems have not been widely adopted. This systematic review aims to characterize current medical QA systems, assess their suitability for healthcare, and identify areas of improvement.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and methods<\/jats:title>\n                  <jats:p>We searched PubMed, IEEE Xplore, ACM Digital Library, ACL Anthology, and forward and backward citations on February 7, 2023. We included peer-reviewed journal and conference papers describing the design and evaluation of biomedical QA systems. Two reviewers screened titles, abstracts, and full-text articles. We conducted a narrative synthesis and risk of bias assessment for each study. We assessed the utility of biomedical QA systems.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We included 79 studies and identified themes, including question realism, answer reliability, answer utility, clinical specialism, systems, usability, and evaluation methods. Clinicians\u2019 questions used to train and evaluate QA systems were restricted to certain sources, types and complexity levels. No system communicated confidence levels in the answers or sources. Many studies suffered from high risks of bias and applicability concerns. Only 8 studies completely satisfied any criterion for clinical utility, and only 7 reported user evaluations. Most systems were built with limited input from clinicians.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>While machine learning methods have led to increased accuracy, most studies imperfectly reflected real-world healthcare information needs. Key research priorities include developing more realistic healthcare QA datasets and considering the reliability of answer sources, rather than merely focusing on accuracy.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocae015","type":"journal-article","created":{"date-parts":[[2024,2,17]],"date-time":"2024-02-17T10:29:56Z","timestamp":1708165796000},"page":"1009-1024","source":"Crossref","is-referenced-by-count":23,"title":["Question answering systems for health professionals at the point of care\u2014a systematic review"],"prefix":"10.1093","volume":"31","author":[{"given":"Gregory","family":"Kell","sequence":"first","affiliation":[{"name":"Department of Population Health Sciences, King\u2019s College London , London, Greater London, SE1 1UL, United Kingdom"}]},{"given":"Angus","family":"Roberts","sequence":"additional","affiliation":[{"name":"Department of Biostatistics and Health Informatics, King\u2019s College London , London, Greater London, SE5 8AB, United Kingdom"}]},{"given":"Serge","family":"Umansky","sequence":"additional","affiliation":[{"name":"Metadvice Ltd , London, Greater London, SW1Y 5JG, United Kingdom"}]},{"given":"Linglong","family":"Qian","sequence":"additional","affiliation":[{"name":"Department of Biostatistics and Health Informatics, King\u2019s College London , London, Greater London, SE5 8AB, United Kingdom"}]},{"given":"Davide","family":"Ferrari","sequence":"additional","affiliation":[{"name":"Department of Population Health Sciences, King\u2019s College London , London, Greater London, SE1 1UL, United Kingdom"}]},{"given":"Frank","family":"Soboczenski","sequence":"additional","affiliation":[{"name":"Department of Population Health Sciences, King\u2019s College London , London, Greater London, SE1 1UL, United Kingdom"}]},{"given":"Byron C","family":"Wallace","sequence":"additional","affiliation":[{"name":"Khoury College of Computer Sciences, Northeastern University , Boston, MA 02115, United States"}]},{"given":"Nikhil","family":"Patel","sequence":"additional","affiliation":[{"name":"Department of Population Health Sciences, King\u2019s College London , London, Greater London, SE1 1UL, United Kingdom"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2594-2654","authenticated-orcid":false,"given":"Iain J","family":"Marshall","sequence":"additional","affiliation":[{"name":"Department of Population Health Sciences, King\u2019s College London , London, Greater London, SE1 1UL, United Kingdom"}]}],"member":"286","published-online":{"date-parts":[[2024,2,16]]},"reference":[{"issue":"5","key":"2024040320031881600_ocae015-B1","doi-asserted-by":"crossref","first-page":"710","DOI":"10.1001\/jamainternmed.2014.368","article-title":"Clinical questions raised by clinicians at the point of care: a systematic review","volume":"174","author":"Del Fiol","year":"2014","journal-title":"JAMA Intern Med"},{"issue":"9","key":"2024040320031881600_ocae015-B2","doi-asserted-by":"crossref","first-page":"e1000326","DOI":"10.1371\/journal.pmed.1000326","article-title":"Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?","volume":"7","author":"Bastian","year":"2010","journal-title":"PLoS Med"},{"issue":"4","key":"2024040320031881600_ocae015-B3","doi-asserted-by":"crossref","first-page":"e29","DOI":"10.2196\/jmir.1012","article-title":"Answers to questions posed during daily patient care are more likely to be answered by UpToDate than PubMed","volume":"10","author":"Hoogendam","year":"2008","journal-title":"J Med Internet Res"},{"issue":"1","key":"2024040320031881600_ocae015-B4","doi-asserted-by":"crossref","first-page":"47","DOI":"10.3163\/1536-5050.97.1.009","article-title":"The information-seeking behavior of clinical staff in a large health care organization","volume":"97","author":"Hider","year":"2009","journal-title":"J Med Libr Assoc"},{"issue":"2","key":"2024040320031881600_ocae015-B5","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1016\/j.jbi.2011.01.004","article-title":"AskHERMES: an online question answering system for complex clinical questions","volume":"44","author":"Cao","year":"2011","journal-title":"J Biomed Inform"},{"issue":"5","key":"2024040320031881600_ocae015-B6","doi-asserted-by":"crossref","first-page":"570","DOI":"10.1016\/j.ipm.2015.04.006","article-title":"MEANS: a medical question-answering system combining NLP techniques and semantic web technologies","volume":"51","author":"Ben Abacha","year":"2015","journal-title":"Inform Procss Manage"},{"issue":"10","key":"2024040320031881600_ocae015-B7","doi-asserted-by":"crossref","first-page":"1511","DOI":"10.1016\/j.compbiomed.2007.01.013","article-title":"A knowledge based method for the medical question answering problem","volume":"37","author":"Terol","year":"2007","journal-title":"Comput Biol Med"},{"key":"2024040320031881600_ocae015-B8","first-page":"297","author":"Goodwin","year":"2016"},{"issue":"1","key":"2024040320031881600_ocae015-B9","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1186\/s12859-019-3119-4","article-title":"A question-entailment approach to question answering","volume":"20","author":"Ben Abacha","year":"2019","journal-title":"BMC Bioinform"},{"key":"2024040320031881600_ocae015-B10"},{"issue":"1","key":"2024040320031881600_ocae015-B11","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1162\/coli.2007.33.1.63","article-title":"Answering clinical questions with knowledge-based and statistical techniques","volume":"33","author":"Demner-Fushman","year":"2007","journal-title":"Comput Linguist"},{"key":"2024040320031881600_ocae015-B12","first-page":"171","article-title":"The MiPACQ clinical question answering system. AMIA","volume":"2011","author":"Cairns","year":"2011","journal-title":"Annu Sympos Proc AMIA Symp"},{"key":"2024040320031881600_ocae015-B13","first-page":"73","author":"Niu","year":"2003"},{"key":"2024040320031881600_ocae015-B14","author":"Brown","year":"2020"},{"key":"2024040320031881600_ocae015-B15","volume-title":"Galactica: A Large Language Model for Science.","author":"Taylor","year":"2022"},{"key":"2024040320031881600_ocae015-B16","doi-asserted-by":"crossref","first-page":"101767","DOI":"10.1016\/j.artmed.2019.101767","article-title":"SemBioNLQA: A semantic biomedical question answering system for retrieving exact and ideal answers to natural language questions","volume":"102","author":"Sarrouti","year":"2020","journal-title":"Artif Intell Med"},{"issue":"3","key":"2024040320031881600_ocae015-B17","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1016\/j.jbi.2007.03.002","article-title":"Development, implementation, and a cognitive evaluation of a definitional question answering system for physicians","volume":"40","author":"Yu","year":"2007","journal-title":"J Biomed Inform"},{"key":"2024040320031881600_ocae015-B18","first-page":"28","author":"Kell","year":"2021"},{"issue":"1","key":"2024040320031881600_ocae015-B19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cmpb.2009.10.003","article-title":"Biomedical question answering: a survey","volume":"99","author":"Athenikos","year":"2010","journal-title":"Comput Methods Programs Biomed"},{"issue":"2","key":"2024040320031881600_ocae015-B20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3490238","article-title":"Biomedical question answering: a survey of approaches and challenges","volume":"55","author":"Jin","year":"2022","journal-title":"ACM Comput Surv"},{"key":"2024040320031881600_ocae015-B21","author":"Popay","year":"2006"},{"issue":"1","key":"2024040320031881600_ocae015-B22","doi-asserted-by":"crossref","first-page":"51","DOI":"10.7326\/M18-1376","article-title":"PROBAST: a tool to assess the risk of bias and applicability of prediction model studies","volume":"170","author":"Wolff","year":"2019","journal-title":"Ann Intern Med"},{"issue":"9","key":"2024040320031881600_ocae015-B23","doi-asserted-by":"crossref","first-page":"e2335377","DOI":"10.1001\/jamanetworkopen.2023.35377","article-title":"APPRAISE-AI Tool for quantitative evaluation of AI studies for clinical decision support","volume":"6","author":"Kwong","year":"2023","journal-title":"JAMA Netw Open"},{"key":"2024040320031881600_ocae015-B24","doi-asserted-by":"crossref","first-page":"n71","DOI":"10.1136\/bmj.n71","article-title":"The PRISMA 2020 statement: an updated guideline for reporting systematic reviews","volume":"372","author":"Page","year":"2021","journal-title":"BMJ"},{"key":"2024040320031881600_ocae015-B25","doi-asserted-by":"crossref","first-page":"I6890","DOI":"10.1136\/bmj.l6890","article-title":"Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline","volume":"368","author":"Campbell","year":"2020","journal-title":"BMJ"},{"key":"2024040320031881600_ocae015-B26","first-page":"27","author":"Rakotoson","year":"2022"},{"key":"2024040320031881600_ocae015-B27","author":"Wu","year":"2021"},{"key":"2024040320031881600_ocae015-B28","first-page":"61","author":"Tutos","year":"2010"},{"key":"2024040320031881600_ocae015-B29","first-page":"215","article-title":"CliniQA : highly reliable clinical question answering system","volume":"180","author":"Ni","year":"2012","journal-title":"Stud Health Technol Inform"},{"key":"2024040320031881600_ocae015-B30","first-page":"1","author":"Vong","year":"2015"},{"key":"2024040320031881600_ocae015-B31","first-page":"24","author":"Demner-Fushman","year":"2006"},{"key":"2024040320031881600_ocae015-B32","doi-asserted-by":"crossref","first-page":"11003","DOI":"10.1007\/s13369-021-05810-5","article-title":"COBERT: COVID-19 question answering system using BERT","volume":"48","author":"Alzubi","year":"2021","journal-title":"Arab J Sci Eng"},{"key":"2024040320031881600_ocae015-B33","first-page":"1433","author":"Francis","year":"2018"},{"key":"2024040320031881600_ocae015-B34","doi-asserted-by":"crossref","DOI":"10.1093\/database\/baz137","article-title":"Bio-AnswerFinder: a system to find answers to questions from biomedical texts","volume":"2020","author":"Ozyurt","year":"2020","journal-title":"Database"},{"key":"2024040320031881600_ocae015-B35","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.ymeth.2019.06.024","article-title":"Deep scaled dot-product attention based domain adaptation model for biomedical question answering","volume":"173","author":"Du","year":"2020","journal-title":"Methods"},{"issue":"1","key":"2024040320031881600_ocae015-B36","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1186\/s12859-021-04176-7","article-title":"External features enriched model for biomedical question answering","volume":"22","author":"Xu","year":"2021","journal-title":"BMC Bioinform"},{"key":"2024040320031881600_ocae015-B37","first-page":"533","author":"Ozyurt","year":"2019"},{"key":"2024040320031881600_ocae015-B38","first-page":"274","author":"Zhang","year":"2022"},{"issue":"4","key":"2024040320031881600_ocae015-B39","first-page":"2365","article-title":"Named entity aware transfer learning for biomedical factoid question answering","volume":"19","author":"Peng","year":"2022"},{"key":"2024040320031881600_ocae015-B40","first-page":"773329","article-title":"SentiMedQAer: a transfer learning-based sentiment-aware model for biomedical question answering","volume":"16","author":"Zhu","year":"2022"},{"key":"2024040320031881600_ocae015-B41","author":"Devlin","year":"2019"},{"issue":"4","key":"2024040320031881600_ocae015-B42","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1093\/bioinformatics\/btz682","article-title":"BioBERT: a pre-trained biomedical language representation model for biomedical text mining","volume":"36","author":"Lee","year":"2020","journal-title":"Bioinformatics"},{"key":"2024040320031881600_ocae015-B43","author":"Radford","year":"2018"},{"key":"2024040320031881600_ocae015-B44","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1007\/978-3-030-45442-5_71","volume-title":"Advances in Information Retrieval","author":"Krallinger","year":"2020"},{"key":"2024040320031881600_ocae015-B45","first-page":"1","author":"Nentidis","year":"2018"},{"key":"2024040320031881600_ocae015-B46","first-page":"1","author":"Omar","year":"2020"},{"key":"2024040320031881600_ocae015-B47","first-page":"328","article-title":"A cognitive evaluation of four online search engines for answering definitional questions posed by physicians","author":"Yu","year":"2007","journal-title":"Pac Symp Biocomput"},{"key":"2024040320031881600_ocae015-B48","first-page":"703","author":"Doucette","year":"2012"},{"key":"2024040320031881600_ocae015-B49","first-page":"91","author":"Li","year":"2015"},{"key":"2024040320031881600_ocae015-B50","first-page":"73","author":"Makar","year":"2008"},{"issue":"1","key":"2024040320031881600_ocae015-B51","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1093\/jamiaopen\/ooz072","article-title":"Adapting and evaluating a deep learning language model for clinical why-question answering","volume":"3","author":"Wen","year":"2020","journal-title":"JAMIA Open"},{"key":"2024040320031881600_ocae015-B52","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1186\/s12859-015-0564-6","article-title":"An overview of the BIOASQ large-scale biomedical semantic indexing and question answering competition","volume":"16","author":"Tsatsaronis","year":"2015","journal-title":"BMC Bioinformatics"},{"key":"2024040320031881600_ocae015-B53","first-page":"841","author":"Demner-Fushman","year":"2006"},{"key":"2024040320031881600_ocae015-B54","first-page":"495","author":"Weiming","year":"2007"},{"key":"2024040320031881600_ocae015-B55","first-page":"569","article-title":"Automatic medical knowledge acquisition using question-answering","volume":"150","author":"Pasche","year":"2009","journal-title":"Stud Health Technol Inform"},{"key":"2024040320031881600_ocae015-B56","first-page":"469","author":"Lee","year":"2006"},{"issue":"1","key":"2024040320031881600_ocae015-B57","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1186\/s12859-014-0365-3","article-title":"Biomedical question answering using semantic relations","volume":"16","author":"Hristovski","year":"2015","journal-title":"BMC Bioinform"},{"key":"2024040320031881600_ocae015-B58","first-page":"1","author":"Kaddari","year":"2020"},{"key":"2024040320031881600_ocae015-B59","first-page":"216","article-title":"Clinical judgement study using question answering from electronic health records","volume":"106","author":"Singh Rawat","year":"2019","journal-title":"Proc Mach Learn Res"},{"key":"2024040320031881600_ocae015-B60","first-page":"171","author":"Cao","year":"2009"},{"issue":"20","key":"2024040320031881600_ocae015-B61","doi-asserted-by":"crossref","first-page":"4129","DOI":"10.1093\/bioinformatics\/btz195","article-title":"Health assistant: answering your questions anytime from biomedical literature","volume":"35","author":"Jin","year":"2019","journal-title":"Bioinformatics"},{"key":"2024040320031881600_ocae015-B62","first-page":"362","author":"Du","year":"2018"},{"key":"2024040320031881600_ocae015-B63","first-page":"370","author":"Du","year":"2019"},{"key":"2024040320031881600_ocae015-B64","first-page":"688","author":"Mairittha","year":"2020"},{"key":"2024040320031881600_ocae015-B65","first-page":"3882","article-title":"Multi-label question classification for factoid and list type questions in biomedical question answering","volume":"7","author":"Wasim","year":"2019"},{"issue":"1","key":"2024040320031881600_ocae015-B66","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1186\/s12911-019-0798-8","article-title":"QAnalysis: a question-answer driven analytic tool on knowledge graphs for leveraging electronic medical records for clinical research","volume":"19","author":"Ruan","year":"2019","journal-title":"BMC Med Inform Decis Mak"},{"key":"2024040320031881600_ocae015-B67","first-page":"1596","author":"Qiu","year":"2019"},{"key":"2024040320031881600_ocae015-B68","first-page":"1","author":"Gobeill","year":"2009"},{"issue":"1","key":"2024040320031881600_ocae015-B69","first-page":"28576","article-title":"Question processing and clustering in INDOC: a biomedical question answering system","volume":"2007","author":"Sondhi","year":"2007","journal-title":"EURASIP J Bioinform Syst Biol"},{"issue":"4","key":"2024040320031881600_ocae015-B70","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1111\/j.1471-1842.2010.00896.x","article-title":"Question-answering systems as efficient sources of terminological information: an evaluation","volume":"27","author":"Olvera-Lobo","year":"2010","journal-title":"Health Info Libr J"},{"key":"2024040320031881600_ocae015-B71","first-page":"626","author":"Xu","year":"2009"},{"key":"2024040320031881600_ocae015-B72","first-page":"863","article-title":"Trustworthiness and relevance in web-based clinical question answering","volume":"180","author":"Cruchet","year":"2012","journal-title":"Stud Health Technol Inform"},{"key":"2024040320031881600_ocae015-B73","doi-asserted-by":"crossref","first-page":"103118","DOI":"10.1016\/j.jbi.2019.103118","article-title":"Word embeddings and external resources for answer processing in biomedical factoid question answering","volume":"92","author":"Dimitriadis","year":"2019","journal-title":"J Biomed Inform"},{"key":"2024040320031881600_ocae015-B74","author":"Bai","year":"2022"},{"issue":"1","key":"2024040320031881600_ocae015-B75","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1186\/s12859-022-04688-w","article-title":"Benchmarking for biomedical natural language processing tasks with a domain specific ALBERT","volume":"23","author":"Naseem","year":"2022","journal-title":"BMC Bioinform"},{"key":"2024040320031881600_ocae015-B76","first-page":"659","author":"Du","year":"2021"},{"issue":"2","key":"2024040320031881600_ocae015-B77","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1093\/jamia\/ocac222","article-title":"Epidemic question answering: question generation and entailment for Answer Nugget discovery","volume":"30","author":"Weinzierl","year":"2023","journal-title":"J Am Med Inform Assoc"},{"key":"2024040320031881600_ocae015-B78","author":"Du","year":"2022"},{"issue":"3","key":"2024040320031881600_ocae015-B79","doi-asserted-by":"crossref","first-page":"1864","DOI":"10.1109\/TCBB.2022.3219375","article-title":"Improving biomedical ReQA with consistent NLI-transfer and post-whitening","volume":"20","author":"Bai","year":"2023","journal-title":"IEEE\/ACM Trans Comput Biol Bioinform"},{"issue":"15","key":"2024040320031881600_ocae015-B80","doi-asserted-by":"crossref","first-page":"3794","DOI":"10.1093\/bioinformatics\/btac397","article-title":"Sequence tagging for biomedical extractive question answering","volume":"38","author":"Yoon","year":"2022","journal-title":"Bioinformatics"},{"key":"2024040320031881600_ocae015-B81","first-page":"509","article-title":"QA-driven guidelines generation for bacteriotherapy","volume":"2009","author":"Pasche","year":"2009","journal-title":"AMIA Annu Symp Proc"},{"key":"2024040320031881600_ocae015-B82","doi-asserted-by":"crossref","first-page":"bav081","DOI":"10.1093\/database\/bav081","article-title":"Deep Question Answering for protein annotation","volume":"2015","author":"Gobeill","year":"2015","journal-title":"Database"},{"key":"2024040320031881600_ocae015-B83","first-page":"1331","author":"Raza","year":"2022"},{"key":"2024040320031881600_ocae015-B84","first-page":"45080","article-title":"Adaptable closed-domain question answering using contextualized CNN-attention models and question expansion","volume":"10","author":"Kia","year":"2022"},{"issue":"1","key":"2024040320031881600_ocae015-B85","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1186\/s12859-022-04751-6","article-title":"CoQUAD: a COVID-19 question answering dataset system, facilitating research, benchmarking, and practice","volume":"23","author":"Raza","year":"2022","journal-title":"BMC Bioinform"},{"key":"2024040320031881600_ocae015-B86","first-page":"2383","author":"Rajpurkar","year":"2016"},{"key":"2024040320031881600_ocae015-B87","first-page":"784","author":"Rajpurkar","year":"2018"},{"key":"2024040320031881600_ocae015-B88","first-page":"74","volume-title":"Text Summarization Branches Out","author":"Lin","year":"2004"},{"key":"2024040320031881600_ocae015-B89","first-page":"311","author":"Papineni","year":"2002"},{"key":"2024040320031881600_ocae015-B90","doi-asserted-by":"crossref","first-page":"670","DOI":"10.1007\/978-3-030-43887-6_60","volume-title":"Machine Learning and Knowledge Discovery in Databases","author":"Oita","year":"2020"},{"issue":"1","key":"2024040320031881600_ocae015-B91","doi-asserted-by":"crossref","first-page":"104486","DOI":"10.1016\/j.jbi.2023.104486","article-title":"A self-supervised language model selection strategy for biomedical question answering","volume":"146","author":"Arabzadeh","year":"2023","journal-title":"J Biomed Inform"},{"key":"2024040320031881600_ocae015-B92","author":"Pergola","year":"2021"},{"key":"2024040320031881600_ocae015-B93","author":"Yang","year":"2016"},{"key":"2024040320031881600_ocae015-B94","author":"Krithara","year":"2016."},{"key":"2024040320031881600_ocae015-B95","author":"Sarrouti","year":"2017"},{"key":"2024040320031881600_ocae015-B96","author":"Nentidis","year":"2017"},{"key":"2024040320031881600_ocae015-B97","author":"Papagiannopoulou","year":"2016"},{"key":"2024040320031881600_ocae015-B98","author":"Eckert","year":"2018"},{"key":"2024040320031881600_ocae015-B99","author":"Shin","year":"2020"},{"key":"2024040320031881600_ocae015-B100","author":"Nishida","year":"2021"},{"key":"2024040320031881600_ocae015-B101","first-page":"2567","author":"Jin","year":"2019"},{"key":"2024040320031881600_ocae015-B102","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.jbi.2017.03.001","article-title":"A passage retrieval method based on probabilistic information retrieval model and UMLS concepts in biomedical question answering","volume":"68","author":"Sarrouti","year":"2017","journal-title":"J Biomed Inform"},{"key":"2024040320031881600_ocae015-B103","author":"Brokos","year":"2016"},{"key":"2024040320031881600_ocae015-B104","author":"Ozyurt","year":"2020"},{"key":"2024040320031881600_ocae015-B105","author":"Pappas","year":"2022"},{"key":"2024040320031881600_ocae015-B106","author":"Wang","year":"2022"},{"key":"2024040320031881600_ocae015-B107","author":"Wang","year":"2020"},{"key":"2024040320031881600_ocae015-B108","author":"Neves","year":"2017"},{"key":"2024040320031881600_ocae015-B109","author":"Wiese","year":"2017"},{"key":"2024040320031881600_ocae015-B110","author":"Wiese","year":"2017"},{"key":"2024040320031881600_ocae015-B111","first-page":"5392","volume-title":"Proceedings of the Twelfth Language Resources and Evaluation Conference","author":"Nishida","year":"2020"},{"issue":"11","key":"2024040320031881600_ocae015-B112","doi-asserted-by":"crossref","first-page":"e0242061","DOI":"10.1371\/journal.pone.0242061","article-title":"List-wise learning to rank biomedical question-answer pairs with deep ranking recursive autoencoders","volume":"15","author":"Yan","year":"2020","journal-title":"PLoS One"},{"key":"2024040320031881600_ocae015-B113","volume-title":"BioNLP 2017","author":"Jin","year":"2017"},{"key":"2024040320031881600_ocae015-B114","first-page":"469","article-title":"Beyond information retrieval-medical question answering","volume":"2006","author":"Lee","year":"2006","journal-title":"AMIA Annu Symp Proc"},{"key":"2024040320031881600_ocae015-B115","first-page":"26","article-title":"Examining question-answering technology from the task technology fit perspective","volume":"30","author":"Robles-Flores","year":"2012","journal-title":"Commun Assoc Inf Syst"},{"key":"2024040320031881600_ocae015-B116","author":"Law","year":"2021"},{"key":"2024040320031881600_ocae015-B117","first-page":"2369","author":"Yang","year":"2018"},{"key":"2024040320031881600_ocae015-B118","first-page":"7076","author":"Schuff","year":"2020"},{"key":"2024040320031881600_ocae015-B119","first-page":"1","author":"Chowdhery"},{"key":"2024040320031881600_ocae015-B120","first-page":"172","author":"Singhal","year":"2022"},{"key":"2024040320031881600_ocae015-B121","first-page":"1387","author":"Shaib","year":"2023"},{"key":"2024040320031881600_ocae015-B122","author":"Das"},{"key":"2024040320031881600_ocae015-B123","author":"Kuhn"},{"key":"2024040320031881600_ocae015-B124"},{"issue":"1","key":"2024040320031881600_ocae015-B125","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1186\/s12916-019-1463-x","article-title":"The NASSS framework for ex post theorisation of technology-supported change in healthcare: worked example of the TORPEDO programme","volume":"17","author":"Abimbola","year":"2019","journal-title":"BMC Med"},{"issue":"11","key":"2024040320031881600_ocae015-B126","doi-asserted-by":"crossref","first-page":"e367","DOI":"10.2196\/jmir.8775","article-title":"Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies","volume":"19","author":"Greenhalgh","year":"2017","journal-title":"J Med Internet Res"},{"key":"2024040320031881600_ocae015-B127","first-page":"135","article-title":"Redesign of the Columbia University Infobutton Manager","volume":"2007","author":"Cimino","year":"2007","journal-title":"AMIA Annu Symp Proc"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/4\/1009\/57148499\/ocae015.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/4\/1009\/57148499\/ocae015.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,3]],"date-time":"2024-04-03T20:06:13Z","timestamp":1712174773000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/4\/1009\/7609555"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,16]]},"references-count":127,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2024,2,16]]},"published-print":{"date-parts":[[2024,4,3]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocae015","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,4,1]]},"published":{"date-parts":[[2024,2,16]]}}}