{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T11:29:40Z","timestamp":1774438180132,"version":"3.50.1"},"reference-count":33,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2019,10,8]],"date-time":"2019-10-08T00:00:00Z","timestamp":1570492800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000092","name":"National Library of Medicine","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,2,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Consumers increasingly turn to the internet in search of health-related information; and they want their questions answered with short and precise passages, rather than needing to analyze lists of relevant documents returned by search engines and reading each document to find an answer. We aim to answer consumer health questions with information from reliable sources.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>We combine knowledge-based, traditional machine and deep learning approaches to understand consumers\u2019 questions and select the best answers from consumer-oriented sources. We evaluate the end-to-end system and its components on simple questions generated in a pilot development of MedlinePlus Alexa skill, as well as the short and long real-life questions submitted to the National Library of Medicine by consumers.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Our system achieves 78.7% mean average precision and 87.9% mean reciprocal rank on simple Alexa questions, and 44.5% mean average precision and 51.6% mean reciprocal rank on real-life questions submitted by National Library of Medicine consumers.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>The ensemble of deep learning, domain knowledge, and traditional approaches recognizes question type and focus well in the simple questions, but it leaves room for improvement on the real-life consumers\u2019 questions. Information retrieval approaches alone are sufficient for finding answers to simple Alexa questions. Answering real-life questions, however, benefits from a combination of information retrieval and inference approaches.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>A pilot practical implementation of research needed to help consumers find reliable answers to their health-related questions demonstrates that for most questions the reliable answers exist and can be found automatically with acceptable accuracy.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocz152","type":"journal-article","created":{"date-parts":[[2019,8,8]],"date-time":"2019-08-08T19:12:19Z","timestamp":1565291539000},"page":"194-201","source":"Crossref","is-referenced-by-count":53,"title":["Consumer health information and question answering: helping consumers find answers to their health-related information needs"],"prefix":"10.1093","volume":"27","author":[{"given":"Dina","family":"Demner-Fushman","sequence":"first","affiliation":[{"name":"Lister Hill National Center for Biomedical Communications, National Library of Medicine, National Institutes of Health, Bethesda, Maryland, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yassine","family":"Mrabet","sequence":"additional","affiliation":[{"name":"Lister Hill National Center for Biomedical Communications, National Library of Medicine, National Institutes of Health, Bethesda, Maryland, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Asma","family":"Ben Abacha","sequence":"additional","affiliation":[{"name":"Lister Hill National Center for Biomedical Communications, National Library of Medicine, National Institutes of Health, Bethesda, Maryland, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2019,10,8]]},"reference":[{"key":"2020110613073683800_ocz152-B1"},{"key":"2020110613073683800_ocz152-B2"},{"issue":"4","key":"2020110613073683800_ocz152-B3","doi-asserted-by":"crossref","first-page":"802","DOI":"10.1093\/jamia\/ocw024","article-title":"Interactive use of online health resources: a comparison of consumer and professional questions","volume":"23","author":"Roberts","year":"2016","journal-title":"J Am Med Inform Assoc"},{"issue":"6","key":"2020110613073683800_ocz152-B4","doi-asserted-by":"crossref","first-page":"1032","DOI":"10.1016\/j.jbi.2011.08.008","article-title":"Toward automated consumer question answering: Automatically separating consumer questions from professional questions in the healthcare domain","volume":"44","author":"Liu","year":"2011","journal-title":"J Biomed Inform"},{"issue":"11","key":"2020110613073683800_ocz152-B5","doi-asserted-by":"crossref","first-page":"e0203429","DOI":"10.1371\/journal.pone.0203429","article-title":"Exploring patient information needs in type 2 diabetes: A cross sectional study of questions","volume":"13","author":"Crangle","year":"2018","journal-title":"PLoS ONE"},{"key":"2020110613073683800_ocz152-B6"},{"key":"2020110613073683800_ocz152-B7"},{"key":"2020110613073683800_ocz152-B8"},{"issue":"3","key":"2020110613073683800_ocz152-B9","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1093\/jamia\/ocy171","article-title":"Spell checker for consumer language (CSpell)","volume":"26","author":"Lu","year":"2019","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613073683800_ocz152-B10","author":"Ben Abacha","year":"2019"},{"issue":"7","key":"2020110613073683800_ocz152-B11","doi-asserted-by":"crossref","first-page":"1724","DOI":"10.1002\/asi.23806","article-title":"A protocol-driven approach to automatically finding authoritative answers to consumer health questions in online resources","volume":"68","author":"Deardorff","year":"2017","journal-title":"J Assoc Inf Sci Technol"},{"key":"2020110613073683800_ocz152-B12","volume-title":"proceedings of the LREC","author":"Kilicoglu","year":"2016"},{"issue":"1","key":"2020110613073683800_ocz152-B13","doi-asserted-by":"crossref","first-page":"34.","DOI":"10.1186\/s12859-018-2045-1","article-title":"Semantic annotation of consumer health questions","volume":"19","author":"Kilicoglu","year":"2018","journal-title":"BMC Bioinform"},{"key":"2020110613073683800_ocz152-B14","first-page":"727","article-title":"An ensemble method for spelling correction in consumer health questions","volume":"2015","author":"Kilicoglu","year":"2015","journal-title":"AMIA Annu Symp Proc"},{"key":"2020110613073683800_ocz152-B15","author":"Ben Abacha","year":"2017"},{"key":"2020110613073683800_ocz152-B16","author":"Ben Abacha","year":"2019"},{"key":"2020110613073683800_ocz152-B17","first-page":"1018","article-title":"Automatically classifying question types for consumer health questions","volume":"2014","author":"Roberts","year":"2014","journal-title":"AMIA Annu Symp Proc"},{"key":"2020110613073683800_ocz152-B18","author":"Roberts"},{"key":"2020110613073683800_ocz152-B19","first-page":"914","article-title":"Combining open-domain and biomedical knowledge for topic recognition in consumer health questions","volume":"2017","author":"Mrabet","year":"2017","journal-title":"AMIA Annu Symp Proc"},{"key":"2020110613073683800_ocz152-B20","first-page":"1","article-title":"MetaMap Lite: an evaluation of a new Java implementation of MetaMap","author":"Demner-Fushman","year":"2017","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613073683800_ocz152-B21","author":"Pennington"},{"key":"2020110613073683800_ocz152-B22","first-page":"310","article-title":"Recognizing question entailment for medical question answering","volume":"2017","author":"Ben Abacha","year":"2017","journal-title":"AMIA Annu Symp Proc"},{"key":"2020110613073683800_ocz152-B23","author":"Ben Abacha"},{"key":"2020110613073683800_ocz152-B24","author":"Ben Abacha","year":"2019"},{"issue":"4","key":"2020110613073683800_ocz152-B25","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1055\/s-0038-1634945","article-title":"The Unified Medical Language System","volume":"32","author":"Lindberg","year":"1993","journal-title":"Methods Inf Med"},{"key":"2020110613073683800_ocz152-B26"},{"key":"2020110613073683800_ocz152-B27","author":"Ma","year":"2016"},{"key":"2020110613073683800_ocz152-B28"},{"key":"2020110613073683800_ocz152-B29"},{"issue":"2","key":"2020110613073683800_ocz152-B30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2668120","article-title":"A comparative analysis of interleaving methods for aggregated search","volume":"33","author":"Chuklin","year":"2015","journal-title":"ACM Trans Inf Syst"},{"key":"2020110613073683800_ocz152-B31"},{"key":"2020110613073683800_ocz152-B32"},{"key":"2020110613073683800_ocz152-B33","author":"Ben Abacha"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/2\/194\/34152452\/ocz152.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/27\/2\/194\/34152452\/ocz152.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T19:15:23Z","timestamp":1604690123000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/27\/2\/194\/5583718"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,8]]},"references-count":33,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2019,10,8]]},"published-print":{"date-parts":[[2020,2,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocz152","relation":{},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,2]]},"published":{"date-parts":[[2019,10,8]]}}}