{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T00:52:23Z","timestamp":1775868743844,"version":"3.50.1"},"reference-count":33,"publisher":"Oxford University Press (OUP)","issue":"11","license":[{"start":{"date-parts":[[2019,8,7]],"date-time":"2019-08-07T00:00:00Z","timestamp":1565136000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000092","name":"National Library of Medicine","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000092","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>Information overload remains a challenge for patients seeking clinical trials. We present a novel system (DQueST) that reduces information overload for trial seekers using dynamic questionnaires.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>DQueST first performs information extraction and criteria library curation. DQueST transforms criteria narratives in the ClinicalTrials.gov repository into a structured format, normalizes clinical entities using standard concepts, clusters related criteria, and stores the resulting curated library. DQueST then implements a real-time dynamic question generation algorithm. During user interaction, the initial search is similar to a standard search engine, and then DQueST performs real-time dynamic question generation to select criteria from the library 1 at a time by maximizing its relevance score that reflects its ability to rule out ineligible trials. DQueST dynamically updates the remaining trial set by removing ineligible trials based on user responses to corresponding questions. The process iterates until users decide to stop and begin manually reviewing the remaining trials.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>In simulation experiments initiated by 10 diseases, DQueST reduced information overload by filtering out 60%\u201380% of initial trials after 50 questions. Reviewing the generated questions against previous answers, on average, 79.7% of the questions were relevant to the queried conditions. By examining the eligibility of random samples of trials ruled out by DQueST, we estimate the accuracy of the filtering procedure is 63.7%. In a study using 5 mock patient profiles, DQueST on average retrieved trials with a 1.465 times higher density of eligible trials than an existing search engine. In a patient-centered usability evaluation, patients found DQueST useful, easy to use, and returning relevant results.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>DQueST contributes a novel framework for transforming free-text eligibility criteria to questions and filtering out clinical trials based on user answers to questions dynamically. It promises to augment keyword-based methods to improve clinical trial search.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocz121","type":"journal-article","created":{"date-parts":[[2019,6,19]],"date-time":"2019-06-19T11:10:04Z","timestamp":1560942604000},"page":"1333-1343","source":"Crossref","is-referenced-by-count":14,"title":["DQueST: dynamic questionnaire for search of clinical trials"],"prefix":"10.1093","volume":"26","author":[{"given":"Cong","family":"Liu","sequence":"first","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University, New York, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chi","family":"Yuan","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University, New York, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alex M","family":"Butler","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University, New York, New York, USA"},{"name":"Department of Medicine, Columbia University, New York, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Richard D","family":"Carvajal","sequence":"additional","affiliation":[{"name":"Department of Medicine, Columbia University, New York, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ziran Ryan","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University, New York, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Casey N","family":"Ta","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University, New York, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chunhua","family":"Weng","sequence":"additional","affiliation":[{"name":"Department of Biomedical Informatics, Columbia University, New York, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2019,8,7]]},"reference":[{"issue":"6","key":"2020110613080670000_ocz121-B1","doi-asserted-by":"crossref","first-page":"869","DOI":"10.1197\/jamia.M3119","article-title":"Electronic screening improves efficiency in clinical trial recruitment","volume":"16","author":"Thadani","year":"2009","journal-title":"J Am Med Inform Assoc"},{"issue":"7573","key":"2020110613080670000_ocz121-B2","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1038\/nature15819","article-title":"Patient-centric trials for therapeutic development in precision oncology","volume":"526","author":"Biankin","year":"2015","journal-title":"Nature"},{"issue":"9","key":"2020110613080670000_ocz121-B3","doi-asserted-by":"crossref","first-page":"852","DOI":"10.1056\/NEJMsa1012065","article-title":"The ClinicalTrials.gov results database\u2013update and key issues","volume":"364","author":"Zarin","year":"2011","journal-title":"N Engl J Med"},{"issue":"6","key":"2020110613080670000_ocz121-B4","doi-asserted-by":"crossref","first-page":"1060","DOI":"10.1016\/j.jbi.2013.07.014","article-title":"eTACTS: a method for dynamically filtering clinical trial search results","volume":"46","author":"Miotto","year":"2013","journal-title":"J Biomed Inform"},{"key":"2020110613080670000_ocz121-B5","doi-asserted-by":"crossref","first-page":"D267","DOI":"10.1093\/nar\/gkh061","article-title":"The unified medical language system (UMLS): integrating biomedical terminology","volume":"32","author":"Bodenreider","year":"2004","journal-title":"Nucleic Acids Res"},{"issue":"3","key":"2020110613080670000_ocz121-B6","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1016\/j.jbi.2009.12.004","article-title":"Formal representation of eligibility criteria: a literature review","volume":"43","author":"Weng","year":"2010","journal-title":"J Biomed Inform"},{"issue":"2","key":"2020110613080670000_ocz121-B7","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1016\/j.jbi.2010.09.007","article-title":"A practical method for transforming free-text eligibility criteria into computable criteria","volume":"44","author":"Tu","year":"2011","journal-title":"J Biomed Inform"},{"issue":"1","key":"2020110613080670000_ocz121-B8","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/j.jbi.2012.07.006","article-title":"A human-computer collaborative approach to identifying common data elements in clinical trial eligibility criteria","volume":"46","author":"Luo","year":"2013","journal-title":"J Biomed Inform"},{"key":"2020110613080670000_ocz121-B9","doi-asserted-by":"crossref","first-page":"i116","DOI":"10.1136\/amiajnl-2011-000321","article-title":"EliXR: an approach to eligibility criteria extraction and representation","volume":"18 (Suppl 1)","author":"Weng","year":"2011","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613080670000_ocz121-B10","first-page":"71","article-title":"EliXR-TIME: a temporal knowledge representation for clinical research eligibility criteria","volume":"2012","author":"Boland","year":"2012","journal-title":"AMIA Jt Summits Transl Sci Proc"},{"issue":"3","key":"2020110613080670000_ocz121-B11","doi-asserted-by":"crossref","first-page":"266","DOI":"10.3414\/ME15-01-0112","article-title":"Valx: a system for extracting and structuring numeric lab test comparison statements from text","volume":"55","author":"Hao","year":"2016","journal-title":"Methods Inf Med"},{"issue":"6","key":"2020110613080670000_ocz121-B12","doi-asserted-by":"crossref","first-page":"1062","DOI":"10.1093\/jamia\/ocx019","article-title":"EliIE: an open-source information extraction system for clinical trial eligibility criteria","volume":"24","author":"Kang","year":"2017","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613080670000_ocz121-B13"},{"issue":"2","key":"2020110613080670000_ocz121-B14","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/j.jbi.2012.10.006","article-title":"Procurement of shared data instruments for research electronic data capture (REDCap)","volume":"46","author":"Obeid","year":"2013","journal-title":"J Biomed Inform"},{"issue":"1","key":"2020110613080670000_ocz121-B15","doi-asserted-by":"crossref","first-page":"154.","DOI":"10.1097\/EDE.0b013e31818f2e96","article-title":"Randomized trial of questionnaire length","volume":"20","author":"Rothman","year":"2009","journal-title":"Epidemiology"},{"issue":"1","key":"2020110613080670000_ocz121-B16","doi-asserted-by":"crossref","first-page":"2.","DOI":"10.1186\/1745-6215-11-2","article-title":"Questionnaires in clinical trials: guidelines for optimal design and administration","volume":"11","author":"Edwards","year":"2010","journal-title":"Trials"},{"key":"2020110613080670000_ocz121-B17","author":"Manning"},{"key":"2020110613080670000_ocz121-B18","author":"Lafferty"},{"issue":"5","key":"2020110613080670000_ocz121-B19","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1006\/jbin.2001.1029","article-title":"A simple algorithm for identifying negated findings and diseases in discharge summaries","volume":"34","author":"Chapman","year":"2001","journal-title":"J Biomed Inform"},{"key":"2020110613080670000_ocz121-B20","first-page":"574","article-title":"Observational health data sciences and informatics (OHDSI): opportunities for observational researchers","volume":"216","author":"Hripcsak","year":"2015","journal-title":"Stud Health Technol Inform"},{"key":"2020110613080670000_ocz121-B21","first-page":"950","article-title":"An OMOP CDM-based relational database of clinical research eligibility criteria","volume":"245","author":"Si","year":"2017","journal-title":"Stud Health Technol Inform"},{"key":"2020110613080670000_ocz121-B22","author":"Bia\u0142ecki","year":"2012"},{"issue":"2","key":"2020110613080670000_ocz121-B23","first-page":"29","article-title":"SUS: a retrospective","volume":"8","author":"Brooke","year":"2013","journal-title":"J Usability Stud"},{"issue":"1-2","key":"2020110613080670000_ocz121-B24","doi-asserted-by":"crossref","first-page":"S123.","DOI":"10.1016\/j.ymgme.2016.11.320","article-title":"ThinkGenetic: identification of misinformation and educational gaps using an innovative and interactive website","volume":"120","author":"Simmons","year":"2017","journal-title":"Mol Genet Metab"},{"issue":"2","key":"2020110613080670000_ocz121-B25","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1111\/1467-8640.00215","article-title":"Semantic-based information retrieval for content management and security","volume":"19","author":"Yun","year":"2003","journal-title":"Comput Intell"},{"key":"2020110613080670000_ocz121-B26","first-page":"1252.","article-title":"MetaMap lite in excel: biomedical named-entity recognition for non-technical users","volume":"245","author":"Bhupatiraju","year":"2017","journal-title":"Stud Health Technol Inform"},{"key":"2020110613080670000_ocz121-B27"},{"issue":"5","key":"2020110613080670000_ocz121-B28","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1136\/jamia.2009.001560","article-title":"Mayo clinical text analysis and knowledge extraction system (cTAKES): architecture, component evaluation and applications","volume":"17","author":"Savova","year":"2010","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2020110613080670000_ocz121-B29","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1136\/jamia.1994.95236146","article-title":"A general natural-language text processor for clinical radiology","volume":"1","author":"Friedman","year":"1994","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613080670000_ocz121-B30","author":"Collobert"},{"key":"2020110613080670000_ocz121-B31","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1016\/j.jbi.2015.05.005","article-title":"Enhancing reuse of structured eligibility criteria and supporting their relaxation","volume":"56","author":"Milian","year":"2015","journal-title":"J Biomed Inform"},{"issue":"4","key":"2020110613080670000_ocz121-B32","doi-asserted-by":"crossref","first-page":"999","DOI":"10.1016\/j.compedu.2009.10.003","article-title":"AH-questionnaire: An adaptive hierarchical questionnaire for learning styles","volume":"54","author":"Ortigosa","year":"2010","journal-title":"Comput Educ"},{"key":"2020110613080670000_ocz121-B33"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/26\/11\/1333\/34151822\/ocz121.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/26\/11\/1333\/34151822\/ocz121.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T19:18:49Z","timestamp":1604690329000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/26\/11\/1333\/5544734"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,7]]},"references-count":33,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2019,8,7]]},"published-print":{"date-parts":[[2019,11,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocz121","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,11]]},"published":{"date-parts":[[2019,8,7]]}}}