{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T08:21:30Z","timestamp":1776414090310,"version":"3.51.2"},"reference-count":17,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2007,6,15]],"date-time":"2007-06-15T00:00:00Z","timestamp":1181865600000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2007,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Background<\/jats:title>\n            <jats:p>Supporting 21<jats:sup>st<\/jats:sup> century health care and the practice of evidence-based medicine (EBM) requires ubiquitous access to clinical information and to knowledge-based resources to answer clinical questions. Many questions go unanswered, however, due to lack of skills in formulating questions, crafting effective search strategies, and accessing databases to identify best levels of evidence.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods<\/jats:title>\n            <jats:p>This randomized trial was designed as a pilot study to measure the relevancy of search results using three different interfaces for the PubMed search system. Two of the search interfaces utilized a specific framework called PICO, which was designed to focus clinical questions and to prompt for publication type or type of question asked. The third interface was the standard PubMed interface readily available on the Web. Study subjects were recruited from interns and residents on an inpatient general medicine rotation at an academic medical center in the US. Thirty-one subjects were randomized to one of the three interfaces, given 3 clinical questions, and asked to search PubMed for a set of relevant articles that would provide an answer for each question. The success of the search results was determined by a precision score, which compared the number of relevant or gold standard articles retrieved in a result set to the total number of articles retrieved in that set.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>Participants using the PICO templates (Protocol A or Protocol B) had higher precision scores for each question than the participants who used Protocol C, the standard PubMed Web interface. (Question 1: A = 35%, B = 28%, C = 20%; Question 2: A = 5%, B = 6%, C = 4%; Question 3: A = 1%, B = 0%, C = 0%) 95% confidence intervals were calculated for the precision for each question using a lower boundary of zero. However, the 95% confidence limits were overlapping, suggesting no statistical difference between the groups.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusion<\/jats:title>\n            <jats:p>Due to the small number of searches for each arm, this pilot study could not demonstrate a statistically significant difference between the search protocols. However there was a trend towards higher precision that needs to be investigated in a larger study to determine if PICO can improve the relevancy of search results.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1186\/1472-6947-7-16","type":"journal-article","created":{"date-parts":[[2007,6,16]],"date-time":"2007-06-16T13:24:32Z","timestamp":1182000272000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2299,"title":["Utilization of the PICO framework to improve searching PubMed for clinical questions"],"prefix":"10.1186","volume":"7","author":[{"given":"Connie","family":"Schardt","sequence":"first","affiliation":[]},{"given":"Martha B","family":"Adams","sequence":"additional","affiliation":[]},{"given":"Thomas","family":"Owens","sequence":"additional","affiliation":[]},{"given":"Sheri","family":"Keitz","sequence":"additional","affiliation":[]},{"given":"Paul","family":"Fontelo","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2007,6,15]]},"reference":[{"key":"147_CR1","volume-title":"Evidence-based medicine: how to practice and teach EBM","author":"SE Straus","year":"2005","unstructured":"Straus SE: Evidence-based medicine: how to practice and teach EBM. 2005, London: United Kingdom Elsevier, 3","edition":"3"},{"key":"147_CR2","unstructured":"PubMed. [http:\/\/www.pubmed.gov]"},{"key":"147_CR3","doi-asserted-by":"publisher","first-page":"270","DOI":"10.1097\/00001888-200303000-00007","volume":"78","author":"SD Crowley","year":"2003","unstructured":"Crowley SD, Owens TA, Schardt CM, Wardell SI, Peterson J, Garrison S, Keitz SA: A Web-based compendium of clinical questions and medical evidence to educate internal medicine residents. Acad Med. 2003, 78: 270-274. 10.1097\/00001888-200303000-00007.","journal-title":"Acad Med"},{"key":"147_CR4","doi-asserted-by":"publisher","first-page":"489","DOI":"10.1097\/00001888-199406000-00017","volume":"69","author":"MS Klein","year":"1994","unstructured":"Klein MS, Ross FV, Adams DL, Gilbert CM: Effect of online literature searching on length of stay and patient care costs. Acad Med. 1994, 69: 489-95. 10.1097\/00001888-199406000-00017.","journal-title":"Acad Med"},{"issue":"3","key":"147_CR5","doi-asserted-by":"publisher","first-page":"315","DOI":"10.1197\/jamia.M1717","volume":"12","author":"JI Westbrook","year":"2005","unstructured":"Westbrook JI, Coiera EW, Gosling AS: Do online information retrieval systems help experienced clinicians answer clinical questions?. J Am Med Inform Assoc. 2005, 12 (3): 315-21. 10.1197\/jamia.M1717.","journal-title":"J Am Med Inform Assoc"},{"key":"147_CR6","doi-asserted-by":"publisher","first-page":"710","DOI":"10.1136\/bmj.324.7339.710","volume":"324","author":"JW Ely","year":"2002","unstructured":"Ely JW, Osheroff JA, Ebell MH, Chambliss ML, Vinson DC, Stevermer JJ, Pifer E: Obstacles to answering doctors' questions aboutpatient care with evidence: qualitative study. BMJ. 2002, 324: 710-10.1136\/bmj.324.7339.710.","journal-title":"BMJ"},{"key":"147_CR7","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1016\/S0002-9343(00)00458-7","volume":"109","author":"ML Green","year":"2000","unstructured":"Green ML, Ciampi MA, Ellis PJ: Residents' medical information needs in clinic: are they being met?. Am J Med. 2000, 109: 218-23. 10.1016\/S0002-9343(00)00458-7.","journal-title":"Am J Med"},{"key":"147_CR8","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1097\/00001888-200502000-00016","volume":"80","author":"ML Green","year":"2005","unstructured":"Green ML, Ruff TR: Why do residents fail to answer their clinical questions? A qualitative study of barriers to practicing evidence-based medicine. Acad Med. 2005, 80: 176-82. 10.1097\/00001888-200502000-00016.","journal-title":"Acad Med"},{"key":"147_CR9","doi-asserted-by":"crossref","first-page":"A12","DOI":"10.7326\/ACPJC-1995-123-3-A12","volume":"123","author":"WS Richardson","year":"1995","unstructured":"Richardson WS, Wilson MC, Nishikawa J, Hayward RS: The well-built clinical question: a key to evidence-based decisions. ACP J Club. 1995, 123: A12-3.","journal-title":"ACP J Club"},{"key":"147_CR10","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1186\/1472-6947-1-4","volume":"1","author":"EV Villanueva","year":"2001","unstructured":"Villanueva EV, Burrows EA, Fennessy PA, Rajendran M, Anderson JN: Improving question formulation for use in evidence appraisalin a tertiary care setting: a randomised controlled trial. BMC Med Inform Decis Mak. 2001, 1: 4-10.1186\/1472-6947-1-4. Epub 2001 Nov 8.","journal-title":"BMC Med Inform Decis Mak"},{"key":"147_CR11","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1046\/j.1365-2532.1997.1430133.x-i1","volume":"14","author":"R Snowball","year":"1997","unstructured":"Snowball R: Using the clinical question to teach search strategy: fostering transferable conceptual skills in user education by active learning. Health Libr Rev. 1997, 14: 167-173. 10.1046\/j.1365-2532.1997.1430167.x.","journal-title":"Health Libr Rev"},{"key":"147_CR12","first-page":"904","volume-title":"Proc AMIA Annu Symp","author":"NL Wilczynski","year":"2002","unstructured":"Wilczynski NL, Haynes RB, Hedges Team: Robustness of empirical search strategies for clinical content in MEDLINE. Proc AMIA Annu Symp. 2002, 904-8."},{"issue":"7","key":"147_CR13","first-page":"486","volume":"37","author":"GR Bergus","year":"2005","unstructured":"Bergus GR, Randall CS, Sinift SD, Rosenthal DM: Family medicine residents do not ask better-formulated clinical questions as they advance in their training. Fam Med. 2005, 37 (7): 486-90.","journal-title":"Fam Med"},{"key":"147_CR14","unstructured":"PICO A. [http:\/\/pubmedhh.nlm.nih.gov\/nlm\/picostudy\/pico3.html]"},{"key":"147_CR15","unstructured":"PICO B. [http:\/\/pubmedhh.nlm.nih.gov\/nlm\/picostudy\/pico2.html]"},{"key":"147_CR16","first-page":"359","volume-title":"AMIA Annu Symp Proc","author":"X Huang","year":"2006","unstructured":"Huang X, Lin J, Demner-Fushman D: Evaluation of PICO as a Knowledge Representation for Clinical Questiosns. AMIA Annu Symp Proc. 2006, 359-63."},{"key":"147_CR17","unstructured":"NLM Technical Bulletin. 2005, [http:\/\/www.nlm.nih.gov\/pubs\/techbull\/mj05\/mj05_mla_dg.html]"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/1472-6947-7-16.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/1472-6947-7-16\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/1472-6947-7-16","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1472-6947-7-16.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,31]],"date-time":"2021-08-31T22:13:23Z","timestamp":1630448003000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/1472-6947-7-16"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2007,6,15]]},"references-count":17,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2007,12]]}},"alternative-id":["147"],"URL":"https:\/\/doi.org\/10.1186\/1472-6947-7-16","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2007,6,15]]},"assertion":[{"value":"15 February 2007","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 June 2007","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 June 2007","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"16"}}