{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,10,8]],"date-time":"2024-10-08T04:17:24Z","timestamp":1728361044593},"reference-count":24,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2004,12,10]],"date-time":"2004-12-10T00:00:00Z","timestamp":1102636800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/2.0\/"},{"start":{"date-parts":[[2004,12,10]],"date-time":"2004-12-10T00:00:00Z","timestamp":1102636800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/2.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                        <jats:title>Background<\/jats:title>\n                        <jats:p>Critically Appraised Topics (CATs) are a useful tool that helps physicians to make clinical decisions as the healthcare moves towards the practice of Evidence-Based Medicine (EBM). The fast growing World Wide Web has provided a place for physicians to share their appraised topics online, but an increasing amount of time is needed to find a particular topic within such a rich repository.<\/jats:p>\n                     <\/jats:sec><jats:sec>\n                        <jats:title>Methods<\/jats:title>\n                        <jats:p>A web-based application, namely the CAT Crawler, was developed by Singapore's Bioinformatics Institute to allow physicians to adequately access available appraised topics on the Internet. A meta-search engine, as the core component of the application, finds relevant topics following keyword input. The primary objective of the work presented here is to evaluate the quantity and quality of search results obtained from the meta-search engine of the CAT Crawler by comparing them with those obtained from two individual CAT search engines. From the CAT libraries at these two sites, all possible keywords were extracted using a keyword extractor. Of those common to both libraries, ten were randomly chosen for evaluation. All ten were submitted to the two search engines individually, and through the meta-search engine of the CAT Crawler. Search results were evaluated for relevance both by medical amateurs and professionals, and the respective recall and precision were calculated.<\/jats:p>\n                     <\/jats:sec><jats:sec>\n                        <jats:title>Results<\/jats:title>\n                        <jats:p>While achieving an identical recall, the meta-search engine showed a precision of 77.26% (\u00b114.45) compared to the individual search engines' 52.65% (\u00b112.0) (p &lt; 0.001).<\/jats:p>\n                     <\/jats:sec><jats:sec>\n                        <jats:title>Conclusion<\/jats:title>\n                        <jats:p>The results demonstrate the validity of the CAT Crawler meta-search engine approach. The improved precision due to inherent filters underlines the practical usefulness of this tool for clinicians.<\/jats:p>\n                     <\/jats:sec>","DOI":"10.1186\/1472-6947-4-21","type":"journal-article","created":{"date-parts":[[2005,1,13]],"date-time":"2005-01-13T13:35:47Z","timestamp":1105623347000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Quantitative evaluation of recall and precision of CAT Crawler, a search engine specialized on retrieval of Critically Appraised Topics"],"prefix":"10.1186","volume":"4","author":[{"given":"Peng","family":"Dong","sequence":"first","affiliation":[]},{"given":"Ling Ling","family":"Wong","sequence":"additional","affiliation":[]},{"given":"Sarah","family":"Ng","sequence":"additional","affiliation":[]},{"given":"Marie","family":"Loh","sequence":"additional","affiliation":[]},{"given":"Adrian","family":"Mondry","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2004,12,10]]},"reference":[{"key":"49_CR1","doi-asserted-by":"publisher","first-page":"2420","DOI":"10.1001\/jama.1992.03490170092032","volume":"268","author":"EBMW Group","year":"1992","unstructured":"Group EBMW: Evidence-Based Medicine. A new approach to teaching the practice of medicine. JAMA. 1992, 268: 2420-2425. 10.1001\/jama.268.17.2420.","journal-title":"JAMA"},{"key":"49_CR2","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1136\/bmj.312.7023.71","volume":"312","author":"DL Sackett","year":"1996","unstructured":"Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS: Evidence based medicine: what it is and what it isn't. BMJ. 1996, 312: 71-72.","journal-title":"BMJ"},{"key":"49_CR3","volume-title":"Evidence-Based Medicine: How to practice and teach EBM","author":"DL Sackett","year":"2000","unstructured":"Sackett DL, Straus SE, Richardson WS, Rosenberg W, Haynes RB: Evidence-Based Medicine: How to practice and teach EBM. 2000, London, Churchill Livingstone"},{"key":"49_CR4","first-page":"396","volume":"28","author":"S Sauve","year":"1995","unstructured":"Sauve S, Lee HN, Meade MO, Lang JD, Farkouh M, Cook DJ, Sackett DL: The critically appraised topic: a practical approach to learning critical appraisal. Ann Roy Soc Phys Surg Canada. 1995, 28: 396-398.","journal-title":"Ann Roy Soc Phys Surg Canada"},{"key":"49_CR5","unstructured":"BETs and CATs, Emergency Department, Manchester Royal Infirmary. [http:\/\/www.bestbets.org\/background\/betscats.html]-"},{"key":"49_CR6","unstructured":"Pediatric Critical Care Medicine, Evidence-Based Journal Club Review. [http:\/\/pedsccm.wustl.edu\/ebjournal_club.html]-"},{"key":"49_CR7","unstructured":"CAT Library, Oxford-Centre for Evidence Based Medicine. [http:\/\/www.minervation.com\/cebm2\/cats\/allcats.html]-"},{"key":"49_CR8","unstructured":"BET Database Search Engine, Emergency Department, Manchester Royal Infirmary. [http:\/\/www.bestbets.org\/database\/search.html]-"},{"key":"49_CR9","unstructured":"CAT Library Search Engine, University of Michigan. [http:\/\/www.med.umich.edu\/pediatrics\/ebm\/Search.htm]-"},{"key":"49_CR10","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1016\/S1386-5056(01)00159-9","volume":"62","author":"L Bin","year":"2001","unstructured":"Bin L, Lun KC: The retrieval effectiveness of medical information on the web. Int J Med Inf. 2001, 62: 155-163. 10.1016\/S1386-5056(01)00159-9.","journal-title":"Int J Med Inf"},{"key":"49_CR11","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1080\/14639230310001655849","volume":"29","author":"P Dong","year":"2004","unstructured":"Dong P, Mondry A: Enhanced quality and quantity of retrieval of Critically Appraised Topics using the CAT Crawler. Med Inform Internet Med. 2004, 29: 43-55. 10.1080\/14639230310001655849.","journal-title":"Med Inform Internet Med"},{"key":"49_CR12","unstructured":"CAT Crawler - an online resource for Critically Appraised Topics (CATs). [http:\/\/www.bii.as-tar.edu.sg\/research\/mig\/cat.asp]"},{"key":"49_CR13","unstructured":"AnalogX Keyword Extractor. [http:\/\/www.analogx.com]"},{"key":"49_CR14","doi-asserted-by":"publisher","first-page":"539","DOI":"10.1007\/978-0-387-21721-5_15","volume-title":"Medical Informatics","author":"WR Hersh","year":"2001","unstructured":"Hersh WR, Detmer WM, Frisse ME: Information-Retrieval Systems. Medical Informatics. Edited by: H SE and E PL. 2001, New York, Springer, 539-572."},{"key":"49_CR15","doi-asserted-by":"publisher","first-page":"488","DOI":"10.1002\/asi.10399","volume":"55","author":"G Benoit","year":"2004","unstructured":"Benoit G: Properties-based retrieval and user decision states: User control and behavior modeling. JASIST. 2004, 55: 488-497. 10.1002\/asi.10399.","journal-title":"JASIST"},{"key":"49_CR16","first-page":"176","volume":"71","author":"ME Funk","year":"1983","unstructured":"Funk ME, Reid CA: Indexing consistency in MEDLINE. Bull Med Libr Assoc. 1983, 71: 176-183.","journal-title":"Bull Med Libr Assoc"},{"key":"49_CR17","doi-asserted-by":"publisher","first-page":"78","DOI":"10.7326\/0003-4819-112-1-78","volume":"112","author":"RB Haynes","year":"1990","unstructured":"Haynes RB, McKibbon KA, Walker CJ, Ryan N, Fitzgerald D, Ramsden MF: Online access to MEDLINE in clinical settings: A study of use and usefulness. Ann Intern Med. 1990, 112: 78-84.","journal-title":"Ann Intern Med"},{"key":"49_CR18","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1002\/(SICI)1097-4571(199404)45:3<201::AID-ASI9>3.0.CO;2-W","volume":"45","author":"WR Hersh","year":"1994","unstructured":"Hersh WR: Relevance and retrieval evaluation: perspectives from medicine. J Am Soc Inform Sci. 1994, 45: 201-206. 10.1002\/(SICI)1097-4571(199404)45:3<201::AID-ASI9>3.0.CO;2-W.","journal-title":"J Am Soc Inform Sci"},{"key":"49_CR19","first-page":"81","volume-title":"ESSIR LNCS","author":"SE Robertson","year":"2000","unstructured":"Robertson SE: Evaluation in information retrieval. ESSIR LNCS. Edited by: Agosti M, Crestani F and Pasi G. 2000, , Springer-Verlag, 81-92."},{"key":"49_CR20","doi-asserted-by":"publisher","first-page":"685","DOI":"10.1147\/sj.393.0685","volume":"39","author":"BJ Rhodes","year":"2000","unstructured":"Rhodes BJ, Maes P: Just-in-time information retrieval agents. IBM Systems Journal. 2000, 39: 685-704.","journal-title":"IBM Systems Journal"},{"key":"49_CR21","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1145\/64789.64790","volume":"7","author":"DE Egan","year":"1989","unstructured":"Egan DE, Remde JR, Gomez LM, Landauer TK, Eberhardt J, Lochbaum CC: Formative design-evaluation of Superbook. ACM Trans Inf Syst. 1989, 7: 30-57. 10.1145\/64789.64790.","journal-title":"ACM Trans Inf Syst"},{"key":"49_CR22","first-page":"164","volume-title":"Towards new measures of information retrieval evaluation: Jul 9-13; Seattle, Washington, USA.","author":"WR Hersh","year":"1995","unstructured":"Hersh WR, Elliot DL, Hickam DH, Wolf SL, Molnar A, Leichtenstein C: Towards new measures of information retrieval evaluation: Jul 9-13; Seattle, Washington, USA. 1995, New York: ACM Press, 164-170."},{"key":"49_CR23","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1001\/jama.1994.03520020096029","volume":"272","author":"WP Whitely","year":"1994","unstructured":"Whitely WP, Rennie D, Hafner AW: The scientific community's response to evidence of fraudulent publication. The Robert Slutsky case. JAMA. 1994, 272: 170-173. 10.1001\/jama.272.2.170.","journal-title":"JAMA"},{"key":"49_CR24","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1002\/(SICI)1097-4571(199601)47:1<50::AID-ASI5>3.0.CO;2-1","volume":"47","author":"WR Hersh","year":"1996","unstructured":"Hersh WR, Pentecost J, Hickham DH: A task-oriented approach to information retrieval evaluation. J Am Soc Inform Sci. 1996, 47: 50-56.","journal-title":"J Am Soc Inform Sci"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1472-6947-4-21.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/1472-6947-4-21\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/1472-6947-4-21","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1472-6947-4-21.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,7]],"date-time":"2024-10-07T13:19:09Z","timestamp":1728307149000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/1472-6947-4-21"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2004,12,10]]},"references-count":24,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2004,12]]}},"alternative-id":["49"],"URL":"https:\/\/doi.org\/10.1186\/1472-6947-4-21","relation":{},"ISSN":["1472-6947"],"issn-type":[{"type":"electronic","value":"1472-6947"}],"subject":[],"published":{"date-parts":[[2004,12,10]]},"assertion":[{"value":"20 August 2004","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 December 2004","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 December 2004","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"21"}}