{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T00:33:13Z","timestamp":1761006793702,"version":"build-2065373602"},"reference-count":26,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2010,11,18]],"date-time":"2010-11-18T00:00:00Z","timestamp":1290038400000},"content-version":"vor","delay-in-days":686,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc of Assoc for Info"],"published-print":{"date-parts":[[2009,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper reports results of an evaluation study of MAP (Multi\u2010faceted Access to PubMed), a metadata induced query suggestion interface for PubMed bibliographic search.<\/jats:p><jats:p>A novel evaluation methodology was used to address the challenges involved in evaluating an IIR (Interactive Information Retrieval) system such as the MAP interface. The most significant aspect of this methodology is that, instead of using assigned tasks common in traditional IR evaluation, it asks real users with real search requests to search with real systems in an experimental setting. Several performance measures were created based on which comparisons were made between MAP and PubMed baseline. MAP was shown to perform better in several of these measures, especially when the search requests had not been attempted before.<\/jats:p><jats:p>The finding pointed to search characteristics as an important intervening variable in IIR evaluation. The advantages of and potential threats to our methodology were also discussed.<\/jats:p>","DOI":"10.1002\/meet.2009.1450460238","type":"journal-article","created":{"date-parts":[[2010,1,29]],"date-time":"2010-01-29T11:13:43Z","timestamp":1264763623000},"page":"1-18","source":"Crossref","is-referenced-by-count":0,"title":["Evaluating a metadata\u2010based term suggestion interface for PubMed with real users with real requests"],"prefix":"10.1002","volume":"46","author":[{"given":"Muh\u2010Chyun","family":"Tang","sequence":"first","affiliation":[]},{"given":"Wan\u2010Ching","family":"Wu","sequence":"additional","affiliation":[]},{"given":"Bang\u2010Woei","family":"Hung","sequence":"additional","affiliation":[]}],"member":"311","published-online":{"date-parts":[[2010,11,18]]},"reference":[{"key":"e_1_2_8_2_1","doi-asserted-by":"publisher","DOI":"10.1108\/eb024320"},{"key":"e_1_2_8_3_1","first-page":"133","article-title":"Anomalous states of knowledge as a basis for information retrieval","volume":"5","author":"Belkin N. J.","year":"1980","journal-title":"Canadian Journal of Information Science"},{"key":"e_1_2_8_4_1","doi-asserted-by":"publisher","DOI":"10.1108\/EUM0000000007110"},{"key":"e_1_2_8_5_1","doi-asserted-by":"crossref","unstructured":"Doms A. &Schroeder M.(2005).GoPubMed: exploring PubMed with the Gene Ontology. Nucleic Acids Research. 33 (Web Server issue) 783\u2013786.","DOI":"10.1093\/nar\/gki470"},{"key":"e_1_2_8_6_1","first-page":"123","volume-title":"TREC: Experiment and evaluation in information retrieval","author":"Dumais S. T.","year":"2005"},{"key":"e_1_2_8_7_1","doi-asserted-by":"publisher","DOI":"10.1002\/1097-4571(2000)9999:9999<::AID-ASI1002>3.0.CO;2-B"},{"key":"e_1_2_8_8_1","doi-asserted-by":"crossref","unstructured":"GoetzT &von der LiethC W. (2005).PubFinder: a tool for improving retrieval rate of relevant PubMed abstracts. Nucleic Acids Research. 33 (Web Server issue) 774\u2013778.","DOI":"10.1093\/nar\/gki429"},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/567498.567525"},{"key":"e_1_2_8_10_1","doi-asserted-by":"crossref","unstructured":"Hersh W. Turpin A. Price S. Kraemer D. Chan B. Sacherek L. et al. (2000).Do Batch and User Evaluations Give the Same Results? An Analysis from the TREC\u20108 Interactive Track. NIST Special Publication. (500) 531\u2013540.","DOI":"10.6028\/NIST.SP.500-246.interactive-OHSU"},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(99)00056-4"},{"key":"e_1_2_8_12_1","doi-asserted-by":"crossref","unstructured":"Joho H. &Jose J. M.(2006).Slicing and dicing the information space using local contexts. In IIiX: Proceedings of the 1st international conference on Information interaction in context (pp.66\u201374). New York NY USA: ACM Press.","DOI":"10.1145\/1164820.1164836"},{"key":"e_1_2_8_13_1","unstructured":"Kek\u00e4l\u00e4inen J. &J\u00e4rvelin K.(2002).Evaluating information retrieval systems under the challenges of interaction and multidimensional dynamic relevance. Paper presented at the Proceedings of the CoLIS 4 Conference Greenwood Village Colo."},{"key":"e_1_2_8_14_1","doi-asserted-by":"crossref","unstructured":"Lagergren E. &Over P.(1998).Comparing interactive information retrieval systems across sites: the TREC\u20106 interactive track matrix experiment. Paper presented at The 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval Melbourne Australia.","DOI":"10.1145\/290941.290986"},{"key":"e_1_2_8_15_1","doi-asserted-by":"crossref","unstructured":"Lin X.(1999).Visual MeSH. Paper presented at The 22nd International Conferences on Research and Development in Information Retrieval Berkeley CA.","DOI":"10.1145\/312624.312749"},{"key":"e_1_2_8_16_1","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-7-424"},{"key":"e_1_2_8_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0968-0004(01)01926-0"},{"issue":"2","key":"e_1_2_8_18_1","first-page":"37","article-title":"The key role of classification and indexing in view\u2010based searching","volume":"27","author":"Pollitt A. S.","year":"1998","journal-title":"International cataloguing and bibliographic control"},{"key":"e_1_2_8_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2007.09.006"},{"key":"e_1_2_8_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(92)90004-J"},{"key":"e_1_2_8_21_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20319"},{"key":"e_1_2_8_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20689"},{"key":"e_1_2_8_23_1","doi-asserted-by":"publisher","DOI":"10.5860\/crl_29_03_178"},{"key":"e_1_2_8_24_1","first-page":"413","volume-title":"Task\u2010based information searching. Annual Review of Information Science and Technology 2003","author":"Vakkari P.","year":"2003"},{"key":"e_1_2_8_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1189702.1189711"},{"key":"e_1_2_8_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1121949.1121978"},{"key":"e_1_2_8_27_1","doi-asserted-by":"crossref","unstructured":"White R. W. Ruthven I. &Jose J. M.(2005).A study of factors affecting the utility of implicit relevance feedback. In Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval (pp.35\u201042). Salvador Brazil: ACM.","DOI":"10.1145\/1076034.1076044"}],"container-title":["Proceedings of the American Society for Information Science and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fmeet.2009.1450460238","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fmeet.2009.1450460238","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/meet.2009.1450460238","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T10:13:15Z","timestamp":1760955195000},"score":1,"resource":{"primary":{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/10.1002\/meet.2009.1450460238"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,1]]},"references-count":26,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2009,1]]}},"alternative-id":["10.1002\/meet.2009.1450460238"],"URL":"https:\/\/doi.org\/10.1002\/meet.2009.1450460238","archive":["Portico"],"relation":{},"ISSN":["0044-7870","1550-8390"],"issn-type":[{"type":"print","value":"0044-7870"},{"type":"electronic","value":"1550-8390"}],"subject":[],"published":{"date-parts":[[2009,1]]}}}