{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,21]],"date-time":"2025-10-21T00:41:49Z","timestamp":1761007309542,"version":"build-2065373602"},"reference-count":22,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2007,10,10]],"date-time":"2007-10-10T00:00:00Z","timestamp":1191974400000},"content-version":"vor","delay-in-days":647,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc of Assoc for Info"],"published-print":{"date-parts":[[2006,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>MetaCrystal aims to help users find the documents that are most likely to be relevant. It compares the results returned by multiple search engines and displays the documents based on the number of engines that found them and their rank positions in the result lists. First, this paper examines the validity of the MetaCrystal design approach by calculating the probability that a document is relevant based on the number of engines that found it and its rank positions in the result lists. Using TREC data, it is shown that MetaCrystal's visual design is sound because it visually emphasizes documents based on their likelihood of being relevant. Second, this paper investigates if users are able to use the MetaCrystal's visualizations to find the documents that are most likely to be relevant. The results of a user study are reported that show that novice users are able to accomplish this task.<\/jats:p>","DOI":"10.1002\/meet.1450430174","type":"journal-article","created":{"date-parts":[[2007,10,10]],"date-time":"2007-10-10T13:19:32Z","timestamp":1192022372000},"page":"1-20","source":"Crossref","is-referenced-by-count":6,"title":["Visualizing meta search results: Evaluating the metacrystal toolset"],"prefix":"10.1002","volume":"43","author":[{"given":"Anselm","family":"Spoerri","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2007,10,10]]},"reference":[{"key":"e_1_2_10_2_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1009984519381"},{"key":"e_1_2_10_3_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.1995.cgf143_0349.x"},{"key":"e_1_2_10_4_1","first-page":"127","volume-title":"Advances in Information Retrieval","author":"Callan. J.","year":"2000"},{"key":"e_1_2_10_5_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.1180"},{"key":"e_1_2_10_6_1","unstructured":"CuginiJ. PiatkoC.&LaskowskiS.(1996) Interactive 3D Visuali\u2010zation for Document RetrievalProc. of Workshop on New Paradigms in Information Visualization & Manipulation CIKM '96"},{"key":"e_1_2_10_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/138859.138866"},{"volume-title":"2nd Annual Text Retrieval Conference (TREC\u20102), Gaithersburg, MD, 2000","year":"1994","author":"Fox E.","key":"e_1_2_10_8_1"},{"key":"e_1_2_10_9_1","unstructured":"Grokkerhttp:\/\/www.groxis.com"},{"key":"e_1_2_10_10_1","unstructured":"HavreS. HetzlerE. PerrineK. JurrusE. &MillerN.(2001) Interactive Visualization of Multiple Query Re\u2010sultsProc. IEEE Information Visualization Symposium. 2001"},{"key":"e_1_2_10_11_1","first-page":"257","volume-title":"Modern Informa\u2010tion Retrieval","author":"Hearst M.","year":"1999"},{"key":"e_1_2_10_12_1","doi-asserted-by":"crossref","unstructured":"HemmjeM. C.Kunkel &A.Willet(1994) LyberWorld\u2010a visuali\u2010zation user interface supporting fulltext re\u2010trieval Proceedings of ACM SIGIR pp. 254\u2013259Kartoohttp:\/\/www.kartoo.com","DOI":"10.1007\/978-1-4471-2099-5_26"},{"key":"e_1_2_10_13_1","doi-asserted-by":"crossref","unstructured":"KeimD. A.&KriegelH. P.(1994) VisDB: Database Exploration Using Multidimensional VisualizationIEEE CG&A Sept. 1994pp.40\u201349","DOI":"10.1109\/38.310723"},{"key":"e_1_2_10_14_1","doi-asserted-by":"publisher","DOI":"10.1038\/21987"},{"key":"e_1_2_10_15_1","unstructured":"MannT.(2002)Visualization of Search Results from the WWWPh.D. Thesis University of Konstanz"},{"key":"e_1_2_10_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(93)90024-8"},{"key":"e_1_2_10_17_1","doi-asserted-by":"crossref","unstructured":"SaracevicT.andKantorP.(1988) A study of informa\u2010tion seeking and retrieving. III. Searchers searches and overlapJASISTVolume 39 3 197\u2013216","DOI":"10.1002\/(SICI)1097-4571(198805)39:3<197::AID-ASI4>3.0.CO;2-A"},{"key":"e_1_2_10_18_1","unstructured":"SpoerriA.(2004a)Visual Editor for Composing Meta SearchesProc. of the 67th Annual Meeting of the American Society for Infor\u2010mation Science and Technology (ASIST 2004)"},{"key":"e_1_2_10_19_1","unstructured":"SpoerriA.(2004b) RankSpiral: Toward Enhancing Search Result VisualizationsProc. IEEE Information Visualization Symp. 2004"},{"issue":"3","key":"e_1_2_10_20_1","first-page":"297","article-title":"Toward Enabling Users to Visually Evaluate the Effectiveness of Different Queries or Engines","volume":"3","author":"Spoerri A.","year":"2004","journal-title":"Journal of Web Engi\u2010neering"},{"key":"e_1_2_10_21_1","doi-asserted-by":"crossref","unstructured":"SpoerriA.(2005) How the Overlap Between the Search Results of Different Retrieval Systems Correlates with Document RelevanceProc. of the 68th Annual Meeting of the American Society for Infor\u2010mation Science and Technology (ASIST 2005)","DOI":"10.1002\/meet.14504201175"},{"key":"e_1_2_10_22_1","doi-asserted-by":"crossref","unstructured":"TorresR. SilvaC. MedeirosC.&.RochaH.(2003) Visual Structures for Image Browsing CIKM'03 November 3\u20108 2003 New Orleans LouisianaVivisimohttp:\/\/www.vivisimo.com","DOI":"10.1145\/956873.956874"},{"volume-title":"The Eighth Text REtrieval Confer\u2010ence (TREC\u20108), Gaithersburg, MD 2000","year":"1999","author":"Voorhees E.","key":"e_1_2_10_23_1"}],"container-title":["Proceedings of the American Society for Information Science and Technology"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fmeet.1450430174","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/meet.1450430174","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T12:47:37Z","timestamp":1760964457000},"score":1,"resource":{"primary":{"URL":"https:\/\/asistdl.onlinelibrary.wiley.com\/doi\/10.1002\/meet.1450430174"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,1]]},"references-count":22,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2006,1]]}},"alternative-id":["10.1002\/meet.1450430174"],"URL":"https:\/\/doi.org\/10.1002\/meet.1450430174","archive":["Portico"],"relation":{},"ISSN":["0044-7870","1550-8390"],"issn-type":[{"type":"print","value":"0044-7870"},{"type":"electronic","value":"1550-8390"}],"subject":[],"published":{"date-parts":[[2006,1]]}}}