{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,14]],"date-time":"2024-09-14T07:12:39Z","timestamp":1726297959014},"reference-count":32,"publisher":"World Scientific Pub Co Pte Lt","issue":"01","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Inter. Net."],"published-print":{"date-parts":[[2013,3]]},"abstract":"<jats:p> Combining multiple information retrieval (IR) systems has been shown to improve performance over individual systems. However, it remains a challenging problem to determine when and how a set of individual systems should to be combined. In this paper, we investigate these issues using combinatorial fusion analysis and five data sets provide by TREC 2, 3, 4, 5, and 6. In particular, we compare the performance of combining six IR systems selected by random choice vs. by performance measurement from these five TREC data sets. Two experiments are conducted, which include: (1) combination of two systems and their performance outcome in terms of performance ratio and cognitive diversity, and (2) combinatorial fusion of t-systems, t = 2 to 6, using both score and rank combinations and exploration of the effect of diversity on the performance outcome. It is demonstrated in both experiments that combination of two or more systems improves the performance more significantly when the systems are selected by performance evaluation than those selected by random choice. Our work provides a distinctive method of system selection for the combination of multiple retrieval systems. <\/jats:p>","DOI":"10.1142\/s0219265913500035","type":"journal-article","created":{"date-parts":[[2013,7,1]],"date-time":"2013-07-01T07:25:10Z","timestamp":1372663510000},"page":"1350003","source":"Crossref","is-referenced-by-count":3,"title":["COMPARING SYSTEM SELECTION METHODS FOR THE COMBINATORIAL FUSION OF MULTIPLE RETRIEVAL SYSTEMS"],"prefix":"10.1142","volume":"14","author":[{"given":"CHUN-YI","family":"LIU","sequence":"first","affiliation":[{"name":"Department of Computer Science, National Tshing Hua University, HsinChu 30013, Taiwan"}]},{"given":"CHUAN-YI","family":"TANG","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Engineering, Providence University, TaiChung City 43301, Taiwan"}]},{"given":"D. FRANK","family":"HSU","sequence":"additional","affiliation":[{"name":"Department of Computer and Information Science, Fordham University, New York, NY 10023, USA"}]}],"member":"219","published-online":{"date-parts":[[2013,7]]},"reference":[{"key":"p_5","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-35236-2_22"},{"key":"p_6","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20012"},{"key":"p_7","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(94)00057-A"},{"key":"p_9","doi-asserted-by":"publisher","DOI":"10.1108\/17427371011097604"},{"key":"p_10","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-72523-7_41"},{"key":"p_12","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008752200506"},{"key":"p_13","doi-asserted-by":"publisher","DOI":"10.1007\/0-306-47019-5_1"},{"key":"p_14","doi-asserted-by":"publisher","DOI":"10.1016\/S1566-2535(00)00006-3"},{"key":"p_16","first-page":"1","volume":"500","author":"Donna H.","year":"1996","journal-title":"Proceeding of the Fourth Text REtrieval Conference (TREC-4), NIST Special Publication"},{"key":"p_17","first-page":"3","volume":"500","author":"Harman V.","year":"1998","journal-title":"Proceeding of the Sixth Text REtrieval Conference (TREC-6), NIST Special Publication"},{"key":"p_18","doi-asserted-by":"publisher","DOI":"10.1126\/science.1194920"},{"key":"p_19","first-page":"1","volume":"500","author":"Harman D.","year":"1994","journal-title":"Proceeding of the Second Text REtrieval Conference (TREC-2), NIST Special Publication"},{"key":"p_20","first-page":"1","volume":"500","author":"Harman D.","year":"1995","journal-title":"Proceeding of the Third Text REtrieval Conference (TREC-3), NIST Special Publication"},{"key":"p_22","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23605-1_2"},{"key":"p_23","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-15314-3_5"},{"key":"p_24","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-005-6994-4"},{"key":"p_25","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-84882-628-1_8"},{"key":"p_26","doi-asserted-by":"publisher","DOI":"10.1109\/4234.940986"},{"key":"p_27","first-page":"231","volume":"7","author":"Krogh A.","year":"1995","journal-title":"Advances in Neural Information Processing Systems"},{"key":"p_30","doi-asserted-by":"publisher","DOI":"10.1109\/TNB.2007.897482"},{"key":"p_34","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2008.08.009"},{"key":"p_39","doi-asserted-by":"publisher","DOI":"10.1002\/1097-4571(2000)9999:9999<::AID-ASI1030>3.0.CO;2-E"},{"key":"p_43","doi-asserted-by":"publisher","DOI":"10.1023\/A:1009980820262"},{"key":"p_44","first-page":"1","volume":"500","author":"Voorhees E. M.","year":"1997","journal-title":"Proceeding of the Fifth Text REtrieval Conference (TREC-5), NIST Special Publication"},{"key":"p_45","doi-asserted-by":"publisher","DOI":"10.1021\/ci010025x"},{"key":"p_46","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2008.01.019"},{"key":"p_47","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2012.02.007"},{"key":"p_48","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-78849-2_43"},{"key":"p_49","doi-asserted-by":"publisher","DOI":"10.1007\/11880592_57"},{"key":"p_50","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2005.08.004"},{"key":"p_51","doi-asserted-by":"publisher","DOI":"10.1109\/21.155943"},{"key":"p_52","doi-asserted-by":"publisher","DOI":"10.1021\/ci050034w"}],"container-title":["Journal of Interconnection Networks"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0219265913500035","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,8,6]],"date-time":"2019-08-06T21:43:12Z","timestamp":1565127792000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0219265913500035"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,3]]},"references-count":32,"journal-issue":{"issue":"01","published-online":{"date-parts":[[2013,7]]},"published-print":{"date-parts":[[2013,3]]}},"alternative-id":["10.1142\/S0219265913500035"],"URL":"https:\/\/doi.org\/10.1142\/s0219265913500035","relation":{},"ISSN":["0219-2659","1793-6713"],"issn-type":[{"value":"0219-2659","type":"print"},{"value":"1793-6713","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,3]]}}}