{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,4,18]],"date-time":"2023-04-18T05:30:44Z","timestamp":1681795844110},"reference-count":14,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2018,2,22]],"date-time":"2018-02-22T00:00:00Z","timestamp":1519257600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGIR Forum"],"published-print":{"date-parts":[[2018,2,22]]},"abstract":"<jats:p>The 2nd workshop on the evaluation of collaborative information retrieval and seeking (ECol) was held in conjunction with the ACM SIGIR Conference on Human Information Interaction &amp; Retrieval (CHIIR) in Oslo, Norway. The workshop focused on discussing the challenges and difficulties of researching and studying collaborative information retrieval and seeking (CIS\/CIR). After an introductory and scene setting overview of developments in CIR\/CIS, participants were challenged with devising a range of possible CIR\/CIS tasks that could be used for evaluation purposes. Through the brainstorming and discussions, valuable insights regarding the evaluation of CIR\/CIS tasks become apparent ? for particular tasks efficiency and\/or effectiveness is most important, however for the majority of tasks the success and quality of outcomes along with knowledge sharing and sense-making were most important ? of which these latter attributes are much more difficult to measure and evaluate. Thus the major challenge for CIR\/CIS research is to develop methods, measures and methodologies to evaluate these high order attributes.<\/jats:p>","DOI":"10.1145\/3190580.3190599","type":"journal-article","created":{"date-parts":[[2018,2,23]],"date-time":"2018-02-23T16:40:01Z","timestamp":1519404001000},"page":"122-127","update-policy":"http:\/\/dx.doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Report on the Second International Workshop on the Evaluation on Collaborative Information Seeking and Retrieval (ECol?2017 @ CHIIR)"],"prefix":"10.1145","volume":"51","author":[{"given":"Leif","family":"Azzopardi","sequence":"first","affiliation":[{"name":"University of Glasgow, Glasgow, United Kingdom"}]},{"given":"Jeremy","family":"Pickens","sequence":"additional","affiliation":[{"name":"Catalyst Repository Systems, Denver, CO, USA"}]},{"given":"Chirag","family":"Shah","sequence":"additional","affiliation":[{"name":"Rutgers University, New Brunswick, NJ, USA"}]},{"given":"Laure","family":"Soulier","sequence":"additional","affiliation":[{"name":"Sorbonnes Universit\u00e9s, Paris, France"}]},{"given":"Lynda","family":"Tamine","sequence":"additional","affiliation":[{"name":"Universit\u00e9 de Toulouse, Toulouse, France"}]}],"member":"320","published-online":{"date-parts":[[2018,2,22]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"'15: Proceedings of the 2015 Workshop on Evaluation on Collaborative Information Retrieval and Seeking","year":"2015","unstructured":"ECol '15: Proceedings of the 2015 Workshop on Evaluation on Collaborative Information Retrieval and Seeking , New York, NY, USA , 2015 . ACM. ECol '15: Proceedings of the 2015 Workshop on Evaluation on Collaborative Information Retrieval and Seeking, New York, NY, USA, 2015. ACM."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v8i1.14533"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2492517.2492559"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2009.10.012"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1002\/aris.1440400115"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3020165.3020172"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1871437.1871678"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753587"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531706"},{"key":"e_1_2_1_10_1","volume-title":"ICWSM","author":"Paul S. A.","year":"2011","unstructured":"S. A. Paul , L. Hong , and H. Chi . Is twitter a good place for asking questions? a characterization study . In ICWSM , 2011 . S. A. Paul, L. Hong, and H. Chi. Is twitter a good place for asking questions? a characterization study. In ICWSM, 2011."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2812376.2812381"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2010038"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2964797.2964805"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1935826.1935842"}],"container-title":["ACM SIGIR Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3190580.3190599","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,18]],"date-time":"2023-04-18T04:17:27Z","timestamp":1681791447000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3190580.3190599"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,2,22]]},"references-count":14,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2018,2,22]]}},"alternative-id":["10.1145\/3190580.3190599"],"URL":"https:\/\/doi.org\/10.1145\/3190580.3190599","relation":{},"ISSN":["0163-5840"],"issn-type":[{"value":"0163-5840","type":"print"}],"subject":[],"published":{"date-parts":[[2018,2,22]]},"assertion":[{"value":"2018-02-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}