{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,16]],"date-time":"2026-01-16T19:06:45Z","timestamp":1768590405979,"version":"3.49.0"},"reference-count":14,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2017,2,14]],"date-time":"2017-02-14T00:00:00Z","timestamp":1487030400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGIR Forum"],"published-print":{"date-parts":[[2017,2,14]]},"abstract":"<jats:p>The workshop and hackathon on developing Information Retrieval Evaluation Resources using Lucene (L4IR) was held on the 8th and 9th of September, 2016 at the University of Strathclyde in Glasgow, UK and funded by the ESF Elias Network. The event featured three main elements: (i) a series of keynote and invited talks on industry, teaching and evaluation; (ii) planning, coding and hacking where a number of groups created modules and infrastructure to use Lucene to undertake TREC based evaluations; and (iii) a number of breakout groups discussing challenges, opportunities and problems in bridging the divide between academia and industry, and how we can use Lucene for teaching and learning Information Retrieval (IR). The event was composed of a mix and blend of academics, experts and students wanting to learn, share and create evaluation resources for the community. The hacking was intense and the discussions lively creating the basis of many useful tools but also raising numerous issues. It was clear that by adopting and contributing to most widely used and supported Open Source IR toolkit, there were many benefits for academics, students, researchers, developers and practitioners - providing a basis for stronger evaluation practices, increased reproducibility, more efficient knowledge transfer, greater collaboration between academia and industry, and shared teaching and training resources.<\/jats:p>","DOI":"10.1145\/3053408.3053421","type":"journal-article","created":{"date-parts":[[2017,2,16]],"date-time":"2017-02-16T15:18:48Z","timestamp":1487258328000},"page":"58-75","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["Lucene4IR"],"prefix":"10.1145","volume":"50","author":[{"given":"Leif","family":"Azzopardi","sequence":"first","affiliation":[{"name":"University of Strathclyde"}]},{"given":"Yashar","family":"Moshfeghi","sequence":"additional","affiliation":[{"name":"University of Glasgow"}]},{"given":"Martin","family":"Halvey","sequence":"additional","affiliation":[{"name":"University of Strathclyde"}]},{"given":"Rami S.","family":"Alkhawaldeh","sequence":"additional","affiliation":[{"name":"University of Glasgow"}]},{"given":"Krisztian","family":"Balog","sequence":"additional","affiliation":[{"name":"University of Stavanger"}]},{"given":"Emanuele","family":"Di Buccio","sequence":"additional","affiliation":[{"name":"University of Padova"}]},{"given":"Diego","family":"Ceccarelli","sequence":"additional","affiliation":[{"name":"Bloomberg"}]},{"given":"Juan M.","family":"Fern\u00e1ndez-Luna","sequence":"additional","affiliation":[{"name":"University of Granada"}]},{"given":"Charlie","family":"Hull","sequence":"additional","affiliation":[{"name":"Flax"}]},{"given":"Jake","family":"Mannix","sequence":"additional","affiliation":[{"name":"LucidWorks"}]},{"given":"Sauparna","family":"Palchowdhury","sequence":"additional","affiliation":[{"name":"National Institute of Standards and Technology, USA"}]}],"member":"320","published-online":{"date-parts":[[2017,2,14]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2888422.2888439"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-36973-5_94"},{"key":"e_1_2_1_3_1","unstructured":"Elasticsearch. https:\/\/www.elastic.co\/products\/elasticsearch.  Elasticsearch. https:\/\/www.elastic.co\/products\/elasticsearch."},{"key":"e_1_2_1_4_1","first-page":"6634","volume-title":"4Th International Conference on Education and New Learning Technologies (EDULEARN)","author":"Fern\u00e1ndez-Luna J. M.","year":"2012","unstructured":"Fern\u00e1ndez-Luna , J. M. , Huete , J. F. , Rodr\u00edguez-Cano , J. C. , and Rodr\u00edguez - Hern\u00e1ndez, M. Teaching and learning information retrieval based on a visual and interactive tool: sulair . In 4Th International Conference on Education and New Learning Technologies (EDULEARN) ( 2012 ), pp. 6634 -- 6642 . Fern\u00e1ndez-Luna, J. M., Huete, J. F., Rodr\u00edguez-Cano, J. C., and Rodr\u00edguez- Hern\u00e1ndez, M. Teaching and learning information retrieval based on a visual and interactive tool: sulair. In 4Th International Conference on Education and New Learning Technologies (EDULEARN) (2012), pp. 6634--6642."},{"key":"e_1_2_1_5_1","unstructured":"Lucene. https:\/\/lucene.apache.org.  Lucene. https:\/\/lucene.apache.org."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2010070"},{"key":"e_1_2_1_7_1","volume-title":"Proc. of OSIR at SIGIR","author":"Macdonald C.","year":"2012","unstructured":"Macdonald , C. , McCreadie , R. , Santos , R. L. , and Ounis , I . From puppy to maturity: Experiences in developing terrier . Proc. of OSIR at SIGIR ( 2012 ), 60--63. Macdonald, C., McCreadie, R., Santos, R. L., and Ounis, I. From puppy to maturity: Experiences in developing terrier. Proc. of OSIR at SIGIR (2012), 60--63."},{"key":"e_1_2_1_8_1","volume-title":"Franco Angeli","author":"Melucci M.","year":"2013","unstructured":"Melucci , M. Information retrieval. Metodi e modelli per i motori di ricerca. Informatica: Nuova serie . Franco Angeli , 2013 . Melucci, M. Information retrieval. Metodi e modelli per i motori di ricerca. Informatica: Nuova serie. Franco Angeli, 2013."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348283.2348534"},{"key":"e_1_2_1_10_1","first-page":"103","volume-title":"TREC","volume":"10","author":"Ogilvie P.","year":"2001","unstructured":"Ogilvie , P. , and Callan , J. P . Experiments using the lemur toolkit . In TREC ( 2001 ), vol. 10 , pp. 103 -- 108 . Ogilvie, P., and Callan, J. P. Experiments using the lemur toolkit. In TREC (2001), vol. 10, pp. 103--108."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-31865-1_37"},{"key":"e_1_2_1_12_1","unstructured":"PyLucene. http:\/\/lucene.apache.org\/pylucene\/.  PyLucene. http:\/\/lucene.apache.org\/pylucene\/."},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the InternationalConference on Intelligent Analysis","author":"Strohman T.","year":"2005","unstructured":"Strohman , T. , Metzler , D. , Turtle , H. , and Croft , W. B . Indri: a languagemodel based search engine for complex queries. Tech. rep ., in Proceedings of the InternationalConference on Intelligent Analysis , 2005 . Strohman, T., Metzler, D., Turtle, H., and Croft, W. B. Indri: a languagemodel based search engine for complex queries. Tech. rep., in Proceedings of the InternationalConference on Intelligent Analysis, 2005."},{"key":"e_1_2_1_14_1","volume-title":"The zettair search engine","author":"Zobel J.","year":"2004","unstructured":"Zobel , J. , Williams , H. , Scholer , F. , Yiannis , J. , and Hein , S . The zettair search engine . Search Engine Group, RMIT University, Melbourne , Australia ( 2004 ). Zobel, J., Williams, H., Scholer, F., Yiannis, J., and Hein, S. The zettair search engine. Search Engine Group, RMIT University, Melbourne, Australia (2004)."}],"container-title":["ACM SIGIR Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3053408.3053421","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3053408.3053421","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:03:35Z","timestamp":1750215815000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3053408.3053421"}},"subtitle":["Developing Information Retrieval Evaluation Resources using Lucene"],"short-title":[],"issued":{"date-parts":[[2017,2,14]]},"references-count":14,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2017,2,14]]}},"alternative-id":["10.1145\/3053408.3053421"],"URL":"https:\/\/doi.org\/10.1145\/3053408.3053421","relation":{},"ISSN":["0163-5840"],"issn-type":[{"value":"0163-5840","type":"print"}],"subject":[],"published":{"date-parts":[[2017,2,14]]},"assertion":[{"value":"2017-02-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}