{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:20:02Z","timestamp":1750220402582,"version":"3.41.0"},"reference-count":31,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T00:00:00Z","timestamp":1638316800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGIR Forum"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:p>\n            This is a report on the second edition of the International Conference on Design of Experimental Search &amp; Information REtrieval Systems (\n            <jats:italic>DESIRES<\/jats:italic>\n            2021) held at the Department of Information Engineering of the University od Padua (Padua, Italy) from September 15 to September 18, 2021.\n          <\/jats:p>\n          <jats:p>\n            <jats:bold>Date<\/jats:bold>\n            : 15--18 September, 2021.\n          <\/jats:p>\n          <jats:p>\n            <jats:bold>Website<\/jats:bold>\n            : http:\/\/desires.dei.unipd.it\/.\n          <\/jats:p>","DOI":"10.1145\/3527546.3527563","type":"journal-article","created":{"date-parts":[[2022,3,17]],"date-time":"2022-03-17T23:24:36Z","timestamp":1647559476000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Report on the 2nd international conference on design of experimental search &amp; information retrieval systems (DESIRES 2021)"],"prefix":"10.1145","volume":"55","author":[{"given":"Omar","family":"Alonso","sequence":"first","affiliation":[{"name":"Instacart"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stefano","family":"Marchesin","sequence":"additional","affiliation":[{"name":"University of Padua"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marc","family":"Najork","sequence":"additional","affiliation":[{"name":"Google"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gianmaria","family":"Silvello","sequence":"additional","affiliation":[{"name":"University of Padua"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,3,17]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"191","volume-title":"Searching in the smart city? In Alonso et al. [2021a]","author":"Ahlers Dirk","unstructured":"Dirk Ahlers . Searching in the smart city? In Alonso et al. [2021a] , pages 191 -- 192 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-19.pdf. Dirk Ahlers. Searching in the smart city? In Alonso et al. [2021a], pages 191--192. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-19.pdf."},{"key":"e_1_2_1_2_1","series-title":"CEUR Workshop Proceedings","volume-title":"Padova, Italy, September 15--18","author":"Alonso Omar","year":"2021","unstructured":"Omar Alonso , Stefano Marchesin , Marc Najork , and Gianmaria Silvello , editors. Proceedings of the Second International Conference on Design of Experimental Search & Information REtrieval Systems , Padova, Italy, September 15--18 , 2021 , volume 2950 of CEUR Workshop Proceedings , 2021a. CEUR-WS.org. URL http:\/\/ceur-ws.org\/Vol-2950. Omar Alonso, Stefano Marchesin, Marc Najork, and Gianmaria Silvello, editors. Proceedings of the Second International Conference on Design of Experimental Search & Information REtrieval Systems, Padova, Italy, September 15--18, 2021, volume 2950 of CEUR Workshop Proceedings, 2021a. CEUR-WS.org. URL http:\/\/ceur-ws.org\/Vol-2950."},{"volume-title":"Alonso et al. [2021a]","author":"Alonso Omar","key":"e_1_2_1_3_1","unstructured":"Omar Alonso , Marc Najork , and Gianmaria Silvello . Preface . In Alonso et al. [2021a] , pages I--III. URL http:\/\/ceur-ws.org\/Vol-2950\/preface-01.pdf. Omar Alonso, Marc Najork, and Gianmaria Silvello. Preface. In Alonso et al. [2021a], pages I--III. URL http:\/\/ceur-ws.org\/Vol-2950\/preface-01.pdf."},{"key":"e_1_2_1_4_1","first-page":"173","volume-title":"Alonso et al. [2021a]","author":"Althammer Sophia","unstructured":"Sophia Althammer . RUDI: real-time learning to update dense retrieval indices . In Alonso et al. [2021a] , pages 173 -- 175 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-20.pdf. Sophia Althammer. RUDI: real-time learning to update dense retrieval indices. In Alonso et al. [2021a], pages 173--175. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-20.pdf."},{"key":"e_1_2_1_5_1","first-page":"3","volume-title":"Alonso et al. [2021a]","author":"Anand Mayank","unstructured":"Mayank Anand , Jiarui Zhang , Shane Ding , Ji Xin , and Jimmy Lin . Serverless BM25 search and BERT reranking . In Alonso et al. [2021a] , pages 3 -- 9 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-01.pdf. Mayank Anand, Jiarui Zhang, Shane Ding, Ji Xin, and Jimmy Lin. Serverless BM25 search and BERT reranking. In Alonso et al. [2021a], pages 3--9. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-01.pdf."},{"key":"e_1_2_1_6_1","first-page":"162","volume-title":"Alonso et al. [2021a]","author":"Askari Arian","unstructured":"Arian Askari and Suzan Verberne . Combining lexical and neural retrieval with longformer-based summarization for effective case law retrieval . In Alonso et al. [2021a] , pages 162 -- 170 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-02.pdf. Arian Askari and Suzan Verberne. Combining lexical and neural retrieval with longformer-based summarization for effective case law retrieval. In Alonso et al. [2021a], pages 162--170. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-02.pdf."},{"key":"e_1_2_1_7_1","first-page":"80","volume-title":"Alonso et al. [2021a]","author":"Balog Krisztian","unstructured":"Krisztian Balog . Conversational AI from an information retrieval perspective: Remaining challenges and a case for user simulation . In Alonso et al. [2021a] , pages 80 -- 90 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-03.pdf. Krisztian Balog. Conversational AI from an information retrieval perspective: Remaining challenges and a case for user simulation. In Alonso et al. [2021a], pages 80--90. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-03.pdf."},{"key":"e_1_2_1_8_1","first-page":"30","volume-title":"Alonso et al. [2021a]","author":"Bobic Aleksandar","unstructured":"Aleksandar Bobic , Jean-Marie Le Goff, and Christian G\u00fctl. Towards supporting complex retrieval tasks through graph-based information retrieval and visual analytics . In Alonso et al. [2021a] , pages 30 -- 37 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-04.pdf. Aleksandar Bobic, Jean-Marie Le Goff, and Christian G\u00fctl. Towards supporting complex retrieval tasks through graph-based information retrieval and visual analytics. In Alonso et al. [2021a], pages 30--37. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-04.pdf."},{"key":"e_1_2_1_9_1","first-page":"70","volume-title":"Alonso et al. [2021a]","author":"Bradford Roger B.","unstructured":"Roger B. Bradford . Lessons learned from 20 years of implementing LSI applications . In Alonso et al. [2021a] , pages 70 -- 79 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-05.pdf. Roger B. Bradford. Lessons learned from 20 years of implementing LSI applications. In Alonso et al. [2021a], pages 70--79. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-05.pdf."},{"key":"e_1_2_1_10_1","first-page":"171","volume-title":"Alonso et al. [2021a]","author":"Canu Serena","unstructured":"Serena Canu . It's messy out there: Dbc's journey towards its first test collection . In Alonso et al. [2021a] , pages 171 -- 172 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-21.pdf. Serena Canu. It's messy out there: Dbc's journey towards its first test collection. In Alonso et al. [2021a], pages 171--172. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-21.pdf."},{"key":"e_1_2_1_11_1","first-page":"61","volume-title":"What makes a query semantically hard? In Alonso et al. [2021a]","author":"Faggioli Guglielmo","unstructured":"Guglielmo Faggioli and Stefano Marchesin . What makes a query semantically hard? In Alonso et al. [2021a] , pages 61 -- 69 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-06.pdf. Guglielmo Faggioli and Stefano Marchesin. What makes a query semantically hard? In Alonso et al. [2021a], pages 61--69. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-06.pdf."},{"key":"e_1_2_1_12_1","first-page":"187","volume-title":"Alonso et al. [2021a]","author":"Geisler Nadja","unstructured":"Nadja Geisler . Quest: A query-driven explanation framework for black-box classifiers on tabular data . In Alonso et al. [2021a] , pages 187 -- 188 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-24.pdf. Nadja Geisler. Quest: A query-driven explanation framework for black-box classifiers on tabular data. In Alonso et al. [2021a], pages 187--188. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-24.pdf."},{"key":"e_1_2_1_13_1","first-page":"117","volume-title":"Alonso et al. [2021a]","author":"Ghosh Souvick","unstructured":"Souvick Ghosh and Satanu Ghosh . \"do users need human-like conversational agents?\" - exploring conversational system design using framework of human needs. In Alonso et al. [2021a] , pages 117 -- 127 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-07.pdf. Souvick Ghosh and Satanu Ghosh. \"do users need human-like conversational agents?\" - exploring conversational system design using framework of human needs. In Alonso et al. [2021a], pages 117--127. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-07.pdf."},{"key":"e_1_2_1_14_1","first-page":"179","volume-title":"Alonso et al. [2021a]","author":"H\u00e4ttasch Benjamin","unstructured":"Benjamin H\u00e4ttasch . Wannadb: Ad-hoc structured exploration of text collections using queries . In Alonso et al. [2021a] , pages 179 -- 180 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-23.pdf. Benjamin H\u00e4ttasch. Wannadb: Ad-hoc structured exploration of text collections using queries. In Alonso et al. [2021a], pages 179--180. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-23.pdf."},{"key":"e_1_2_1_15_1","first-page":"38","volume-title":"Alonso et al. [2021a]","author":"H\u00e4ttasch Benjamin","unstructured":"Benjamin H\u00e4ttasch , Nadja Geisler , and Carsten Binnig . Netted?! how to improve the usefulness of spider & co. In Alonso et al. [2021a] , pages 38 -- 43 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-08.pdf. Benjamin H\u00e4ttasch, Nadja Geisler, and Carsten Binnig. Netted?! how to improve the usefulness of spider & co. In Alonso et al. [2021a], pages 38--43. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-08.pdf."},{"key":"e_1_2_1_16_1","first-page":"53","volume-title":"Alonso et al. [2021a]","author":"Heflin Jeff","unstructured":"Jeff Heflin , Brian D. Davison , and Haiyan Jia . Exploring datasets via cell-centric indexing . In Alonso et al. [2021a] , pages 53 -- 60 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-09.pdf. Jeff Heflin, Brian D. Davison, and Haiyan Jia. Exploring datasets via cell-centric indexing. In Alonso et al. [2021a], pages 53--60. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-09.pdf."},{"key":"e_1_2_1_17_1","first-page":"184","volume-title":"Alonso et al. [2021a]","author":"Jatowt Adam","unstructured":"Adam Jatowt . Timeline as information retrieval and ranking unit in news search . In Alonso et al. [2021a] , pages 184 -- 186 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-25.pdf. Adam Jatowt. Timeline as information retrieval and ranking unit in news search. In Alonso et al. [2021a], pages 184--186. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-25.pdf."},{"key":"e_1_2_1_18_1","first-page":"10","volume-title":"Alonso et al. [2021a]","author":"Kamphuis Chris","unstructured":"Chris Kamphuis and Arjen P . de Vries. Geesedb: A python graph engine for exploration and search . In Alonso et al. [2021a] , pages 10 -- 18 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-11.pdf. Chris Kamphuis and Arjen P. de Vries. Geesedb: A python graph engine for exploration and search. In Alonso et al. [2021a], pages 10--18. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-11.pdf."},{"key":"e_1_2_1_19_1","first-page":"91","volume-title":"Benno Stein, and Matthias Hagen. Toward conversational query reformulation. In Alonso et al. [2021a]","author":"Kiesel Johannes","unstructured":"Johannes Kiesel , Xiaoni Cai , Roxanne El Baff , Benno Stein, and Matthias Hagen. Toward conversational query reformulation. In Alonso et al. [2021a] , pages 91 -- 101 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-12.pdf. Johannes Kiesel, Xiaoni Cai, Roxanne El Baff, Benno Stein, and Matthias Hagen. Toward conversational query reformulation. In Alonso et al. [2021a], pages 91--101. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-12.pdf."},{"key":"e_1_2_1_20_1","first-page":"44","volume-title":"Alonso et al. [2021a]","author":"Landoni Monica","unstructured":"Monica Landoni , Theo Huibers , Mohammad Aliannejadi , Emiliana Murgia , and Maria Soledad Pera . Getting to know you: Search logs and expert grading to define children's search roles in the classroom . In Alonso et al. [2021a] , pages 44 -- 52 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-10.pdf. Monica Landoni, Theo Huibers, Mohammad Aliannejadi, Emiliana Murgia, and Maria Soledad Pera. Getting to know you: Search logs and expert grading to define children's search roles in the classroom. In Alonso et al. [2021a], pages 44--52. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-10.pdf."},{"key":"e_1_2_1_21_1","first-page":"176","volume-title":"Alonso et al. [2021a]","author":"Lin Jimmy","unstructured":"Jimmy Lin , Xueguang Ma , Joel Mackenzie , and Antonio Mallia . On the separation of logical and physical ranking models for text retrieval applications . In Alonso et al. [2021a] , pages 176 -- 178 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-26.pdf. Jimmy Lin, Xueguang Ma, Joel Mackenzie, and Antonio Mallia. On the separation of logical and physical ranking models for text retrieval applications. In Alonso et al. [2021a], pages 176--178. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-26.pdf."},{"key":"e_1_2_1_22_1","first-page":"19","volume-title":"Alonso et al. [2021a]","author":"Maxwell David","unstructured":"David Maxwell and Claudia Hauff . Developing contemporaryweb-based interaction logging infrastructure: The design and challenges of logui . In Alonso et al. [2021a] , pages 19 -- 29 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-13.pdf. David Maxwell and Claudia Hauff. Developing contemporaryweb-based interaction logging infrastructure: The design and challenges of logui. In Alonso et al. [2021a], pages 19--29. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-13.pdf."},{"key":"e_1_2_1_23_1","first-page":"193","volume-title":"Alonso et al. [2021a]","author":"Moshfeghi Yashar","unstructured":"Yashar Moshfeghi . Neurasearch: Neuroscience and information retrieval . In Alonso et al. [2021a] , pages 193 -- 194 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-27.pdf. Yashar Moshfeghi. Neurasearch: Neuroscience and information retrieval. In Alonso et al. [2021a], pages 193--194. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-27.pdf."},{"key":"e_1_2_1_24_1","first-page":"128","volume-title":"Alonso et al. [2021a]","author":"Nagase Kousuke","unstructured":"Kousuke Nagase and Hideo Joho . Enhancing SNS profilewriting with a search-based assistant system . In Alonso et al. [2021a] , pages 128 -- 135 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-14.pdf. Kousuke Nagase and Hideo Joho. Enhancing SNS profilewriting with a search-based assistant system. In Alonso et al. [2021a], pages 128--135. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-14.pdf."},{"key":"e_1_2_1_25_1","first-page":"156","volume-title":"Alonso et al. [2021a]","author":"Purpura Alberto","unstructured":"Alberto Purpura and Gian Antonio Susto . A bayesian neural model for documents' relevance estimation . In Alonso et al. [2021a] , pages 156 -- 161 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-15.pdf. Alberto Purpura and Gian Antonio Susto. A bayesian neural model for documents' relevance estimation. In Alonso et al. [2021a], pages 156--161. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-15.pdf."},{"key":"e_1_2_1_26_1","first-page":"136","volume-title":"Alonso et al. [2021a]","author":"David","unstructured":"David P. Sander and Laura Dietz. EXAM: how to evaluate retrieve-and-generate systems for users who do not (yet) know what they want . In Alonso et al. [2021a] , pages 136 -- 146 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-16.pdf. David P. Sander and Laura Dietz. EXAM: how to evaluate retrieve-and-generate systems for users who do not (yet) know what they want. In Alonso et al. [2021a], pages 136--146. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-16.pdf."},{"key":"e_1_2_1_27_1","first-page":"181","volume-title":"Alonso et al. [2021a]","author":"Sousa Hugo O.","unstructured":"Hugo O. Sousa . Temporal relation extraction: The event ordering task . In Alonso et al. [2021a] , pages 181 -- 183 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-28.pdf. Hugo O. Sousa. Temporal relation extraction: The event ordering task. In Alonso et al. [2021a], pages 181--183. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-28.pdf."},{"key":"e_1_2_1_28_1","first-page":"1","volume-title":"Alonso et al. [2021a]","author":"Suchanek Fabian M.","unstructured":"Fabian M. Suchanek . A hitchhiker's guide to ontology . In Alonso et al. [2021a] , pages 1 -- 2 . URL http:\/\/ceur-ws.org\/Vol-2950\/keynote-02.pdf. Fabian M. Suchanek. A hitchhiker's guide to ontology. In Alonso et al. [2021a], pages 1--2. URL http:\/\/ceur-ws.org\/Vol-2950\/keynote-02.pdf."},{"key":"e_1_2_1_29_1","first-page":"102","volume-title":"Alonso et al. [2021a]","author":"Wadhwa Somin","unstructured":"Somin Wadhwa and Hamed Zamani . Towards system-initiative conversational information seeking . In Alonso et al. [2021a] , pages 102 -- 116 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-17.pdf. Somin Wadhwa and Hamed Zamani. Towards system-initiative conversational information seeking. In Alonso et al. [2021a], pages 102--116. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-17.pdf."},{"key":"e_1_2_1_30_1","first-page":"147","volume-title":"Alonso et al. [2021a]","author":"Yang Eugene","unstructured":"Eugene Yang , David D. Lewis , and Ophir Frieder . TAR on social media: A framework for online content moderation . In Alonso et al. [2021a] , pages 147 -- 155 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-18.pdf. Eugene Yang, David D. Lewis, and Ophir Frieder. TAR on social media: A framework for online content moderation. In Alonso et al. [2021a], pages 147--155. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-18.pdf."},{"key":"e_1_2_1_31_1","first-page":"189","volume-title":"Alonso et al. [2021a]","author":"Zein Dima El","unstructured":"Dima El Zein . User knowledge and search goals in information retrieval: A benchmark and study on the evolution of users' knowledge gain . In Alonso et al. [2021a] , pages 189 -- 190 . URL http:\/\/ceur-ws.org\/Vol-2950\/paper-22.pdf. Dima El Zein. User knowledge and search goals in information retrieval: A benchmark and study on the evolution of users' knowledge gain. In Alonso et al. [2021a], pages 189--190. URL http:\/\/ceur-ws.org\/Vol-2950\/paper-22.pdf."}],"container-title":["ACM SIGIR Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3527546.3527563","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3527546.3527563","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:53Z","timestamp":1750191533000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3527546.3527563"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12]]},"references-count":31,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["10.1145\/3527546.3527563"],"URL":"https:\/\/doi.org\/10.1145\/3527546.3527563","relation":{},"ISSN":["0163-5840"],"issn-type":[{"type":"print","value":"0163-5840"}],"subject":[],"published":{"date-parts":[[2021,12]]},"assertion":[{"value":"2022-03-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}