{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T23:34:44Z","timestamp":1774308884778,"version":"3.50.1"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2024,6,1]],"date-time":"2024-06-01T00:00:00Z","timestamp":1717200000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGIR Forum"],"published-print":{"date-parts":[[2024,6]]},"abstract":"<jats:p>The first International Workshop on Open Web Search (WOWS) was held on Thursday, March 28th, at ECIR 2024 in Glasgow, UK. The full-day workshop had two calls for contributions: the first call aimed at scientific contributions to building, operating, and evaluating search engines cooperatively and the cooperative use of the web as a resource for researchers and innovators. The second call for implementations of retrieval components aimed to gain practical experience with joint, cooperative evaluation of search engines and their components. In total, 2 papers were accepted for the first call, and 11 software components were submitted for the second. The workshop ended with breakout sessions on how the Open-WebSearch.eu project can incorporate collaborative evaluations and a hub of search engines.<\/jats:p>\n          <jats:p>\n            <jats:bold>Date<\/jats:bold>\n            : 28 March 2024.\n          <\/jats:p>\n          <jats:p>\n            <jats:bold>Website<\/jats:bold>\n            : https:\/\/opensearchfoundation.org\/wows2024\/.\n          <\/jats:p>","DOI":"10.1145\/3687273.3687290","type":"journal-article","created":{"date-parts":[[2024,8,7]],"date-time":"2024-08-07T22:24:53Z","timestamp":1723069493000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Report on the 1st International Workshop on Open Web Search (WOWS 2024) at ECIR 2024"],"prefix":"10.1145","volume":"58","author":[{"given":"Sheikh Mastura","family":"Farzana","sequence":"first","affiliation":[{"name":"German Aerospace Center (DLR), Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maik","family":"Fr\u00f6be","sequence":"additional","affiliation":[{"name":"Friedrich-Schiller-Universit\u00e4t Jena, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Granitzer","sequence":"additional","affiliation":[{"name":"University of Passau, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gijs","family":"Hendriksen","sequence":"additional","affiliation":[{"name":"Radboud University, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Djoerd","family":"Hiemstra","sequence":"additional","affiliation":[{"name":"Radboud University, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martin","family":"Potthast","sequence":"additional","affiliation":[{"name":"University of Kassel, hessian.AI, and ScaDS.AI, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Arjen P.","family":"de Vries","sequence":"additional","affiliation":[{"name":"Radboud University, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Saber","family":"Zerhoudi","sequence":"additional","affiliation":[{"name":"University of Passau, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,8,7]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Guido Zuccon. Overview of the TREC 2019 Decision track. In Proceedings of TREC","author":"Abualsaud Mustafa","year":"2019","unstructured":"Mustafa Abualsaud, Mark D. Smucker, Christina Lioma, Maria Maistro, and Guido Zuccon. Overview of the TREC 2019 Decision track. In Proceedings of TREC, 2019."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3477495.3531737"},{"key":"e_1_2_1_3_1","first-page":"23","volume-title":"Farzana et al. [2024b]","author":"Alexander Daria","year":"2024","unstructured":"Daria Alexander, Wojciech Kusa, and Arjen P. de Vries. ORCAS-I query intent predictor as component of TIRA. In Farzana et al. [2024b], pages 23--29. URL https:\/\/ceur-ws.org\/Vol-3689\/WOWS_2024_paper_3.pdf."},{"key":"e_1_2_1_4_1","volume-title":"Fr\u00e9chet distance for offline evaluation of information retrieval systems with sparse labels. arXiv preprint arXiv:2401.17543","author":"Arabzadeh Negar","year":"2024","unstructured":"Negar Arabzadeh and Charles LA Clarke. Fr\u00e9chet distance for offline evaluation of information retrieval systems with sparse labels. arXiv preprint arXiv:2401.17543, 2024."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2888422.2888439"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3084374"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3636341.3636351"},{"key":"e_1_2_1_8_1","first-page":"51","volume-title":"Overcoming methodological challenges in information retrieval and recommender systems through awareness and education. Bauer et al.[2023a]","author":"Bauer Christine","year":"2023","unstructured":"Christine Bauer, Maik Fr\u00f6be, Dietmar Jannach, Udo Kruschwitz, Paolo Rosso, Damiano Spina, and Nava Tintarev. Overcoming methodological challenges in information retrieval and recommender systems through awareness and education. Bauer et al.[2023a], pages 51--67, 2023b."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3336191.3371848"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58219-7_26"},{"key":"e_1_2_1_11_1","first-page":"1432","volume-title":"The SIGIR 2019 open-source IR replicability challenge (OSIRRC","author":"Clancy Ryan","year":"2019","unstructured":"Ryan Clancy, Nicola Ferro, Claudia Hauff, Jimmy Lin, Tetsuya Sakai, and Ze Zhong Wu. The SIGIR 2019 open-source IR replicability challenge (OSIRRC 2019). In Benjamin Piwowarski, Max Chevalier, \u00c9ric Gaussier, Yoelle Maarek, Jian-Yun Nie, and Falk Scholer, editors, Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2019, Paris, France, July 21-25, 2019, pages 1432--1434. ACM, 2019."},{"key":"e_1_2_1_12_1","first-page":"2","volume-title":"Farzana et al. [2024b]","author":"Dinzinger Michael","year":"2024","unstructured":"Michael Dinzinger, Florian He\u00df, and Michael Granitzer. A Survey of Web Content Control for Generative AI. In Farzana et al. [2024b], pages 2--13. URL https:\/\/ceur-ws.org\/Vol-3689\/WOWS_2024_paper_1.pdf."},{"key":"e_1_2_1_13_1","first-page":"73","volume-title":"Tuan Giang Trinh, Julius Gonsior, and Anja Reusch. Assembling four Open Web Search Components: TU Dresden at WOWS","author":"Erben Linda","year":"2024","unstructured":"Linda Erben, Maria Hampel, Malte-Christian Kuns, Vincent Melisch, Per Natzschka, Wilhelm Pertsch, Lina Razouk, Reiner Stolle, Robert Thomas Thoss, Tuan Giang Trinh, Julius Gonsior, and Anja Reusch. Assembling four Open Web Search Components: TU Dresden at WOWS 2024. In Farzana et al. [2024b], pages 73--93. URL https:\/\/ceur-ws.org\/Vol-3689\/WOWS_2024_paper_8.pdf."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-72113-8_8"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-56069-9_58"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the first International Workshop on Open Web Search co-located with the 46th European Conference on Information Retrieval ECIR 2024, number 3689 in CEUR Workshop Proceedings","author":"Farzana Sheikh Mastura","year":"2024","unstructured":"Sheikh Mastura Farzana, Maik Fr\u00f6be, Gijs Hendriksen, Michael Granitzer, Djoerd Hiemstra, Martin Potthast, and Saber Zerhoudi, editors. Proceedings of the first International Workshop on Open Web Search co-located with the 46th European Conference on Information Retrieval ECIR 2024, number 3689 in CEUR Workshop Proceedings, Aachen, 2024b. URL https:\/\/ceur-ws.org\/Vol-3689\/."},{"key":"e_1_2_1_17_1","volume-title":"SPLADE v2: Sparse lexical and expansion model for information retrieval. CoRR, abs\/2109.10086","author":"Formal Thibault","year":"2021","unstructured":"Thibault Formal, Carlos Lassance, Benjamin Piwowarski, and St\u00e9phane Clinchant. SPLADE v2: Sparse lexical and expansion model for information retrieval. CoRR, abs\/2109.10086, 2021a. URL https:\/\/arxiv.org\/abs\/2109.10086."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3463098"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3539618.3591888"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-28241-6_20"},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","unstructured":"Maik Fr\u00f6be Harrisen Scells Theresa Elstner Christopher Akiki Lukas Gienapp Jan Heinrich Reimer Sean MacAvaney Benno Stein Matthias Hagen and Martin Potthast. Resources for Combining Teaching and Research in Information Retrieval Courses. In 47th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2024). ACM July 2024.","DOI":"10.1145\/3626772.3657886"},{"key":"e_1_2_1_22_1","first-page":"63","volume-title":"Farzana et al. [2024b]","author":"Gohsen Marcel","year":"2024","unstructured":"Marcel Gohsen and Benno Stein. Integrating Query Interpretation Components into the Information Retrieval Experiment Platform. In Farzana et al. [2024b], pages 63--72. URL https:\/\/ceur-ws.org\/Vol-3689\/WOWS_2024_paper_7.pdf."},{"key":"e_1_2_1_23_1","volume-title":"Journal of the Association for Information Science and Technology","author":"Granitzer Michael","year":"2023","unstructured":"Michael Granitzer, Stefan Voigt, et al. Impact and development of an open web index for open web search. Journal of the Association for Information Science and Technology, 2023."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","unstructured":"Gijs Hendriksen Michael Dinzinger Sheikh Mastura Farzana Noor Afshan Fathima Maik Fr\u00f6be Sebastian Schmidt Saber Zerhoudi Michael Granitzer Matthias Hagen Djoerd Hiemstra Martin Potthast and Benno Stein. The open web index - crawling and indexing the web for public use. In Nazli Goharian Nicola Tonellotto Yulan He Aldo Lipani Graham McDonald Craig Macdonald and Iadh Ounis editors Advances in Information Retrieval - 46th European Conference on Information Retrieval ECIR 2024 Glasgow UK March 24-28 2024 Proceedings Part V volume 14612 of Lecture Notes in Computer Science pages 130--143. Springer 2024. \\_10. URL https:\/\/doi.org\/10.1007\/978-3-031-56069-9_10. 10.1007\/978-3-031-56069-9","DOI":"10.1007\/978-3-031-56069-9_10"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3488560.3498532"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1080\/0144929X.2022.2056507"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3463254"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3511808.3557231"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3482013"},{"key":"e_1_2_1_30_1","volume-title":"The State of Google Critique and Intervention","author":"Mager Astrid","year":"2023","unstructured":"Astrid Mager, Cristian Norocel, and Richard Rogers, editors. The State of Google Critique and Intervention, 2023. Sage Journals."},{"key":"e_1_2_1_31_1","volume-title":"From doc2query to doctttttquery. Online preprint","author":"Nogueira Rodrigo","year":"2019","unstructured":"Rodrigo Nogueira and Jimmy Lin. From doc2query to doctttttquery. Online preprint, 2019."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.14778\/3157794.3157797"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3477495.3531766"},{"key":"e_1_2_1_34_1","first-page":"14","volume-title":"Farzana et al. [2024b]","author":"Schlatt Ferdinand","year":"2024","unstructured":"Ferdinand Schlatt. Efficiently Scoring the Health-relatedness of Web Pages. In Farzana et al. [2024b], pages 14--22. URL https:\/\/ceur-ws.org\/Vol-3689\/WOWS_2024_paper_2.pdf."},{"key":"e_1_2_1_35_1","unstructured":"Ferdinand Schlatt Dieter Bettin Matthias Hagen Benno Stein and Martin Potthast. Mining Health-related Cause-Effect Statements with High Precision at Large Scale. In Nicoletta Calzolari Chu-Ren Huang Hansaem Kim James Pustejovsky Leo Wanner Key-Sun Choi Pum-Mo Ryu Hsin-Hsi Chen Lucia Donatelli Heng Ji Sadao Kurohashi Patrizia Paggio Nianwen Xue Seokhwan Kim Younggyun Hahm Zhong He Tony Kyungil Lee Enrico Santus Francis Bond and Seung-Hoon Na editors 29th International Conference on Computational Linguistics (COLING 2022) pages 1925--1936. International Committee on Computational Linguistics October 2022. URL https:\/\/aclanthology.org\/2022.coling-1.167."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2422256.2422269"},{"key":"e_1_2_1_37_1","first-page":"37","volume-title":"Maximilian Ernst, Martin Potthast, Matthias Hagen, and Benno Stein. A Mastodon Corpus to Evaluate Federated Microblog Search. In Farzana et al. [2024b]","author":"Wiegmann Matti","year":"2024","unstructured":"Matti Wiegmann, Jan Heinrich Reimer, Maximilian Ernst, Martin Potthast, Matthias Hagen, and Benno Stein. A Mastodon Corpus to Evaluate Federated Microblog Search. In Farzana et al. [2024b], pages 37--49. URL https:\/\/ceur-ws.org\/Vol-3689\/WOWS_2024_paper_5.pdf."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1189702.1189712"},{"key":"e_1_2_1_39_1","first-page":"30","volume-title":"Farzana et al. [2024b]","author":"Zelch Ines","year":"2024","unstructured":"Ines Zelch, Gustav Lahmann, and Matthias Hagen. Embedding-based Query Spelling Correction. In Farzana et al. [2024b], pages 30--36. URL https:\/\/ceur-ws.org\/Vol-3689\/WOWS_2024_paper_4.pdf."},{"key":"e_1_2_1_40_1","first-page":"50","volume-title":"Farzana et al. [2024b]","author":"Zendel Oleg","year":"2024","unstructured":"Oleg Zendel, Maik Fr\u00f6be, and Guglielmo Faggioli. QPPTK@TIREx: Simplified Query Performance Prediction for Ad-Hoc Retrieval Experiments. In Farzana et al. [2024b], pages 50--62. URL https:\/\/ceur-ws.org\/Vol-3689\/WOWS_2024_paper_6.pdf."}],"container-title":["ACM SIGIR Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3687273.3687290","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3687273.3687290","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:10:01Z","timestamp":1750295401000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3687273.3687290"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["10.1145\/3687273.3687290"],"URL":"https:\/\/doi.org\/10.1145\/3687273.3687290","relation":{},"ISSN":["0163-5840"],"issn-type":[{"value":"0163-5840","type":"print"}],"subject":[],"published":{"date-parts":[[2024,6]]},"assertion":[{"value":"2024-08-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}