{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:43:42Z","timestamp":1750308222452,"version":"3.41.0"},"reference-count":12,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2023,12,1]],"date-time":"2023-12-01T00:00:00Z","timestamp":1701388800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGIR Forum"],"published-print":{"date-parts":[[2023,12]]},"abstract":"<jats:p>Evaluation is a central step when developing, optimizing, and deploying recommender systems. The PERSPECTIVES 2023 workshop, held as part of the 17th ACM Conference on Recommender Systems (RecSys 2023), served as a forum where researchers from both academia and industry critically reflected on the evaluation of recommender systems. The goal of the PERSPECTIVES workshop series is to capture the current state of evaluation from different perspectives and discuss the different targets that recommender systems evaluation should strive for. In the third edition of the workshop, we discussed problems and lessons learned, and aimed to move the discourse forward within the community.<\/jats:p>\n          <jats:p>\n            <jats:bold>Date<\/jats:bold>\n            : 19 September 2023.\n          <\/jats:p>\n          <jats:p>\n            <jats:bold>Website<\/jats:bold>\n            : https:\/\/perspectives-ws.github.io\/2023\/.\n          <\/jats:p>","DOI":"10.1145\/3642979.3643000","type":"journal-article","created":{"date-parts":[[2024,1,22]],"date-time":"2024-01-22T17:05:12Z","timestamp":1705943112000},"page":"1-4","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Report on the 3rd Workshop on the Perspectives on the Evaluation of Recommender Systems (PERSPECTIVES 2023) at RecSys 2023"],"prefix":"10.1145","volume":"57","author":[{"given":"Alan","family":"Said","sequence":"first","affiliation":[{"name":"University of Gothenburg, Sweden"}]},{"given":"Eva","family":"Zangerle","sequence":"additional","affiliation":[{"name":"University of Innsbruck, Austria"}]},{"given":"Christine","family":"Bauer","sequence":"additional","affiliation":[{"name":"Paris Lodron University Salzburg, Austria"}]}],"member":"320","published-online":{"date-parts":[[2024,1,22]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Ghazaleh Haratinezhad Torbati Anna Tigunova and Gerhard Weikum. Unveiling challenging cases in text-based recommender systems. In Said et al. [2023b]. URL https:\/\/ceur-ws.org\/Vol-3476\/paper5.pdf."},{"key":"e_1_2_1_2_1","unstructured":"Olivier Jeunen. A common misassumption in online experiments with machine learning models. In Said et al. [2023b]. URL https:\/\/ceur-ws.org\/Vol-3476\/abstract1.pdf."},{"key":"e_1_2_1_3_1","unstructured":"Marta Moscati Yashar Deldjoo Giulio Davide Carparelli and Markus Schedl. Multiobjective hyperparameter optimization of recommender systems. In Said et al. [2023b]. URL https:\/\/ceur-ws.org\/Vol-3476\/paper3.pdf."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3604915.3608748"},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the Perspectives on the Evaluation of Recommender Systems Workshop 2023, volume 3476 of CEUR Workshop Proceedings","author":"Said Alan","year":"2023","unstructured":"Alan Said, Eva Zangerle, and Christine Bauer, editors. Proceedings of the Perspectives on the Evaluation of Recommender Systems Workshop 2023, volume 3476 of CEUR Workshop Proceedings, Aachen, Germany, 2023b. CEUR-WS.org. URL https:\/\/ceur-ws.org\/Vol-3476\/."},{"key":"e_1_2_1_6_1","unstructured":"Andra-Georgiana Sav Andrew M. Demetriou and Cynthia C. S. Liem. Annotation practices in societally impactful machine learning applications: What are popular recommender systems models actually trained on? In Said et al. [2023b]. URL https:\/\/ceur-ws.org\/Vol-3476\/paper1.pdf."},{"key":"e_1_2_1_7_1","unstructured":"Mete Sertkan Sophia Althammer Sebastian Hofst\u00e4tter Peter Knees and Julia Neidhardt. Exploring effect-size-based meta-analysis for multi-dataset evaluation. In Said et al. [2023b]. URL https:\/\/ceur-ws.org\/Vol-3476\/paper2.pdf."},{"key":"e_1_2_1_8_1","unstructured":"Lukas Wegmeth Tobias Vente Lennart Purucker and Joeran Beel. The effect of random seeds for data splitting on recommendation accuracy. In Said et al. [2023b]. URL https:\/\/ceur-ws.org\/Vol-3476\/paper4.pdf."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3460231.3470929"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3527546.3527565"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3523227.3547408"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3582900.3582919"}],"container-title":["ACM SIGIR Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3642979.3643000","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3642979.3643000","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T16:31:21Z","timestamp":1750264281000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3642979.3643000"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12]]},"references-count":12,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,12]]}},"alternative-id":["10.1145\/3642979.3643000"],"URL":"https:\/\/doi.org\/10.1145\/3642979.3643000","relation":{},"ISSN":["0163-5840"],"issn-type":[{"type":"print","value":"0163-5840"}],"subject":[],"published":{"date-parts":[[2023,12]]},"assertion":[{"value":"2024-01-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}