{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:12:54Z","timestamp":1750219974024,"version":"3.41.0"},"reference-count":12,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2022,12,1]],"date-time":"2022-12-01T00:00:00Z","timestamp":1669852800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGIR Forum"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:p>Evaluation is a central step when it comes to developing, optimizing, and deploying recommender systems. The PERSPECTIVES 2022 workshop at the 16th ACM Conference on Recommender Systems brought together academia and industry to critically reflect on the evaluation of recommender systems. The primary goal of the workshop was to capture the current state of evaluation from different, and maybe even diverging or contradictory perspectives.<\/jats:p>\n          <jats:p>\n            <jats:bold>Date:<\/jats:bold>\n            22 September, 2022.\n          <\/jats:p>\n          <jats:p>\n            <jats:bold>Website:<\/jats:bold>\n            https:\/\/perspectives-ws.github.io\/2022\/.\n          <\/jats:p>","DOI":"10.1145\/3582900.3582919","type":"journal-article","created":{"date-parts":[[2023,1,31]],"date-time":"2023-01-31T23:13:31Z","timestamp":1675206811000},"page":"1-4","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Report on the 2nd Workshop on the Perspectives on the Evaluation of Recommender Systems (PERSPECTIVES 2022) at RecSys 2022"],"prefix":"10.1145","volume":"56","author":[{"given":"Eva","family":"Zangerle","sequence":"first","affiliation":[{"name":"Universit\u00e4t Innsbruck, Austria"}]},{"given":"Christine","family":"Bauer","sequence":"additional","affiliation":[{"name":"Utrecht University, The Netherlands"}]},{"given":"Alan","family":"Said","sequence":"additional","affiliation":[{"name":"University of Gothenburg, Sweden"}]}],"member":"320","published-online":{"date-parts":[[2023,1,31]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings","author":"Hazrati Naieme","year":"2022","unstructured":"Naieme Hazrati and Francesco Ricci . Learning choice models for simulating users' interactions with recommender systems . In Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings , September 2022 . URL https:\/\/ceur-ws.org\/Vol-3228\/paper4.pdf. Naieme Hazrati and Francesco Ricci. Learning choice models for simulating users' interactions with recommender systems. In Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings, September 2022. URL https:\/\/ceur-ws.org\/Vol-3228\/paper4.pdf."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings","author":"Kaya Mesut","year":"2022","unstructured":"Mesut Kaya and Toine Bogers . Towards comparing recommendation to multiple-query search sessions for talent search . In Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings , September 2022 . URL https:\/\/ceur-ws.org\/Vol-3228\/paper6.pdf. Mesut Kaya and Toine Bogers. Towards comparing recommendation to multiple-query search sessions for talent search. In Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings, September 2022. URL https:\/\/ceur-ws.org\/Vol-3228\/paper6.pdf."},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings","author":"Loepp Benedikt","year":"2022","unstructured":"Benedikt Loepp . Recommender systems alone are not everything: Towards a broader perspective in the evaluation of recommender systems . In Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings , September 2022 . URL https:\/\/ceur-ws.org\/Vol-3228\/paper5.pdf. Benedikt Loepp. Recommender systems alone are not everything: Towards a broader perspective in the evaluation of recommender systems. In Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings, September 2022. URL https:\/\/ceur-ws.org\/Vol-3228\/paper5.pdf."},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings","author":"Michiels Lien","year":"2022","unstructured":"Lien Michiels , Robin Verachtert , Kim Falk , and Bart Groethals . Abstract : Should algorithm evaluation extend to testing? we think so . In Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings , September 2022 . URL https:\/\/ceur-ws.org\/Vol-3228\/abstract1.pdf. Lien Michiels, Robin Verachtert, Kim Falk, and Bart Groethals. Abstract: Should algorithm evaluation extend to testing? we think so. In Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings, September 2022. URL https:\/\/ceur-ws.org\/Vol-3228\/abstract1.pdf."},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings","author":"Lucas Joel Pinho","year":"2022","unstructured":"Joel Pinho Lucas , Let\u00edcia Freire de Figueiredo , and Felipe Alves Ferreira . Abstract : Multi-domain news recommender systems at globo: Challenges, approaches and evaluation metrics . In Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings , September 2022 . URL https:\/\/ceur-ws.org\/Vol-3228\/abstract2.pdf. Joel Pinho Lucas, Let\u00edcia Freire de Figueiredo, and Felipe Alves Ferreira. Abstract: Multi-domain news recommender systems at globo: Challenges, approaches and evaluation metrics. In Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings, September 2022. URL https:\/\/ceur-ws.org\/Vol-3228\/abstract2.pdf."},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings","author":"Sertkan Mete","year":"2022","unstructured":"Mete Sertkan , Sofia Althammer , Sebastian Hoftst\u00e4tter , and Julia Neidhardt . Diversifying sentiments in news recommendation . In Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings , September 2022 . URL https:\/\/ceur-ws.org\/Vol-3228\/paper3.pdf. Mete Sertkan, Sofia Althammer, Sebastian Hoftst\u00e4tter, and Julia Neidhardt. Diversifying sentiments in news recommendation. In Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings, September 2022. URL https:\/\/ceur-ws.org\/Vol-3228\/paper3.pdf."},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings","author":"Verachtert Robin","year":"2022","unstructured":"Robin Verachtert , Lien Michiels , and Bart Goethals . Are we forgetting something? correctly evaluate a recommender system with an optimal training window . In Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings , September 2022 . URL https:\/\/ceur-ws.org\/Vol-3228\/paper1.pdf. Robin Verachtert, Lien Michiels, and Bart Goethals. Are we forgetting something? correctly evaluate a recommender system with an optimal training window. In Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings, September 2022. URL https:\/\/ceur-ws.org\/Vol-3228\/paper1.pdf."},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings","author":"Wegmeth Lukas","year":"2022","unstructured":"Lukas Wegmeth and Joeran Beel . Camels : Cooperative meta-learning service for recommender systems . In Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings , September 2022 . URL https:\/\/ceur-ws.org\/Vol-3228\/paper2.pdf. Lukas Wegmeth and Joeran Beel. Camels: Cooperative meta-learning service for recommender systems. In Proceedings of the 2nd Perspectives on the Evaluation of Recommender Systems Workshop, PERSPECTIVES '22. CEUR Workshop Proceedings, September 2022. URL https:\/\/ceur-ws.org\/Vol-3228\/paper2.pdf."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3460231.3470929"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3527546.3527565"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3523227.3547408"},{"key":"e_1_2_1_12_1","series-title":"CEUR Workshop Proceedings","volume-title":"Proceedings of the Perspectives on the Evaluation of Recommender Systems Workshop","author":"Zangerle Eva","year":"2022","unstructured":"Eva Zangerle , Christine Bauer , and Alan Said . Proceedings of the Perspectives on the Evaluation of Recommender Systems Workshop 2022 , volume 3228 of CEUR Workshop Proceedings . CEUR-WS.org, 2022c. ISBN 1613-0073. URL http:\/\/ceur-ws.org\/Vol-3228\/. Eva Zangerle, Christine Bauer, and Alan Said. Proceedings of the Perspectives on the Evaluation of Recommender Systems Workshop 2022, volume 3228 of CEUR Workshop Proceedings. CEUR-WS.org, 2022c. ISBN 1613-0073. URL http:\/\/ceur-ws.org\/Vol-3228\/."}],"container-title":["ACM SIGIR Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3582900.3582919","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3582900.3582919","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:20Z","timestamp":1750182560000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3582900.3582919"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12]]},"references-count":12,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["10.1145\/3582900.3582919"],"URL":"https:\/\/doi.org\/10.1145\/3582900.3582919","relation":{},"ISSN":["0163-5840"],"issn-type":[{"type":"print","value":"0163-5840"}],"subject":[],"published":{"date-parts":[[2022,12]]},"assertion":[{"value":"2023-01-31","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}