{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:18:51Z","timestamp":1750220331625,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":8,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,9,13]],"date-time":"2021-09-13T00:00:00Z","timestamp":1631491200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,9,13]]},"DOI":"10.1145\/3460231.3470929","type":"proceedings-article","created":{"date-parts":[[2021,9,13]],"date-time":"2021-09-13T21:45:04Z","timestamp":1631569504000},"page":"794-795","source":"Crossref","is-referenced-by-count":2,"title":["Perspectives on the Evaluation of Recommender Systems (PERSPECTIVES)"],"prefix":"10.1145","author":[{"given":"Eva","family":"Zangerle","sequence":"first","affiliation":[{"name":"Department of Computer Science University of Innsbruck, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christine","family":"Bauer","sequence":"additional","affiliation":[{"name":"Department of Information and Computing Sciences Utrecht University, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alan","family":"Said","sequence":"additional","affiliation":[{"name":"University of Gothenburg, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,9,13]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Himan Abdollahpouri Gediminas Adomavicius Robin Burke Ido Guy Dietmar Jannach Toshihiro Kamishima Jan Krasnodebski and Luiz Pizzato. 2020. Multistakeholder recommendation: Survey and research directions. User Modeling and User-Adapted Interaction(2020). https:\/\/doi.org\/10.1007\/s11257-019-09256-1  Himan Abdollahpouri Gediminas Adomavicius Robin Burke Ido Guy Dietmar Jannach Toshihiro Kamishima Jan Krasnodebski and Luiz Pizzato. 2020. Multistakeholder recommendation: Survey and research directions. User Modeling and User-Adapted Interaction(2020). https:\/\/doi.org\/10.1007\/s11257-019-09256-1","DOI":"10.1007\/s11257-019-09256-1"},{"key":"e_1_3_2_1_2_1","volume-title":"Proceedings of the 1st Workshop on the Impact of Recommender Systems","author":"Bauer Christine","year":"2019","unstructured":"Christine Bauer and Eva Zangerle . 2019 . Leveraging Multi-Method Evaluation for Multi-Stakeholder Settings . In Proceedings of the 1st Workshop on the Impact of Recommender Systems ( Copenhagen, Denmark, 19 September) (ImpactRS \u201919), Oren\u00a0Sar Shalom, Dietmar Jannach, and Ido Guy (Eds.). 3\u00a0pages. arxiv :2001.04348arXiv:2001.04348. Christine Bauer and Eva Zangerle. 2019. Leveraging Multi-Method Evaluation for Multi-Stakeholder Settings. In Proceedings of the 1st Workshop on the Impact of Recommender Systems (Copenhagen, Denmark, 19 September) (ImpactRS \u201919), Oren\u00a0Sar Shalom, Dietmar Jannach, and Ido Guy (Eds.). 3\u00a0pages. arxiv:2001.04348arXiv:2001.04348."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2532508.2532512"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/963770.963772"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2959100.2959186"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v41i4.5312"},{"key":"e_1_3_2_1_7_1","unstructured":"Dietmar Jannach Oren\u00a0Sar Shalom and Joseph\u00a0A Konstan. 2019. Towards More Impactful Recommender Systems Research. In Proceedings of the 1st Workshop on the Impact of Recommender Systems co-located with 13th ACM Conference on Recommender Systems ImpactRS@RecSys 2019) (Copenhagen Denmark) (CEUR Workshop Proceedings Vol.\u00a02462). CEUR-WS.org. http:\/\/ceur-ws.org\/Vol-2462\/short6.pdf  Dietmar Jannach Oren\u00a0Sar Shalom and Joseph\u00a0A Konstan. 2019. Towards More Impactful Recommender Systems Research. In Proceedings of the 1st Workshop on the Impact of Recommender Systems co-located with 13th ACM Conference on Recommender Systems ImpactRS@RecSys 2019) (Copenhagen Denmark) (CEUR Workshop Proceedings Vol.\u00a02462). CEUR-WS.org. http:\/\/ceur-ws.org\/Vol-2462\/short6.pdf"},{"key":"e_1_3_2_1_8_1","volume-title":"Proceedings of the Workshop on Recommendation Utility Evaluation: Beyond RMSE","author":"Said Alan","year":"2012","unstructured":"Alan Said , Domonkos Tikk , Klara Stumpf , Yue Shi , Martha Larson , and Paolo Cremonesi . 2012 . Recommender Systems Evaluation: A 3D Benchmark . In Proceedings of the Workshop on Recommendation Utility Evaluation: Beyond RMSE ( Dublin, Ireland) (RUE \u201912, Vol.\u00a0910). CEUR Workshop Proceedings, 21\u201323. http:\/\/ceur-ws.org\/Vol-910\/ Alan Said, Domonkos Tikk, Klara Stumpf, Yue Shi, Martha Larson, and Paolo Cremonesi. 2012. Recommender Systems Evaluation: A 3D Benchmark. In Proceedings of the Workshop on Recommendation Utility Evaluation: Beyond RMSE (Dublin, Ireland) (RUE \u201912, Vol.\u00a0910). CEUR Workshop Proceedings, 21\u201323. http:\/\/ceur-ws.org\/Vol-910\/"}],"event":{"name":"RecSys '21: Fifteenth ACM Conference on Recommender Systems","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGAI ACM Special Interest Group on Artificial Intelligence","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data","SIGIR ACM Special Interest Group on Information Retrieval","SIGCHI ACM Special Interest Group on Computer-Human Interaction","SIGecom Special Interest Group on Economics and Computation"],"location":"Amsterdam Netherlands","acronym":"RecSys '21"},"container-title":["Fifteenth ACM Conference on Recommender Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3460231.3470929","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3460231.3470929","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:12:16Z","timestamp":1750191136000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3460231.3470929"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,13]]},"references-count":8,"alternative-id":["10.1145\/3460231.3470929","10.1145\/3460231"],"URL":"https:\/\/doi.org\/10.1145\/3460231.3470929","relation":{},"subject":[],"published":{"date-parts":[[2021,9,13]]}}}