{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T00:55:55Z","timestamp":1774400155255,"version":"3.50.1"},"reference-count":28,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2022,12,1]],"date-time":"2022-12-01T00:00:00Z","timestamp":1669852800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGIR Forum"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:p>Explainable recommenders are systems that explain why an item is recommended, in addition to suggesting relevant items to the users of the system. Although explanations are known to be able to significantly affect a user's decision-making process, significant gaps remain concerning methodologies to evaluate them. This hinders cross-comparison between explainable recommendation approaches and is one of the issues hampering the widespread adoption of explanations in industry settings. The goal of QUARE '22 was to promote discussion upon future research and practice directions around evaluation methodologies for explanations in recommender systems. To that end, we brought together researchers and practitioners from academia and industry in a half-day event, co-located with SIGIR 2022. The workshop's program included two keynote talks, three sessions of technical paper presentations in the form of lightning talks followed by panel discussions, and a final plenary discussion session. Although the area of explanations for recommender systems is still in its early stages, QUARE saw the participation of researchers and practitioners from several fields, laying the groundwork for the creation of a community around this topic and indicating promising directions for future research and development.<\/jats:p>\n          <jats:p>\n            <jats:bold>Date:<\/jats:bold>\n            15 July, 2022.\n          <\/jats:p>\n          <jats:p>\n            <jats:bold>Website:<\/jats:bold>\n            https:\/\/sites.google.com\/view\/quare-2022\/home.\n          <\/jats:p>","DOI":"10.1145\/3582900.3582915","type":"journal-article","created":{"date-parts":[[2023,1,31]],"date-time":"2023-01-31T23:13:31Z","timestamp":1675206811000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Report on the 1st Workshop on Measuring the Quality of Explanations in Recommender Systems (QUARE 2022) at SIGIR 2022"],"prefix":"10.1145","volume":"56","author":[{"given":"Alessandro","family":"Piscopo","sequence":"first","affiliation":[{"name":"Datalab, BBC, London, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Oana","family":"Inel","sequence":"additional","affiliation":[{"name":"University of Zurich, Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sanne","family":"Vrijenhoek","sequence":"additional","affiliation":[{"name":"University of Amsterdam, Amsterdam, the Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martijn","family":"Millecamp","sequence":"additional","affiliation":[{"name":"AE NV, Bruges, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Krisztian","family":"Balog","sequence":"additional","affiliation":[{"name":"Google, Stavanger, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,1,31]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3477495.3532041"},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of Beyond Personalization 2005: A Workshop on the Next Stage of Recommender Systems Research at the 2005 International Conference on Intelligent User Interfaces","author":"Bilgic Mustafa","year":"2005","unstructured":"Mustafa Bilgic and Raymond Mooney . Explaining recommendations : Satisfaction vs. promotion . In Proceedings of Beyond Personalization 2005: A Workshop on the Next Stage of Recommender Systems Research at the 2005 International Conference on Intelligent User Interfaces , 2005 . Mustafa Bilgic and Raymond Mooney. Explaining recommendations: Satisfaction vs. promotion. In Proceedings of Beyond Personalization 2005: A Workshop on the Next Stage of Recommender Systems Research at the 2005 International Conference on Intelligent User Interfaces, 2005."},{"key":"e_1_2_1_3_1","volume-title":"A comprehensive survey on the evaluation of explainable recommendation. arXiv, cs.IR\/2202.06466","author":"Chen Xu","year":"2022","unstructured":"Xu Chen , Yongfeng Zhang , and Ji-Rong Wen . Measuring \"why\" in recommender systems : A comprehensive survey on the evaluation of explainable recommendation. arXiv, cs.IR\/2202.06466 , 2022 . Xu Chen, Yongfeng Zhang, and Ji-Rong Wen. Measuring \"why\" in recommender systems: A comprehensive survey on the evaluation of explainable recommendation. arXiv, cs.IR\/2202.06466, 2022."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/296"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/3491440.3491854"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3180308.3180366"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302274"},{"key":"e_1_2_1_8_1","first-page":"13","article-title":"Recommenders you can rely on: A legal and empirical perspective on the transparency and control individuals require to trust news personalisation","author":"van Drunen Max","year":"2022","unstructured":"Max van Drunen , Brahim Zarouali , and Natali Helberger . Recommenders you can rely on: A legal and empirical perspective on the transparency and control individuals require to trust news personalisation . JIPITEC , 13 , 2022 . Max van Drunen, Brahim Zarouali, and Natali Helberger. Recommenders you can rely on: A legal and empirical perspective on the transparency and control individuals require to trust news personalisation. JIPITEC, 13, 2022.","journal-title":"JIPITEC"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2013.12.007"},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","first-page":"3850","DOI":"10.1145\/3442381.3449848","volume-title":"Proceedings of the Web Conference 2021","author":"Ghazimatin Azin","year":"2021","unstructured":"Azin Ghazimatin , Soumajit Pramanik , Rishiraj Saha Roy , and Gerhard Weikum . Elixir : learning from user feedback on explanations to improve recommender models . In Proceedings of the Web Conference 2021 , pages 3850 -- 3860 , 2021 . Azin Ghazimatin, Soumajit Pramanik, Rishiraj Saha Roy, and Gerhard Weikum. Elixir: learning from user feedback on explanations to improve recommender models. In Proceedings of the Web Conference 2021, pages 3850--3860, 2021."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462939"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/358916.358995"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2210.07024"},{"key":"e_1_2_1_14_1","first-page":"2122","volume-title":"Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP '16","author":"Liu Chia-Wei","year":"2016","unstructured":"Chia-Wei Liu , Ryan Lowe , Iulian Serban , Mike Noseworthy , Laurent Charlin , and Joelle Pineau . How NOT to evaluate your dialogue system: An empirical study of unsupervised evaluation metrics for dialogue response generation . In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP '16 , pages 2122 -- 2132 , November 2016 . Chia-Wei Liu, Ryan Lowe, Iulian Serban, Mike Noseworthy, Laurent Charlin, and Joelle Pineau. How NOT to evaluate your dialogue system: An empirical study of unsupervised evaluation metrics for dialogue response generation. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, EMNLP '16, pages 2122--2132, November 2016."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467315"},{"key":"e_1_2_1_16_1","volume-title":"Nudging towards news diversity: A theoretical framework for facilitating diverse news consumption through recommender design. new media & society, page 14614448221104413","author":"Mattis Nicolas","year":"2022","unstructured":"Nicolas Mattis , Philipp Masur , Judith M\u00f6ller , and Wouter van Atteveldt . Nudging towards news diversity: A theoretical framework for facilitating diverse news consumption through recommender design. new media & society, page 14614448221104413 , 2022 . Nicolas Mattis, Philipp Masur, Judith M\u00f6ller, and Wouter van Atteveldt. Nudging towards news diversity: A theoretical framework for facilitating diverse news consumption through recommender design. new media & society, page 14614448221104413, 2022."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411763.3443441"},{"key":"e_1_2_1_18_1","volume-title":"A systematic review and taxonomy of explanations in decision support and recommender systems. User Model. User-adapt. Interact., 27(3--5):393--444","author":"Nunes Ingrid","year":"2017","unstructured":"Ingrid Nunes and Dietmar Jannach . A systematic review and taxonomy of explanations in decision support and recommender systems. User Model. User-adapt. Interact., 27(3--5):393--444 , 2017 . Ingrid Nunes and Dietmar Jannach. A systematic review and taxonomy of explanations in decision support and recommender systems. User Model. User-adapt. Interact., 27(3--5):393--444, 2017."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3498366.3505828"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3519795"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2021.103506"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-7637-6_10"},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","first-page":"711","DOI":"10.1007\/978-1-0716-2197-4_19","volume-title":"Recommender Systems Handbook","author":"Tintarev Nava","year":"2022","unstructured":"Nava Tintarev and Judith Masthoff . Beyond explaining single item recommendations . In Recommender Systems Handbook , pages 711 -- 756 . Springer , 2022 . Nava Tintarev and Judith Masthoff. Beyond explaining single item recommendations. In Recommender Systems Handbook, pages 711--756. Springer, 2022."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3463005"},{"key":"e_1_2_1_25_1","volume-title":"A survey on effects of adding explanations to recommender systems. Concurrency and Computation: Practice and Experience, page e6834","author":"Vultureanu-Albi\u015fi Alexandra","year":"2022","unstructured":"Alexandra Vultureanu-Albi\u015fi and Costin B\u0103dic\u0103 . A survey on effects of adding explanations to recommender systems. Concurrency and Computation: Practice and Experience, page e6834 , 2022 . Alexandra Vultureanu-Albi\u015fi and Costin B\u0103dic\u0103. A survey on effects of adding explanations to recommender systems. Concurrency and Computation: Practice and Experience, page e6834, 2022."},{"key":"e_1_2_1_26_1","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1109\/ICDM.2018.00074","volume-title":"2018 IEEE international conference on data mining (ICDM)","author":"Wang Xiting","year":"2018","unstructured":"Xiting Wang , Yiru Chen , Jie Yang , Le Wu , Zhengtao Wu , and Xing Xie . A reinforcement learning framework for explainable recommendation . In 2018 IEEE international conference on data mining (ICDM) , pages 587 -- 596 . IEEE, 2018 . Xiting Wang, Yiru Chen, Jie Yang, Le Wu, Zhengtao Wu, and Xing Xie. A reinforcement learning framework for explainable recommendation. In 2018 IEEE international conference on data mining (ICDM), pages 587--596. IEEE, 2018."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467105"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3534678.3539277"}],"container-title":["ACM SIGIR Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3582900.3582915","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3582900.3582915","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:20Z","timestamp":1750182560000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3582900.3582915"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12]]},"references-count":28,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["10.1145\/3582900.3582915"],"URL":"https:\/\/doi.org\/10.1145\/3582900.3582915","relation":{},"ISSN":["0163-5840"],"issn-type":[{"value":"0163-5840","type":"print"}],"subject":[],"published":{"date-parts":[[2022,12]]},"assertion":[{"value":"2023-01-31","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}