{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T21:54:04Z","timestamp":1791323644220,"version":"4.3.1"},"reference-count":80,"publisher":"Association for Computing Machinery (ACM)","issue":"3","funder":[{"DOI":"10.13039\/501100002428","name":"Austrian Science Fund","doi-asserted-by":"publisher","award":["10.55776\/COE12"],"award-info":[{"award-number":["10.55776\/COE12"]}],"id":[{"id":"10.13039\/501100002428","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Recomm. Syst."],"published-print":{"date-parts":[[2026,9,30]]},"abstract":"<jats:p>The idea of calibrated recommendations is that the properties of the items that are suggested to users should match the distribution of their individual past preferences. Calibration techniques are therefore helpful to ensure that the recommendations provided to a user are not limited to a certain subset of the user\u2019s interests. Over the past few years, we have observed an increasing number of research works that use calibration for different purposes, including questions of diversity, biases, and fairness. In this work, we provide a survey on the recent developments in the area of calibrated recommendations. We both review existing technical approaches for calibration and provide an overview on empirical and analytical studies on the effectiveness of calibration for different use cases. Furthermore, we discuss limitations and common challenges when implementing calibration in practice.<\/jats:p>","DOI":"10.1145\/3789266","type":"journal-article","created":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T21:14:59Z","timestamp":1769030099000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Calibrated Recommendations: Survey and Future Directions"],"prefix":"10.1145","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7132-1977","authenticated-orcid":false,"given":"Diego","family":"da Silva","sequence":"first","affiliation":[{"name":"Artificial Intelligence and Cybersecurity (AICS), Universit\u00e4t Klagenfurt","place":["Klagenfurt am W\u00f6rthersee, Austria"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4698-8507","authenticated-orcid":false,"given":"Dietmar","family":"Jannach","sequence":"additional","affiliation":[{"name":"University of Klagenfurt","place":["Klagenfurt, Austria"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,3,5]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3450614.3461681"},{"key":"e_1_3_2_3_2","first-page":"413","volume-title":"Proceedings of the 32nd International Florida Artificial Intelligence Research Society Conference","author":"Abdollahpouri Himan","year":"2019","unstructured":"Himan Abdollahpouri, Robin Burke, and Bamshad Mobasher. 2019. Managing popularity bias in recommender systems with personalized re-ranking. In Proceedings of the 32nd International Florida Artificial Intelligence Research Society Conference, Roman Bart\u00e1k and Keith W. Brawner (Eds.). 413\u2013418. Retrieved from https:\/\/aaai.org\/ocs\/index.php\/FLAIRS\/FLAIRS19\/paper\/view\/18199"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3383313.3418487"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3450613.3456821"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3539597.3570402"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3109859.3109954"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3650044"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3627043.3659558"},{"key":"e_1_3_2_10_2","first-page":"75","volume-title":"Proceedings of the 12th National Conference in Artificial Intelligence and Cognitive Science","author":"Bradley Keith","year":"2001","unstructured":"Keith Bradley and Ben Smyth. 2001. Improving recommendation diversity. In Proceedings of the 12th National Conference in Artificial Intelligence and Cognitive Science. 75\u201384."},{"issue":"4","key":"e_1_3_2_11_2","first-page":"300","article-title":"Comprehensive survey on distance\/similarity measures between probability density functions","volume":"1","author":"Cha Sung-Hyuk","year":"2007","unstructured":"Sung-Hyuk Cha. 2007. Comprehensive survey on distance\/similarity measures between probability density functions. International Journal of Mathematical Models and Methods in Applied Sciences 1, 4 (042007), 300\u2013307. Retrieved from http:\/\/www.fisica.edu.uy\/cris\/teaching\/Cha_pdf_distances_2007.pdf","journal-title":"International Journal of Mathematical Models and Methods in Applied Sciences"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.3390\/app122211765"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10489-022-03718-7"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1177\/01655515231182069"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10489-023-04681-7"},{"key":"e_1_3_2_16_2","volume-title":"Proceedings of theAmerican Conference on Information SystemsAMCIS 2023","volume":"6","author":"Silva Diego Corr\u00eaa da","year":"2023","unstructured":"Diego Corr\u00eaa da Silva and Frederico Ara\u00fajo Dur\u00e3o. 2023. How novel and unexpected the calibrated recommendations are?, In Proceedings of theAmerican Conference on Information Systems. AMCIS 2023 6, 6. Retrieved from https:\/\/aisel.aisnet.org\/amcis2023\/sig_odis\/sig_odis\/6"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2025.126380"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3716858"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2021.115112"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-023-09364-z"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-64755-0_1"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3576840.3578287"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/1864708.1864761"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3640457.3688067"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-56027-9_2"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.3389\/fdata.2023.1157899"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/3700890"},{"key":"e_1_3_2_28_2","volume-title":"Recommender Systems \u2013 An Introduction","author":"Jannach Dietmar","year":"2011","unstructured":"Dietmar Jannach, Markus Zanker, Alexander Felfernig, and Gerhard Friedrich. 2011. Recommender Systems \u2013 An Introduction. Cambridge University Press."},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3627673.3679728"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2017.03.055"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/2926720"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3298689.3347045"},{"key":"e_1_3_2_33_2","volume-title":"Guidelines for Performing Systematic Literature Reviews in Software Engineering","author":"Kitchenham Barbara","year":"2007","unstructured":"Barbara Kitchenham and Stuart Charters. 2007. Guidelines for Performing Systematic Literature Reviews in Software Engineering. Technical Report EBSE-2007-01. School of Computer Science and Mathematics, Keele University."},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-71033-9_25"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3604915.3610637"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-09316-6_8"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-024-09406-0"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-37249-0_1"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.3389\/fdata.2023.1245198"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1117\/12.3004143"},{"key":"e_1_3_2_41_2","volume-title":"MORS@ RecSys","author":"Lesota Oleg","year":"2022","unstructured":"Oleg Lesota, Stefan Brandl, Matthias Wenzel, Alessandro B Melchiorre, Elisabeth Lex, Navid Rekabsaz, and Markus Schedl. 2022. Exploring cross-group discrepancies in calibrated popularity for accuracy\/fairness trade-off optimization. In MORS@ RecSys."},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3539618.3591964"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3640457.3688187"},{"key":"e_1_3_2_44_2","volume-title":"Proceedings of the AAAI-23 Workshop on AI for Web Advertising","author":"Li Yunqi","year":"2023","unstructured":"Yunqi Li, Michiharu Yamashita, Hanxiong Chen, Dongwon Lee, and Yongfeng Zhang. 2023. Fairness in job recommendation under quantity constraints. In Proceedings of the AAAI-23 Workshop on AI for Web Advertising. Retrieved from https:\/\/pike.psu.edu\/publications\/aaai23-fair.pdf"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/3631700.3664869"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3372923.3404793"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/3124791.3124795"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3124791.3124795"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/1125451.1125659"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2023.127140"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3664190.3672507"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3511808.3557713"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3485447.3512115"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2011.110"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.5753\/webmedia_estendido.2024.244310"},{"key":"e_1_3_2_56_2","unstructured":"Steffen Rendle Christoph Freudenthaler Zeno Gantner and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence. 452\u2013461."},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/192844.192905"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-7637-6"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-09316-6_9"},{"key":"e_1_3_2_60_2","volume-title":"Proceedings of the 13th ACM Conference on Recommender Systems (RecSys\u201919)","author":"Sacharidis Dimitris","year":"2019","unstructured":"Dimitris Sacharidis, Kyriakos Mouratidis, and Dimitrios Kleftogiannis. 2019. A common approach for consumer and provider fairness in recommendations. In Proceedings of the 13th ACM Conference on Recommender Systems (RecSys\u201919). Retrieved from http:\/\/ceur-ws.org\/Vol-2431\/paper1.pdf"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.5220\/0011846000003467"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/371920.372071"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1145\/3460231.3478857"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/3605098.3636092"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/3428757.3429096"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1145\/3428757.3429096"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1145\/3240323.3240372"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1145\/3627043.3659571"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1145\/3640457.3688102"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2010124"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/2348283.2348297"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/3523227.3546780"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/3604915.3608799"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467249"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1145\/3589334.3645518"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1145\/3650042"},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.1145\/3556536"},{"key":"e_1_3_2_78_2","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380065"},{"key":"e_1_3_2_79_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442381.3450099"},{"key":"e_1_3_2_80_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v38i20.30263"},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.1145\/1060745.1060754"}],"container-title":["ACM Transactions on Recommender Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3789266","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,15]],"date-time":"2026-03-15T09:27:29Z","timestamp":1773566849000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3789266"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,5]]},"references-count":80,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,9,30]]}},"alternative-id":["10.1145\/3789266"],"URL":"https:\/\/doi.org\/10.1145\/3789266","relation":{},"ISSN":["2770-6699"],"issn-type":[{"value":"2770-6699","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,5]]},"assertion":[{"value":"2025-07-03","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-12-31","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-03-05","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}