{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,5]],"date-time":"2026-03-05T19:16:12Z","timestamp":1772738172108,"version":"3.50.1"},"reference-count":52,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2025,5,19]],"date-time":"2025-05-19T00:00:00Z","timestamp":1747612800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Coordena\u00e7\u00e3o de Aperfei\u00e7oamento de Pessoal de N\u00edvel Superior\u2014Brasil (CAPES)\u2014Finance","award":["001"],"award-info":[{"award-number":["001"]}]},{"name":"Austrian Science Fund","award":["10.55776\/COE12"],"award-info":[{"award-number":["10.55776\/COE12"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2025,6,30]]},"abstract":"<jats:p>The essence of calibration in recommender systems is to generate recommendations that match the distribution of a given user\u2019s past preferences regarding certain item features\u2014e.g., in terms of preferred genres in the case of movies\u2014while preserving relevance. The user\u2019s past preference distribution is usually derived by considering the features of all items that the user previously liked. However, the most common approach in the literature to derive this distribution has certain limitations. First, it does not consider that user preferences may change over time. Second, there are domains where the relevant item features are set-valued, e.g., a movie can have several genres. In such cases, existing calibration approaches may represent the true user\u2019s preference distribution in a suboptimal way. In this work, we, therefore, propose two novel approaches to derive the preference distributions of users for the purpose of calibration. The first method allows us to decrease the relevance of possibly outdated preference information. The second method is an entropy-based approach, which aims to capture better the user\u2019s true preferences toward certain item features. Extensive experimental evaluations on four distinct datasets confirm that the proposed techniques are more effective in reducing the level of miscalibration than the common state-of-the-art calibration approach.<\/jats:p>","DOI":"10.1145\/3716858","type":"journal-article","created":{"date-parts":[[2025,2,13]],"date-time":"2025-02-13T18:42:53Z","timestamp":1739472173000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Considering Time and Feature Entropy in Calibrated Recommendations"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7132-1977","authenticated-orcid":false,"given":"Diego Corr\u00eaa","family":"da Silva","sequence":"first","affiliation":[{"name":"Institute of Computing, Federal University of Bahia, Salvador, Brazil and Artificial Intelligence and Cybersecurity, University of Klagenfurt, Klagenfurt, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4698-8507","authenticated-orcid":false,"given":"Dietmar","family":"Jannach","sequence":"additional","affiliation":[{"name":"Artificial Intelligence and Cybersecurity, University of Klagenfurt, Klagenfurt, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7766-6666","authenticated-orcid":false,"given":"Frederico Ara\u00fajo","family":"Dur\u00e3o","sequence":"additional","affiliation":[{"name":"Institute of Computing, Federal University of Bahia, Salvador, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,5,19]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"crossref","first-page":"726","DOI":"10.1145\/3383313.3418487","volume-title":"Proceedings of the 14th ACM Conference on Recommender Systems (RecSys \u201920)","author":"Abdollahpouri Himan","year":"2020","unstructured":"Himan Abdollahpouri, Masoud Mansoury, Robin Burke, and Bamshad Mobasher. 2020. The connection between popularity bias, calibration, and fairness in recommendation. In Proceedings of the 14th ACM Conference on Recommender Systems (RecSys \u201920), 726\u2013731. DOI: 10.1145\/3383313.3418487"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/3450613.3456821"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3539597.3570402"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3627043.3659558"},{"key":"e_1_3_2_6_2","unstructured":"Mikhail Andronov and Sergey Kolesnikov. 2023. CVTT: Cross-validation through time. arXiv:2205.05393. Retrieved from https:\/\/arxiv.org\/abs\/2205.05393"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.physa.2022.127214"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.3390\/app122211765"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1177\/01655515231182069"},{"key":"e_1_3_2_10_2","first-page":"6","volume-title":"Proceedings of the AMCIS 2023","author":"da Silva Diego Corr\u00eaa","year":"2023","unstructured":"Diego Corr\u00eaa da Silva and Frederico Ara\u00fajo Dur\u00e3o. 2023. How novel and unexpected the calibrated recommendations are? In Proceedings of the AMCIS 2023, 6."},{"issue":"19","key":"e_1_3_2_11_2","doi-asserted-by":"crossref","first-page":"22044","DOI":"10.1007\/s10489-023-04681-7","article-title":"Introducing a framework and a decision protocol to calibrated recommender systems","volume":"53","author":"da Silva Diego Corr\u00eaa","year":"2023","unstructured":"Diego Corr\u00eaa da Silva and Frederico Ara\u00fajo Dur\u00e3o. 2023. Introducing a framework and a decision protocol to calibrated recommender systems. Applied Intelligence 53, 19 (Oct. 2023), 22044\u201322072.","journal-title":"Applied Intelligence"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","unstructured":"Diego Corr\u00eaa da Silva and Frederico Ara\u00fajo Dur\u00e3o. 2023. Understanding Distribution Structure on Calibrated Recommendation System. DOI: 10.2139\/ssrn.4644467","DOI":"10.2139\/ssrn.4644467"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2025.126380"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2021.115112"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3434185"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3539618.3591647"},{"key":"e_1_3_2_17_2","doi-asserted-by":"crossref","first-page":"1157899","DOI":"10.3389\/fdata.2023.1157899","article-title":"A survey on multi-objective recommender systems","volume":"6","author":"Jannach Dietmar","year":"2023","unstructured":"Dietmar Jannach and Himan Abdollahpouri. 2023. A survey on multi-objective recommender systems. Frontiers in Big Data 6 (2023), 1157899.","journal-title":"Frontiers in Big Data"},{"issue":"2","key":"e_1_3_2_18_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3700890","article-title":"A survey on intent-aware recommender systems","volume":"3","author":"Jannach Dietmar","year":"2024","unstructured":"Dietmar Jannach and Markus Zanker. 2024. A survey on intent-aware recommender systems. ACM Transactions on Recommender Systems 3, 2 (2024), 1\u201332.","journal-title":"ACM Transactions on Recommender Systems"},{"key":"e_1_3_2_19_2","volume-title":"Recommender Systems\u2014An Introduction","author":"Jannach Dietmar","year":"2011","unstructured":"Dietmar Jannach, Markus Zanker, Alexander Felfernig, and Gerhard Friedrich. 2011. Recommender Systems\u2014An Introduction. Cambridge University Press."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3627673.3679728"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2017.03.055"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/2926720"},{"key":"e_1_3_2_23_2","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1145\/3298689.3347045","volume-title":"Proceedings of the 13th ACM Conference on Recommender Systems (RecSys \u201919)","author":"Kaya Mesut","year":"2019","unstructured":"Mesut Kaya and Derek Bridge. 2019. A comparison of calibrated and intent-aware recommendations. In Proceedings of the 13th ACM Conference on Recommender Systems (RecSys \u201919), 151\u2013159. DOI: 10.1145\/3298689.3347045"},{"key":"e_1_3_2_24_2","doi-asserted-by":"crossref","first-page":"1084","DOI":"10.1145\/3604915.3610637","volume-title":"Proceedings of the 17th ACM Conference on Recommender Systems (Late Breaking Results)","author":"Klimashevskaia Anastasiia","year":"2023","unstructured":"Anastasiia Klimashevskaia, Mehdi Elahi, Dietmar Jannach, Lars Skj\u00e6rven, Astrid Tessem, and Christoph Trattner. 2023. Evaluating the effects of calibrated popularity bias mitigation: A field study. In Proceedings of the 17th ACM Conference on Recommender Systems (Late Breaking Results), 1084\u20131089."},{"key":"e_1_3_2_25_2","first-page":"82","volume-title":"Proceedings of the 3rd International Workshop on Algorithmic Bias in Search and Recommendation (Bias 2022) (ECIR \u201922)","author":"Klimashevskaia Anastasiia","year":"2022","unstructured":"Anastasiia Klimashevskaia, Mehdi Elahi, Dietmar Jannach, Christoph Trattner, and Lars Skj\u00e6rven. 2022. Mitigating popularity bias in recommendation: Potential and limits of calibration approaches. In Proceedings of the 3rd International Workshop on Algorithmic Bias in Search and Recommendation (Bias 2022) (ECIR \u201922), 82\u201390."},{"key":"e_1_3_2_26_2","unstructured":"Oleksii Kuchaiev and Boris Ginsburg. 2017. Training deep autoEncoders for collaborative filtering. arXiv:1708.01715. Retrieved from https:\/\/arxiv.org\/abs\/1708.01715"},{"key":"e_1_3_2_27_2","first-page":"86","volume-title":"Adjunct Proceedings of the ACM Conference on User Modeling, Adaptation and Personalization (UMAP \u201924)","author":"Lin Kun","year":"2024","unstructured":"Kun Lin, Masoud Mansoury, Farzad Eskandanian, Milad Sabouri, and Bamshad Mobasher. 2024. Beyond static calibration: The impact of user preference dynamics on calibrated recommendation. In Adjunct Proceedings of the ACM Conference on User Modeling, Adaptation and Personalization (UMAP \u201924), 86\u201391."},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3372923.3404793"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3485447.3512104"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1613"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/1125451.1125659"},{"key":"e_1_3_2_32_2","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1145\/3523227.3546756","volume-title":"Proceedings of the 16th ACM Conference on Recommender Systems (RecSys \u201922)","author":"Melchiorre Alessandro B.","year":"2022","unstructured":"Alessandro B. Melchiorre, Navid Rekabsaz, Christian Ganh\u00f6r, and Markus Schedl. 2022. ProtoMF: Prototype-based matrix factorization for effective and explainable recommendations. In Proceedings of the 16th ACM Conference on Recommender Systems (RecSys \u201922), 246\u2013256. DOI: 10.1145\/3523227.3546756"},{"key":"e_1_3_2_33_2","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1145\/3640457.3688073","volume-title":"Proceedings of the 18th ACM Conference on Recommender Systems (RecSys \u201924)","author":"Milogradskii Aleksandr","year":"2024","unstructured":"Aleksandr Milogradskii, Oleg Lashinin, P. Alexander, Marina Ananyeva, and Sergey Kolesnikov. 2024. Revisiting BPR: A replicability study of a common recommender system baseline. In Proceedings of the 18th ACM Conference on Recommender Systems (RecSys \u201924), 267\u2013277. DOI: 10.1145\/3640457.3688073"},{"key":"e_1_3_2_34_2","doi-asserted-by":"crossref","unstructured":"Mohammadmehdi Naghiaei Mahdi Dehghan Hossein A. Rahmani Javad Azizi and Mohammad Aliannejadi. 2024. Personalized Beyond-Accuracy Calibration in Recommendation. Retrieved from https:\/\/openreview.net\/forum?id=hOAhzO10Z1","DOI":"10.1145\/3664190.3672507"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2011.110"},{"key":"e_1_3_2_36_2","unstructured":"Steffen Rendle Christoph Freudenthaler Zeno Gantner and Lars Schmidt-Thieme. 2012. BPR: Bayesian personalized ranking from implicit feedback. arXiv:1205.2618. Retrieved from https:\/\/arxiv.org\/abs\/1205.2618"},{"key":"e_1_3_2_37_2","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1145\/3383313.3412488","volume-title":"Proceedings of the 14th ACM Conference on Recommender Systems (RecSys \u201920)","author":"Rendle Steffen","year":"2020","unstructured":"Steffen Rendle, Walid Krichene, Li Zhang, and John R. Anderson. 2020. Neural collaborative filtering vs. matrix factorization revisited. In Proceedings of the 14th ACM Conference on Recommender Systems (RecSys \u201920), 240\u2013248. DOI: 10.1145\/3383313.3412488"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3523227.3548486"},{"key":"e_1_3_2_39_2","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4899-7637-6","volume-title":"Recommender Systems Handbook","author":"Ricci Francesco","year":"2015","unstructured":"Francesco Ricci, Lior Rokach, Bracha Shapira, and Paul B. Kantor. 2015. Recommender Systems Handbook (2nd ed.). Springer-Verlag.","edition":"2"},{"key":"e_1_3_2_40_2","volume-title":"Proceedings of the 13th ACM Conference on Recommender Systems (RecSys \u201919)","author":"Sacharidis Dimitris","year":"2019","unstructured":"Dimitris Sacharidis, Kyriakos Mouratidis, and Dimitrios Kleftogiannis. 2019. A common approach for consumer and provider fairness in recommendations. In Proceedings of the 13th ACM Conference on Recommender Systems (RecSys \u201919). ACM, New York, NY, USA. Retrieved from http:\/\/ceur-ws.org\/Vol-2431\/paper1.pdf"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3460231.3478857"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3605098.3636092"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3428757.3429096"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3240323.3240372"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2020.102228"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/2043932.2043987"},{"key":"e_1_3_2_47_2","unstructured":"Chen Wang Fangxin Wang Ruocheng Guo Yueqing Liang Kay Liu and Philip S. Yu. 2024. Confidence-aware fine-tuning of sequential recommendation systems via conformal prediction. arXiv:2402.08976. Retrieved from https:\/\/arxiv.org\/abs\/2402.08976"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.physa.2019.123917"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2021.102494"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3543507.3583336"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380065"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442381.3450099"},{"key":"e_1_3_2_53_2","doi-asserted-by":"crossref","unstructured":"Yuying Zhao Yu Wang Yi Zhang Pamela Wisniewski Charu Aggarwal and Tyler Derr. 2024. Leveraging opposite gender interaction ratio as a path towards fairness in online dating recommendations based on user sexual orientation. arXiv:2402.12541. Retrieved from https:\/\/arxiv.org\/abs\/2402.12541","DOI":"10.1609\/aaai.v38i20.30263"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3716858","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3716858","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:18:53Z","timestamp":1750295933000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3716858"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,19]]},"references-count":52,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,6,30]]}},"alternative-id":["10.1145\/3716858"],"URL":"https:\/\/doi.org\/10.1145\/3716858","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,19]]},"assertion":[{"value":"2024-07-24","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-01-20","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-19","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}