{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T02:43:37Z","timestamp":1783737817925,"version":"3.55.0"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"1","funder":[{"name":"Science and Technology Innovation Key R&D Program of Chongqing","award":["CSTB2023TIAD-STX0031, CSTB2025TIAD-STX0023"],"award-info":[{"award-number":["CSTB2023TIAD-STX0031, CSTB2025TIAD-STX0023"]}]},{"name":"Chongqing Natural Science Foundation Innovation and Development Joint Fund","award":["CSTB2025NSCQ LZX0061"],"award-info":[{"award-number":["CSTB2025NSCQ LZX0061"]}]},{"name":"Chinese Academy of Sciences \u201cLight of West China\u201d Program"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Web"],"published-print":{"date-parts":[[2026,2,28]]},"abstract":"<jats:p>\n                    As recommender systems are essential to various web domains such as e-commerce and web content sharing, providing equitable item exposure regardless of popularity becomes an imperative requirement. However, traditional fairness-aware approaches typically aim to achieve a better tradeoff between recommendation accuracy and fairness, and focus on improving the exposure rate of the long-tail items on static settings, evaluating fairness on one-shot recommendation decisions using logged data. Such methods overlook the dynamic nature of user preferences in real-world interactive environments. In contrast, our work seeks a win-win solution that simultaneously enhances recommendation accuracy and fairness over the long term, rather than merely trading off one against the other. To achieve this goal, we empirically demonstrate and analyze the spatiotemporal heterogeneity of user popularity preference. Our findings reveal complementary characteristics that, when fully exploited, can guide personalized strategies for long-term fairness. Building on this insight, we propose HER4IF, a novel hierarchical reinforcement learning framework designed for interactive recommendation. HER4IF decomposes the recommendation process into two key tasks: dynamic fairness control and item recommendation. The high-level agent continuously learns adaptive fairness constraints from evolving user popularity preferences, while the low-level agent refines recommendation policies under these personalized constraints. Extensive experiments on three real-world datasets and the interactive recommendation platform KuaiSim demonstrate that HER4IF significantly outperforms state-of-the-art methods, achieving substantial improvements in both fairness and recommendation accuracy. Our code is available at:\n                    <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/github.com\/1163710212\/HER4IF\">https:\/\/github.com\/1163710212\/HER4IF<\/jats:ext-link>\n                    .\n                  <\/jats:p>","DOI":"10.1145\/3769471","type":"journal-article","created":{"date-parts":[[2025,9,25]],"date-time":"2025-09-25T11:06:15Z","timestamp":1758798375000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Beyond Trade-offs: Leveraging Spatiotemporal Heterogeneity of User Preference for Long-term Fairness and Accuracy in Interactive Recommendation"],"prefix":"10.1145","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-6762-3312","authenticated-orcid":false,"given":"Chongjun","family":"Xia","sequence":"first","affiliation":[{"name":"Chongqing Institute of Green and Intelligent Technology, chinese Academy of Sciences, Chinese Academy of Sciences","place":["Chongqing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4267-7795","authenticated-orcid":false,"given":"Xiaoyu","family":"Shi","sequence":"additional","affiliation":[{"name":"Chongqing Institute of Green and Intelligent Technology, chinese Academy of Sciences, Chinese Academy of Sciences","place":["Chongqing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7935-7210","authenticated-orcid":false,"given":"Hong","family":"Xie","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, University of Science and Technology of China","place":["Hefei, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-5615-3897","authenticated-orcid":false,"given":"Yun","family":"Lu","sequence":"additional","affiliation":[{"name":"Chongqing Institute of Green and Intelligent Technology, chinese Academy of Sciences, Chinese Academy of Sciences","place":["Chongqing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-0291-1160","authenticated-orcid":false,"given":"Pu","family":"Li","sequence":"additional","affiliation":[{"name":"Chongqing Institute of Green and Intelligent Technology, chinese Academy of Sciences, Chinese Academy of Sciences","place":["Chongqing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7024-2270","authenticated-orcid":false,"given":"Mingsheng","family":"Shang","sequence":"additional","affiliation":[{"name":"Chongqing Institute of Green and Intelligent Technology, chinese Academy of Sciences, Chinese Academy of Sciences","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,2,18]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3109859.3109912"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmp.2010.08.009"},{"key":"e_1_3_1_4_2","unstructured":"Xueying Bai Jian Guan and Hongning Wang. 2019. A model-based reinforcement learning with adversarial training for online recommendation. Advances in Neural Information Processing Systems 32 (2019) 10735\u201310746."},{"key":"e_1_3_1_5_2","doi-asserted-by":"crossref","unstructured":"Andrew G. Barto and Sridhar Mahadevan. 2003. Recent advances in hierarchical reinforcement learning. Discrete Event Dynamic Systems 13 4 (2003) 341\u2013379.","DOI":"10.1023\/A:1025696116075"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330745"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDMW.2009.83"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3564284"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.3390\/app10217748"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3539618.3591636"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/3511808.3557220"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3511808.3557624"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3594871"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/3437963.3441824"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3488560.3498487"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330691"},{"key":"e_1_3_1_17_2","doi-asserted-by":"crossref","unstructured":"Zhihao Guan Jia-Qi Yang Yang Yang Hengshu Zhu Wenjie Li and Hui Xiong. 2024. JobFormer: Skill-aware job recommendation with semantic-enhanced transformer. ACM Transactions on Knowledge Discovery from Data 19 1 (2024) 1\u201320.","DOI":"10.1145\/3701735"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/2827872"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401063"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.3390\/make4010009"},{"key":"e_1_3_1_21_2","volume-title":"Proceedings of the 33rd International Joint Conference on Artificial Intelligence (IJCAI \u201924)","author":"Jiang Lu","year":"2024","unstructured":"Lu Jiang, Yanan Xiao, Xinxin Zhao, Yuanbo Xu, Shuli Hu, Pengyang Wang, and Minghao Yin. 2024. Hierarchical reinforcement learning on multi-channel hypergraph neural network for course recommendation. In Proceedings of the 33rd International Joint Conference on Artificial Intelligence (IJCAI \u201924). Article 232, 9 pages."},{"key":"e_1_3_1_22_2","unstructured":"Vijay Konda and John Tsitsiklis. 1999. Actor-critic algorithms. Advances in Neural Information Processing Systems 12 (1999) 1008\u20131014."},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177729694"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359554"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v39i11.33313"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3610302"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/3485447.3512104"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","unstructured":"Weiwen Liu Feng Liu Ruiming Tang Ben Liao Guangyong Chen and Pheng Ann Heng. 2020. Balancing between Accuracy and Fairness for Interactive Recommendation with Reinforcement Learning. Springer-Verlag Berlin 13. DOI:DOI:10.1007\/978-3-030-47426-3_13","DOI":"10.1007\/978-3-030-47426-3_13"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3453160"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3539618.3591656"},{"key":"e_1_3_1_31_2","unstructured":"Steffen Rendle Christoph Freudenthaler Zeno Gantner and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence (UAI). 452\u2013461."},{"key":"e_1_3_1_32_2","first-page":"1670","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Schnabel Tobias","year":"2016","unstructured":"Tobias Schnabel, Adith Swaminathan, Ashudeep Singh, Navin Chandak, and Thorsten Joachims. 2016. Recommendations as treatments: Debiasing learning and evaluation. In Proceedings of the International Conference on Machine Learning. PMLR, 1670\u20131679."},{"key":"e_1_3_1_33_2","unstructured":"John Schulman Filip Wolski Prafulla Dhariwal Alec Radford and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv:1707.06347. Retrieved from https:\/\/arxiv.org\/abs\/1707.06347"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3497748"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2019.2941938"},{"key":"e_1_3_1_36_2","doi-asserted-by":"crossref","unstructured":"Xiaoyu Shi Quanliang Liu Hong Xie Yanan Bai and Mingsheng Shang. 2024. Maximum entropy policy for long-term fairness in interactive recommender systems. IEEE Transactions on Services Computing 17 3 (2024) 1029\u20131043.","DOI":"10.1109\/TSC.2024.3349636"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/3618107"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1186\/s40537-019-0197-0"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/3336191.3371855"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3643670"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3547333"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467289"},{"key":"e_1_3_1_43_2","volume-title":"Proceedings of the 33rd International Joint Conference on Artificial Intelligence (IJCAI \u201924)","author":"Xiao Yanan","year":"2024","unstructured":"Yanan Xiao, Lu Jiang, Kunpeng Liu, Yuanbo Xu, Pengyang Wang, and Minghao Yin. 2024. Hierarchical reinforcement learning for point of interest recommendation. In Proceedings of the 33rd International Joint Conference on Artificial Intelligence (IJCAI \u201924). Article 272, 9 pages."},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i5.16580"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1145\/3589334.3645536"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.3301435"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462875"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3550279"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401170"},{"key":"e_1_3_1_50_2","first-page":"44880","article-title":"KuaiSim: A comprehensive simulator for recommender systems","volume":"36","author":"Zhao Kesen","year":"2023","unstructured":"Kesen Zhao, Shuchang Liu, Qingpeng Cai, Xiangyu Zhao, Ziru Liu, Dong Zheng, Peng Jiang, and Kun Gai. 2023. KuaiSim: A comprehensive simulator for recommender systems. Advances in Neural Information Processing Systems 36 (2023), 44880\u201344897.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2023\/273"},{"key":"e_1_3_1_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3240323.3240374"},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219886"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3664928"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3185994"},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442381.3449788"},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.emnlp-main.86"},{"key":"e_1_3_1_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3271795"},{"key":"e_1_3_1_59_2","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462948"}],"container-title":["ACM Transactions on the Web"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3769471","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,5]],"date-time":"2026-03-05T22:18:44Z","timestamp":1772749124000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3769471"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,18]]},"references-count":58,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,2,28]]}},"alternative-id":["10.1145\/3769471"],"URL":"https:\/\/doi.org\/10.1145\/3769471","relation":{},"ISSN":["1559-1131","1559-114X"],"issn-type":[{"value":"1559-1131","type":"print"},{"value":"1559-114X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,18]]},"assertion":[{"value":"2025-03-10","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-09-15","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-02-18","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}