{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:13:06Z","timestamp":1750219986539,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":46,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,10,17]],"date-time":"2022-10-17T00:00:00Z","timestamp":1665964800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,10,17]]},"DOI":"10.1145\/3511808.3557373","type":"proceedings-article","created":{"date-parts":[[2022,10,16]],"date-time":"2022-10-16T01:29:57Z","timestamp":1665883797000},"page":"47-56","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["KRAF: A Flexible Advertising Framework using Knowledge Graph-Enriched Multi-Agent Reinforcement Learning"],"prefix":"10.1145","author":[{"given":"Jose A.","family":"Ayala-Romero","sequence":"first","affiliation":[{"name":"Huawei Ireland Research Center, Dublin, Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"P\u00e9ter","family":"Mernyei","sequence":"additional","affiliation":[{"name":"Huawei Ireland Research Center, Dublin, Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bichen","family":"Shi","sequence":"additional","affiliation":[{"name":"Huawei Ireland Research Center, Dublin, Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Diego","family":"Maz\u00f3n","sequence":"additional","affiliation":[{"name":"Huawei Ireland Research Center, Dublin, Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,10,17]]},"reference":[{"doi-asserted-by":"publisher","key":"e_1_3_2_1_1_1","DOI":"10.1145\/1376616.1376746"},{"unstructured":"Pamela Bump. 2021. The Death of the Third-Party Cookie: What Marketers Need to Know About Google's 2022 Phase-Out. HubSpot. https:\/\/blog.hubspot.com\/ marketing\/third-party-cookie-phase-out  Pamela Bump. 2021. The Death of the Third-Party Cookie: What Marketers Need to Know About Google's 2022 Phase-Out. HubSpot. https:\/\/blog.hubspot.com\/ marketing\/third-party-cookie-phase-out","key":"e_1_3_2_1_2_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_3_1","DOI":"10.1145\/3018661.3018702"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_4_1","DOI":"10.1145\/3404835.3462913"},{"key":"e_1_3_2_1_5_1","volume-title":"Know Your Enemies and Know Yourself in the Real-Time Bidding Function Optimisation. In 2019 International Conference on Data Mining Workshops (ICDMW). IEEE, 973--981","author":"Du Manxing","year":"2019","unstructured":"Manxing Du , Alexander I Cowen-Rivers , Ying Wen , Phu Sakulwongtana , Jun Wang , Mats Brorsson , and Radu State . 2019 . Know Your Enemies and Know Yourself in the Real-Time Bidding Function Optimisation. In 2019 International Conference on Data Mining Workshops (ICDMW). IEEE, 973--981 . Manxing Du, Alexander I Cowen-Rivers, Ying Wen, Phu Sakulwongtana, Jun Wang, Mats Brorsson, and Radu State. 2019. Know Your Enemies and Know Yourself in the Real-Time Bidding Function Optimisation. In 2019 International Conference on Data Mining Workshops (ICDMW). IEEE, 973--981."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_6_1","DOI":"10.1007\/978-3-319-69179-4_50"},{"unstructured":"Forbes. 2021. Autonomous Advertising: Mapping The Future Of Machine Learning In Ad Tech. Article. https:\/\/www.forbes.com\/sites\/forbestechcouncil\/2021\/ 03\/30\/autonomous-advertising-mapping-the-future-of-machine-learning-inad- tech\/'sh=636968852960  Forbes. 2021. Autonomous Advertising: Mapping The Future Of Machine Learning In Ad Tech. Article. https:\/\/www.forbes.com\/sites\/forbestechcouncil\/2021\/ 03\/30\/autonomous-advertising-mapping-the-future-of-machine-learning-inad- tech\/'sh=636968852960","key":"e_1_3_2_1_7_1"},{"key":"e_1_3_2_1_8_1","volume-title":"International conference on machine learning. PMLR, 1587--1596","author":"Fujimoto Scott","year":"2018","unstructured":"Scott Fujimoto , Herke Hoof , and David Meger . 2018 . Addressing function approximation error in actor-critic methods . In International conference on machine learning. PMLR, 1587--1596 . Scott Fujimoto, Herke Hoof, and David Meger. 2018. Addressing function approximation error in actor-critic methods. In International conference on machine learning. PMLR, 1587--1596."},{"unstructured":"Google. 2022. Interest-based advertising (IBA). Technical Specification. https:\/\/github.com\/jkarlin\/topics  Google. 2022. Interest-based advertising (IBA). Technical Specification. https:\/\/github.com\/jkarlin\/topics","key":"e_1_3_2_1_9_1"},{"key":"e_1_3_2_1_10_1","volume-title":"A Survey on Knowledge Graph-Based Recommender Systems. CoRR","author":"Guo Qingyu","year":"2020","unstructured":"Qingyu Guo , Fuzhen Zhuang , Chuan Qin , Hengshu Zhu , Xing Xie , Hui Xiong , and Qing He. 2020. A Survey on Knowledge Graph-Based Recommender Systems. CoRR ( 2020 ). Qingyu Guo, Fuzhen Zhuang, Chuan Qin, Hengshu Zhu, Xing Xie, Hui Xiong, and Qing He. 2020. A Survey on Knowledge Graph-Based Recommender Systems. CoRR (2020)."},{"key":"e_1_3_2_1_11_1","volume-title":"Lukas Block, and Maximilian Werner","author":"Herrmann Florian","year":"2021","unstructured":"Florian Herrmann , Sebastian Stegm\u00fcller , Lukas Block, and Maximilian Werner . 2021 . Keynote Speech Disruption in mobility--new trends, new concepts and new business models?! In Vehicles of Tomorrow 2019. Springer , 1--9. Florian Herrmann, Sebastian Stegm\u00fcller, Lukas Block, and Maximilian Werner. 2021. Keynote Speech Disruption in mobility--new trends, new concepts and new business models?! In Vehicles of Tomorrow 2019. Springer, 1--9."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_12_1","DOI":"10.1145\/3209978.3210017"},{"unstructured":"IAB. 2021. A Guide to Modernized Contextual Advertising. Industry Paper. http:\/\/iabcanada.com\/content\/uploads\/2021\/04\/IABCanadaContextualAdvertising_ 043021.pdf  IAB. 2021. A Guide to Modernized Contextual Advertising. Industry Paper. http:\/\/iabcanada.com\/content\/uploads\/2021\/04\/IABCanadaContextualAdvertising_ 043021.pdf","key":"e_1_3_2_1_13_1"},{"key":"e_1_3_2_1_14_1","volume-title":"Reinforcement learning with unsupervised auxiliary tasks. arXiv preprint arXiv:1611.05397","author":"Jaderberg Max","year":"2016","unstructured":"Max Jaderberg , Volodymyr Mnih , Wojciech Marian Czarnecki , Tom Schaul , Joel Z Leibo , David Silver , and Koray Kavukcuoglu . 2016. Reinforcement learning with unsupervised auxiliary tasks. arXiv preprint arXiv:1611.05397 ( 2016 ). Max Jaderberg, Volodymyr Mnih,Wojciech Marian Czarnecki, Tom Schaul, Joel Z Leibo, David Silver, and Koray Kavukcuoglu. 2016. Reinforcement learning with unsupervised auxiliary tasks. arXiv preprint arXiv:1611.05397 (2016)."},{"volume-title":"ATM Forum contribution","author":"Jain Raj","unstructured":"Raj Jain , Arjan Durresi , and Gojko Babic . 1999. Throughput fairness index: An explanation . In ATM Forum contribution , Vol. 99 . Raj Jain, Arjan Durresi, and Gojko Babic. 1999. Throughput fairness index: An explanation. In ATM Forum contribution, Vol. 99.","key":"e_1_3_2_1_15_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_16_1","DOI":"10.1145\/3269206.3272021"},{"key":"e_1_3_2_1_17_1","volume-title":"Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907","author":"Kipf Thomas N","year":"2016","unstructured":"Thomas N Kipf and MaxWelling. 2016. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 ( 2016 ). Thomas N Kipf and MaxWelling. 2016. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016)."},{"unstructured":"Minne Li Zhiwei Qin Yan Jiao Yaodong Yang Jun Wang Chenxi Wang Guobin Wu and Jieping Ye. 2019. Efficient ridesharing order dispatching with mean field multi-agent reinforcement learning. In The world wide web conference. 983--994.  Minne Li Zhiwei Qin Yan Jiao Yaodong Yang Jun Wang Chenxi Wang Guobin Wu and Jieping Ye. 2019. Efficient ridesharing order dispatching with mean field multi-agent reinforcement learning. In The world wide web conference. 983--994.","key":"e_1_3_2_1_18_1"},{"key":"e_1_3_2_1_19_1","volume-title":"Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971","author":"Lillicrap Timothy P","year":"2015","unstructured":"Timothy P Lillicrap , Jonathan J Hunt , Alexander Pritzel , Nicolas Heess , Tom Erez , Yuval Tassa , David Silver , and Daan Wierstra . 2015. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971 ( 2015 ). Timothy P Lillicrap, Jonathan J Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra. 2015. Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971 (2015)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_20_1","DOI":"10.5555\/2886521.2886624"},{"key":"e_1_3_2_1_21_1","volume-title":"OpenAI Pieter Abbeel, and Igor Mordatch","author":"Lowe Ryan","year":"2017","unstructured":"Ryan Lowe , Yi I Wu , Aviv Tamar , Jean Harb , OpenAI Pieter Abbeel, and Igor Mordatch . 2017 . Multi-agent actor-critic for mixed cooperative-competitive environments. Advances in neural information processing systems 30 (2017). Ryan Lowe, Yi I Wu, Aviv Tamar, Jean Harb, OpenAI Pieter Abbeel, and Igor Mordatch. 2017. Multi-agent actor-critic for mixed cooperative-competitive environments. Advances in neural information processing systems 30 (2017)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_22_1","DOI":"10.1145\/3340531.3412721"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_23_1","DOI":"10.1145\/2339530.2339655"},{"unstructured":"PWC. 2021. Internet Advertising Revenue Report. https:\/\/www.iab.com\/wpcontent\/ uploads\/2021\/04\/IAB_2020-Internet-Advertising-Revenue-Report- Webinar_4.7.21-PwC-1.pdf  PWC. 2021. Internet Advertising Revenue Report. https:\/\/www.iab.com\/wpcontent\/ uploads\/2021\/04\/IAB_2020-Internet-Advertising-Revenue-Report- Webinar_4.7.21-PwC-1.pdf","key":"e_1_3_2_1_24_1"},{"unstructured":"R. Qian. 2013. Understand your world with Bing. Bing search blog. https:\/\/blogs.bing.com\/search\/2013\/03\/21\/understand-your-world-with-bing\/  R. Qian. 2013. Understand your world with Bing. Bing search blog. https:\/\/blogs.bing.com\/search\/2013\/03\/21\/understand-your-world-with-bing\/","key":"e_1_3_2_1_25_1"},{"key":"e_1_3_2_1_26_1","volume-title":"BPR: Bayesian personalized ranking from implicit feedback. arXiv preprint arXiv:1205.2618","author":"Rendle Steffen","year":"2012","unstructured":"Steffen Rendle , Christoph Freudenthaler , Zeno Gantner , and Lars Schmidt-Thieme . 2012 . BPR: Bayesian personalized ranking from implicit feedback. arXiv preprint arXiv:1205.2618 (2012). Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2012. BPR: Bayesian personalized ranking from implicit feedback. arXiv preprint arXiv:1205.2618 (2012)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_27_1","DOI":"10.1145\/2806416.2806528"},{"key":"e_1_3_2_1_28_1","volume-title":"Graph attention networks. arXiv preprint arXiv:1710.10903","author":"Velickovi\u0107 Petar","year":"2017","unstructured":"Petar Velickovi\u0107 , Guillem Cucurull , Arantxa Casanova , Adriana Romero , Pietro Lio , and Yoshua Bengio . 2017. Graph attention networks. arXiv preprint arXiv:1710.10903 ( 2017 ). Petar Velickovi\u0107, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. 2017. Graph attention networks. arXiv preprint arXiv:1710.10903 (2017)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_29_1","DOI":"10.1145\/3269206.3271739"},{"doi-asserted-by":"crossref","unstructured":"Hongwei Wang Fuzheng Zhang Miao Zhao Wenjie Li Xing Xie and Minyi Guo. 2019. Multi-task feature learning for knowledge graph enhanced recommendation. In The world wide web conference. 2000--2010.  Hongwei Wang Fuzheng Zhang Miao Zhao Wenjie Li Xing Xie and Minyi Guo. 2019. Multi-task feature learning for knowledge graph enhanced recommendation. In The world wide web conference. 2000--2010.","key":"e_1_3_2_1_30_1","DOI":"10.1145\/3308558.3313411"},{"key":"e_1_3_2_1_31_1","volume-title":"Display advertising with realtime bidding (RTB) and behavioural targeting. arXiv preprint arXiv:1610.03013","author":"Wang Jun","year":"2016","unstructured":"Jun Wang , Weinan Zhang , and Shuai Yuan . 2016. Display advertising with realtime bidding (RTB) and behavioural targeting. arXiv preprint arXiv:1610.03013 ( 2016 ). Jun Wang, Weinan Zhang, and Shuai Yuan. 2016. Display advertising with realtime bidding (RTB) and behavioural targeting. arXiv preprint arXiv:1610.03013 (2016)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_32_1","DOI":"10.1145\/3397271.3401134"},{"key":"e_1_3_2_1_33_1","volume-title":"Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining. 950--958","author":"He Xiangnan","year":"2019","unstructured":"XiangWang, Xiangnan He , Yixin Cao , Meng Liu , and Tat-Seng Chua . 2019 . KGAT: Knowledge graph attention network for recommendation . In Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining. 950--958 . XiangWang, Xiangnan He, Yixin Cao, Meng Liu, and Tat-Seng Chua. 2019. KGAT: Knowledge graph attention network for recommendation. In Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining. 950--958."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_34_1","DOI":"10.1145\/3331184.3331267"},{"key":"e_1_3_2_1_35_1","volume-title":"Ladder: A human-level bidding agent for large-scale real-time online auctions. arXiv preprint arXiv:1708.05565","author":"Wang Yu","year":"2017","unstructured":"Yu Wang , Jiayi Liu , Yuxiang Liu , Jun Hao , Yang He , Jinghe Hu , Weipeng P Yan , and Mantian Li . 2017 . Ladder: A human-level bidding agent for large-scale real-time online auctions. arXiv preprint arXiv:1708.05565 (2017). Yu Wang, Jiayi Liu, Yuxiang Liu, Jun Hao, Yang He, Jinghe Hu, Weipeng P Yan, and Mantian Li. 2017. Ladder: A human-level bidding agent for large-scale real-time online auctions. arXiv preprint arXiv:1708.05565 (2017)."},{"unstructured":"Web Incubator CG. 2021. Federated Learning of Cohorts (FLoC). Technical Specification. https:\/\/github.com\/WICG\/floc  Web Incubator CG. 2021. Federated Learning of Cohorts (FLoC). Technical Specification. https:\/\/github.com\/WICG\/floc","key":"e_1_3_2_1_36_1"},{"key":"e_1_3_2_1_37_1","volume-title":"Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. 1129--1139","author":"Xu Miao","year":"2022","unstructured":"ChaoWen, Miao Xu , Zhilin Zhang , Zhenzhe Zheng , YuhuiWang, Xiangyu Liu , Yu Rong , Dong Xie , Xiaoyang Tan , Chuan Yu , 2022 . A Cooperative-Competitive Multi-Agent Framework for Auto-bidding in Online Advertising . In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. 1129--1139 . ChaoWen, Miao Xu, Zhilin Zhang, Zhenzhe Zheng, YuhuiWang, Xiangyu Liu, Yu Rong, Dong Xie, Xiaoyang Tan, Chuan Yu, et al. 2022. A Cooperative-Competitive Multi-Agent Framework for Auto-bidding in Online Advertising. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. 1129--1139."},{"key":"e_1_3_2_1_38_1","volume-title":"A multi-agent reinforcement learning method for impression allocation in online display advertising. arXiv preprint arXiv:1809.03152","author":"Wu Di","year":"2018","unstructured":"Di Wu , Cheng Chen , Xun Yang , Xiujun Chen , Qing Tan , Jian Xu , and Kun Gai . 2018. A multi-agent reinforcement learning method for impression allocation in online display advertising. arXiv preprint arXiv:1809.03152 ( 2018 ). Di Wu, Cheng Chen, Xun Yang, Xiujun Chen, Qing Tan, Jian Xu, and Kun Gai. 2018. A multi-agent reinforcement learning method for impression allocation in online display advertising. arXiv preprint arXiv:1809.03152 (2018)."},{"key":"e_1_3_2_1_39_1","volume-title":"International Conference on Machine Learning. PMLR, 5453--5462","author":"Xu Keyulu","year":"2018","unstructured":"Keyulu Xu , Chengtao Li , Yonglong Tian , Tomohiro Sonobe , Ken-ichi Kawarabayashi, and Stefanie Jegelka . 2018 . Representation learning on graphs with jumping knowledge networks . In International Conference on Machine Learning. PMLR, 5453--5462 . Keyulu Xu, Chengtao Li, Yonglong Tian, Tomohiro Sonobe, Ken-ichi Kawarabayashi, and Stefanie Jegelka. 2018. Representation learning on graphs with jumping knowledge networks. In International Conference on Machine Learning. PMLR, 5453--5462."},{"key":"e_1_3_2_1_40_1","volume-title":"International Conference on Machine Learning. PMLR, 5571--5580","author":"Yang Yaodong","year":"2018","unstructured":"Yaodong Yang , Rui Luo , Minne Li , Ming Zhou , Weinan Zhang , and Jun Wang . 2018 . Mean field multi-agent reinforcement learning . In International Conference on Machine Learning. PMLR, 5571--5580 . Yaodong Yang, Rui Luo, Minne Li, Ming Zhou, Weinan Zhang, and Jun Wang. 2018. Mean field multi-agent reinforcement learning. In International Conference on Machine Learning. PMLR, 5571--5580."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_41_1","DOI":"10.1145\/2939672.2939673"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_42_1","DOI":"10.1145\/2623330.2623633"},{"key":"e_1_3_2_1_43_1","volume-title":"Real-time bidding benchmarking with ipinyou dataset. arXiv preprint arXiv:1407.7073","author":"Zhang Weinan","year":"2014","unstructured":"Weinan Zhang , Shuai Yuan , JunWang, and Xuehua Shen . 2014. Real-time bidding benchmarking with ipinyou dataset. arXiv preprint arXiv:1407.7073 ( 2014 ). Weinan Zhang, Shuai Yuan, JunWang, and Xuehua Shen. 2014. Real-time bidding benchmarking with ipinyou dataset. arXiv preprint arXiv:1407.7073 (2014)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_44_1","DOI":"10.1145\/3097983.3098063"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_45_1","DOI":"10.1162\/dint_a_00008"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_46_1","DOI":"10.1145\/3397271.3401174"}],"event":{"sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"],"acronym":"CIKM '22","name":"CIKM '22: The 31st ACM International Conference on Information and Knowledge Management","location":"Atlanta GA USA"},"container-title":["Proceedings of the 31st ACM International Conference on Information & Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3511808.3557373","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3511808.3557373","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:29Z","timestamp":1750182569000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3511808.3557373"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,17]]},"references-count":46,"alternative-id":["10.1145\/3511808.3557373","10.1145\/3511808"],"URL":"https:\/\/doi.org\/10.1145\/3511808.3557373","relation":{},"subject":[],"published":{"date-parts":[[2022,10,17]]},"assertion":[{"value":"2022-10-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}