{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T19:12:11Z","timestamp":1790795531302,"version":"4.1.0"},"reference-count":133,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2025,2,10]],"date-time":"2025-02-10T00:00:00Z","timestamp":1739145600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Research Foundation Singapore and DSO National Laboratories","award":["AISG2-RP-2020-019"],"award-info":[{"award-number":["AISG2-RP-2020-019"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2025,6,30]]},"abstract":"<jats:p>Artificial intelligence-empowered Real-Time Bidding (AIRTB) is regarded as one of the most enabling technologies for online advertising. It has attracted significant research attention from diverse fields such as pattern recognition, game theory, and mechanism design. Despite its remarkable development and deployment, the AIRTB system can sometimes work against the interests of its participants (e.g., depleting the advertisers\u2019 budget with various kinds of fraud). As such, building trustworthy AIRTB auctioning systems has emerged as an important direction of research in this field in recent years. Owing to the highly interdisciplinary nature of this field and a lack of a comprehensive survey, it is a challenge for researchers to enter this field and contribute towards building trustworthy AIRTB technologies. This article bridges this important gap in trustworthy AIRTB literature. We start by analyzing the key concerns of various AIRTB stakeholders and identify five main dimensions of trust building in AIRTB: robustness, explainability, fairness, auditability and accountability, and environmental well-being. For each of these dimensions, we propose a unique taxonomy of the state-of-the-art, trace the root causes of possible breakdown of trust, and discuss the necessity of the given dimension. This is followed by a comprehensive review of existing strategies for fulfilling the requirements of each trust dimension. In addition, we discuss the promising future directions of research essential towards building trustworthy AIRTB systems to benefit the field of online advertising.<\/jats:p>","DOI":"10.1145\/3701741","type":"journal-article","created":{"date-parts":[[2025,1,10]],"date-time":"2025-01-10T06:20:58Z","timestamp":1736490058000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Towards Trustworthy AI-Empowered Real-Time Bidding for Online Advertisement Auctioning"],"prefix":"10.1145","volume":"57","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1967-2953","authenticated-orcid":false,"given":"Xiaoli","family":"Tang","sequence":"first","affiliation":[{"name":"Nanyang Technological University, Singapore, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6893-8650","authenticated-orcid":false,"given":"Han","family":"Yu","sequence":"additional","affiliation":[{"name":"Nanyang Technological University, Singapore Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,2,10]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-10-8360-0_23"},{"key":"e_1_3_2_3_2","doi-asserted-by":"crossref","unstructured":"Abbas Acar Hidayet Aksu A. Selcuk Uluagac and Mauro Conti. 2018. A survey on homomorphic encryption schemes: Theory and implementation. ACM Computing Surveys (Csur) 51 4 (2018) 1\u201335.","DOI":"10.1145\/3214303"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3359301"},{"key":"e_1_3_2_5_2","doi-asserted-by":"crossref","unstructured":"Ashiq Anjum Manu Sporny and Alan Sill. 2017. Blockchain standards for compliance and trust. IEEE Cloud Computing 4 4 (2017) 84\u201390.","DOI":"10.1109\/MCC.2017.3791019"},{"key":"e_1_3_2_6_2","doi-asserted-by":"crossref","unstructured":"Vinod Anupam Alain Mayer Kobbi Nissim Benny Pinkas and Michael K. Reiter. 1999. On the security of pay-per-click and other web advertising schemes. Computer Networks 31 11\u201316 (1999) 1091\u20131100.","DOI":"10.1016\/S1389-1286(99)00023-7"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/INFCOM.1999.751458"},{"issue":"1","key":"e_1_3_2_8_2","first-page":"1","article-title":"Click fraud detection in mobile ads served in programmatic inventory","volume":"1","author":"Badhe Anup","year":"2017","unstructured":"Anup Badhe. 2017. Click fraud detection in mobile ads served in programmatic inventory. Neural Networks & Machine Learning 1, 1 (2017), 1\u20131.","journal-title":"Neural Networks & Machine Learning"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.58496\/MJBD\/2023\/009"},{"key":"e_1_3_2_10_2","first-page":"9607","volume-title":"AISTATS","author":"Balcan Maria-Florina","year":"2023","unstructured":"Maria-Florina Balcan, Rattana Pukdee, Pradeep Ravikumar, and Hongyang Zhang. 2023. Nash equilibria and pitfalls of adversarial training in adversarial robustness games. In AISTATS. 9607\u20139636."},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.leaqua.2022.101673"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-015-0827-6"},{"key":"e_1_3_2_13_2","unstructured":"Miles Brundage Shahar Avin Jasmine Wang Haydn Belfield Gretchen Krueger Gillian Hadfield Heidy Khlaaf Jingying Yang Helen Toner Ruth Fong and others. 2020. Toward trustworthy AI development: Mechanisms for supporting verifiable claims. arXiv preprint arXiv:2004.07213 (2020)."},{"key":"e_1_3_2_14_2","first-page":"1","article-title":"Threats to online advertising and countermeasures: A technical survey","volume":"1","author":"Cai Yegui","year":"2020","unstructured":"Yegui Cai, George O. M. Yee, Yuan Xiang Gu, and Chung-Horng Lung. 2020. Threats to online advertising and countermeasures: A technical survey. DTRAP 1 (2020), 1\u201327.","journal-title":"DTRAP"},{"key":"e_1_3_2_15_2","doi-asserted-by":"crossref","unstructured":"Patricia Callejo Ruben Cuevas Angel Cuevas and Mikko Kotila. 2016. Independent auditing of online display advertising campaigns. In Proceedings of the 15th ACM Workshop on Hot Topics in Networks. 120\u2013126.","DOI":"10.1145\/3005745.3005752"},{"issue":"4","key":"e_1_3_2_16_2","first-page":"1285","article-title":"AdSherlock: Efficient and deployable click fraud detection for mobile applications","volume":"20","author":"Cao Chenhong","year":"2020","unstructured":"Chenhong Cao, Yi Gao, Yang Luo, Mingyuan Xia, Wei Dong, Chun Chen, and Xue Liu. 2020. AdSherlock: Efficient and deployable click fraud detection for mobile applications. TMC 20, 4 (2020), 1285\u20131297.","journal-title":"TMC"},{"key":"e_1_3_2_17_2","first-page":"4456","volume-title":"ICMLC","author":"Celis Elisa","year":"2019","unstructured":"Elisa Celis, Anay Mehrotra, and Nisheeth Vishnoi. 2019. Toward controlling discrimination in online ad auctions. In ICMLC. 4456\u20134465."},{"key":"e_1_3_2_18_2","doi-asserted-by":"crossref","unstructured":"L. Elisa Celis Sayash Kapoor Farnood Salehi and Nisheeth Vishnoi. 2019. Controlling polarization in personalization: An algorithmic framework. In Proceedings of the Conference on Fairness Accountability and Transparency. 160\u2013169.","DOI":"10.1145\/3287560.3287601"},{"key":"e_1_3_2_19_2","doi-asserted-by":"crossref","unstructured":"Yueting Chai Chunyan Miao Baowen Sun Yongqing Zheng and Qingzhong Li. 2017. Crowd science and engineering: Concept and research framework. International Journal of Crowd Science 1 1 (2017) 2\u20138.","DOI":"10.1108\/IJCS-01-2017-0004"},{"key":"e_1_3_2_20_2","first-page":"42:1\u201342:21","volume-title":"ITCS","author":"Chawla Shuchi","year":"2022","unstructured":"Shuchi Chawla and Meena Jagadeesan. 2022. Individual fairness in advertising auctions through inverse proportionality. In ITCS. 42:1\u201342:21."},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/2594368.2594391"},{"key":"e_1_3_2_22_2","article-title":"Automated experiments on ad privacy settings: A tale of opacity, choice, and discrimination","author":"Datta Amit","year":"2014","unstructured":"Amit Datta, Michael Carl Tschantz, and Anupam Datta. 2014. Automated experiments on ad privacy settings: A tale of opacity, choice, and discrimination. arXiv:1408.6491 (2014).","journal-title":"arXiv:1408.6491"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/2342356.2342394"},{"key":"e_1_3_2_24_2","first-page":"765","volume-title":"CCS","author":"Dave Vacha","year":"2013","unstructured":"Vacha Dave, Saikat Guha, and Yin Zhang. 2013. ViceROI: Catching click-spam in search ad networks. In CCS. 765\u2013776."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3439729"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-13708-2_32"},{"key":"e_1_3_2_27_2","first-page":"297","volume-title":"ACSAC","author":"Dong Xinshu","year":"2011","unstructured":"Xinshu Dong, Minh Tran, Zhenkai Liang, and Xuxian Jiang. 2011. AdSentry: Comprehensive and flexible confinement of JavaScript-based advertisements. In ACSAC. 297\u2013306."},{"issue":"4","key":"e_1_3_2_28_2","first-page":"12","article-title":"A game of clicks: Economic incentives to fight click fraud in ad networks","volume":"41","author":"Dritsoula Lemonia","year":"2014","unstructured":"Lemonia Dritsoula and John Musacchio. 2014. A game of clicks: Economic incentives to fight click fraud in ad networks. PER 41, 4 (2014), 12\u201315.","journal-title":"PER"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.5555\/1791834.1791836"},{"key":"e_1_3_2_30_2","article-title":"Fairness under composition","author":"Dwork Cynthia","year":"2018","unstructured":"Cynthia Dwork and Christina Ilvento. 2018. Fairness under composition. arXiv:1806.06122 (2018).","journal-title":"arXiv:1806.06122"},{"key":"e_1_3_2_31_2","first-page":"277","volume-title":"OTM","author":"Ioini Nabil El","year":"2018","unstructured":"Nabil El Ioini and Claus Pahl. 2018. A review of distributed ledger technologies. In OTM. 277\u2013288."},{"key":"e_1_3_2_32_2","first-page":"1388","volume-title":"CCS","author":"Englehardt Steven","year":"2016","unstructured":"Steven Englehardt and Arvind Narayanan. 2016. Online tracking: A 1-million-site measurement and analysis. In CCS. 1388\u20131401."},{"issue":"1","key":"e_1_3_2_33_2","first-page":"32","article-title":"Online advertising: Analysis of privacy threats and protection approaches","volume":"100","author":"Estrada-Jim\u00e9nez Jos\u00e9","year":"2017","unstructured":"Jos\u00e9 Estrada-Jim\u00e9nez, Javier Parra-Arnau, Ana Rodr\u00edguez-Hoyos, and Jordi Forn\u00e9. 2017. Online advertising: Analysis of privacy threats and protection approaches. CC 100, 1 (2017), 32\u201351.","journal-title":"CC"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/2046614.2046618"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/28395.28419"},{"key":"e_1_3_2_36_2","first-page":"363","volume-title":"ACSAC","author":"Ford Sean","year":"2009","unstructured":"Sean Ford et\u00a0al. 2009. Analyzing and detecting malicious Flash advertisements. In ACSAC. 363\u2013372."},{"issue":"2","key":"e_1_3_2_37_2","first-page":"131","article-title":"Badvertisements: Stealthy click-fraud with unwitting accessories","volume":"1","author":"Gandhi Mona","year":"2006","unstructured":"Mona Gandhi et\u00a0al. 2006. Badvertisements: Stealthy click-fraud with unwitting accessories. JDFP 1, 2 (2006), 131\u2013142.","journal-title":"JDFP"},{"key":"e_1_3_2_38_2","article-title":"Advertising for demographically fair outcomes","author":"Gelauff Lodewijk","year":"2020","unstructured":"Lodewijk Gelauff et\u00a0al. 2020. Advertising for demographically fair outcomes. arXiv:2006.03983 (2020).","journal-title":"arXiv:2006.03983"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1100.1246"},{"issue":"110","key":"e_1_3_2_40_2","article-title":"Secure multi-party computation","volume":"78","author":"Goldreich Oded","year":"1998","unstructured":"Oded Goldreich. 1998. Secure multi-party computation. Manuscript. Preliminary version 78, 110 pages (1998).","journal-title":"Manuscript. Preliminary version"},{"key":"e_1_3_2_41_2","doi-asserted-by":"crossref","unstructured":"Oded Goldreich Silvio Micali and Avi Wigderson. 1986. Proofs that yield nothing but their validity and a methodology of cryptographic protocol design. In 27th Annual Symposium on Foundations of Computer Science (sfcs 1986). 174\u2013187.","DOI":"10.1109\/SFCS.1986.47"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/2185448.2185464"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2021.3116976"},{"issue":"2","key":"e_1_3_2_44_2","first-page":"21","article-title":"Fighting online click-fraud using bluff ads","volume":"40","author":"Haddadi Hamed","year":"2010","unstructured":"Hamed Haddadi. 2010. Fighting online click-fraud using bluff ads. CCR 40, 2 (2010), 21\u201325.","journal-title":"CCR"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICC.2017.7996807"},{"issue":"6","key":"e_1_3_2_46_2","first-page":"1257","article-title":"A Bayesian game theoretic approach for inspecting web-based malvertising","volume":"17","author":"Huang Chin-Tser","year":"2018","unstructured":"Chin-Tser Huang, Muhammad N. Sakib, Charles A. Kamhoua, Kevin A. Kwiat, and Laurent Njilla. 2018. A Bayesian game theoretic approach for inspecting web-based malvertising. TDSC 17, 6 (2018), 1257\u20131268.","journal-title":"TDSC"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/WGEC.2008.45"},{"key":"e_1_3_2_48_2","unstructured":"IAB. 2016. IAB Tech Lab Publisher Ad Blocking Primer. (2016). Retrieved June 1 2022 from https:\/\/www.iab.com\/wp-content\/uploads\/2016\/03\/IABTechLab_Publisher_AdBlocking_Primer.pdf"},{"key":"e_1_3_2_49_2","first-page":"348","volume-title":"FAT","author":"Ilvento Christina","year":"2020","unstructured":"Christina Ilvento et\u00a0al. 2020. Multi-category fairness in sponsored search auctions. In FAT. 348\u2013358."},{"key":"e_1_3_2_50_2","first-page":"3767","volume-title":"WWW","author":"Imana Basileal","year":"2021","unstructured":"Basileal Imana et\u00a0al. 2021. Auditing for discrimination in algorithms delivering job ads. In WWW. 3767\u20133778."},{"issue":"3","key":"e_1_3_2_51_2","first-page":"e1871","article-title":"Protecting Internet users from becoming victimized attackers of click-fraud","volume":"30","author":"Iqbal Md. Shahrear","year":"2018","unstructured":"Md. Shahrear Iqbal, Mohammad Zulkernine, Fehmi Jaafar, and Yuan Gu. 2018. Protecting Internet users from becoming victimized attackers of click-fraud. JSEP 30, 3 (2018), e1871.","journal-title":"JSEP"},{"key":"e_1_3_2_52_2","article-title":"AdGraph: A machine learning approach to automatic and effective adblocking","author":"Iqbal Umar","year":"2018","unstructured":"Umar Iqbal et\u00a0al. 2018. AdGraph: A machine learning approach to automatic and effective adblocking. arXiv:1805.09155 (2018).","journal-title":"arXiv:1805.09155"},{"key":"e_1_3_2_53_2","unstructured":"J. Chen D. Lin A. Kaufman and Y. Villa. 2014. Click stream analysis for fraud detection. (2014). Retrieved June 1 2022 from https:\/\/patents.google.com\/patent\/US8880441"},{"key":"e_1_3_2_54_2","unstructured":"Lauren Johnson. 2018. Procter & Gamble Cut Up to $140 Million in Digital Ad Spending Because of Brand Safety Concerns. (2018). https:\/\/www.straitstimes.com\/business\/companies-markets\/procter-gamble-makes-us100m-cutback-on-ineffective-digital-ads"},{"key":"e_1_3_2_55_2","first-page":"17","volume-title":"USENIX Security","author":"Juels Ari","year":"2007","unstructured":"Ari Juels, Sid Stamm, and Markus Jakobsson. 2007. Combating click fraud via premium clicks. In USENIX Security. 17\u201326."},{"key":"e_1_3_2_56_2","first-page":"467","volume-title":"AAMAS","author":"Kamar Ece","year":"2012","unstructured":"Ece Kamar, Severin Hacker, and Eric Horvitz. 2012. Combining human and machine intelligence in large-scale crowdsourcing. In AAMAS, Vol. 12. 467\u2013474."},{"key":"e_1_3_2_57_2","doi-asserted-by":"crossref","unstructured":"Sarit Kraus Yaniv Oshrat Yonatan Aumann Tal Hollander Oleg Maksimov Anita Ostroumov and Natali Shechtman. 2023. Customer service combining human operators and virtual agents: A call for multidisciplinary AI research. (2023).","DOI":"10.1609\/aaai.v37i13.26795"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2018.2887322"},{"key":"e_1_3_2_59_2","article-title":"ProportionNet: Balancing fairness and revenue for auction design with deep learning","author":"Kuo Kevin","year":"2020","unstructured":"Kevin Kuo, Anthony Ostuni, Elizabeth Horishny, Michael J. Curry, Samuel Dooley, Ping-yeh Chiang, Tom Goldstein, and John P. Dickerson. 2020. ProportionNet: Balancing fairness and revenue for auction design with deep learning. arXiv:2010.06398 (2020).","journal-title":"arXiv:2010.06398"},{"key":"e_1_3_2_60_2","first-page":"728","article-title":"Fairness without demographics through adversarially reweighted learning","author":"Lahoti Preethi","year":"2020","unstructured":"Preethi Lahoti, Alex Beutel, Jilin Chen, Kang Lee, Flavien Prost, Nithum Thain, Xuezhi Wang, and Ed Chi. 2020. Fairness without demographics through adversarially reweighted learning. NIPS, 728\u2013740.","journal-title":"NIPS"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2018.3093"},{"key":"e_1_3_2_62_2","unstructured":"Larry Kim. 2011. The Most Expensive Keywords in Google Adwords. (2011). Retrieved June 1 2022 from https:\/\/www.wordstream.com\/blog\/ws\/2011\/07\/18\/most-expensive-keywords-google-adwords"},{"key":"e_1_3_2_63_2","doi-asserted-by":"publisher","DOI":"10.1145\/2742647.2742676"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/2556195.2556214"},{"key":"e_1_3_2_65_2","first-page":"674","volume-title":"CCS","author":"Li Zhou","year":"2012","unstructured":"Zhou Li, Kehuan Zhang, Yinglian Xie, Fang Yu, and XiaoFeng Wang. 2012. Knowing your enemy: understanding and detecting malicious web advertising. In CCS. 674\u2013686."},{"key":"e_1_3_2_66_2","first-page":"57","volume-title":"NSDI","author":"Liu Bin","year":"2014","unstructured":"Bin Liu, Suman Nath, Ramesh Govindan, and Jie Liu. 2014. DECAF: Detecting and characterizing ad fraud in mobile apps. In NSDI. 57\u201370."},{"key":"e_1_3_2_67_2","article-title":"Trustworthy AI: A computational perspective","author":"Liu Haochen","year":"2022","unstructured":"Haochen Liu, Yiqi Wang, Wenqi Fan, Xiaorui Liu, Yaxin Li, Shaili Jain, Yunhao Liu, Anil K. Jain, and Jiliang Tang. 2022. Trustworthy AI: A computational perspective. TIST (2022), 1\u201359.","journal-title":"TIST"},{"issue":"10","key":"e_1_3_2_68_2","first-page":"1810","article-title":"Research progress of real-time bidding for display advertising","volume":"43","author":"Liu Mengjuan","year":"2020","unstructured":"Mengjuan Liu, Wei Yue, Lizhou Qiu, Jiaxing Li, and Zhiguang Qin. 2020. Research progress of real-time bidding for display advertising. Chinese Journal of Computers 43, 10 (2020), 1810\u20131841.","journal-title":"Chinese Journal of Computers"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1109\/TGCN.2022.3158004"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/2660460.2660475"},{"key":"e_1_3_2_71_2","unstructured":"Scott M. Lundberg and Su-In Lee. 2017. A unified approach to interpreting model predictions. In Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS\u201917). 4768\u20134777."},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/3457607"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.14722\/ndss.2016.23353"},{"key":"e_1_3_2_74_2","first-page":"537","volume-title":"ISMIR","author":"Mishra Saumitra","year":"2017","unstructured":"Saumitra Mishra, Bob L. Sturm, and Simon Dixon. 2017. Local interpretable model-agnostic explanations for music content analysis. In ISMIR, Vol. 53. 537\u2013543."},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24315-3_11"},{"key":"e_1_3_2_76_2","volume-title":"Should ad networks bother fighting click fraud?(yes, they should.)","author":"Mungamuru Bob","year":"2008","unstructured":"Bob Mungamuru, Stephen Weis, and Hector Garcia-Molina. 2008. Should ad networks bother fighting click fraud?(yes, they should.). Technical Report. Stanford University."},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.1287\/moor.6.1.58"},{"key":"e_1_3_2_78_2","first-page":"337","volume-title":"FAT","author":"Nasr Milad","year":"2020","unstructured":"Milad Nasr and Michael Carl Tschantz. 2020. Bidding strategies with gender nondiscrimination constraints for online ad auctions. In FAT. 337\u2013347."},{"key":"e_1_3_2_79_2","first-page":"1","volume-title":"FOCI","author":"Nithyanand Rishab","year":"2016","unstructured":"Rishab Nithyanand et\u00a0al. 2016. Adblocking and counter blocking: A slice of the arms race. In FOCI. 1\u20137."},{"key":"e_1_3_2_80_2","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2627438"},{"key":"e_1_3_2_81_2","first-page":"1840","article-title":"Privacy preserving secure online advertising","volume":"195","author":"Oger Mustafa","year":"2015","unstructured":"Mustafa Oger, Isa Olmez, Erinc Inci, Serkan K\u00fcc\u00fckbay, and Fatih Emekci. 2015. Privacy preserving secure online advertising. PSBS 195 (2015), 1840\u20131845.","journal-title":"PSBS"},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.1145\/2381966.2381968"},{"key":"e_1_3_2_83_2","volume-title":"ISPRS","author":"Ozturk D.","year":"2011","unstructured":"D. Ozturk and F. Batuk. 2011. Technique for order preference by similarity to ideal solution (TOPSIS) for spatial decision problems. In ISPRS, Vol. 1."},{"key":"e_1_3_2_84_2","first-page":"141","volume-title":"CCS","author":"Pearce Paul","year":"2014","unstructured":"Paul Pearce et\u00a0al. 2014. Characterizing large-scale click fraud in zeroaccess. In CCS. 141\u2013152."},{"key":"e_1_3_2_85_2","doi-asserted-by":"publisher","DOI":"10.1145\/2414456.2414498"},{"key":"e_1_3_2_86_2","unstructured":"Neehar Peri Michael Curry Samuel Dooley and John Dickerson. 2021. PreferenceNet: Encoding human preferences in auction design with deep learning. (2021) 17532\u201317542."},{"key":"e_1_3_2_87_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2021.3118271"},{"key":"e_1_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-10-2035-3_23"},{"key":"e_1_3_2_89_2","first-page":"140","volume-title":"ICIS","author":"Ray Abhishek","year":"2017","unstructured":"Abhishek Ray, Hossein Ghasemkhani, and Karthik N. Kannan. 2017. Ad-blockers, advertisers, and Internet: The economic implications of ad-blocker platforms. In ICIS. 140\u2013152."},{"key":"e_1_3_2_90_2","first-page":"2016","article-title":"Regulation (EU) 2016\/679 of the European Parliament and of the Council","volume":"679","author":"Regulation Protection","year":"2016","unstructured":"Protection Regulation. 2016. Regulation (EU) 2016\/679 of the European Parliament and of the Council. Regulation (EU) 679 (2016), 2016.","journal-title":"Regulation (EU)"},{"key":"e_1_3_2_91_2","first-page":"31","volume-title":"NSDI","author":"Reis Charles","year":"2008","unstructured":"Charles Reis, Steven D. Gribble, Tadayoshi Kohno, and Nicholas C. Weaver. 2008. Detecting in-flight page changes with web tripwires. In NSDI, Vol. 8. 31\u201344."},{"key":"e_1_3_2_92_2","first-page":"116","volume-title":"CCS","author":"Reznichenko Alexey","year":"2014","unstructured":"Alexey Reznichenko and Paul Francis. 2014. Private-by-design advertising meets the real world. In CCS. 116\u2013128."},{"key":"e_1_3_2_93_2","doi-asserted-by":"publisher","DOI":"10.1201\/9781003102670-2"},{"key":"e_1_3_2_94_2","doi-asserted-by":"publisher","DOI":"10.1038\/s43017-023-00431-y"},{"key":"e_1_3_2_95_2","doi-asserted-by":"publisher","DOI":"10.1145\/2660460.2660477"},{"key":"e_1_3_2_96_2","doi-asserted-by":"publisher","DOI":"10.1109\/Trustcom.2015.539"},{"key":"e_1_3_2_97_2","doi-asserted-by":"publisher","DOI":"10.1145\/3306618.3314248"},{"key":"e_1_3_2_98_2","first-page":"553","volume-title":"USENIX Security","author":"Shekhar Shashi","year":"2012","unstructured":"Shashi Shekhar, Michael Dietz, and Dan S. Wallach. 2012. AdSplit: Separating smartphone advertising from applications. In USENIX Security. 553\u2013567."},{"key":"e_1_3_2_99_2","doi-asserted-by":"publisher","DOI":"10.1145\/1941530.1941540"},{"key":"e_1_3_2_100_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICC40277.2020.9149420"},{"key":"e_1_3_2_101_2","first-page":"659","volume-title":"WWW","author":"Singh Kapil","year":"2012","unstructured":"Kapil Singh et\u00a0al. 2012. Practical end-to-end web content integrity. In WWW. 659\u2013668."},{"issue":"4","key":"e_1_3_2_102_2","first-page":"97","article-title":"The EU approach to ethics guidelines for trustworthy artificial intelligence","volume":"20","author":"Smuha Nathalie A.","year":"2019","unstructured":"Nathalie A. Smuha. 2019. The EU approach to ethics guidelines for trustworthy artificial intelligence. CRi 20, 4 (2019), 97\u2013106.","journal-title":"CRi"},{"key":"e_1_3_2_103_2","unstructured":"William E. Sobel and Sourabh Satish. 2012. Methods and Systems for Detecting Man-in-the-Browser Attacks. (July 17 2012). US Patent 8 225 401."},{"key":"e_1_3_2_104_2","first-page":"279","volume-title":"IMC","author":"Stone-Gross Brett","year":"2011","unstructured":"Brett Stone-Gross et\u00a0al. 2011. Understanding fraudulent activities in online ad exchanges. In IMC. 279\u2013294."},{"key":"e_1_3_2_105_2","first-page":"265","article-title":"Distributed ledger technology","author":"Sunyaev Ali","year":"2020","unstructured":"Ali Sunyaev. 2020. Distributed ledger technology. Internet Computing: Principles of Distributed Systems and Emerging Internet-Based Technologies, Springer, 265\u2013299.","journal-title":"Internet Computing: Principles of Distributed Systems and Emerging Internet-Based Technologies"},{"key":"e_1_3_2_106_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2024\/972"},{"key":"e_1_3_2_107_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2023\/474"},{"key":"e_1_3_2_108_2","article-title":"Efficient large-scale personalizable bidding for multi-agent auction-based federated learning","author":"Tang Xiaoli","year":"2024","unstructured":"Xiaoli Tang and Han Yu. 2024. Efficient large-scale personalizable bidding for multi-agent auction-based federated learning. IEEE Internet of Things Journal (2024).","journal-title":"IEEE Internet of Things Journal"},{"key":"e_1_3_2_109_2","article-title":"Agent-oriented joint decision support for data owners in auction-based federated learning","author":"Tang Xiaoli","year":"2024","unstructured":"Xiaoli Tang, Han Yu, and Xiaoxiao Li. 2024. Agent-oriented joint decision support for data owners in auction-based federated learning. arXiv preprint arXiv:2405.05991 (2024).","journal-title":"arXiv preprint arXiv:2405.05991"},{"key":"e_1_3_2_110_2","article-title":"Intelligent agents for auction-based federated learning: A survey","author":"Tang Xiaoli","year":"2024","unstructured":"Xiaoli Tang, Han Yu, Xiaoxiao Li, and Sarit Kraus. 2024. Intelligent agents for auction-based federated learning: A survey. arXiv preprint arXiv:2404.13244 (2024).","journal-title":"arXiv preprint arXiv:2404.13244"},{"key":"e_1_3_2_111_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2024\/552"},{"key":"e_1_3_2_112_2","doi-asserted-by":"crossref","unstructured":"Xiaoli Tang Han Yu Run Tang Chao Ren Anran Li and Xiaoxiao Li. 2024. Dual calibration-based personalised federated learning. In Proceedings of the 33rd International Joint Conference on Artificial Intelligence (IJCAI\u201924). 4982\u20134990.","DOI":"10.24963\/ijcai.2024\/551"},{"key":"e_1_3_2_113_2","doi-asserted-by":"crossref","unstructured":"Scott Thiebes Sebastian Lins and Ali Sunyaev. 2021. Trustworthy artificial intelligence. Electronic Markets 31 (2021) 447\u2013464.","DOI":"10.1007\/s12525-020-00441-4"},{"key":"e_1_3_2_114_2","doi-asserted-by":"publisher","DOI":"10.1145\/2736277.2741136"},{"key":"e_1_3_2_115_2","first-page":"1","volume-title":"NDSS","author":"Toubiana Vincent","year":"2010","unstructured":"Vincent Toubiana, Arvind Narayanan, Dan Boneh, Helen Nissenbaum, and Solon Barocas. 2010. Adnostic: Privacy preserving targeted advertising. In NDSS. 1\u201321."},{"key":"e_1_3_2_116_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-3157-6_2"},{"key":"e_1_3_2_117_2","first-page":"3584","volume-title":"WWW","author":"Turkel Eray","year":"2022","unstructured":"Eray Turkel. 2022. Regulating online political advertising. In WWW. 3584\u20133593."},{"key":"e_1_3_2_118_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2004.04.028"},{"key":"e_1_3_2_119_2","unstructured":"Vermeren I.2015. Men vs. Women: Who Is More Active on Social Media? (2015). Retrieved June 1 2022 from http:\/\/bit.ly\/2Xvy6xY"},{"key":"e_1_3_2_120_2","first-page":"1","volume-title":"CollSec","author":"Vratonjic Nevena","year":"2010","unstructured":"Nevena Vratonjic et\u00a0al. 2010. Integrity of the web content: The case of online advertising. In CollSec. 1\u201312."},{"key":"e_1_3_2_121_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-17197-0_10"},{"issue":"4","key":"e_1_3_2_122_2","first-page":"297","article-title":"Display advertising with real-time bidding (RTB) and behavioural targeting","volume":"11","author":"Wang Jun","year":"2017","unstructured":"Jun Wang, Weinan Zhang, Shuai Yuan, et\u00a0al. 2017. Display advertising with real-time bidding (RTB) and behavioural targeting. FTIR 11, 4-5 (2017), 297\u2013435.","journal-title":"FTIR"},{"key":"e_1_3_2_123_2","article-title":"A survey on the fairness of recommender systems","author":"Wang Yifan","year":"2022","unstructured":"Yifan Wang et\u00a0al. 2022. A survey on the fairness of recommender systems. arXiv:2206.03761 (2022).","journal-title":"arXiv:2206.03761"},{"key":"e_1_3_2_124_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-11212-1_24"},{"key":"e_1_3_2_125_2","article-title":"Towards reasoning in large language models via multi-agent peer review collaboration","author":"Xu Zhenran","year":"2023","unstructured":"Zhenran Xu et\u00a0al. 2023. Towards reasoning in large language models via multi-agent peer review collaboration. arXiv preprint arXiv:2311.08152 (2023).","journal-title":"arXiv preprint arXiv:2311.08152"},{"key":"e_1_3_2_126_2","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3482373"},{"key":"e_1_3_2_127_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-022-10283-5"},{"key":"e_1_3_2_128_2","article-title":"Robust optimization over time: A critical review","author":"Yazdani Danial","year":"2023","unstructured":"Danial Yazdani et\u00a0al. 2023. Robust optimization over time: A critical review. TEC (2023).","journal-title":"TEC"},{"key":"e_1_3_2_129_2","first-page":"357","volume-title":"AAMAS","author":"Yu Han","year":"2014","unstructured":"Han Yu, Chunyan Miao, Bo An, Zhiqi Shen, and Cyril Leung. 2014. Reputation-aware task allocation for human trustees. In AAMAS. 357\u2013364."},{"issue":"4","key":"e_1_3_2_130_2","article-title":"Mitigating herding in hierarchical crowdsourcing networks","volume":"6","author":"Yu Han","year":"2016","unstructured":"Han Yu, Chunyan Miao, Cyril Leung, Yiqiang Chen, Simon Fauvel, Victor R. Lesser, and Qiang Yang. 2016. Mitigating herding in hierarchical crowdsourcing networks. Scientific Reports 6, 4 (2016).","journal-title":"Scientific Reports"},{"key":"e_1_3_2_131_2","doi-asserted-by":"crossref","unstructured":"Jiehuang Zhang and Han Yu. 2023. EID: Facilitating explainable AI design discussions in team-based settings. International Journal of Crowd Science 7 2 (2023) 47\u201354.","DOI":"10.26599\/IJCS.2022.9100034"},{"key":"e_1_3_2_132_2","doi-asserted-by":"publisher","DOI":"10.1504\/IJWGS.2018.095647"},{"key":"e_1_3_2_133_2","doi-asserted-by":"publisher","DOI":"10.14722\/ndss.2018.23331"},{"key":"e_1_3_2_134_2","unstructured":"Xingquan Zhu Haicheng Tao Zhiang Wu Jie Cao Kristopher Kalish and Jeremy Kayne. 2017. Fraud prevention in online digital advertising."}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3701741","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3701741","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T21:57:16Z","timestamp":1750283836000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3701741"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,10]]},"references-count":133,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2025,6,30]]}},"alternative-id":["10.1145\/3701741"],"URL":"https:\/\/doi.org\/10.1145\/3701741","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,10]]},"assertion":[{"value":"2022-09-13","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-10-10","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-02-10","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}