{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T16:47:35Z","timestamp":1755794855933,"version":"3.44.0"},"publisher-location":"New York, NY, USA","reference-count":63,"publisher":"ACM","license":[{"start":{"date-parts":[[2025,7,20]],"date-time":"2025-07-20T00:00:00Z","timestamp":1752969600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,7,20]]},"DOI":"10.1145\/3690624.3709419","type":"proceedings-article","created":{"date-parts":[[2025,4,4]],"date-time":"2025-04-04T18:42:22Z","timestamp":1743792142000},"page":"2235-2246","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Experimenting, Fast and Slow: Bayesian Optimization of Long-term Outcomes with Online Experiments"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-9535-4374","authenticated-orcid":false,"given":"Qing","family":"Feng","sequence":"first","affiliation":[{"name":"Meta, Menlo Park, CA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1448-7396","authenticated-orcid":false,"given":"Samuel","family":"Daulton","sequence":"additional","affiliation":[{"name":"Meta, Menlo Park, CA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-5205-8212","authenticated-orcid":false,"given":"Benjamin","family":"Letham","sequence":"additional","affiliation":[{"name":"Meta, Menlo Park, CA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8214-8935","authenticated-orcid":false,"given":"Maximilian","family":"Balandat","sequence":"additional","affiliation":[{"name":"Meta, Menlo Park, CA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-6480-9879","authenticated-orcid":false,"given":"Eytan","family":"Bakshy","sequence":"additional","affiliation":[{"name":"Meta, Menlo Park, CA, USA"}]}],"member":"320","published-online":{"date-parts":[[2025,7,20]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3219847"},{"key":"e_1_3_2_2_2_1","volume-title":"Thirty-seventh Conference on Neural Information Processing Systems. https:\/\/openreview.net\/forum?id=1vyAG6j9PE","author":"Ament Sebastian","year":"2023","unstructured":"Sebastian Ament, Sam Daulton, David Eriksson, Maximilian Balandat, and Eytan Bakshy. 2023. Unexpected Improvements to Expected Improvement for Bayesian Optimization. In Thirty-seventh Conference on Neural Information Processing Systems. https:\/\/openreview.net\/forum?id=1vyAG6j9PE"},{"key":"e_1_3_2_2_3_1","unstructured":"Analytics at Meta. 2022. Notifications: why less is more -- how Facebook has been increasing both user satisfaction and app usage by sending only a few notifications. https:\/\/medium.com\/@AnalyticsAtMeta\/notifications-why-less-is-more-how-facebook-has-been-increasing-both-user-satisfaction-and-app-9463f7325e7d"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"crossref","unstructured":"Susan Athey Raj Chetty Guido W Imbens and Hyunseung Kang. 2019a. The surrogate index: Combining short-term proxies to estimate long-term treatment effects more rapidly and precisely. Technical Report. National Bureau of Economic Research.","DOI":"10.3386\/w26463"},{"volume-title":"The Surrogate Index: Combining Short-Term Proxies to Estimate Long-Term Treatment Effects More Rapidly and Precisely. Working Paper 26463","author":"Athey Susan","key":"e_1_3_2_2_5_1","unstructured":"Susan Athey, Raj Chetty, Guido W Imbens, and Hyunseung Kang. 2019b. The Surrogate Index: Combining Short-Term Proxies to Estimate Long-Term Treatment Effects More Rapidly and Precisely. Working Paper 26463. National Bureau of Economic Research."},{"key":"e_1_3_2_2_6_1","volume-title":"AE: A Domain-Agnostic Platform for Adaptive Experimentation. In NeurIPS Workshop on Systems for Machine Learning.","author":"Bakshy Eytan","year":"2018","unstructured":"Eytan Bakshy, Lili Dworkin, Brian Karrer, Konstantin Kashin, Benjamin Letham, Ashwin Murthy, and Shaun Singh. 2018. AE: A Domain-Agnostic Platform for Adaptive Experimentation. In NeurIPS Workshop on Systems for Machine Learning."},{"volume-title":"Proceedings of the 23rd International Conference on World Wide Web (WWW). 283--292","author":"Bakshy Eytan","key":"e_1_3_2_2_7_1","unstructured":"Eytan Bakshy, Dean Eckles, and Michael S. Bernstein. 2014. Designing and Deploying Online Field Experiments. In Proceedings of the 23rd International Conference on World Wide Web (WWW). 283--292."},{"key":"e_1_3_2_2_8_1","volume-title":"Andrew Gordon Wilson, and Eytan Bakshy","author":"Balandat Maximilian","year":"2020","unstructured":"Maximilian Balandat, Brian Karrer, Daniel R. Jiang, Samuel Daulton, Benjamin Letham, Andrew Gordon Wilson, and Eytan Bakshy. 2020. BoTorch: A Framework for Efficient Monte-Carlo Bayesian Optimization. In Advances in Neural Information Processing Systems 33 (NeurIPS)."},{"key":"e_1_3_2_2_9_1","volume-title":"Williams","author":"Bonilla Edwin V.","year":"2007","unstructured":"Edwin V. Bonilla, Kian Ming A. Chai, and Christopher K. I. Williams. 2007. Multi-task Gaussian Process Prediction. In Advances in Neural Information Processing Systems 20 (NIPS). 153--160."},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.5555\/2567709.2567766"},{"volume-title":"Statistics for Experimenters: Design, Innovation, and Discovery","author":"Box George E. P.","key":"e_1_3_2_2_11_1","unstructured":"George E. P. Box, J. Stuart Hunter, and William Gordon Hunter. 2005. Statistics for Experimenters: Design, Innovation, and Discovery. Wiley."},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10472-015-9463-9"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3289600.3291000"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3437963.3441719"},{"key":"e_1_3_2_2_15_1","unstructured":"Samuel Daulton Maximilian Balandat and Eytan Bakshy. 2020. Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimization. In Advances in Neural Information Processing Systems 33 (NeurIPS)."},{"key":"e_1_3_2_2_16_1","first-page":"2187","article-title":"Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume Improvement","volume":"34","author":"Daulton Samuel","year":"2021","unstructured":"Samuel Daulton, Maximilian Balandat, and Eytan Bakshy. 2021. Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume Improvement. In Advances in Neural Information Processing Systems, Vol. 34. 2187--2200.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_2_17_1","volume-title":"Proceedings of the 40th International Conference on Machine Learning (Proceedings of Machine Learning Research","volume":"7204","author":"Daulton Sam","year":"2023","unstructured":"Sam Daulton, Maximilian Balandat, and Eytan Bakshy. 2023. Hypervolume Knowledge Gradient: A Lookahead Approach for Multi-Objective Bayesian Optimization with Partial Information. In Proceedings of the 40th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 202). PMLR, 7167--7204."},{"key":"e_1_3_2_2_18_1","volume-title":"Workshop on Safety and Robustness in Decision Making","author":"Daulton Samuel","year":"2019","unstructured":"Samuel Daulton, Shaun Singh, Vashist Avadhanula, Drew Dimmery, and Eytan Bakshy. 2019. Thompson sampling for contextual bandit problems with auxiliary safety constraints. NeurIPS 2019, Workshop on Safety and Robustness in Decision Making (2019)."},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2433396.2433413"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v29i1.9375"},{"key":"e_1_3_2_2_21_1","unstructured":"Qing Feng Benjamin Letham Hongzi Mao and Eytan Bakshy. 2020. High-Dimensional Contextual Policy Search with Unknown Context Rewards using Bayesian Optimization. In Advances in Neural Information Processing Systems 33 (NeurIPS)."},{"key":"e_1_3_2_2_22_1","volume-title":"A tutorial on Bayesian optimization. arXiv preprint arXiv:1807.02811","author":"Frazier Peter I","year":"2018","unstructured":"Peter I Frazier. 2018. A tutorial on Bayesian optimization. arXiv preprint arXiv:1807.02811 (2018)."},{"key":"e_1_3_2_2_23_1","volume-title":"Green","author":"Gerber Alan S.","year":"2012","unstructured":"Alan S. Gerber and Donald P. Green. 2012. Field Experiments: Design, Analysis, and Interpretation. WW Norton."},{"key":"e_1_3_2_2_24_1","unstructured":"David Ginsbourger Janis Janusevskis and Rodolphe Le Riche. 2011. Dealing with asynchronicity in parallel Gaussian process based global optimization. Technical Report. Mines Saint-Etienne. hal--00507632 pages."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098043"},{"key":"e_1_3_2_2_26_1","volume-title":"Predictive entropy search for efficient global optimization of black-box functions. Advances in neural information processing systems","author":"Hern\u00e1ndez-Lobato Jos\u00e9 Miguel","year":"2014","unstructured":"Jos\u00e9 Miguel Hern\u00e1ndez-Lobato, Matthew W Hoffman, and Zoubin Ghahramani. 2014. Predictive entropy search for efficient global optimization of black-box functions. Advances in neural information processing systems, Vol. 27 (2014)."},{"key":"e_1_3_2_2_27_1","volume-title":"Sequential Model-Based Optimization for General Algorithm Configuration. In International Conference on Learning and Intelligent Optimization (LION). 507--523","author":"Hutter Frank","year":"2011","unstructured":"Frank Hutter, Holger H. Hoos, and Kevin Leyton-Brown. 2011. Sequential Model-Based Optimization for General Algorithm Configuration. In International Conference on Learning and Intelligent Optimization (LION). 507--523."},{"key":"e_1_3_2_2_28_1","first-page":"11494","article-title":"Joint entropy search for maximally-informed Bayesian optimization","volume":"35","author":"Hvarfner Carl","year":"2022","unstructured":"Carl Hvarfner, Frank Hutter, and Luigi Nardi. 2022. Joint entropy search for maximally-informed Bayesian optimization. Advances in Neural Information Processing Systems, Vol. 35 (2022), 11494--11506.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008306431147"},{"key":"e_1_3_2_2_30_1","volume-title":"International Conference on Artificial Intelligence and Statistics. PMLR, 133--142","author":"Kandasamy Kirthevasan","year":"2018","unstructured":"Kirthevasan Kandasamy, Akshay Krishnamurthy, Jeff Schneider, and Barnab\u00e1s P\u00f3czos. 2018. Parallelised Bayesian optimisation via Thompson sampling. In International Conference on Artificial Intelligence and Statistics. PMLR, 133--142."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447548.3467091"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2339530.2339653"},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-008-0114-1"},{"volume-title":"Trustworthy Online Controlled Experiments: A Practical Guide to A\/B Testing","author":"Kohavi Ron","key":"e_1_3_2_2_34_1","unstructured":"Ron Kohavi, Diane Tang, and Ya Xu. 2020. Trustworthy Online Controlled Experiments: A Practical Guide to A\/B Testing. Cambridge University Press."},{"key":"e_1_3_2_2_35_1","first-page":"1","article-title":"Bayesian Optimization for Policy Search via Online-Offline Experimentation","volume":"20","author":"Letham Benjamin","year":"2019","unstructured":"Benjamin Letham and Eytan Bakshy. 2019. Bayesian Optimization for Policy Search via Online-Offline Experimentation. Journal of Machine Learning Research, Vol. 20, 145 (2019), 1--30.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_2_36_1","volume-title":"Efficient tuning of online systems using Bayesian optimization. https:\/\/research.facebook.com\/blog\/2018\/9\/efficient-tuning-of-online-systems-using-bayesian-optimization\/","author":"Letham Ben","year":"2024","unstructured":"Ben Letham, Brian Karrer, Guilherme Ottoni, and Eytan Bakshy. 2018. Efficient tuning of online systems using Bayesian optimization. https:\/\/research.facebook.com\/blog\/2018\/9\/efficient-tuning-of-online-systems-using-bayesian-optimization\/. Accessed: July 2024."},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1214\/18-BA1110"},{"key":"e_1_3_2_2_38_1","volume-title":"ICML Workshop on Real World Experiment Design and Active Learning.","author":"Lin Jerry","year":"2020","unstructured":"Jerry Lin, Adam Obeng, and Eytan Bakshy. 2020. Preference learning for real-world multi-objective decision making. In ICML Workshop on Real World Experiment Design and Active Learning."},{"key":"e_1_3_2_2_39_1","volume-title":"International Conference on Artificial Intelligence and Statistics. PMLR, 4235--4258","author":"Lin Zhiyuan Jerry","year":"2022","unstructured":"Zhiyuan Jerry Lin, Raul Astudillo, Peter Frazier, and Eytan Bakshy. 2022. Preference exploration for efficient bayesian optimization with multiple outcomes. In International Conference on Artificial Intelligence and Statistics. PMLR, 4235--4258."},{"key":"e_1_3_2_2_40_1","volume-title":"International Conference on Artificial Intelligence and Statistics. PMLR, 3754--3774","author":"Liu Sulin","year":"2023","unstructured":"Sulin Liu, Qing Feng, David Eriksson, Benjamin Letham, and Eytan Bakshy. 2023. Sparse bayesian optimization. In International Conference on Artificial Intelligence and Statistics. PMLR, 3754--3774."},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.5555\/1625275.1625428"},{"key":"e_1_3_2_2_42_1","volume-title":"ICML Workshop on Reinforcement Learning for Real Life (RL4RealLife)","author":"Mao Hongzi","year":"2019","unstructured":"Hongzi Mao, Shannon Chen, Drew Dimmery, Shaun Singh, Drew Blaisdell, Yuandong Tian, Mohammad Alizadeh, and Eytan Bakshy. 2019. Real-world video adaptation with reinforcement learning. ICML Workshop on Reinforcement Learning for Real Life (RL4RealLife) (2019)."},{"key":"e_1_3_2_2_43_1","first-page":"1054","article-title":"Safe and Efficient Off-Policy Reinforcement Learning","volume":"29","author":"Munos R\u00e9mi","year":"2016","unstructured":"R\u00e9mi Munos, Tom Stepleton, Anna Harutyunyan, and Marc Bellemare. 2016. Safe and Efficient Off-Policy Reinforcement Learning. Advances in Neural Information Processing Systems 29 (2016), 1054--1062.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_2_44_1","volume-title":"Using Bayesian optimization for balancing metrics in recommendation systems. https:\/\/www.linkedin.com\/blog\/engineering\/recommendations\/using-bayesian-optimization-for-balancing-metrics-in-recommendat","author":"Ouyang Yunbo","year":"2024","unstructured":"Yunbo Ouyang. 2022. Using Bayesian optimization for balancing metrics in recommendation systems. https:\/\/www.linkedin.com\/blog\/engineering\/recommendations\/using-bayesian-optimization-for-balancing-metrics-in-recommendat. Accessed: July 2024."},{"key":"e_1_3_2_2_45_1","volume-title":"Advances in Neural Information Processing Systems","volume":"32","author":"Perrone Valerio","year":"2019","unstructured":"Valerio Perrone, Huibin Shen, Matthias W Seeger, Cedric Archambeau, and Rodolphe Jenatton. 2019. Learning search spaces for Bayesian optimization: Another view of hyperparameter transfer learning. In Advances in Neural Information Processing Systems, Vol. 32."},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1080\/00401706.2012.707580"},{"key":"e_1_3_2_2_47_1","volume-title":"Multi-information source optimization. Advances in neural information processing systems","author":"Poloczek Matthias","year":"2017","unstructured":"Matthias Poloczek, Jialei Wang, and Peter Frazier. 2017. Multi-information source optimization. Advances in neural information processing systems, Vol. 30 (2017)."},{"volume-title":"Proceedings of the IEEE International Conference on Robotics and Automation (ICRA). 1771--1778","author":"Rai Akshara","key":"e_1_3_2_2_48_1","unstructured":"Akshara Rai, Rika Antonova, Seungmoon Song, William Martin, Hartmut Geyer, and Christopher G. Atkeson. 2018. Bayesian Optimization Using Domain Knowledge on the ATRIAS Biped. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA). 1771--1778."},{"key":"e_1_3_2_2_49_1","volume-title":"Williams","author":"Rasmussen Carl Edward","year":"2006","unstructured":"Carl Edward Rasmussen and Christopher K. I. Williams. 2006. Gaussian Processes for Machine Learning. The MIT Press, Cambridge, Massachusetts."},{"key":"e_1_3_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v051.i01"},{"key":"e_1_3_2_2_51_1","volume-title":"Notz","author":"Santner Thomas J.","year":"2003","unstructured":"Thomas J. Santner, Brian J. Williams, and William I. Notz. 2003. The Design and Analysis of Computer Experiments. Springer."},{"key":"e_1_3_2_2_52_1","volume-title":"Adams","author":"Snoek Jasper","year":"2012","unstructured":"Jasper Snoek, Hugo Larochelle, and Ryan P. Adams. 2012. Practical Bayesian Optimization of Machine Learning Algorithms. In Advances in Neural Information Processing Systems 25 (NIPS). 2951--2959."},{"key":"e_1_3_2_2_53_1","volume-title":"Proceedings of the 27th International Conference on Machine Learning (ICML). 1015--1022","author":"Srinivas Niranjan","year":"2010","unstructured":"Niranjan Srinivas, Andreas Krause, Sham Kakade, and Matthias Seeger. 2010. Gaussian Process Optimization in the Bandit Setting: No Regret and Experimental Design. In Proceedings of the 27th International Conference on Machine Learning (ICML). 1015--1022."},{"key":"e_1_3_2_2_54_1","volume-title":"Weinberger (Eds.)","volume":"26","author":"Swersky Kevin","year":"2013","unstructured":"Kevin Swersky, Jasper Snoek, and Ryan P Adams. 2013. Multi-Task Bayesian Optimization. In Advances in Neural Information Processing Systems, C.J. Burges, L. Bottou, M. Welling, Z. Ghahramani, and K.Q. Weinberger (Eds.), Vol. 26. Curran Associates, Inc. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2013\/file\/f33ba15effa5c10e873bf3842afb46a6-Paper.pdf"},{"key":"e_1_3_2_2_55_1","volume-title":"Faster Experimentation. In Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD). 17--26","author":"Tang Diane","year":"2010","unstructured":"Diane Tang, Ashish Agarwal, Deirdre O'Brien, and Mike Meyer. 2010. Overlapping Experiment Infrastructure: More, Better, Faster Experimentation. In Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD). 17--26."},{"key":"e_1_3_2_2_56_1","volume-title":"Proceedings of the 33rd International Conference on Machine Learning (ICML). 2139--2148","author":"Thomas Philip","year":"2016","unstructured":"Philip Thomas and Emma Brunskill. 2016. Data-Efficient Off-Policy Policy Evaluation for Reinforcement Learning. In Proceedings of the 33rd International Conference on Machine Learning (ICML). 2139--2148."},{"key":"e_1_3_2_2_57_1","volume-title":"Bayesian optimization is superior to random search for machine learning hyperparameter tuning: Analysis of the black-box optimization challenge","author":"Turner Ryan","year":"2020","unstructured":"Ryan Turner, David Eriksson, Michael McCourt, Juha Kiili, Eero Laaksonen, Zhen Xu, and Isabelle Guyon. 2021. Bayesian optimization is superior to random search for machine learning hyperparameter tuning: Analysis of the black-box optimization challenge 2020. In NeurIPS 2020 Competition and Demonstration Track. PMLR, 3--26."},{"key":"e_1_3_2_2_58_1","volume-title":"International Conference on Machine Learning. PMLR, 3627--3635","author":"Wang Zi","year":"2017","unstructured":"Zi Wang and Stefanie Jegelka. 2017. Max-value entropy search for efficient Bayesian optimization. In International Conference on Machine Learning. PMLR, 3627--3635."},{"key":"e_1_3_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3269206.3272018"},{"key":"e_1_3_2_2_60_1","unstructured":"Jian Wu Saul Toscano-Palmerin Peter I Frazier and Andrew Gordon Wilson. 2020. Practical multi-fidelity bayesian optimization for hyperparameter tuning. In Uncertainty in Artificial Intelligence. PMLR 788--798."},{"key":"e_1_3_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3534678.3539325"},{"key":"e_1_3_2_2_62_1","volume-title":"Targeting for long-term outcomes. Management Science","author":"Yang Jeremy","year":"2023","unstructured":"Jeremy Yang, Dean Eckles, Paramveer Dhillon, and Sinan Aral. 2023. Targeting for long-term outcomes. Management Science (2023)."},{"key":"e_1_3_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2785956.2787486"}],"event":{"name":"KDD '25: The 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"],"location":"Toronto ON Canada","acronym":"KDD '25"},"container-title":["Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3690624.3709419","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3690624.3709419","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,16]],"date-time":"2025-08-16T15:36:35Z","timestamp":1755358595000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3690624.3709419"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,20]]},"references-count":63,"alternative-id":["10.1145\/3690624.3709419","10.1145\/3690624"],"URL":"https:\/\/doi.org\/10.1145\/3690624.3709419","relation":{},"subject":[],"published":{"date-parts":[[2025,7,20]]},"assertion":[{"value":"2025-07-20","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}