{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,12]],"date-time":"2025-12-12T01:51:58Z","timestamp":1765504318344,"version":"3.48.0"},"publisher-location":"New York, NY, USA","reference-count":50,"publisher":"ACM","funder":[{"name":"Research Grants Council of Hong Kong","award":["CityU C1043-24GF, R6021-20F, R1012-21, C6015- 23G, N_CityU139\/21, and CRS_HKUST601\/24"],"award-info":[{"award-number":["CityU C1043-24GF, R6021-20F, R1012-21, C6015- 23G, N_CityU139\/21, and CRS_HKUST601\/24"]}]},{"name":"Innovation and Technology Commission of Hong Kong (ITC)","award":["MHP\/135\/23"],"award-info":[{"award-number":["MHP\/135\/23"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,11,10]]},"DOI":"10.1145\/3746252.3761138","type":"proceedings-article","created":{"date-parts":[[2025,11,8]],"date-time":"2025-11-08T00:29:28Z","timestamp":1762561768000},"page":"3623-3634","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["LiveVal: Real-time and Trajectory-based Data Valuation via Adaptive Reference Points"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9924-4157","authenticated-orcid":false,"given":"Jie","family":"Xu","sequence":"first","affiliation":[{"name":"Department of Computer Science, City University of Hong Kong, Kowloon, Hong Kong"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6551-6177","authenticated-orcid":false,"given":"Zihan","family":"Wu","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, City University of Hong Kong, Kowloon, Hong Kong"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0547-315X","authenticated-orcid":false,"given":"Cong","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Computer Science, City University of Hong Kong, Kowloon, Hong Kong"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8702-8302","authenticated-orcid":false,"given":"Xiaohua","family":"Jia","sequence":"additional","affiliation":[{"name":"Department of Computer Science, City University of Hong Kong, Kowloon, Hong Kong"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,11,10]]},"reference":[{"key":"e_1_3_2_1_1_1","first-page":"17953","article-title":"If influence functions are the answer, then what is the question","volume":"35","author":"Bae Juhan","year":"2022","unstructured":"Juhan Bae, Nathan Ng, Alston Lo, Marzyeh Ghassemi, and Roger B Grosse. 2022. If influence functions are the answer, then what is the question? Advances in Neural Information Processing Systems, Vol. 35 (2022), 17953-17967.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_2_1","volume-title":"Influence Functions in Deep Learning Are Fragile. In International Conference on Learning Representations (ICLR).","author":"Basu S","year":"2021","unstructured":"S Basu, P Pope, and S Feizi. 2021. Influence Functions in Deep Learning Are Fragile. In International Conference on Learning Representations (ICLR)."},{"key":"e_1_3_2_1_3_1","volume-title":"International Conference on Machine Learning. PMLR, 715-724","author":"Basu Samyadeep","year":"2020","unstructured":"Samyadeep Basu, Xuchen You, and Soheil Feizi. 2020. On second-order group influence functions for black-box predictions. In International Conference on Machine Learning. PMLR, 715-724."},{"unstructured":"Sang Keun Choe Hwijeen Ahn Juhan Bae Kewen Zhao Minsoo Kang Youngseog Chung Adithya Pratapa Willie Neiswanger Emma Strubell Teruko Mitamura et al. 2024. What is Your Data Worth to GPT? LLM-Scale Data Valuation with Influence Functions. arXiv preprint arXiv:2405.13954 (2024).","key":"e_1_3_2_1_4_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_5_1","DOI":"10.2307\/1271434"},{"key":"e_1_3_2_1_6_1","volume-title":"Autoaugment: Learning augmentation policies from data. arXiv preprint arXiv:1805.09501","author":"Cubuk Ekin D","year":"2018","unstructured":"Ekin D Cubuk, Barret Zoph, Dandelion Mane, Vijay Vasudevan, and Quoc V Le. 2018. Autoaugment: Learning augmentation policies from data. arXiv preprint arXiv:1805.09501 (2018)."},{"unstructured":"Dheeru Dua and Casey Graff. 2019. UCI Machine Learning Repository. http:\/\/archive.ics.uci.edu\/ml","key":"e_1_3_2_1_7_1"},{"key":"e_1_3_2_1_8_1","volume-title":"Chris JM Yoon, and Ivan Beschastnikh","author":"Fung Clement","year":"2018","unstructured":"Clement Fung, Chris JM Yoon, and Ivan Beschastnikh. 2018. Mitigating sybils in federated learning poisoning. arXiv preprint arXiv:1808.04866 (2018)."},{"key":"e_1_3_2_1_9_1","volume-title":"International Conference on Machine Learning. PMLR, 3535-3544","author":"Ghorbani Amirata","year":"2020","unstructured":"Amirata Ghorbani, Michael Kim, and James Zou. 2020. A distributional framework for data valuation. In International Conference on Machine Learning. PMLR, 3535-3544."},{"key":"e_1_3_2_1_10_1","volume-title":"International Conference on Machine Learning. PMLR, 2242-2251","author":"Ghorbani Amirata","year":"2019","unstructured":"Amirata Ghorbani and James Zou. 2019. Data shapley: Equitable valuation of data for machine learning. In International Conference on Machine Learning. PMLR, 2242-2251."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_11_1","DOI":"10.1109\/IEEECONF56349.2022.10064696"},{"key":"e_1_3_2_1_12_1","volume-title":"Explaining and harnessing adversarial examples. arXiv preprint arXiv:1412.6572","author":"Goodfellow Ian J","year":"2014","unstructured":"Ian J Goodfellow, Jonathon Shlens, and Christian Szegedy. 2014. Explaining and harnessing adversarial examples. arXiv preprint arXiv:1412.6572 (2014)."},{"unstructured":"Roger Grosse Juhan Bae Cem Anil Nelson Elhage Alex Tamkin Amirhossein Tajdini Benoit Steiner Dustin Li Esin Durmus Ethan Perez et al. 2023. Studying large language model generalization with influence functions. arXiv preprint arXiv:2308.03296 (2023).","key":"e_1_3_2_1_13_1"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_14_1","DOI":"10.1007\/s10994-023-06495-7"},{"key":"e_1_3_2_1_15_1","volume-title":"Logan Engstrom, Guillaume Leclerc, and Aleksander Madry.","author":"Ilyas Andrew","year":"2022","unstructured":"Andrew Ilyas, Sung Min Park, Logan Engstrom, Guillaume Leclerc, and Aleksander Madry. 2022. Datamodels: Predicting predictions from training data. arXiv preprint arXiv:2202.00622 (2022)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_16_1","DOI":"10.14778\/3342263.3342637"},{"key":"e_1_3_2_1_17_1","volume-title":"International Conference on Artificial Intelligence and Statistics. PMLR, 1167-1176","author":"Jia Ruoxi","year":"2019","unstructured":"Ruoxi Jia, David Dao, Boxin Wang, Frances Ann Hubis, Nick Hynes, Nezihe Merve G\u00fcrel, Bo Li, Ce Zhang, Dawn Song, and Costas J Spanos. 2019. Towards efficient data valuation based on the shapley value. In International Conference on Artificial Intelligence and Statistics. PMLR, 1167-1176."},{"key":"e_1_3_2_1_18_1","volume-title":"International Conference on Machine Learning. PMLR","author":"Koh Pang Wei","year":"2017","unstructured":"Pang Wei Koh and Percy Liang. 2017. Understanding black-box predictions via influence functions. In International Conference on Machine Learning. PMLR, 1885-1894."},{"key":"e_1_3_2_1_19_1","volume-title":"Stronger data poisoning attacks break data sanitization defenses. Machine Learning","author":"Koh Pang Wei","year":"2022","unstructured":"Pang Wei Koh, Jacob Steinhardt, and Percy Liang. 2022. Stronger data poisoning attacks break data sanitization defenses. Machine Learning (2022), 1-47."},{"key":"e_1_3_2_1_20_1","volume-title":"Advances in Neural Information Processing Systems","volume":"32","author":"Koh Pang Wei W","year":"2019","unstructured":"Pang Wei W Koh, Kai-Siang Ang, Hubert Teo, and Percy S Liang. 2019. On the accuracy of influence functions for measuring group effects. Advances in Neural Information Processing Systems, Vol. 32 (2019)."},{"key":"e_1_3_2_1_21_1","volume-title":"International Conference on Artificial Intelligence and Statistics. PMLR, 8780-8802","author":"Kwon Yongchan","year":"2022","unstructured":"Yongchan Kwon and James Zou. 2022a. Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning. In International Conference on Artificial Intelligence and Statistics. PMLR, 8780-8802."},{"key":"e_1_3_2_1_22_1","volume-title":"International conference on machine learning. PMLR","author":"Kwon Yongchan","year":"2023","unstructured":"Yongchan Kwon and James Zou. 2023. Data-OOB: Out-of-bag estimate as a simple and efficient data value. In International conference on machine learning. PMLR, 18135-18152."},{"key":"e_1_3_2_1_23_1","first-page":"34363","article-title":"Weightedshap: analyzing and improving shapley based feature attributions","volume":"35","author":"Kwon Yongchan","year":"2022","unstructured":"Yongchan Kwon and James Y Zou. 2022b. Weightedshap: analyzing and improving shapley based feature attributions. Advances in Neural Information Processing Systems, Vol. 35 (2022), 34363-34376.","journal-title":"Advances in Neural Information Processing Systems"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_24_1","DOI":"10.1016\/B978-1-55860-377-6.50048-7"},{"unstructured":"Yann LeCun Corinna Cortes Chris Burges et al. 2010. MNIST handwritten digit database. http:\/\/yann.lecun.com\/exdb\/mnist.","key":"e_1_3_2_1_25_1"},{"key":"e_1_3_2_1_26_1","volume-title":"One Sample Fits All: Approximating All Probabilistic Values Simultaneously and Efficiently. arXiv preprint arXiv:2410.23808","author":"Li Weida","year":"2024","unstructured":"Weida Li and Yaoliang Yu. 2024a. One Sample Fits All: Approximating All Probabilistic Values Simultaneously and Efficiently. arXiv preprint arXiv:2410.23808 (2024)."},{"key":"e_1_3_2_1_27_1","volume-title":"Advances in Neural Information Processing Systems","volume":"36","author":"Li Weida","year":"2024","unstructured":"Weida Li and Yaoliang Yu. 2024b. Robust data valuation with weighted banzhaf values. Advances in Neural Information Processing Systems, Vol. 36 (2024)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_28_1","DOI":"10.1145\/3639311"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_29_1","DOI":"10.1109\/TIFS.2022.3196274"},{"key":"e_1_3_2_1_30_1","first-page":"1415","volume-title":"31st USENIX Security Symposium (USENIX Security 22)","author":"Nguyen Thien Duc","year":"2022","unstructured":"Thien Duc Nguyen, Phillip Rieger, Roberta De Viti, Huili Chen, Bj\u00f6rn B Brandenburg, Hossein Yalame, Helen M\u00f6llering, Hossein Fereidooni, Samuel Marchal, Markus Miettinen, et al., 2022. {FLAME}: Taming backdoors in federated learning. In 31st USENIX Security Symposium (USENIX Security 22). 1415-1432."},{"key":"e_1_3_2_1_31_1","volume-title":"International conference on machine learning. Pmlr, 1310-1318","author":"Pascanu Razvan","year":"2013","unstructured":"Razvan Pascanu, Tomas Mikolov, and Yoshua Bengio. 2013. On the difficulty of training recurrent neural networks. In International conference on machine learning. Pmlr, 1310-1318."},{"key":"e_1_3_2_1_32_1","first-page":"20596","article-title":"Deep learning on a data diet: Finding important examples early in training","volume":"34","author":"Paul Mansheej","year":"2021","unstructured":"Mansheej Paul, Surya Ganguli, and Gintare Karolina Dziugaite. 2021. Deep learning on a data diet: Finding important examples early in training. Advances in Neural Information Processing Systems, Vol. 34 (2021), 20596-20607.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_33_1","first-page":"19920","article-title":"Estimating training data influence by tracing gradient descent","volume":"33","author":"Pruthi Garima","year":"2020","unstructured":"Garima Pruthi, Frederick Liu, Satyen Kale, and Mukund Sundararajan. 2020. Estimating training data influence by tracing gradient descent. Advances in Neural Information Processing Systems, Vol. 33 (2020), 19920-19930.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_34_1","volume-title":"A stochastic approximation method. The annals of mathematical statistics","author":"Robbins Herbert","year":"1951","unstructured":"Herbert Robbins and Sutton Monro. 1951. A stochastic approximation method. The annals of mathematical statistics (1951), 400-407."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_35_1","DOI":"10.1609\/aaai.v36i8.20791"},{"key":"e_1_3_2_1_36_1","volume-title":"A value for n-person games. Contribution to the Theory of Games","author":"Shapley Lloyd S","year":"1953","unstructured":"Lloyd S Shapley. 1953. A value for n-person games. Contribution to the Theory of Games, Vol. 2 (1953)."},{"key":"e_1_3_2_1_37_1","volume-title":"International Joint Conference on Artificial Intelligence. 5607-5614","author":"Ling Sim Rachael Hwee","year":"2022","unstructured":"Rachael Hwee Ling Sim, Xinyi Xu, and Bryan Kian Hsiang Low. 2022. Data Valuation in Machine Learning: ''Ingredients'', Strategies, and Open Challenges. In International Joint Conference on Artificial Intelligence. 5607-5614."},{"key":"e_1_3_2_1_38_1","volume-title":"International Conference on Machine Learning. PMLR, 8927-8936","author":"Ling Sim Rachael Hwee","year":"2020","unstructured":"Rachael Hwee Ling Sim, Yehong Zhang, Mun Choon Chan, and Bryan Kian Hsiang Low. 2020. Collaborative machine learning with incentive-aware model rewards. In International Conference on Machine Learning. PMLR, 8927-8936."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_39_1","DOI":"10.1109\/BigData47090.2019.9006327"},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_40_1","DOI":"10.1145\/3580305.3599500"},{"key":"e_1_3_2_1_41_1","first-page":"18251","article-title":"Data pruning via moving-one-sample-out","author":"Tan Haoru","year":"2023","unstructured":"Haoru Tan, Sitong Wu, Fei Du, Yukang Chen, Zhibin Wang, Fan Wang, and Xiaojuan Qi. 2023. Data pruning via moving-one-sample-out. In Advances in Neural Information Processing Systems. 18251-18262.","journal-title":"Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_1_42_1","volume-title":"International Conference on Artificial Intelligence and Statistics. PMLR, 6388-6421","author":"Wang Jiachen T","year":"2023","unstructured":"Jiachen T Wang and Ruoxi Jia. 2023. Data banzhaf: A robust data valuation framework for machine learning. In International Conference on Artificial Intelligence and Statistics. PMLR, 6388-6421."},{"key":"e_1_3_2_1_43_1","volume-title":"Data Shapley in One Training Run. In International Conference on Learning Representations (ICLR).","author":"Wang Jiachen T","year":"2025","unstructured":"Jiachen T Wang, Prateek Mittal, Dawn Song, and Ruoxi Jia. 2025a. Data Shapley in One Training Run. In International Conference on Learning Representations (ICLR)."},{"key":"e_1_3_2_1_44_1","volume-title":"Capturing the Temporal Dependence of Training Data Influence. In The Thirteenth International Conference on Learning Representations.","author":"Wang Jiachen T","year":"2025","unstructured":"Jiachen T Wang, Dawn Song, James Zou, Prateek Mittal, and Ruoxi Jia. 2025b. Capturing the Temporal Dependence of Training Data Influence. In The Thirteenth International Conference on Learning Representations."},{"key":"e_1_3_2_1_45_1","volume-title":"A principled approach to data valuation for federated learning","author":"Wang Tianhao","year":"2020","unstructured":"Tianhao Wang, Johannes Rausch, Ce Zhang, Ruoxi Jia, and Dawn Song. 2020. A principled approach to data valuation for federated learning. Federated Learning: Privacy and Incentive (2020), 153-167."},{"key":"e_1_3_2_1_46_1","volume-title":"Proceedings of the 41st International Conference on Machine Learning. 54104-54132","author":"Xia Mengzhou","year":"2024","unstructured":"Mengzhou Xia, Sadhika Malladi, Suchin Gururangan, Sanjeev Arora, and Danqi Chen. 2024. LESS: selecting influential data for targeted instruction tuning. In Proceedings of the 41st International Conference on Machine Learning. 54104-54132."},{"key":"e_1_3_2_1_47_1","first-page":"16104","article-title":"Gradient driven rewards to guarantee fairness in collaborative machine learning","volume":"34","author":"Xu Xinyi","year":"2021","unstructured":"Xinyi Xu, Lingjuan Lyu, Xingjun Ma, Chenglin Miao, Chuan Sheng Foo, and Bryan Kian Hsiang Low. 2021. Gradient driven rewards to guarantee fairness in collaborative machine learning. Advances in Neural Information Processing Systems, Vol. 34 (2021), 16104-16117.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_48_1","first-page":"108735","article-title":"Mates: Model-aware data selection for efficient pretraining with data influence models","volume":"37","author":"Yu Zichun","year":"2024","unstructured":"Zichun Yu, Spandan Das, and Chenyan Xiong. 2024. Mates: Model-aware data selection for efficient pretraining with data influence models. Advances in Neural Information Processing Systems, Vol. 37 (2024), 108735-108759.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_49_1","volume-title":"Understanding deep learning requires rethinking generalization. arXiv preprint arXiv:1611.03530","author":"Zhang Chiyuan","year":"2016","unstructured":"Chiyuan Zhang, Samy Bengio, Moritz Hardt, Benjamin Recht, and Oriol Vinyals. 2016. Understanding deep learning requires rethinking generalization. arXiv preprint arXiv:1611.03530 (2016)."},{"doi-asserted-by":"publisher","key":"e_1_3_2_1_50_1","DOI":"10.1145\/3588728"}],"event":{"sponsor":["SIGIR ACM Special Interest Group on Information Retrieval","SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"],"acronym":"CIKM '25","name":"CIKM '25: The 34th ACM International Conference on Information and Knowledge Management","location":"Seoul Republic of Korea"},"container-title":["Proceedings of the 34th ACM International Conference on Information and Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3746252.3761138","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,12]],"date-time":"2025-12-12T01:50:58Z","timestamp":1765504258000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3746252.3761138"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,10]]},"references-count":50,"alternative-id":["10.1145\/3746252.3761138","10.1145\/3746252"],"URL":"https:\/\/doi.org\/10.1145\/3746252.3761138","relation":{},"subject":[],"published":{"date-parts":[[2025,11,10]]},"assertion":[{"value":"2025-11-10","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}