{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,15]],"date-time":"2026-04-15T03:28:23Z","timestamp":1776223703196,"version":"3.50.1"},"reference-count":34,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,5,3]],"date-time":"2022-05-03T00:00:00Z","timestamp":1651536000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001381","name":"National Research Foundation, Singapore","doi-asserted-by":"crossref","award":["AISG2-RP-2020-019"],"award-info":[{"award-number":["AISG2-RP-2020-019"]}],"id":[{"id":"10.13039\/501100001381","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Joint NTU-WeBank Research Centre on Fintech","award":["NWJ-2020-008"],"award-info":[{"award-number":["NWJ-2020-008"]}]},{"DOI":"10.13039\/501100001475","name":"Nanyang Technological University, Singapore","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001475","id-type":"DOI","asserted-by":"crossref"}]},{"name":"RIE 2020 Advanced Manufacturing and Engineering (AME) Programmatic","award":["A20G8b0102"],"award-info":[{"award-number":["A20G8b0102"]}]},{"name":"Joint SDU-NTU Research Centre on Artificial Intelligence (C-FAIR), Shandong University, China","award":["NSC-2019-011"],"award-info":[{"award-number":["NSC-2019-011"]}]},{"DOI":"10.13039\/501100001809","name":"NSFC","doi-asserted-by":"crossref","award":["91846205"],"award-info":[{"award-number":["91846205"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"SDNSFC","award":["ZR2019LZH008"],"award-info":[{"award-number":["ZR2019LZH008"]}]},{"name":"Shandong Provincial Key Research and Development Program","award":["2021CXGC010108"],"award-info":[{"award-number":["2021CXGC010108"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2022,8,31]]},"abstract":"<jats:p>Federated Learning (FL) bridges the gap between collaborative machine learning and preserving data privacy. To sustain the long-term operation of an FL ecosystem, it is important to attract high-quality data owners with appropriate incentive schemes. As an important building block of such incentive schemes, it is essential to fairly evaluate participants\u2019 contribution to the performance of the final FL model without exposing their private data. Shapley Value (SV)\u2013based techniques have been widely adopted to provide a fair evaluation of FL participant contributions. However, existing approaches incur significant computation costs, making them difficult to apply in practice. In this article, we propose the Guided Truncation Gradient Shapley (GTG-Shapley) approach to address this challenge. It reconstructs FL models from gradient updates for SV calculation instead of repeatedly training with different combinations of FL participants. In addition, we design a guided Monte Carlo sampling approach combined with within-round and between-round truncation to further reduce the number of model reconstructions and evaluations required. This is accomplished through extensive experiments under diverse realistic data distribution settings. The results demonstrate that GTG-Shapley can closely approximate actual Shapley values while significantly increasing computational efficiency compared with the state-of-the-art, especially under non-i.i.d. settings.<\/jats:p>","DOI":"10.1145\/3501811","type":"journal-article","created":{"date-parts":[[2022,2,4]],"date-time":"2022-02-04T22:33:18Z","timestamp":1644013998000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":106,"title":["GTG-Shapley: Efficient and Accurate Participant Contribution Evaluation in Federated Learning"],"prefix":"10.1145","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1236-531X","authenticated-orcid":false,"given":"Zelei","family":"Liu","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Nanyang Technological University, Singapore"}]},{"given":"Yuanyuan","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Nanyang Technological University, Singapore"}]},{"given":"Han","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Nanyang Technological University, Singapore"}]},{"given":"Yang","family":"Liu","sequence":"additional","affiliation":[{"name":"Institute for AI Industry Research, Tsinghua University, Beijing, China"}]},{"given":"Lizhen","family":"Cui","sequence":"additional","affiliation":[{"name":"School of Software, Shandong University, Shandong, China"}]}],"member":"320","published-online":{"date-parts":[[2022,5,3]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1080\/15427951.2013.830164"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cor.2008.04.004"},{"key":"e_1_3_2_4_2","first-page":"106","volume-title":"Federated Learning: Privacy and Incentives","author":"Chen Yiqiang","year":"2020","unstructured":"Yiqiang Chen, Xiaodong Yang, Xin Qin, Han Yu, Biao Chen, and Zhiqi Shen. 2020. Dealing with label quality disparity in federated learning. In Federated Learning: Privacy and Incentives, Qiang Yang, Lixin Fan, and Han Yu (Eds.). Springer, 106\u2013120."},{"key":"e_1_3_2_5_2","first-page":"1","volume-title":"WiOPT","author":"Ding Ningning","year":"2020","unstructured":"Ningning Ding, Zhixuan Fang, and Jianwei Huang. 2020. Incentive mechanism design for federated learning with multi-dimensional private information. In WiOPT. 1\u20138."},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/iThings\/GreenCom\/CPSCom\/SmartData.2019.00148"},{"key":"e_1_3_2_7_2","unstructured":"GDPR. 2018. General data protection regulation."},{"key":"e_1_3_2_8_2","unstructured":"Amirata Ghorbani and James Zou. 2019. Data Shapley: Equitable valuation of data for machine learning. In International Conference on Machine Learning . PMLR 2242\u20132251."},{"key":"e_1_3_2_9_2","first-page":"43:1\u201343:14","volume-title":"ESA","author":"Gollapudi Sreenivas","year":"2017","unstructured":"Sreenivas Gollapudi, Kostas Kollias, Debmalya Panigrahi, and Venetia Pliatsika. 2017. Profit sharing and efficiency in utility games. In ESA. 43:1\u201343:14."},{"key":"e_1_3_2_10_2","first-page":"1167","volume-title":"AISTATS","author":"Jia Ruoxi","year":"2019","unstructured":"Ruoxi Jia, David Dao, Boxin Wang, Frances Ann Hubis, Nick Hynes, Nezihe Merve G\u00fcrel, Bo Li, Ce Zhang, Dawn Song, and Costas J. Spanos. 2019. Towards efficient data valuation based on the Shapley value. In AISTATS. 1167\u20131176."},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2019.2940820"},{"key":"e_1_3_2_12_2","article-title":"MNIST handwritten digit database","volume":"2","author":"LeCun Yann","year":"2010","unstructured":"Yann LeCun, Corinna Cortes, and C. J. Burges. 2010. MNIST handwritten digit database. ATT Labs [Online]. Retrieved February 17, 2022 from http:\/\/yann.lecun.com\/exdb\/mnist. 2.","journal-title":"ATT Labs [Online]"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-63076-8_14"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2020.2996273"},{"key":"e_1_3_2_15_2","article-title":"Bounding the estimation error of sampling-based Shapley value approximation","author":"Maleki Sasan","year":"2013","unstructured":"Sasan Maleki, Long Tran-Thanh, Greg Hines, Talal Rahwan, and Alex Rogers. 2013. Bounding the estimation error of sampling-based Shapley value approximation. aarXiv:1306.4265.","journal-title":"aarXiv:1306.4265"},{"key":"e_1_3_2_16_2","first-page":"1273","volume-title":"AISTATS","author":"McMahan Brendan","year":"2017","unstructured":"Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. 2017. Communication-efficient learning of deep networks from decentralized data. In AISTATS. 1273\u20131282."},{"key":"e_1_3_2_17_2","article-title":"Estimation of individual device contributions for incentivizing federated learning","author":"Nishio Takayuki","year":"2020","unstructured":"Takayuki Nishio, Ryoichi Shinkuma, and Narayan B. Mandayam. 2020. Estimation of individual device contributions for incentivizing federated learning. arXiv:2009.09371.","journal-title":"arXiv:2009.09371"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2020.2971981"},{"key":"e_1_3_2_19_2","article-title":"Rewarding high-quality data via influence functions","author":"Richardson Adam","year":"2019","unstructured":"Adam Richardson, Aris Filos-Ratsikas, and Boi Faltings. 2019. Rewarding high-quality data via influence functions. arXiv:1908.11598.","journal-title":"arXiv:1908.11598"},{"issue":"28","key":"e_1_3_2_20_2","first-page":"307","article-title":"A value for n-person games","volume":"2","author":"Shapley Lloyd S.","year":"1953","unstructured":"Lloyd S. Shapley. 1953. A value for n-person games. Contributions to the Theory of Games 2, 28 (1953), 307\u2013317.","journal-title":"Contributions to the Theory of Games"},{"key":"e_1_3_2_21_2","first-page":"2577","volume-title":"IEEE BigData","author":"Song Tianshu","year":"2019","unstructured":"Tianshu Song, Yongxin Tong, and Shuyue Wei. 2019. Profit allocation for federated learning. In IEEE BigData. 2577\u20132586."},{"key":"e_1_3_2_22_2","article-title":"Towards personalized federated learning","author":"Tan Alysa Ziying","year":"2021","unstructured":"Alysa Ziying Tan, Han Yu, Lizhen Cui, and Qiang Yang. 2021. Towards personalized federated learning. arXiv: 2103.00710.","journal-title":"arXiv: 2103.00710"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM42981.2021.9488705"},{"issue":"1","key":"e_1_3_2_24_2","first-page":"1","article-title":"A new approximation method for the Shapley value applied to the WTC 9\/11 terrorist attack","volume":"8","author":"Campen Tjeerd van","year":"2018","unstructured":"Tjeerd van Campen, Herbert Hamers, Bart Husslage, and Roy Lindelauf. 2018. A new approximation method for the Shapley value applied to the WTC 9\/11 terrorist attack. Social Network Analysis and Mining 8, 1 (2018), 1\u201312.","journal-title":"Social Network Analysis and Mining"},{"key":"e_1_3_2_25_2","first-page":"2597","volume-title":"IEEE BigData","author":"Wang Guan","year":"2019","unstructured":"Guan Wang, Charlie Xiaoqian Dang, and Ziye Zhou. 2019. Measure contribution of participants in federated learning. In IEEE BigData. 2597\u20132604."},{"key":"e_1_3_2_26_2","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1007\/978-3-030-63076-8_11","volume-title":"Federated Learning: Privacy and Incentives","author":"Wang Tianhao","year":"2020","unstructured":"Tianhao Wang, Johannes Rausch, Ce Zhang, Ruoxi Jia, and Dawn Song. 2020. A principled approach to data valuation for federated learning. In Federated Learning: Privacy and Incentives, Qiang Yang, Lixin Fan, and Han Yu (Eds.). Springer, 153\u2013167."},{"key":"e_1_3_2_27_2","first-page":"139","volume-title":"Federated Learning: Privacy and Incentives","author":"Wei Shuyue","year":"2020","unstructured":"Shuyue Wei, Yongxin Tong, Zimu Zhou, and Tianshu Song. 2020. Efficient and fair data valuation for horizontal federated learning. In Federated Learning: Privacy and Incentives, Qiang Yang, Lixin Fan, and Han Yu (Eds.). Springer, 139\u2013152."},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.5555\/3386107"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2020.2987774"},{"issue":"1","key":"e_1_3_2_30_2","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1109\/ACCESS.2013.2259892","article-title":"A survey of multi-agent trust management systems","volume":"1","author":"Yu Han","year":"2013","unstructured":"Han Yu, Zhiqi Shen, Cyril Leung, Chunyan Miao, and Victor R. Lesser. 2013. A survey of multi-agent trust management systems. IEEE Access 1, 1 (2013), 35\u201350.","journal-title":"IEEE Access"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2010.2059690"},{"key":"e_1_3_2_32_2","article-title":"FMore: An incentive scheme of multi-dimensional auction for federated learning in MEC","author":"Zeng Rongfei","year":"2020","unstructured":"Rongfei Zeng, Shixun Zhang, Jiaqi Wang, and Xiaowen Chu. 2020. FMore: An incentive scheme of multi-dimensional auction for federated learning in MEC. arXiv:2002.09699.","journal-title":"arXiv:2002.09699"},{"key":"e_1_3_2_33_2","article-title":"Hierarchically fair federated learning","author":"Zhang Jingfeng","year":"2020","unstructured":"Jingfeng Zhang, Cheng Li, Antonio Robles-Kelly, and Mohan Kankanhalli. 2020. Hierarchically fair federated learning. arXiv:2004.10386.","journal-title":"arXiv:2004.10386"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.26599\/TST.2020.9010046"},{"key":"e_1_3_2_35_2","article-title":"When crowdsensing meets federated learning: Privacy-preserving mobile crowdsensing system","author":"Zhao Bowen","year":"2021","unstructured":"Bowen Zhao, Ximeng Liu, and Wei-neng Chen. 2021. When crowdsensing meets federated learning: Privacy-preserving mobile crowdsensing system. arXiv:2102.10109.","journal-title":"arXiv:2102.10109"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3501811","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3501811","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:09:48Z","timestamp":1750183788000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3501811"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,3]]},"references-count":34,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,8,31]]}},"alternative-id":["10.1145\/3501811"],"URL":"https:\/\/doi.org\/10.1145\/3501811","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,3]]},"assertion":[{"value":"2021-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-05-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}