{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,7]],"date-time":"2025-11-07T09:45:45Z","timestamp":1762508745050,"version":"3.41.0"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2022,9,22]],"date-time":"2022-09-22T00:00:00Z","timestamp":1663804800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62088102"],"award-info":[{"award-number":["62088102"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"PKU-NTU Joint Research Institute (JRI) sponsored by a donation from the Ng Teng Fong Charitable Foundation"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2022,12,31]]},"abstract":"<jats:p>The rapid development of modern artificial intelligence technique is mainly attributed to sufficient and high-quality data. However, in the data collection, personal privacy is at risk of being leaked. This issue can be addressed by federated learning, which is proposed to achieve efficient model training among multiple data providers without direct data access and aggregation. To encourage more parties owning high-quality data to participate in the federated learning, it is important to evaluate and reward the participant contribution in a reasonable, robust, and efficient manner. To achieve this goal, we propose a novel contribution estimation method: Intrinsic Performance Influence-based Contribution Estimation (IPICE). In particular, the class-level intrinsic performance influence is adopted as the contribution estimation criteria in IPICE, and a neural network is employed to exploit the non-linear relationship between the performance change and estimated contribution. Extensive experiments are conducted on various datasets, and the results demonstrate that IPICE is more accurate and stable than the counterpart in various data distribution settings. The computational complexity is significantly reduced in our IPICE, especially when a new party joins the federation. IPICE assigns small contributions to bad\/garbage data and thus prevent them from participating and deteriorating the learning ecosystem.<\/jats:p>\n          <jats:p\/>","DOI":"10.1145\/3523059","type":"journal-article","created":{"date-parts":[[2022,3,22]],"date-time":"2022-03-22T14:20:27Z","timestamp":1647958827000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Intrinsic Performance Influence-based Participant Contribution Estimation for Horizontal Federated Learning"],"prefix":"10.1145","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1049-3104","authenticated-orcid":false,"given":"Lin","family":"Zhang","sequence":"first","affiliation":[{"name":"Peking University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lixin","family":"Fan","sequence":"additional","affiliation":[{"name":"WeBank, Shenzhen, Guangdong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yong","family":"Luo","sequence":"additional","affiliation":[{"name":"Wuhan University, Wuhan, Hubei Province, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ling-Yu","family":"Duan","sequence":"additional","affiliation":[{"name":"Peking University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,9,22]]},"reference":[{"key":"e_1_3_2_2_2","first-page":"477","article-title":"Towards effective device-aware federated learning. In","author":"Anelli Vito Walter","year":"2019","unstructured":"Vito Walter Anelli, Yashar Deldjoo, Tommaso Di Noia, and Antonio Ferrara. 2019. Towards effective device-aware federated learning. InProceedings of the International Conference of the Italian Association for Artificial Intelligence. 477\u2013491.","journal-title":"Proceedings of the International Conference of the Italian Association for Artificial Intelligence"},{"key":"e_1_3_2_3_2","article-title":"Expanding the reach of federated learning by reducing client resource requirements","author":"Caldas Sebastian","year":"2018","unstructured":"Sebastian Caldas, Jakub Konecn\u00fd, H. Brendan McMahan, and Ameet Talwalkar. 2018. Expanding the reach of federated learning by reducing client resource requirements. arXiv:1812.07210. Retrieved from https:\/\/arxiv.org\/abs\/1812.07210.","journal-title":"arXiv:1812.07210"},{"key":"e_1_3_2_4_2","article-title":"Leaf: A benchmark for federated settings","author":"Caldas Sebastian","year":"2018","unstructured":"Sebastian Caldas, Peter Wu, Tian Li, Jakub Kone\u010dn\u1ef3, H. Brendan McMahan, Virginia Smith, and Ameet Talwalkar. 2018. Leaf: A benchmark for federated settings. arXiv:1812.01097. Retrieved from https:\/\/arxiv.org\/abs\/1812.01097.","journal-title":"arXiv:1812.01097"},{"key":"e_1_3_2_5_2","article-title":"EMNIST: an extension of MNIST to handwritten letters","author":"Cohen Gregory","year":"2017","unstructured":"Gregory Cohen, Saeed Afshar, Jonathan Tapson, and Andr\u00e9 van Schaik. 2017. EMNIST: an extension of MNIST to handwritten letters. arXiv:1702.05373. Retrieved from https:\/\/arxiv.org\/abs\/1702.05373.","journal-title":"arXiv:1702.05373"},{"key":"e_1_3_2_6_2","article-title":"Detection of influential observation in linear regression","author":"Cook R. Dennis","year":"1977","unstructured":"R. Dennis Cook. 1977. Detection of influential observation in linear regression. Technometrics (1977).","journal-title":"Technometrics"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-01577-9"},{"key":"e_1_3_2_8_2","article-title":"HHHFL: Hierarchical heterogeneous horizontal federated learning for electroencephalography","author":"Gao Dashan","year":"2019","unstructured":"Dashan Gao, Ce Ju, Xiguang Wei, Yang Liu, Tianjian Chen, and Qiang Yang. 2019. HHHFL: Hierarchical heterogeneous horizontal federated learning for electroencephalography. arXiv:1909.05784. Retrieved from https:\/\/arxiv.org\/abs\/1909.05784.","journal-title":"arXiv:1909.05784"},{"key":"e_1_3_2_9_2","article-title":"Federated learning for mobile keyboard prediction","author":"Hard Andrew","year":"2018","unstructured":"Andrew Hard, Kanishka Rao, Rajiv Mathews, Swaroop Ramaswamy, Fran\u00e7oise Beaufays, Sean Augenstein, Hubert Eichner, Chlo\u00e9 Kiddon, and Daniel Ramage. 2018. Federated learning for mobile keyboard prediction. arXiv:1811.03604. Retrieved from https:\/\/arxiv.org\/abs\/1811.03604.","journal-title":"arXiv:1811.03604"},{"key":"e_1_3_2_10_2","article-title":"Federated learning for ranking browser history suggestions","author":"Hartmann Florian","year":"2019","unstructured":"Florian Hartmann, Sunah Suh, Arkadiusz Komarzewski, Tim D. Smith, and Ilana Segall. 2019. Federated learning for ranking browser history suggestions. arXiv:1911.11807. Retrieved from https:\/\/arxiv.org\/abs\/1911.11807.","journal-title":"arXiv:1911.11807"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298658"},{"key":"e_1_3_2_12_2","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201919)","author":"Hsu Tzu-Ming Harry","year":"2019","unstructured":"Tzu-Ming Harry Hsu, Hang Qi, and Matthew Brown. 2019. Measuring the effects of non-identical data distribution for federated visual classification. In Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201919)."},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3357384.3357909"},{"key":"e_1_3_2_14_2","article-title":"Improving federated learning personalization via model agnostic meta learning. In","author":"Jiang Yihan","year":"2019","unstructured":"Yihan Jiang, Jakub Konecn\u00fd, Keith Rush, and Sreeram Kannan. 2019. Improving federated learning personalization via model agnostic meta learning. InProceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201919).","journal-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201919)"},{"issue":"1","key":"e_1_3_2_15_2","article-title":"Advances and open problems in federated learning","volume":"14","author":"Kairouz Peter","year":"2021","unstructured":"Peter Kairouz, H. Brendan McMahan, Brendan Avent, Aur\u00e9lien Bellet, Mehdi Bennis, Arjun Nitin Bhagoji, et\u00a0al. 2021. Advances and open problems in federated learning. Found. Trends Mach. Learn. 14, 1 (2021).","journal-title":"Found. Trends Mach. Learn."},{"issue":"6","key":"e_1_3_2_16_2","first-page":"10700","article-title":"Incentive mechanism for reliable federated learning: A joint optimization approach to combining reputation and contract theory","volume":"6","author":"Kang Jiawen","year":"2019","unstructured":"Jiawen Kang, Zehui Xiong, Dusit Niyato, Shengli Xie, and Junshan Zhang. 2019. Incentive mechanism for reliable federated learning: A joint optimization approach to combining reputation and contract theory. IEEE IoT J. 6, 6 (2019), 10700\u201310714.","journal-title":"IEEE IoT J."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/VTS-APWCS.2019.8851649"},{"key":"e_1_3_2_18_2","article-title":"Federated learning: Strategies for improving communication efficiency","author":"Kone\u010dn\u00fd Jakub","year":"2018","unstructured":"Jakub Kone\u010dn\u00fd, H. Brendan McMahan, Felix X. Yu, Ananda Theertha Suresh, Dave Bacon, and Peter Richt\u00e1rik. 2018. Federated learning: Strategies for improving communication efficiency. arXiv:1610.05492. Retrieved from https:\/\/arxiv.org\/abs\/1610.05492.","journal-title":"arXiv:1610.05492"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2013.77"},{"key":"e_1_3_2_20_2","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201920)","author":"Li Tian","year":"2020","unstructured":"Tian Li, Maziar Sanjabi, Ahmad Beirami, and Virginia Smith. 2020. Fair resource allocation in federated learning. In Proceedings of the International Conference on Learning Representations (ICLR\u201920)."},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2017.2751966"},{"key":"e_1_3_2_22_2","article-title":"Secure federated transfer learning","author":"Liu Yang","year":"2018","unstructured":"Yang Liu, Tianjian Chen, and Qiang Yang. 2018. Secure federated transfer learning. arXiv:1812.03337. Retrieved from https:\/\/arxiv.org\/abs\/1812.03337.","journal-title":"arXiv:1812.03337"},{"key":"e_1_3_2_23_2","article-title":"Learn electronic health records by fully decentralized federated learning.","author":"Lu Songtao","year":"2019","unstructured":"Songtao Lu, Yawen Zhang, Yunlong Wang, and Christina Mack. 2019. Learn electronic health records by fully decentralized federated learning.arXiv:1912.01792. Retrieved from https:\/\/arxiv.org\/abs\/1912.01792.","journal-title":"arXiv:1912.01792"},{"key":"e_1_3_2_24_2","unstructured":"Brendan McMahan Eider Moore Daniel Ramage Seth Hampson and Blaise Aguera y Arcas. 2017. Communication-efficient learning of deep networks from decentralized data. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics . 1273\u20131282."},{"key":"e_1_3_2_25_2","article-title":"Communication-efficient learning of deep networks from decentralized data","author":"McMahan H. Brendan","year":"2016","unstructured":"H. Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, et\u00a0al. 2016. Communication-efficient learning of deep networks from decentralized data. arXiv:1602.05629. Retrieved from https:\/\/arxiv.org\/abs\/1602.05629.","journal-title":"arXiv:1602.05629"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICVGIP.2008.47"},{"key":"e_1_3_2_27_2","volume-title":"Proceedings of the 8th International Conference on Learning Representations","author":"Peng Xingchao","year":"2020","unstructured":"Xingchao Peng, Zijun Huang, Yizhe Zhu, and Kate Saenko. 2020. Federated adversarial domain adaptation. In Proceedings of the 8th International Conference on Learning Representations(ICLR\u201920)."},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-48881-3_2"},{"key":"e_1_3_2_29_2","first-page":"307","article-title":"A value for n-person games.","volume":"28","author":"Shapley Lloyd S.","year":"1953","unstructured":"Lloyd S. Shapley. 1953. A value for n-person games.Ann. Math. Stud. 28 (1953), 307\u2013317.","journal-title":"Ann. Math. Stud."},{"key":"e_1_3_2_30_2","first-page":"1","article-title":"Federated topic discovery: A semantic consistent approach","author":"Shi Yexuan","year":"2020","unstructured":"Yexuan Shi, Yongxin Tong, Zhiyang Su, Di Jiang, Zimu Zhou, and Wenbin Zhang. 2020. Federated topic discovery: A semantic consistent approach. Missouri Rev. (2020), 1\u20131.","journal-title":"Missouri Rev."},{"key":"e_1_3_2_31_2","doi-asserted-by":"crossref","unstructured":"Hao Luo Wei Jiang Youzhi Gu Fuxu Liu Xingyu Liao Shenqi Lai and Jianyang Gu. 2019. A strong baseline and batch normalization neck for deep person re-identification. IEEE Trans. Multimedia 22 10 (2019) 2597\u20132609.","DOI":"10.1109\/TMM.2019.2958756"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData47090.2019.9006327"},{"key":"e_1_3_2_33_2","article-title":"Data poisoning attacks on federated machine learning","author":"Sun Gan","year":"2020","unstructured":"Gan Sun, Yang Cong, Jiahua Dong, Qiang Wang, and Ji Liu. 2020. Data poisoning attacks on federated machine learning. arXiv:2004.10020. Retrieved from https:\/\/arxiv.org\/abs\/2004.10020.","journal-title":"arXiv:2004.10020"},{"key":"e_1_3_2_34_2","article-title":"Can you really backdoor federated learning","author":"Suresh Ananda Theertha","year":"2019","unstructured":"Ananda Theertha Suresh, Brendan McMahan, Peter Kairouz, and Ziteng Sun. 2019. Can you really backdoor federated learning. arXiv:1911.07963. Retrieved from https:\/\/arxiv.org\/abs\/1911.07963.","journal-title":"arXiv:1911.07963"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58951-6_24"},{"key":"e_1_3_2_36_2","article-title":"The caltech-ucsd birds-200-2011 dataset","author":"Wah Catherine","year":"2011","unstructured":"Catherine Wah, Steve Branson, Peter Welinder, Pietro Perona, and Serge Belongie. 2011. The caltech-ucsd birds-200-2011 dataset. California Institute of Technology.","journal-title":"California Institute of Technology"},{"key":"e_1_3_2_37_2","article-title":"Interpret federated learning with shapley values.","author":"Wang Guan","year":"2019","unstructured":"Guan Wang. 2019. Interpret federated learning with shapley values.arXiv preprint arXiv:1905.04519. Retrieved from https:\/\/arxiv.org\/abs\/1905.04519.","journal-title":"arXiv preprint arXiv:1905.04519"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/BigData47090.2019.9006179"},{"issue":"4","key":"e_1_3_2_39_2","first-page":"6283","article-title":"Federated latent dirichlet allocation: A local differential privacy based framework","volume":"34","author":"Wang Yansheng","year":"2020","unstructured":"Yansheng Wang, Yongxin Tong, and Dingyuan Shi. 2020. Federated latent dirichlet allocation: A local differential privacy based framework. Proc. AAAI Conf. Artif. Intell. 34, 4 (2020), 6283\u20136290.","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-63076-8_10"},{"key":"e_1_3_2_41_2","volume-title":"Proceedings of the International Conference on Learning Representations (ICLR\u201920)","author":"Xie Chulin","year":"2020","unstructured":"Chulin Xie, Keli Huang, Pin-Yu Chen, and Bo Li. 2020. DBA: Distributed backdoor attacks against federated learning. In Proceedings of the International Conference on Learning Representations (ICLR\u201920)."},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3298981"},{"key":"e_1_3_2_43_2","article-title":"Federated learning with unbiased gradient aggregation and controllable meta updating.","author":"Yao Xin","year":"2019","unstructured":"Xin Yao, Tianchi Huang, Rui-Xiao Zhang, Ruiyu Li, and Lifeng Sun. 2019. Federated learning with unbiased gradient aggregation and controllable meta updating.Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201919).","journal-title":"Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS\u201919)"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.405"},{"key":"e_1_3_2_45_2","first-page":"1","article-title":"Applications of federated learning in smart cities: Recent advances, taxonomy, and open challenges","author":"Zheng Zhaohua","year":"2021","unstructured":"Zhaohua Zheng, Yize Zhou, Yilong Sun, Zhang Wang, Boyi Liu, and Keqiu Li. 2021. Applications of federated learning in smart cities: Recent advances, taxonomy, and open challenges. Connect. Sci. (2021), 1\u201328.","journal-title":"Connect. Sci."},{"key":"e_1_3_2_46_2","article-title":"Federated reinforcement learning","author":"Zhuo Hankz Hankui","year":"2019","unstructured":"Hankz Hankui Zhuo, Wenfeng Feng, Qian Xu, Qiang Yang, and Yufeng Lin. 2019. Federated reinforcement learning. arXiv:1901.08277. Retrieved from https:\/\/arxiv.org\/abs\/1901.08277.","journal-title":"arXiv:1901.08277"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3523059","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3523059","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:17Z","timestamp":1750188617000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3523059"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,22]]},"references-count":45,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022,12,31]]}},"alternative-id":["10.1145\/3523059"],"URL":"https:\/\/doi.org\/10.1145\/3523059","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"type":"print","value":"2157-6904"},{"type":"electronic","value":"2157-6912"}],"subject":[],"published":{"date-parts":[[2022,9,22]]},"assertion":[{"value":"2020-09-03","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-02-28","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-09-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}