{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T15:41:28Z","timestamp":1785512488801,"version":"3.56.0"},"reference-count":53,"publisher":"Association for Computing Machinery (ACM)","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:p>\n            Matrix factorization (MF) approximates unobserved ratings in a rating matrix, whose rows correspond to users and columns correspond to items to be rated, and has been serving as a fundamental building block in recommendation systems. This paper comprehensively studies the problem of matrix factorization in different\n            <jats:italic>federated learning<\/jats:italic>\n            (FL) settings, where a set of parties want to cooperate in training but refuse to share data directly. We first propose a generic algorithmic framework for various settings of &lt;u&gt;f&lt;\/u&gt;ederated &lt;u&gt;m&lt;\/u&gt;atrix &lt;u&gt;f&lt;\/u&gt;actorization (FMF) and provide a theoretical convergence guarantee. We then systematically characterize privacy-leakage risks in data collection, training, and publishing stages for three different settings and introduce privacy notions to provide end-to-end privacy protections. The first one is\n            <jats:italic>vertical federated learning<\/jats:italic>\n            (VFL), where multiple parties have the ratings from the same set of users but on disjoint sets of items. The second one is\n            <jats:italic>horizontal federated learning<\/jats:italic>\n            (HFL), where parties have ratings from different sets of users but on the same set of items. The third setting is\n            <jats:italic>local federated learning<\/jats:italic>\n            (LFL), where the ratings of the users are only stored on their local devices. We introduce adapted versions of FMF with the privacy notions guaranteed in the three settings. In particular, a new private learning technique called\n            <jats:italic>embedding clipping<\/jats:italic>\n            is introduced and used in all the three settings to ensure differential privacy. For the LFL setting, we combine differential privacy with secure aggregation to protect the communication between user devices and the server with a strength similar to the local differential privacy model, but much better accuracy. We perform experiments to demonstrate the effectiveness of our approaches.\n          <\/jats:p>","DOI":"10.14778\/3503585.3503598","type":"journal-article","created":{"date-parts":[[2022,4,14]],"date-time":"2022-04-14T22:18:07Z","timestamp":1649974687000},"page":"900-913","source":"Crossref","is-referenced-by-count":30,"title":["Federated matrix factorization with privacy guarantee"],"prefix":"10.14778","volume":"15","author":[{"given":"Zitao","family":"Li","sequence":"first","affiliation":[{"name":"Purdue University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bolin","family":"Ding","sequence":"additional","affiliation":[{"name":"Alibaba Group"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ce","family":"Zhang","sequence":"additional","affiliation":[{"name":"ETH Z\u00fcrich"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ninghui","family":"Li","sequence":"additional","affiliation":[{"name":"Purdue University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingren","family":"Zhou","sequence":"additional","affiliation":[{"name":"Alibaba Group"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,4,14]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2976749.2978318"},{"key":"e_1_2_1_2_1","doi-asserted-by":"crossref","unstructured":"Charu C Aggarwal etal 2016. Recommender systems. Vol. 1. Springer New York USA.  Charu C Aggarwal et al. 2016. Recommender systems. Vol. 1. Springer New York USA.","DOI":"10.1007\/978-3-319-29659-3_1"},{"key":"e_1_2_1_3_1","first-page":"15479","article-title":"Differential privacy has disparate impact on model accuracy","volume":"32","author":"Bagdasaryan Eugene","year":"2019","unstructured":"Eugene Bagdasaryan , Omid Poursaeed , and Vitaly Shmatikov . 2019 . Differential privacy has disparate impact on model accuracy . Advances in Neural Information Processing Systems 32 (2019), 15479 -- 15488 . Eugene Bagdasaryan, Omid Poursaeed, and Vitaly Shmatikov. 2019. Differential privacy has disparate impact on model accuracy. Advances in Neural Information Processing Systems 32 (2019), 15479--15488.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/MLSP.2016.7738886"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3372297.3417885"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3133956.3133982"},{"key":"e_1_2_1_7_1","unstructured":"Lukas Brozovsky and Vaclav Petricek. 2007. Recommender System for Online Dating Service.  Lukas Brozovsky and Vaclav Petricek. 2007. Recommender System for Online Dating Service."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2020.3014880"},{"key":"e_1_2_1_9_1","unstructured":"Tianyi Chen Xiao Jin Yuejiao Sun and Wotao Yin. 2020. VAFL: a Method of Vertical Asynchronous Federated Learning. arXiv:2007.06081 [cs.LG]  Tianyi Chen Xiao Jin Yuejiao Sun and Wotao Yin. 2020. VAFL: a Method of Vertical Asynchronous Federated Learning. arXiv:2007.06081 [cs.LG]"},{"key":"e_1_2_1_10_1","volume-title":"Advances in Neural Information Processing Systems","author":"Chen Xiangyi","year":"2020","unstructured":"Xiangyi Chen , Steven Z. Wu , and Mingyi Hong . 2020. Understanding Gradient Clipping in Private SGD: A Geometric Perspective . In Advances in Neural Information Processing Systems , H. Larochelle, M. Ranzato, R. Hadsell, M. F. Balcan, and H. Lin (Eds.), Vol. 33 . Curran Associates, Inc. , Red Hook, NY, USA , 13773--13782. https:\/\/proceedings.neurips.cc\/paper\/ 2020 \/file\/9ecff5455677b38d19f49ce658ef0608-Paper.pdf Xiangyi Chen, Steven Z. Wu, and Mingyi Hong. 2020. Understanding Gradient Clipping in Private SGD: A Geometric Perspective. In Advances in Neural Information Processing Systems, H. Larochelle, M. Ranzato, R. Hadsell, M. F. Balcan, and H. Lin (Eds.), Vol. 33. Curran Associates, Inc., Red Hook, NY, USA, 13773--13782. https:\/\/proceedings.neurips.cc\/paper\/2020\/file\/9ecff5455677b38d19f49ce658ef0608-Paper.pdf"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/3294996.3295115"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/773153.773173"},{"key":"e_1_2_1_13_1","volume-title":"Theory of Cryptography","author":"Dwork Cynthia","unstructured":"Cynthia Dwork , Frank McSherry , Kobbi Nissim , and Adam Smith . 2006. Calibrating Noise to Sensitivity in Private Data Analysis . In Theory of Cryptography , Shai Halevi and Tal Rabin (Eds.). Springer Berlin Heidelberg , Berlin, Heidelberg , 265--284. Cynthia Dwork, Frank McSherry, Kobbi Nissim, and Adam Smith. 2006. Calibrating Noise to Sensitivity in Private Data Analysis. In Theory of Cryptography, Shai Halevi and Tal Rabin (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 265--284."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-statistics-060116-054123"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2660267.2660348"},{"key":"e_1_2_1_16_1","doi-asserted-by":"crossref","unstructured":"Vitaly Feldman Audra McMillan and Kunal Talwar. 2021. Hiding Among the Clones: A Simple and Nearly Optimal Analysis of Privacy Amplification by Shuffling. arXiv:2012.12803 [cs.LG]  Vitaly Feldman Audra McMillan and Kunal Talwar. 2021. Hiding Among the Clones: A Simple and Nearly Optimal Analysis of Privacy Amplification by Shuffling. arXiv:2012.12803 [cs.LG]","DOI":"10.1109\/FOCS52979.2021.00096"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-67661-2_20"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2020408.2020426"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of The 24th International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research), Arindam Banerjee and Kenji Fukumizu (Eds.)","volume":"130","author":"Girgis Antonious","year":"2021","unstructured":"Antonious Girgis , Deepesh Data , Suhas Diggavi , Peter Kairouz , and Ananda Theertha Suresh . 2021 . Shuffled Model of Differential Privacy in Federated Learning . In Proceedings of The 24th International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research), Arindam Banerjee and Kenji Fukumizu (Eds.) , Vol. 130 . PMLR, USA, 2521--2529. https:\/\/proceedings.mlr.press\/v130\/girgis21a.html Antonious Girgis, Deepesh Data, Suhas Diggavi, Peter Kairouz, and Ananda Theertha Suresh. 2021. Shuffled Model of Differential Privacy in Federated Learning. In Proceedings of The 24th International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research), Arindam Banerjee and Kenji Fukumizu (Eds.), Vol. 130. PMLR, USA, 2521--2529. https:\/\/proceedings.mlr.press\/v130\/girgis21a.html"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611973075.90"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2827872"},{"key":"e_1_2_1_22_1","unstructured":"Yaochen Hu Peng Liu Linglong Kong and Di Niu. 2019. Learning Privately over Distributed Features: An ADMM Sharing Approach. arXiv:1907.07735 [cs.LG]  Yaochen Hu Peng Liu Linglong Kong and Di Niu. 2019. Learning Privately over Distributed Features: An ADMM Sharing Approach. arXiv:1907.07735 [cs.LG]"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330765"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/2832415.2832494"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning (Proceedings of Machine Learning Research), Jennifer Dy and Andreas Krause (Eds.)","volume":"80","author":"Jain Prateek","year":"2018","unstructured":"Prateek Jain , Om Dipakbhai Thakkar , and Abhradeep Thakurta . 2018 . Differentially Private Matrix Completion Revisited . In Proceedings of the 35th International Conference on Machine Learning (Proceedings of Machine Learning Research), Jennifer Dy and Andreas Krause (Eds.) , Vol. 80 . PMLR, USA, 2215--2224. https:\/\/proceedings.mlr.press\/v80\/jain18b.html Prateek Jain, Om Dipakbhai Thakkar, and Abhradeep Thakurta. 2018. Differentially Private Matrix Completion Revisited. In Proceedings of the 35th International Conference on Machine Learning (Proceedings of Machine Learning Research), Jennifer Dy and Andreas Krause (Eds.), Vol. 80. PMLR, USA, 2215--2224. https:\/\/proceedings.mlr.press\/v80\/jain18b.html"},{"key":"e_1_2_1_26_1","doi-asserted-by":"crossref","unstructured":"Peter Kairouz H. Brendan McMahan Brendan Avent Aur\u00e9lien Bellet Mehdi Bennis Arjun Nitin Bhagoji Kallista Bonawitz Zachary Charles Graham Cormode Rachel Cummings Rafael G. L. D'Oliveira Hubert Eichner Salim El Rouayheb David Evans Josh Gardner Zachary Garrett Adri\u00e0 Gasc\u00f3n Badih Ghazi Phillip B. Gibbons Marco Gruteser Zaid Harchaoui Chaoyang He Lie He Zhouyuan Huo Ben Hutchinson Justin Hsu Martin Jaggi Tara Javidi Gauri Joshi Mikhail Khodak Jakub Kone\u010dn\u00fd Aleksandra Korolova Farinaz Koushanfar Sanmi Koyejo Tancr\u00e8de Lepoint Yang Liu Prateek Mittal Mehryar Mohri Richard Nock Ayfer \u00d6zg\u00fcr Rasmus Pagh Mariana Raykova Hang Qi Daniel Ramage Ramesh Raskar Dawn Song Weikang Song Sebastian U. Stich Ziteng Sun Ananda Theertha Suresh Florian Tram\u00e8r Praneeth Vepakomma Jianyu Wang Li Xiong Zheng Xu Qiang Yang Felix X. Yu Han Yu and Sen Zhao. 2021. Advances and Open Problems in Federated Learning. arXiv:1912.04977 [cs.LG]  Peter Kairouz H. Brendan McMahan Brendan Avent Aur\u00e9lien Bellet Mehdi Bennis Arjun Nitin Bhagoji Kallista Bonawitz Zachary Charles Graham Cormode Rachel Cummings Rafael G. L. D'Oliveira Hubert Eichner Salim El Rouayheb David Evans Josh Gardner Zachary Garrett Adri\u00e0 Gasc\u00f3n Badih Ghazi Phillip B. Gibbons Marco Gruteser Zaid Harchaoui Chaoyang He Lie He Zhouyuan Huo Ben Hutchinson Justin Hsu Martin Jaggi Tara Javidi Gauri Joshi Mikhail Khodak Jakub Kone\u010dn\u00fd Aleksandra Korolova Farinaz Koushanfar Sanmi Koyejo Tancr\u00e8de Lepoint Yang Liu Prateek Mittal Mehryar Mohri Richard Nock Ayfer \u00d6zg\u00fcr Rasmus Pagh Mariana Raykova Hang Qi Daniel Ramage Ramesh Raskar Dawn Song Weikang Song Sebastian U. Stich Ziteng Sun Ananda Theertha Suresh Florian Tram\u00e8r Praneeth Vepakomma Jianyu Wang Li Xiong Zheng Xu Qiang Yang Felix X. Yu Han Yu and Sen Zhao. 2021. Advances and Open Problems in Federated Learning. arXiv:1912.04977 [cs.LG]","DOI":"10.1561\/9781680837896"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098118"},{"key":"e_1_2_1_28_1","volume-title":"Federated Optimization: Distributed Machine Learning for On-Device Intelligence. arXiv:1610.02527 [cs.LG]","author":"Kone\u010dn\u00fd Jakub","year":"2016","unstructured":"Jakub Kone\u010dn\u00fd , H. Brendan McMahan , Daniel Ramage , and Peter Richt\u00e1rik . 2016 . Federated Optimization: Distributed Machine Learning for On-Device Intelligence. arXiv:1610.02527 [cs.LG] Jakub Kone\u010dn\u00fd, H. Brendan McMahan, Daniel Ramage, and Peter Richt\u00e1rik. 2016. Federated Optimization: Distributed Machine Learning for On-Device Intelligence. arXiv:1610.02527 [cs.LG]"},{"key":"e_1_2_1_29_1","volume-title":"Ananda Theertha Suresh, and Dave Bacon","author":"Kone\u010dn\u00fd Jakub","year":"2017","unstructured":"Jakub Kone\u010dn\u00fd , H. Brendan McMahan , Felix X. Yu , Peter Richt\u00e1rik , Ananda Theertha Suresh, and Dave Bacon . 2017 . Federated Learning : Strategies for Improving Communication Efficiency . arXiv:1610.05492 [cs.LG] Jakub Kone\u010dn\u00fd, H. Brendan McMahan, Felix X. Yu, Peter Richt\u00e1rik, Ananda Theertha Suresh, and Dave Bacon. 2017. Federated Learning: Strategies for Improving Communication Efficiency. arXiv:1610.05492 [cs.LG]"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2009.263"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2414456.2414474"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBDATA.2020.2992755"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2792838.2800191"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357384.3357878"},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research), Aarti Singh and Jerry Zhu (Eds.)","volume":"54","author":"McMahan Brendan","year":"2017","unstructured":"Brendan McMahan , Eider Moore , Daniel Ramage , Seth Hampson , and Blaise Aguera y Arcas . 2017 . Communication-Efficient Learning of Deep Networks from Decentralized Data . In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research), Aarti Singh and Jerry Zhu (Eds.) , Vol. 54 . PMLR, USA, 1273--1282. https:\/\/proceedings.mlr.press\/v54\/mcmahan17a.html Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. 2017. Communication-Efficient Learning of Deep Networks from Decentralized Data. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (Proceedings of Machine Learning Research), Aarti Singh and Jerry Zhu (Eds.), Vol. 54. PMLR, USA, 1273--1282. https:\/\/proceedings.mlr.press\/v54\/mcmahan17a.html"},{"key":"e_1_2_1_36_1","volume-title":"Learning Differentially Private Recurrent Language Models. In International Conference on Learning Representations. OpenReview.net. https:\/\/openreview.net\/forum?id=BJ0hF1Z0b","author":"McMahan H Brendan","year":"2018","unstructured":"H Brendan McMahan , Daniel Ramage , Kunal Talwar , and Li Zhang . 2018 . Learning Differentially Private Recurrent Language Models. In International Conference on Learning Representations. OpenReview.net. https:\/\/openreview.net\/forum?id=BJ0hF1Z0b H Brendan McMahan, Daniel Ramage, Kunal Talwar, and Li Zhang. 2018. Learning Differentially Private Recurrent Language Models. In International Conference on Learning Representations. OpenReview.net. https:\/\/openreview.net\/forum?id=BJ0hF1Z0b"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559845.1559850"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2019.00029"},{"key":"e_1_2_1_39_1","unstructured":"Arvind Narayanan and Vitaly Shmatikov. 2006. How to break anonymity of the netflix prize dataset.  Arvind Narayanan and Vitaly Shmatikov. 2006. How to break anonymity of the netflix prize dataset."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2014.140"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2018.2805356"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/GlobalSIP.2013.6736861"},{"key":"e_1_2_1_43_1","unstructured":"Apple Differential Privacy Team. 2021. Differential Privacy Overview - Apple. Apple. inc. https:\/\/www.apple.com\/privacy\/docs\/Differential_Privacy_Overview.pdf  Apple Differential Privacy Team. 2021. Differential Privacy Overview - Apple. Apple. inc. https:\/\/www.apple.com\/privacy\/docs\/Differential_Privacy_Overview.pdf"},{"key":"e_1_2_1_44_1","unstructured":"TensorFlow-Privacy. 2021. TensorFlow Privacy. https:\/\/github.com\/tensorflow\/privacy. Accessed: 2021-12-01.  TensorFlow-Privacy. 2021. TensorFlow Privacy. https:\/\/github.com\/tensorflow\/privacy. Accessed: 2021-12-01."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2012.51"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2012.51"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2020.2988575"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP40000.2020.00025"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.14778\/3407790.3407811"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3298981"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611972764.58"},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence 31","author":"Zhao Handong","year":"2017","unstructured":"Handong Zhao , Zhengming Ding , and Yun Fu . 2017 . Multi-view clustering via deep matrix factorization . Proceedings of the AAAI Conference on Artificial Intelligence 31 , 1 (2017), -. https:\/\/ojs.aaai.org\/index.php\/AAAI\/article\/view\/10867 Handong Zhao, Zhengming Ding, and Yun Fu. 2017. Multi-view clustering via deep matrix factorization. Proceedings of the AAAI Conference on Artificial Intelligence 31, 1 (2017), -. https:\/\/ojs.aaai.org\/index.php\/AAAI\/article\/view\/10867"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-63076-8_2"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3503585.3503598","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T10:30:08Z","timestamp":1672223408000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3503585.3503598"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12]]},"references-count":53,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["10.14778\/3503585.3503598"],"URL":"https:\/\/doi.org\/10.14778\/3503585.3503598","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2021,12]]}}}