{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T18:00:24Z","timestamp":1772906424075,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":39,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,10,21]],"date-time":"2023-10-21T00:00:00Z","timestamp":1697846400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,10,21]]},"DOI":"10.1145\/3583780.3615208","type":"proceedings-article","created":{"date-parts":[[2023,10,21]],"date-time":"2023-10-21T07:45:42Z","timestamp":1697874342000},"page":"4365-4369","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["G-Meta: Distributed Meta Learning in GPU Clusters for Large-Scale Recommender Systems"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-5189-3606","authenticated-orcid":false,"given":"Youshao","family":"Xiao","sequence":"first","affiliation":[{"name":"Ant Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-3058-7285","authenticated-orcid":false,"given":"Shangchun","family":"Zhao","sequence":"additional","affiliation":[{"name":"Ant Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4672-3197","authenticated-orcid":false,"given":"Zhenglei","family":"Zhou","sequence":"additional","affiliation":[{"name":"Ant Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3611-0901","authenticated-orcid":false,"given":"Zhaoxin","family":"Huan","sequence":"additional","affiliation":[{"name":"Ant Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-8807-9478","authenticated-orcid":false,"given":"Lin","family":"Ju","sequence":"additional","affiliation":[{"name":"Ant Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8055-0245","authenticated-orcid":false,"given":"Xiaolu","family":"Zhang","sequence":"additional","affiliation":[{"name":"Ant Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9807-9479","authenticated-orcid":false,"given":"Lin","family":"Wang","sequence":"additional","affiliation":[{"name":"Ant Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6033-6102","authenticated-orcid":false,"given":"Jun","family":"Zhou","sequence":"additional","affiliation":[{"name":"Ant Group, Hangzhou, China"}]}],"member":"320","published-online":{"date-parts":[[2023,10,21]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Osdi","volume":"16","author":"Abadi Mart'in","year":"2016","unstructured":"Mart'in Abadi , Paul Barham , Jianmin Chen , Zhifeng Chen , Andy Davis , Jeffrey Dean , Matthieu Devin , Sanjay Ghemawat , Geoffrey Irving , Michael Isard , 2016 . Tensorflow: a system for large-scale machine learning .. In Osdi , Vol. 16 . Savannah, GA, USA, 265--283. Mart'in Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, et al. 2016. Tensorflow: a system for large-scale machine learning.. In Osdi, Vol. 16. Savannah, GA, USA, 265--283."},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigData47090.2019.9005703"},{"key":"e_1_3_2_2_3_1","volume-title":"Aliyun pricing. https:\/\/www.alibabacloud.com\/pricing Retrieved","year":"2023","unstructured":"Aliyun. 2023. Aliyun pricing. https:\/\/www.alibabacloud.com\/pricing Retrieved May 14, 2023 from Aliyun. 2023. Aliyun pricing. https:\/\/www.alibabacloud.com\/pricing Retrieved May 14, 2023 from"},{"key":"e_1_3_2_2_4_1","volume-title":"Philip HS Torr, and Andrea Vedaldi","author":"Bertinetto Luca","year":"2018","unstructured":"Luca Bertinetto , Joao F Henriques , Philip HS Torr, and Andrea Vedaldi . 2018 . Meta-learning with differentiable closed-form solvers. arXiv preprint arXiv:1805.08136 (2018). Luca Bertinetto, Joao F Henriques, Philip HS Torr, and Andrea Vedaldi. 2018. Meta-learning with differentiable closed-form solvers. arXiv preprint arXiv:1805.08136 (2018)."},{"key":"e_1_3_2_2_5_1","volume-title":"Investigating Parallelization of MAML. In International Conference on Discovery Science. Springer, 294--306","author":"Bollenbacher Jan","year":"2020","unstructured":"Jan Bollenbacher , Florian Soulier , Beate Rhein , and Laurenz Wiskott . 2020 . Investigating Parallelization of MAML. In International Conference on Discovery Science. Springer, 294--306 . Jan Bollenbacher, Florian Soulier, Beate Rhein, and Laurenz Wiskott. 2020. Investigating Parallelization of MAML. In International Conference on Discovery Science. Springer, 294--306."},{"key":"e_1_3_2_2_6_1","first-page":"21","article-title":"The hadoop distributed file system: Architecture and design","volume":"11","author":"Borthakur Dhruba","year":"2007","unstructured":"Dhruba Borthakur . 2007 . The hadoop distributed file system: Architecture and design . Hadoop Project Website , Vol. 11 , 2007 (2007), 21 . Dhruba Borthakur. 2007. The hadoop distributed file system: Architecture and design. Hadoop Project Website , Vol. 11, 2007 (2007), 21.","journal-title":"Hadoop Project Website"},{"key":"e_1_3_2_2_7_1","volume-title":"Mxnet: A flexible and efficient machine learning library for heterogeneous distributed systems. arXiv preprint arXiv:1512.01274","author":"Chen Tianqi","year":"2015","unstructured":"Tianqi Chen , Mu Li , Yutian Li , Min Lin , Naiyan Wang , Minjie Wang , Tianjun Xiao , Bing Xu , Chiyuan Zhang , and Zheng Zhang . 2015 . Mxnet: A flexible and efficient machine learning library for heterogeneous distributed systems. arXiv preprint arXiv:1512.01274 (2015). Tianqi Chen, Mu Li, Yutian Li, Min Lin, Naiyan Wang, Minjie Wang, Tianjun Xiao, Bing Xu, Chiyuan Zhang, and Zheng Zhang. 2015. Mxnet: A flexible and efficient machine learning library for heterogeneous distributed systems. arXiv preprint arXiv:1512.01274 (2015)."},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2988450.2988454"},{"key":"e_1_3_2_2_9_1","unstructured":"Jeffrey Dean Greg Corrado Rajat Monga Kai Chen Matthieu Devin Mark Mao Marc'aurelio Ranzato Andrew Senior Paul Tucker Ke Yang etal 2012. Large scale distributed deep networks. Advances in neural information processing systems Vol. 25 (2012).  Jeffrey Dean Greg Corrado Rajat Monga Kai Chen Matthieu Devin Mark Mao Marc'aurelio Ranzato Andrew Senior Paul Tucker Ke Yang et al. 2012. Large scale distributed deep networks. Advances in neural information processing systems Vol. 25 (2012)."},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1327452.1327492"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330726"},{"key":"e_1_3_2_2_12_1","volume-title":"International conference on machine learning. PMLR, 1126--1135","author":"Finn Chelsea","year":"2017","unstructured":"Chelsea Finn , Pieter Abbeel , and Sergey Levine . 2017 . Model-agnostic meta-learning for fast adaptation of deep networks . In International conference on machine learning. PMLR, 1126--1135 . Chelsea Finn, Pieter Abbeel, and Sergey Levine. 2017. Model-agnostic meta-learning for fast adaptation of deep networks. In International conference on machine learning. PMLR, 1126--1135."},{"key":"e_1_3_2_2_13_1","volume-title":"Bringing HPC Techniques to Deep Learning. https:\/\/andrew.gibiansky.com\/blog\/machine-learning\/baidu-allreduce Retrieved","author":"Gibiansky Andrew","year":"2023","unstructured":"Andrew Gibiansky . 2017. Bringing HPC Techniques to Deep Learning. https:\/\/andrew.gibiansky.com\/blog\/machine-learning\/baidu-allreduce Retrieved February 19, 2023 from Andrew Gibiansky. 2017. Bringing HPC Techniques to Deep Learning. https:\/\/andrew.gibiansky.com\/blog\/machine-learning\/baidu-allreduce Retrieved February 19, 2023 from"},{"key":"e_1_3_2_2_14_1","volume-title":"The movielens datasets: History and context. Acm transactions on interactive intelligent systems (tiis)","author":"Maxwell Harper F","year":"2015","unstructured":"F Maxwell Harper and Joseph A Konstan . 2015. The movielens datasets: History and context. Acm transactions on interactive intelligent systems (tiis) , Vol. 5 , 4 ( 2015 ), 1--19. F Maxwell Harper and Joseph A Konstan. 2015. The movielens datasets: History and context. Acm transactions on interactive intelligent systems (tiis), Vol. 5, 4 (2015), 1--19."},{"key":"e_1_3_2_2_15_1","volume-title":"Meta-learning in neural networks: A survey","author":"Hospedales Timothy","year":"2021","unstructured":"Timothy Hospedales , Antreas Antoniou , Paul Micaelli , and Amos Storkey . 2021. Meta-learning in neural networks: A survey . IEEE transactions on pattern analysis and machine intelligence, Vol. 44 , 9 ( 2021 ), 5149--5169. Timothy Hospedales, Antreas Antoniou, Paul Micaelli, and Amos Storkey. 2021. Meta-learning in neural networks: A survey. IEEE transactions on pattern analysis and machine intelligence, Vol. 44, 9 (2021), 5149--5169."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3477495.3536332"},{"key":"e_1_3_2_2_17_1","volume-title":"GPU Technology Conference (GTC)","volume":"2","author":"Jeaugey Sylvain","year":"2017","unstructured":"Sylvain Jeaugey . 2017 . Nccl 2.0 . In GPU Technology Conference (GTC) , Vol. 2 . Sylvain Jeaugey. 2017. Nccl 2.0. In GPU Technology Conference (GTC), Vol. 2."},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3460866.3461773"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330859"},{"key":"e_1_3_2_2_20_1","volume-title":"Alexander J Smola, Amr Ahmed, Vanja Josifovski, James Long, Eugene J Shekita, and Bor-Yiing Su.","author":"Li Mu","year":"2014","unstructured":"Mu Li , David G Andersen , Jun Woo Park , Alexander J Smola, Amr Ahmed, Vanja Josifovski, James Long, Eugene J Shekita, and Bor-Yiing Su. 2014 . Scaling distributed machine learning with the parameter server. In 11th $$USENIX$$ Symposium on Operating Systems Design and Implementation ( $$OSDI$$ 14). 583--598. Mu Li, David G Andersen, Jun Woo Park, Alexander J Smola, Amr Ahmed, Vanja Josifovski, James Long, Eugene J Shekita, and Bor-Yiing Su. 2014. Scaling distributed machine learning with the parameter server. In 11th $$USENIX$$ Symposium on Operating Systems Design and Implementation ($$OSDI$$ 14). 583--598."},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403207"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210104"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403278"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3470496.3533727"},{"key":"e_1_3_2_2_25_1","volume-title":"On first-order meta-learning algorithms. arXiv preprint arXiv:1803.02999","author":"Nichol Alex","year":"2018","unstructured":"Alex Nichol , Joshua Achiam , and John Schulman . 2018. On first-order meta-learning algorithms. arXiv preprint arXiv:1803.02999 ( 2018 ). Alex Nichol, Joshua Achiam, and John Schulman. 2018. On first-order meta-learning algorithms. arXiv preprint arXiv:1803.02999 (2018)."},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331268"},{"key":"e_1_3_2_2_27_1","volume-title":"Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke , Sam Gross , Francisco Massa , Adam Lerer , James Bradbury , Gregory Chanan , Trevor Killeen , Zeming Lin , Natalia Gimelshein , Luca Antiga , 2019 . Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems , Vol. 32 (2019). Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems , Vol. 32 (2019)."},{"key":"e_1_3_2_2_28_1","volume-title":"Meta-learning with implicit gradients. Advances in neural information processing systems","author":"Rajeswaran Aravind","year":"2019","unstructured":"Aravind Rajeswaran , Chelsea Finn , Sham M Kakade , and Sergey Levine . 2019. Meta-learning with implicit gradients. Advances in neural information processing systems , Vol. 32 ( 2019 ). Aravind Rajeswaran, Chelsea Finn, Sham M Kakade, and Sergey Levine. 2019. Meta-learning with implicit gradients. Advances in neural information processing systems , Vol. 32 (2019)."},{"key":"e_1_3_2_2_29_1","volume-title":"International conference on learning representations.","author":"Ravi Sachin","year":"2017","unstructured":"Sachin Ravi and Hugo Larochelle . 2017 . Optimization as a model for few-shot learning . In International conference on learning representations. Sachin Ravi and Hugo Larochelle. 2017. Optimization as a model for few-shot learning. In International conference on learning representations."},{"key":"e_1_3_2_2_30_1","volume-title":"Horovod: fast and easy distributed deep learning in TensorFlow. arXiv preprint arXiv:1802.05799","author":"Sergeev Alexander","year":"2018","unstructured":"Alexander Sergeev and Mike Del Balso . 2018. Horovod: fast and easy distributed deep learning in TensorFlow. arXiv preprint arXiv:1802.05799 ( 2018 ). Alexander Sergeev and Mike Del Balso. 2018. Horovod: fast and easy distributed deep learning in TensorFlow. arXiv preprint arXiv:1802.05799 (2018)."},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3459637.3482239"},{"key":"e_1_3_2_2_32_1","volume-title":"https:\/\/www.tensorflow.org\/tutorials\/load_data\/tfrecord Retrieved","year":"2023","unstructured":"Tensorflow. 2023. TFRecords. https:\/\/www.tensorflow.org\/tutorials\/load_data\/tfrecord Retrieved February 19, 2023 from Tensorflow. 2023. TFRecords. https:\/\/www.tensorflow.org\/tutorials\/load_data\/tfrecord Retrieved February 19, 2023 from"},{"key":"e_1_3_2_2_33_1","volume-title":"A meta-learning perspective on cold-start recommendations for items. Advances in neural information processing systems","author":"Vartak Manasi","year":"2017","unstructured":"Manasi Vartak , Arvind Thiagarajan , Conrado Miranda , Jeshua Bratman , and Hugo Larochelle . 2017. A meta-learning perspective on cold-start recommendations for items. Advances in neural information processing systems , Vol. 30 ( 2017 ). Manasi Vartak, Arvind Thiagarajan, Conrado Miranda, Jeshua Bratman, and Hugo Larochelle. 2017. A meta-learning perspective on cold-start recommendations for items. Advances in neural information processing systems , Vol. 30 (2017)."},{"key":"e_1_3_2_2_34_1","volume-title":"Dropoutnet: Addressing cold start in recommender systems. Advances in neural information processing systems","author":"Volkovs Maksims","year":"2017","unstructured":"Maksims Volkovs , Guangwei Yu , and Tomi Poutanen . 2017 . Dropoutnet: Addressing cold start in recommender systems. Advances in neural information processing systems , Vol. 30 (2017). Maksims Volkovs, Guangwei Yu, and Tomi Poutanen. 2017. Dropoutnet: Addressing cold start in recommender systems. Advances in neural information processing systems , Vol. 30 (2017)."},{"key":"e_1_3_2_2_35_1","volume-title":"Multimodal model-agnostic meta-learning via task-aware modulation. Advances in neural information processing systems","author":"Vuorio Risto","year":"2019","unstructured":"Risto Vuorio , Shao-Hua Sun , Hexiang Hu , and Joseph J Lim . 2019. Multimodal model-agnostic meta-learning via task-aware modulation. Advances in neural information processing systems , Vol. 32 ( 2019 ). Risto Vuorio, Shao-Hua Sun, Hexiang Hu, and Joseph J Lim. 2019. Multimodal model-agnostic meta-learning via task-aware modulation. Advances in neural information processing systems , Vol. 32 (2019)."},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3523227.3547405"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3511808.3557709"},{"key":"e_1_3_2_2_38_1","volume-title":"PICASSO: Unleashing the Potential of GPU-centric Training for Wide-and-deep Recommender Systems. arXiv preprint arXiv:2204.04903","author":"Zhang Yuanxing","year":"2022","unstructured":"Yuanxing Zhang , Langshi Chen , Siran Yang , Man Yuan , Huimin Yi , Jie Zhang , Jiamang Wang , Jianbo Dong , Yunlong Xu , Yue Song , 2022 . PICASSO: Unleashing the Potential of GPU-centric Training for Wide-and-deep Recommender Systems. arXiv preprint arXiv:2204.04903 (2022). Yuanxing Zhang, Langshi Chen, Siran Yang, Man Yuan, Huimin Yi, Jie Zhang, Jiamang Wang, Jianbo Dong, Yunlong Xu, Yue Song, et al. 2022. PICASSO: Unleashing the Potential of GPU-centric Training for Wide-and-deep Recommender Systems. arXiv preprint arXiv:2204.04903 (2022)."},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33015941"}],"event":{"name":"CIKM '23: The 32nd ACM International Conference on Information and Knowledge Management","location":"Birmingham United Kingdom","acronym":"CIKM '23","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 32nd ACM International Conference on Information and Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3583780.3615208","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3583780.3615208","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:36:58Z","timestamp":1750178218000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3583780.3615208"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,21]]},"references-count":39,"alternative-id":["10.1145\/3583780.3615208","10.1145\/3583780"],"URL":"https:\/\/doi.org\/10.1145\/3583780.3615208","relation":{},"subject":[],"published":{"date-parts":[[2023,10,21]]},"assertion":[{"value":"2023-10-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}