{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T19:20:02Z","timestamp":1774466402911,"version":"3.50.1"},"reference-count":35,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2021,7,11]],"date-time":"2021-07-11T00:00:00Z","timestamp":1625961600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGCOMM Comput. Commun. Rev."],"published-print":{"date-parts":[[2021,7,11]]},"abstract":"<jats:p>During the last decade, Machine Learning (ML) has increasingly become a hot topic in the field of Computer Networks and is expected to be gradually adopted for a plethora of control, monitoring and management tasks in real-world deployments. This poses the need to count on new generations of students, researchers and practitioners with a solid background in ML applied to networks. During 2020, the International Telecommunication Union (ITU) has organized the \"ITU AI\/ML in 5G challenge\", an open global competition that has introduced to a broad audience some of the current main challenges in ML for networks. This large-scale initiative has gathered 23 different challenges proposed by network operators, equipment manufacturers and academia, and has attracted a total of 1300+ participants from 60+ countries. This paper narrates our experience organizing one of the proposed challenges: the \"Graph Neural Networking Challenge 2020\". We describe the problem presented to participants, the tools and resources provided, some organization aspects and participation statistics, an outline of the top-3 awarded solutions, and a summary with some lessons learned during all this journey. As a result, this challenge leaves a curated set of educational resources openly available to anyone interested in the topic.<\/jats:p>","DOI":"10.1145\/3477482.3477485","type":"journal-article","created":{"date-parts":[[2021,7,23]],"date-time":"2021-07-23T16:04:51Z","timestamp":1627056291000},"page":"9-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":24,"title":["The graph neural networking challenge"],"prefix":"10.1145","volume":"51","author":[{"given":"Jos\u00e9","family":"Su\u00e1rez-Varela","sequence":"first","affiliation":[{"name":"Barcelona Neural Networking center, Universitat Polit\u00e8cnica de Catalunya, Spain"}]},{"given":"Miquel","family":"Ferriol-Galm\u00e9s","sequence":"additional","affiliation":[{"name":"Barcelona Neural Networking center, Universitat Polit\u00e8cnica de Catalunya, Spain"}]},{"given":"Albert","family":"L\u00f3pez","sequence":"additional","affiliation":[{"name":"Barcelona Neural Networking center, Universitat Polit\u00e8cnica de Catalunya, Spain"}]},{"given":"Paul","family":"Almasan","sequence":"additional","affiliation":[{"name":"Barcelona Neural Networking center, Universitat Polit\u00e8cnica de Catalunya, Spain"}]},{"given":"Guillermo","family":"Bern\u00e1rdez","sequence":"additional","affiliation":[{"name":"Barcelona Neural Networking center, Universitat Polit\u00e8cnica de Catalunya, Spain"}]},{"given":"David","family":"Pujol-Perich","sequence":"additional","affiliation":[{"name":"Barcelona Neural Networking center, Universitat Polit\u00e8cnica de Catalunya, Spain"}]},{"given":"Krzysztof","family":"Rusek","sequence":"additional","affiliation":[{"name":"AGH University of Science and Technology, Department of Telecommunications, Poland"}]},{"given":"Lo\u00efck","family":"Bonniot","sequence":"additional","affiliation":[{"name":"InterDigital, France \/ Univ. Rennes, Inria, CNRS, IRISA, France"}]},{"given":"Christoph","family":"Neumann","sequence":"additional","affiliation":[{"name":"InterDigital, France"}]},{"given":"Fran\u00e7ois","family":"Schnitzler","sequence":"additional","affiliation":[{"name":"InterDigital, France"}]},{"given":"Fran\u00e7ois","family":"Ta\u00efani","sequence":"additional","affiliation":[{"name":"Univ. Rennes, Inria, CNRS, IRISA, France"}]},{"given":"Martin","family":"Happ","sequence":"additional","affiliation":[{"name":"Salzburg Research Forschungsgesellschaft mbH, Austria \/ IDA Lab, University of Salzburg, Austria"}]},{"given":"Christian","family":"Maier","sequence":"additional","affiliation":[{"name":"Salzburg Research Forschungsgesellschaft mbH, Austria"}]},{"given":"Jia Lei","family":"Du","sequence":"additional","affiliation":[{"name":"Salzburg Research Forschungsgesellschaft mbH, Austria"}]},{"given":"Matthias","family":"Herlich","sequence":"additional","affiliation":[{"name":"Salzburg Research Forschungsgesellschaft mbH, Austria"}]},{"given":"Peter","family":"Dorfinger","sequence":"additional","affiliation":[{"name":"Salzburg Research Forschungsgesellschaft mbH, Austria"}]},{"given":"Nick Vincent","family":"Hainke","sequence":"additional","affiliation":[{"name":"Fraunhofer HHI, Germany"}]},{"given":"Stefan","family":"Venz","sequence":"additional","affiliation":[{"name":"Fraunhofer HHI, Germany"}]},{"given":"Johannes","family":"Wegener","sequence":"additional","affiliation":[{"name":"Fraunhofer HHI, Germany"}]},{"given":"Henrike","family":"Wissing","sequence":"additional","affiliation":[{"name":"Fraunhofer HHI, Germany"}]},{"given":"Bo","family":"Wu","sequence":"additional","affiliation":[{"name":"Network Technology Lab., Huawei Technologies Co., Ltd., China"}]},{"given":"Shihan","family":"Xiao","sequence":"additional","affiliation":[{"name":"Network Technology Lab., Huawei Technologies Co., Ltd., China"}]},{"given":"Pere","family":"Barlet-Ros","sequence":"additional","affiliation":[{"name":"Barcelona Neural Networking center, Universitat Polit\u00e8cnica de Catalunya, Spain"}]},{"given":"Albert","family":"Cabellos-Aparicio","sequence":"additional","affiliation":[{"name":"Barcelona Neural Networking center, Universitat Polit\u00e8cnica de Catalunya, Spain"}]}],"member":"320","published-online":{"date-parts":[[2021,7,23]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"ITU-T Y.3170-series supplement 55 -- Machine learning in future networks including IMT-2020: Use cases. (2019). https:\/\/www.itu.int\/rec\/T-REC-Y.Sup55-201910-I.  ITU-T Y.3170-series supplement 55 -- Machine learning in future networks including IMT-2020: Use cases. (2019). https:\/\/www.itu.int\/rec\/T-REC-Y.Sup55-201910-I."},{"key":"e_1_2_1_2_1","volume-title":"Graph Neural Networking Challenge","author":"Global Summit AI","year":"2020","unstructured":"AI for Global Summit . ITU AI\/ML in 5G Challenge : Graph Neural Networking Challenge 2020 . Retrieved 2021-02-12 from https:\/\/aiforgood.itu.int\/events\/itu-ai-ml-in-5g-challenge\/ AI for Global Summit. ITU AI\/ML in 5G Challenge: Graph Neural Networking Challenge 2020. Retrieved 2021-02-12 from https:\/\/aiforgood.itu.int\/events\/itu-ai-ml-in-5g-challenge\/"},{"key":"e_1_2_1_3_1","unstructured":"Dataset description - Graph Neural Networking challenge 2020. Retrieved 2021-06-29 from https:\/\/bnn.upc.edu\/challenge\/gnnet2020\/ch20-dataset  Dataset description - Graph Neural Networking challenge 2020. Retrieved 2021-06-29 from https:\/\/bnn.upc.edu\/challenge\/gnnet2020\/ch20-dataset"},{"key":"e_1_2_1_4_1","unstructured":"ITU AI\/ML in 5G Challenge. Retrieved 2021-02-12 from https:\/\/www.itu.int\/en\/ITU-T\/AI\/challenge\/2020  ITU AI\/ML in 5G Challenge. Retrieved 2021-02-12 from https:\/\/www.itu.int\/en\/ITU-T\/AI\/challenge\/2020"},{"key":"e_1_2_1_5_1","unstructured":"ITU News Magazine - AI and Machine Learning in 5G. Retrieved 2021-02-12 from https:\/\/www.itu.int\/en\/myitu\/Publications\/2020\/12\/10\/08\/43\/ITU-News-Magazine-no-5-2020  ITU News Magazine - AI and Machine Learning in 5G. Retrieved 2021-02-12 from https:\/\/www.itu.int\/en\/myitu\/Publications\/2020\/12\/10\/08\/43\/ITU-News-Magazine-no-5-2020"},{"key":"e_1_2_1_6_1","unstructured":"RouteNet - Graph Neural Networking challenge 2020. Retrieved 2021-06-29 from https:\/\/github.com\/BNN-UPC\/GNNetworkingChallenge\/tree\/2020_Routenet_TF  RouteNet - Graph Neural Networking challenge 2020. Retrieved 2021-06-29 from https:\/\/github.com\/BNN-UPC\/GNNetworkingChallenge\/tree\/2020_Routenet_TF"},{"key":"e_1_2_1_7_1","unstructured":"The Graph Neural Networking Challenge 2020. Retrieved 2021-06-29 from https:\/\/bnn.upc.edu\/challenge\/gnnet2020  The Graph Neural Networking Challenge 2020. Retrieved 2021-06-29 from https:\/\/bnn.upc.edu\/challenge\/gnnet2020"},{"key":"e_1_2_1_8_1","unstructured":"Driven Data - Competitions. Retrieved 2021-02-12 from https:\/\/www.drivendata.org\/competitions\/  Driven Data - Competitions. Retrieved 2021-02-12 from https:\/\/www.drivendata.org\/competitions\/"},{"key":"e_1_2_1_9_1","unstructured":"ImageNet Large Scale Visual Recognition Challenge (ILSVRC). Retrieved 2021-02-12 from http:\/\/www.image-net.org\/challenges\/LSVRC\/  ImageNet Large Scale Visual Recognition Challenge (ILSVRC). Retrieved 2021-02-12 from http:\/\/www.image-net.org\/challenges\/LSVRC\/"},{"key":"e_1_2_1_10_1","unstructured":"Kaggle: Your Machine Learning and Data Science Community. Retrieved 2021-02-12 from https:\/\/www.kaggle.com\/  Kaggle: Your Machine Learning and Data Science Community. Retrieved 2021-02-12 from https:\/\/www.kaggle.com\/"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2020.2988293"},{"key":"e_1_2_1_12_1","volume-title":"Deep reinforcement learning meets graph neural networks: Exploring a routing optimization use case. arXiv preprint arXiv:1910.07421","author":"Almasan Paul","year":"2019","unstructured":"Paul Almasan , Jos\u00e9 Su\u00e1rez-Varela , Arnau Badia-Sampera , Krzysztof Rusek , Pere Barlet-Ros , and Albert Cabellos-Aparicio . 2019. Deep reinforcement learning meets graph neural networks: Exploring a routing optimization use case. arXiv preprint arXiv:1910.07421 ( 2019 ). Paul Almasan, Jos\u00e9 Su\u00e1rez-Varela, Arnau Badia-Sampera, Krzysztof Rusek, Pere Barlet-Ros, and Albert Cabellos-Aparicio. 2019. Deep reinforcement learning meets graph neural networks: Exploring a routing optimization use case. arXiv preprint arXiv:1910.07421 (2019)."},{"key":"e_1_2_1_13_1","unstructured":"Peter W Battaglia Jessica B Hamrick Victor Bapst Alvaro Sanchez-Gonzalez Vinicius Zambaldi Mateusz Malinowski Andrea Tacchetti David Raposo Adam Santoro Ryan Faulkner etal 2018. Relational inductive biases deep learning and graph networks. arXiv preprint arXiv:1806.01261 (2018).  Peter W Battaglia Jessica B Hamrick Victor Bapst Alvaro Sanchez-Gonzalez Vinicius Zambaldi Mateusz Malinowski Andrea Tacchetti David Raposo Adam Santoro Ryan Faulkner et al. 2018. Relational inductive biases deep learning and graph networks. arXiv preprint arXiv:1806.01261 (2018)."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13174-018-0087-2"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2377677.2377747"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2017.8056971"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3229607.3229610"},{"key":"e_1_2_1_19_1","volume-title":"International Conference on Machine Learning. 1263--1272","author":"Gilmer Justin","unstructured":"Justin Gilmer , Samuel S. Schoenholz , Patrick F. Riley , Oriol Vinyals , and George E. Dahl . 2017. Neural message passing for quantum chemistry . In International Conference on Machine Learning. 1263--1272 . Justin Gilmer, Samuel S. Schoenholz, Patrick F. Riley, Oriol Vinyals, and George E. Dahl. 2017. Neural message passing for quantum chemistry. In International Conference on Machine Learning. 1263--1272."},{"key":"e_1_2_1_20_1","doi-asserted-by":"crossref","DOI":"10.52953\/TEJX5530","article-title":"Graph-neural-network-based delay estimation for communication networks with heterogeneous scheduling policies","volume":"2","author":"Happ Martin","year":"2021","unstructured":"Martin Happ , Matthias Herlich , Christian Maier , Jia Lei Du , and Peter Dorfinger . 2021 . Graph-neural-network-based delay estimation for communication networks with heterogeneous scheduling policies . ITU Journal on Future and Evolving Technologies 2 , 4 (2021). Martin Happ, Matthias Herlich, Christian Maier, Jia Lei Du, and Peter Dorfinger. 2021. Graph-neural-network-based delay estimation for communication networks with heterogeneous scheduling policies. ITU Journal on Future and Evolving Technologies 2, 4 (2021).","journal-title":"ITU Journal on Future and Evolving Technologies"},{"key":"e_1_2_1_21_1","volume-title":"International Conference on Machine Learning. 3050--3059","author":"Jay Nathan","year":"2019","unstructured":"Nathan Jay , Noga Rotman , Brighten Godfrey , Michael Schapira , and Aviv Tamar . 2019 . A deep reinforcement learning perspective on internet congestion control . In International Conference on Machine Learning. 3050--3059 . Nathan Jay, Noga Rotman, Brighten Godfrey, Michael Schapira, and Aviv Tamar. 2019. A deep reinforcement learning perspective on internet congestion control. In International Conference on Machine Learning. 3050--3059."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2019.2962338"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2019.2959181"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3234150"},{"key":"e_1_2_1_25_1","volume-title":"Modeling and tools for network simulation","author":"Riley George F","unstructured":"George F Riley and Thomas R Henderson . 2010. The ns-3 network simulator . In Modeling and tools for network simulation . Springer , 15--34. George F Riley and Thomas R Henderson. 2010. The ns-3 network simulator. In Modeling and tools for network simulation. Springer, 15--34."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2020.3000405"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3314148.3314357"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2008.2005605"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.4108\/ICST.SIMUTOOLS2008.3027"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.3004964"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/MNET.2017.1700200"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2018.8485853"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2019.2904897"},{"key":"e_1_2_1_34_1","unstructured":"Cheng Zhou Hongwei Yang and Xiaodong Duan. 2021. Concepts of Digital Twin Network. Internet-Draft draft-zhou-nmrg-digitaltwin-network-concepts-03.  Cheng Zhou Hongwei Yang and Xiaodong Duan. 2021. Concepts of Digital Twin Network . Internet-Draft draft-zhou-nmrg-digitaltwin-network-concepts-03."},{"key":"e_1_2_1_35_1","volume-title":"Graph neural networks: A review of methods and applications. arXiv preprint arXiv:1812.08434","author":"Zhou Jie","year":"2018","unstructured":"Jie Zhou , Ganqu Cui , Zhengyan Zhang , Cheng Yang , Zhiyuan Liu , Lifeng Wang , Changcheng Li , and Maosong Sun . 2018. Graph neural networks: A review of methods and applications. arXiv preprint arXiv:1812.08434 ( 2018 ). Jie Zhou, Ganqu Cui, Zhengyan Zhang, Cheng Yang, Zhiyuan Liu, Lifeng Wang, Changcheng Li, and Maosong Sun. 2018. Graph neural networks: A review of methods and applications. arXiv preprint arXiv:1812.08434 (2018)."}],"container-title":["ACM SIGCOMM Computer Communication Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3477482.3477485","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3477482.3477485","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:32Z","timestamp":1750188632000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3477482.3477485"}},"subtitle":["a worldwide competition for education in AI\/ML for networks"],"short-title":[],"issued":{"date-parts":[[2021,7,11]]},"references-count":35,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,7,11]]}},"alternative-id":["10.1145\/3477482.3477485"],"URL":"https:\/\/doi.org\/10.1145\/3477482.3477485","relation":{},"ISSN":["0146-4833"],"issn-type":[{"value":"0146-4833","type":"print"}],"subject":[],"published":{"date-parts":[[2021,7,11]]},"assertion":[{"value":"2021-07-23","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}