{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T04:28:55Z","timestamp":1772166535791,"version":"3.50.1"},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,4,7]],"date-time":"2021-04-07T00:00:00Z","timestamp":1617753600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,4,7]],"date-time":"2021-04-07T00:00:00Z","timestamp":1617753600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100007601","name":"Horizon 2020","doi-asserted-by":"publisher","award":["815074"],"award-info":[{"award-number":["815074"]}],"id":[{"id":"10.13039\/501100007601","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100012818","name":"Comunidad de Madrid","doi-asserted-by":"publisher","award":["IND2017\/TIC-7732"],"award-info":[{"award-number":["IND2017\/TIC-7732"]}],"id":[{"id":"10.13039\/100012818","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Wireless Com Network"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The fifth generation (5G) of mobile networks is designed to accommodate different types of use cases, each of them with different and stringent requirements and key performance indicators (KPIs). To support the optimization of the network performance and validation of the KPIs, there exist the necessity of a flexible and efficient monitoring system and capable of realizing multi-site and multi-stakeholder scenarios. Nevertheless, for the evolution from 5G to 6G, the network is envisioned as a user-driven, distributed Cloud computing system where the resource pool is foreseen to integrate the participating users. In this paper, we present a distributed monitoring architecture for Beyond 5G multi-site platforms, where different stakeholders share the resource pool in a distributed environment. Taking advantage of the usage of publish-subscribe mechanisms adapted to the Edge, the developed lightweight monitoring solution can manage large amounts of real-time traffic generated by the applications located in the resource pool. We assess the performance of the implemented paradigm, revealing some interesting insights about the platform, such as the effect caused by the throughput of monitoring data in performance parameters such as the latency and packet loss, or the presence of a saturation effect due to software limitations that impacts in the performance of the system under specific conditions. In the end, the performance evaluation process has confirmed that the monitoring platform suits the requirements of the proposed scenarios, being capable of handling similar workloads in real 5G and Beyond 5G scenarios, then discussing how the architecture could be mapped to these real scenarios.<\/jats:p>","DOI":"10.1186\/s13638-021-01962-y","type":"journal-article","created":{"date-parts":[[2021,4,7]],"date-time":"2021-04-07T09:06:05Z","timestamp":1617786365000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["An experimental publish-subscribe monitoring assessment to Beyond 5G networks"],"prefix":"10.1186","volume":"2021","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3450-6141","authenticated-orcid":false,"given":"Ramon","family":"Perez","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jaime","family":"Garcia-Reinoso","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aitor","family":"Zabala","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pablo","family":"Serrano","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Albert","family":"Banchs","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,4,7]]},"reference":[{"key":"1962_CR1","unstructured":"R. Perez, J. Garcia-Reinoso, A. Zabala, P. Serrano, A. Banchs, A monitoring framework for multi-site 5G platforms, in 2020 European Conference on Networks and Communications (EuCNC) (2020), pp. 52\u201356"},{"key":"1962_CR2","doi-asserted-by":"crossref","unstructured":"S.E. Elayoubi, M. Fallgren, P. Spapis, G. Zimmermann, D. Mart\u00edn-Sacrist\u00e1n, C. Yang, S. Jeux, P. Agyapong, L. Campoy, Y. Qi, et al., 5G service requirements and operational use cases: analysis and METIS II vision, in 2016 European Conference on Networks and Communications (EuCNC) (IEEE, 2016), pp. 158\u2013162","DOI":"10.1109\/EuCNC.2016.7561024"},{"issue":"5","key":"1962_CR3","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1109\/MCOM.2017.1600951","volume":"55","author":"X Foukas","year":"2017","unstructured":"X. Foukas, G. Patounas, A. Elmokashfi, M.K. Marina, Network slicing in 5G: survey and challenges. IEEE Commun. Mag. 55(5), 94\u2013100 (2017)","journal-title":"IEEE Commun. Mag."},{"key":"1962_CR4","unstructured":"ITU-R: IMT Vision\u2014framework and overall objectives of the future development of IMT for 2020 and beyond. Recommendation ITU-R M.2083-0 (2015). https:\/\/www.itu.int\/rec\/R-REC-M.2083-0-201509-I"},{"issue":"8","key":"1962_CR5","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1109\/MCOM.2018.1700990","volume":"56","author":"A de la Oliva","year":"2018","unstructured":"A. de la Oliva, X. Li, X. Costa-Perez, C.J. Bernardos, P. Bertin, P. Iovanna, T. Deiss, J. Mangues, A. Mourad, C. Casetti, J.E. Gonzalez, A. Azcorra, 5G-TRANSFORMER: slicing and orchestrating transport networks for industry verticals. IEEE Commun. Mag. 56(8), 78\u201384 (2018)","journal-title":"IEEE Commun. Mag."},{"key":"1962_CR6","doi-asserted-by":"crossref","unstructured":"M. Gupta, R. Legouable, M.M. Rosello, M. Cecchi, J.R. Alonso, M. Lorenzo, E. Kosmatos, M.R. Boldi, G. Carrozzo, The 5G EVE end-to-end 5G facility for extensive trials, in 2019 IEEE International Conference on Communications Workshops (ICC Workshops) (IEEE, 2019), pp. 1\u20135","DOI":"10.1109\/ICCW.2019.8757139"},{"key":"1962_CR7","doi-asserted-by":"crossref","unstructured":"J. Garcia-Reinoso, M.M. Rosell\u00f3, E. Kosmatos, G. Landi, G. Bernini, R. Legouable, L.M. Contreras, M. Lorenzo, K. Trichias, M. Gupta, The 5G EVE multi-site experimental architecture and experimentation workflow, in 2019 IEEE 2nd 5G World Forum (5GWF) (IEEE, 2019), pp. 335\u2013340","DOI":"10.1109\/5GWF.2019.8911624"},{"key":"1962_CR8","doi-asserted-by":"publisher","unstructured":"5G EVE: requirements definition and analysis from participant vertical industries. Deliverable D1.1 (2018). https:\/\/doi.org\/10.5281\/zenodo.3530391","DOI":"10.5281\/zenodo.3530391"},{"key":"1962_CR9","doi-asserted-by":"publisher","unstructured":"5G EVE: 5G EVE end to end reference architecture for vertical industries and core applications. Deliverable D1.3 (2019). https:\/\/doi.org\/10.5281\/zenodo.3628333","DOI":"10.5281\/zenodo.3628333"},{"key":"1962_CR10","unstructured":"C. Papagianni, J. Mangues-Bafalluy, P. Bermudez, S. Barmpounakis, D. De Vleeschauwer, J. Brenes, E. Zeydan, C. Casetti, C. Guimar\u00e3es, P. Murillo, A. Garcia-Saavedra, D. Corujo, T. Pepe, 5Growth: AI-driven 5G for automation in vertical industries, in 2020 European Conference on Networks and Communications (EuCNC) (2020), pp. 17\u201322"},{"key":"1962_CR11","unstructured":"3GPP: architecture enhancements for 5G system (5GS) to support network data analytics services (Release 16). TS 23.288 v16.1.0 (2019). https:\/\/www.3gpp.org\/DynaReport\/23288.htm"},{"key":"1962_CR12","unstructured":"3GPP: management and orchestration; architecture framework. TS 28.533, v16.2.0 (2019). https:\/\/www.3gpp.org\/DynaReport\/28533.htm"},{"key":"1962_CR13","unstructured":"O.-R. Alliance, O-RAN: towards an open and smart RAN. White paper (2018)"},{"key":"1962_CR14","unstructured":"ETSI: network transformation; (orchestration, network and service management framework). White paper no. 32 (2019)"},{"key":"1962_CR15","unstructured":"3GPP: study on integration of open network automation platform (ONAP) and 3GPP management for 5G networks (Release 16). TR 28.890 v16.0.0 (2019). https:\/\/www.3gpp.org\/DynaReport\/28890.htm"},{"key":"1962_CR16","unstructured":"A. Javed, K. Heljanko, A. Buda, K. Fr\u00e4mling, CEFIoT: a fault-tolerant IoT architecture for edge and cloud, in 2018 IEEE 4th World Forum on Internet of Things (WF-IoT) (2018), pp. 813\u2013818"},{"key":"1962_CR17","unstructured":"C. Mart\u00edn, D. Garrido, M. D\u00edaz, B. Rubio, From the edge to the cloud: enabling reliable IoT applications, in 2019 7th International Conference on Future Internet of Things and Cloud (FiCloud) (2019), pp. 17\u201322"},{"key":"1962_CR18","doi-asserted-by":"publisher","first-page":"41649","DOI":"10.1109\/ACCESS.2020.2976858","volume":"8","author":"Q Yuan","year":"2020","unstructured":"Q. Yuan, X. Ji, H. Tang, W. You, Toward latency-optimal placement and autoscaling of monitoring functions in MEC. IEEE Access 8, 41649\u201341658 (2020)","journal-title":"IEEE Access"},{"key":"1962_CR19","doi-asserted-by":"publisher","unstructured":"5G EVE: second implementation of the interworking reference model. Deliverable D3.4 (2020). https:\/\/doi.org\/10.5281\/zenodo.3946323","DOI":"10.5281\/zenodo.3946323"},{"key":"1962_CR20","doi-asserted-by":"publisher","unstructured":"5G EVE: interworking reference model. Deliverable D3.2 (2019). https:\/\/doi.org\/10.5281\/zenodo.3625689","DOI":"10.5281\/zenodo.3625689"},{"key":"1962_CR21","unstructured":"Apache Kafka. https:\/\/kafka.apache.org\/. Accessed 26 Feb 2021"},{"key":"1962_CR22","unstructured":"P. Sommer, F. Schellroth, M. Fischer, J. Schlechtendahl, Message-oriented middleware for industrial production systems, in 2018 IEEE 14th International Conference on Automation Science and Engineering (CASE), Munich (2018), pp. 1217\u20131223"},{"key":"1962_CR23","doi-asserted-by":"publisher","unstructured":"5G EVE: first implementation of the interworking reference model. Deliverable D3.3 (2019). https:\/\/doi.org\/10.5281\/zenodo.3628179","DOI":"10.5281\/zenodo.3628179"},{"key":"1962_CR24","doi-asserted-by":"publisher","first-page":"012038","DOI":"10.1088\/1742-6596\/608\/1\/012038","volume":"608","author":"L Magnoni","year":"2015","unstructured":"L. Magnoni, Modern messaging for distributed systems. J. Phys. Conf. Ser. 608, 012038 (2015). https:\/\/doi.org\/10.1088\/1742-6596\/608\/1\/012038","journal-title":"J. Phys. Conf. Ser."},{"key":"1962_CR25","unstructured":"Beats. https:\/\/www.elastic.co\/beats\/. Accessed 26 Feb 2021"},{"key":"1962_CR26","unstructured":"ELK Stack. https:\/\/www.elastic.co\/what-is\/elk-stack. Accessed 26 Feb 2021"},{"key":"1962_CR27","doi-asserted-by":"publisher","unstructured":"5G EVE: experimentation tools and VNF repository. Deliverable D4.1 (2019). https:\/\/doi.org\/10.5281\/zenodo.3628201","DOI":"10.5281\/zenodo.3628201"},{"key":"1962_CR28","doi-asserted-by":"publisher","unstructured":"5G EVE: first version of the experimental portal and service handbook. Deliverable D4.2 (2019). https:\/\/doi.org\/10.5281\/zenodo.3628316","DOI":"10.5281\/zenodo.3628316"},{"key":"1962_CR29","doi-asserted-by":"publisher","unstructured":"5G EVE: report on benchmarking of new features and on the experimental portal (2nd version). Deliverable D4.4 (2020). https:\/\/doi.org\/10.5281\/zenodo.3946283","DOI":"10.5281\/zenodo.3946283"},{"issue":"1","key":"1962_CR30","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1109\/MCOM.2018.1800084","volume":"57","author":"B Nogales","year":"2019","unstructured":"B. Nogales, I. Vidal, D.R. Lopez, J. Rodriguez, J. Garcia-Reinoso, A. Azcorra, Design and deployment of an open management and orchestration platform for multi-site NFV experimentation. IEEE Commun. Mag. 57(1), 20\u201327 (2019)","journal-title":"IEEE Commun. Mag."},{"key":"1962_CR31","doi-asserted-by":"publisher","unstructured":"5G EVE: initial pilot test and validation. Deliverable D2.4 (2020). https:\/\/doi.org\/10.5281\/zenodo.3946365","DOI":"10.5281\/zenodo.3946365"},{"key":"1962_CR32","unstructured":"Ubuntu. https:\/\/ubuntu.com\/. Accessed 26 Feb 2021"},{"key":"1962_CR33","unstructured":"Proxmox. https:\/\/www.proxmox.com\/en\/. Accessed 26 Feb 2021"},{"key":"1962_CR34","unstructured":"K3s. https:\/\/k3s.io\/. Accessed 26 Feb 2021"},{"key":"1962_CR35","unstructured":"5G EVE Monitoring Dockerized Environment. https:\/\/github.com\/5GEVE\/monitoring_dockerized_environment. Accessed 26 Feb 2021"},{"key":"1962_CR36","unstructured":"Sangrenel. https:\/\/github.com\/jamiealquiza\/sangrenel. Accessed 26 Feb 2021"},{"key":"1962_CR37","unstructured":"Python. https:\/\/www.python.org\/. Accessed 26 Feb 2021"},{"key":"1962_CR38","unstructured":"Apache Kafka: allow consumers to fetch from closest replica. KIP-392 (2019). https:\/\/cwiki.apache.org\/confluence\/display\/KAFKA\/KIP-392%3A+Allow+consumers+to+fetch+from+closest+replica"},{"key":"1962_CR39","unstructured":"Node.js. https:\/\/nodejs.org\/en\/. Accessed 26 Feb 2021"},{"key":"1962_CR40","unstructured":"Apache ZooKeeper. https:\/\/zookeeper.apache.org\/. Accessed 26 Feb 2021"},{"key":"1962_CR41","unstructured":"Docker. https:\/\/www.docker.com\/. Accessed 26 Feb 2021"},{"key":"1962_CR42","doi-asserted-by":"publisher","unstructured":"P. Dobbelaere, K.S. Esmaili, Kafka versus RabbitMQ: a comparative study of two industry reference publish\/subscribe implementations: industry paper, in Proceedings of the 11th ACM International Conference on Distributed and Event-Based Systems. DEBS \u201917 (Association for Computing Machinery, New York, NY, USA, 2017), pp. 227\u2013238. https:\/\/doi.org\/10.1145\/3093742.3093908","DOI":"10.1145\/3093742.3093908"},{"key":"1962_CR43","unstructured":"W. Nakimuli, G. Landi, R. Perez, M. Pergolesi, M. Molla, C. Ntogkas, G. Garcia-Aviles, J. Garcia-Reinoso, M. Femminella, P. Serrano, F. Lombardo, J. Rodriguez, G. Reali, S. Salsano, Automatic deployment, execution and analysis of 5G experiments using the 5G EVE platform, in 2020 IEEE 3rd 5G World Forum (5GWF) (2020), pp. 372\u2013377"},{"key":"1962_CR44","unstructured":"5G EVE Github repository. https:\/\/github.com\/5GEVE. Accessed 26 Feb 2021"}],"container-title":["EURASIP Journal on Wireless Communications and Networking"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13638-021-01962-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s13638-021-01962-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13638-021-01962-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,4,7]],"date-time":"2021-04-07T09:35:43Z","timestamp":1617788143000},"score":1,"resource":{"primary":{"URL":"https:\/\/jwcn-eurasipjournals.springeropen.com\/articles\/10.1186\/s13638-021-01962-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,7]]},"references-count":44,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["1962"],"URL":"https:\/\/doi.org\/10.1186\/s13638-021-01962-y","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-96351\/v1","asserted-by":"object"}]},"ISSN":["1687-1499"],"issn-type":[{"value":"1687-1499","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,7]]},"assertion":[{"value":"19 October 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 March 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 April 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"80"}}