{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:59:12Z","timestamp":1760234352673,"version":"build-2065373602"},"reference-count":46,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2021,5,13]],"date-time":"2021-05-13T00:00:00Z","timestamp":1620864000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Programa Operativo FEDER Andaluc\u00eda. 2014-2020","award":["UMA18-FEDERJA-201,"],"award-info":[{"award-number":["UMA18-FEDERJA-201,"]}]},{"name":"Proyectos de investigaci\u00f3n en colaboraci\u00f3n con el tejido productivo PAIDI","award":["P18-FR-4647"],"award-info":[{"award-number":["P18-FR-4647"]}]},{"name":"Incentivos a los agentes p\u00fablicos del Sistema Andaluz del Conocimiento, 554 para la realizaci\u00f3n de proyectos de I+D+i., en el \u00e1mbito del Plan Andaluz de Investigaci\u00f3n, Desarrollo e Innovaci\u00f3n PAIDI 2020","award":["SMART"],"award-info":[{"award-number":["SMART"]}]},{"DOI":"10.13039\/100010663","name":"H2020 European Research Council","doi-asserted-by":"publisher","award":["ICT-871249","H2020-ICT-11-2014"],"award-info":[{"award-number":["ICT-871249","H2020-ICT-11-2014"]}],"id":[{"id":"10.13039\/100010663","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Although log processing of network equipment is a common technique in cellular network management, several factors make said task challenging, especially during mass attendance events. The present paper assesses classic methods for cellular network measurement and acquisition, showing how the use of on-the-field user probes can provide relevant capabilities to the analysis of cellular network performance. Therefore, a framework for the deployment of this kind of system is proposed here based on the development of a new hardware virtualization platform with radio frequency capabilities. Accordingly, an analysis of the characteristics and requirements for the use of virtual probes was performed. Moreover, the impact that social events (e.g., sports matches) may have on the service provision was evaluated through a real cellular scenario. For this purpose, a long-term measurement study during crowded events (i.e., football matches) in a stadium has been conducted, and the performances of different services and operators under realistic settings has been evaluated. As a result, several considerations are presented that can be used for better management of future networks.<\/jats:p>","DOI":"10.3390\/s21103404","type":"journal-article","created":{"date-parts":[[2021,5,14]],"date-time":"2021-05-14T03:28:36Z","timestamp":1620962916000},"page":"3404","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Cellular Network Radio Monitoring and Management through Virtual UE Probes: A Study Case Based on Crowded Events"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3639-3534","authenticated-orcid":false,"given":"Eduardo","family":"Baena","sequence":"first","affiliation":[{"name":"Instituto de Telecomunicaci\u00f3n (TELMA), Universidad de M\u00e1laga, CEI Andaluc\u00eda TECH, E.T.S. Ingenier\u00eda de Telecomunicaci\u00f3n, Bulevar Louis Pasteur 35, 29010 M\u00e1laga, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5857-6403","authenticated-orcid":false,"given":"Sergio","family":"Fortes","sequence":"additional","affiliation":[{"name":"Instituto de Telecomunicaci\u00f3n (TELMA), Universidad de M\u00e1laga, CEI Andaluc\u00eda TECH, E.T.S. Ingenier\u00eda de Telecomunicaci\u00f3n, Bulevar Louis Pasteur 35, 29010 M\u00e1laga, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5800-2779","authenticated-orcid":false,"given":"\u00d6zg\u00fc","family":"Alay","sequence":"additional","affiliation":[{"name":"Simula Metropolitan Center for Digital Engineering, Pilestredet 52, 0167 Oslo, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4385-0465","authenticated-orcid":false,"given":"Min","family":"Xie","sequence":"additional","affiliation":[{"name":"Telenor Research, Telenor, Snar\u00f8yveien 30, 1360 Fornebu, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6279-7903","authenticated-orcid":false,"given":"H\u00e5kon","family":"L\u00f8nsethagen","sequence":"additional","affiliation":[{"name":"Telenor Research, Telenor, Snar\u00f8yveien 30, 1360 Fornebu, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8993-5229","authenticated-orcid":false,"given":"Raquel","family":"Barco","sequence":"additional","affiliation":[{"name":"Instituto de Telecomunicaci\u00f3n (TELMA), Universidad de M\u00e1laga, CEI Andaluc\u00eda TECH, E.T.S. Ingenier\u00eda de Telecomunicaci\u00f3n, Bulevar Louis Pasteur 35, 29010 M\u00e1laga, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1109\/MCOM.2017.1600907","article-title":"The Unavoidable Convergence of NFV, 5G, and Fog: A Model-Driven Approach to Bridge Cloud and Edge","volume":"55","author":"Yannuzzi","year":"2017","journal-title":"IEEE Commun. Mag."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ramiro, J., and Hamied, K. (2012). Self-Organizing Networks (SON): Self-Planning, Self-Optimization and Self-Healing for GSM, UMTS and LTE, Wiley Publishing. [1st ed.].","DOI":"10.1002\/9781119954224"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1109\/MVT.2015.2431753","article-title":"Context-Aware Self-Optimization: Evolution Based on the Use Case of Load Balancing in Small-Cell Networks","volume":"11","author":"Fortes","year":"2016","journal-title":"IEEE Veh. Technol. Mag."},{"key":"ref_4","unstructured":"3GPP (2020). Telecommunication Management; Subscriber and Equipment Trace; Trace Control and Configuration Management, 3rd Generation Partnership Project (3GPP). Technical Specification (ts)."},{"key":"ref_5","first-page":"2","article-title":"Docker: Lightweight linux containers for consistent development and deployment","volume":"2014","author":"Merkel","year":"2014","journal-title":"Linux J."},{"key":"ref_6","unstructured":"Telecom Infra Project (TIP) (2020, March 01). OpenRAN Project. Available online: https:\/\/telecominfraproject.com\/openran\/."},{"key":"ref_7","unstructured":"O-RAN Alliance (2020, March 01). O-RAN Architecture Description v1.0. Available online: https:\/\/www.o-ran.org\/specifications."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Castagno, P., Mancuso, V., Sereno, M., and Marsan, M.A. (2017, January 12\u201315). Why your smartphone doesn\u2019t work in very crowded environments. Proceedings of the 2017 IEEE 18th International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM), Macau, China.","DOI":"10.1109\/WoWMoM.2017.7974296"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"107046","DOI":"10.1016\/j.comnet.2019.107046","article-title":"Limitations and sidelink-based extensions of 3GPP cellular access protocols for very crowded environments","volume":"168","author":"Castagno","year":"2020","journal-title":"Comput. Netw."},{"key":"ref_10","unstructured":"Huang, J., Qian, F., Gerber, A., Mao, Z.M., Sen, S., and Spatscheck, O. (, January June). A Close Examination of Performance and Power Characteristics of 4G LTE Networks. Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services (MobiSys \u201912), Low Wood Bay Lake District, UK."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Vasicek, D., Mikulec, M., Gresak, E., Rezac, F., and Chromy, E. (2017, January 7). Mobile Probe for Cellular Network Coverage and Quality Measurement. Proceedings of the 3rd Czech-China Scientific Conference, Ostrava, Czech Republic.","DOI":"10.5772\/intechopen.71105"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/j.pmcj.2018.07.001","article-title":"Fine-grained LTE radio link estimation for mobile phones","volume":"49","author":"Bui","year":"2018","journal-title":"Pervasive Mob. Comput."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Nikravesh, A., Choffnes, D., Katz-Bassett, E., Mao, Z., and Welsh, M. (2014). Mobile Network Performance from User Devices: A Longitudinal, Multidimensional Analysis. International Conference on Passive and Active Network Measurement, Springer.","DOI":"10.1007\/978-3-319-04918-2_2"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1109\/MVT.2019.2938448","article-title":"End-To-End Network Management: Modeling Key Quality Indicators","volume":"14","author":"Fortes","year":"2019","journal-title":"IEEE Veh. Technol. Mag."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1304","DOI":"10.1109\/LCOMM.2020.2979713","article-title":"Estimation of Video Streaming KQIs for Radio Access Negotiation in Network Slicing Scenarios","volume":"24","author":"Baena","year":"2020","journal-title":"IEEE Commun. Lett."},{"key":"ref_16","unstructured":"Khatouni, A.S., Soro, F., and Giordano, D. (2019, January 8\u201312). A Machine Learning Application for Latency Prediction in Operational 4G Networks. Proceedings of the 2019 IFIP\/IEEE Symposium on Integrated Network and Service Management (IM), IFIP, Arlington, VA, USA."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Tselios, C., and Tsolis, G. (2016, January 23\u201325). On QoE-awareness through virtualized probes in 5G networks. Proceedings of the 2016 IEEE 21st International Workshop on Computer Aided Modelling and Design of Communication Links and Networks (CAMAD), Toronto, ON, Canada.","DOI":"10.1109\/CAMAD.2016.7790351"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kousias, K., Midoglu, C., Alay, O., Lutu, A., Argyriou, A., and Riegler, M. (2017, January 8\u201313). The same, only different: Contrasting mobile operator behavior from crowdsourced dataset. Proceedings of the 2017 IEEE 28th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC), IEEE, Montreal, QC, Canada.","DOI":"10.1109\/PIMRC.2017.8292203"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Rajiullah, M., Lutu, A., Khatouni, A.S., Fida, M.R., Mellia, M., Brunstrom, A., Alay, O., Alfredsson, S., and Mancuso, V. (2019). Web Experience in Mobile Networks: Lessons from Two Million Page Visits. The World Wide Web Conference, Association for Computing Machinery.","DOI":"10.1145\/3308558.3313606"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Choffnes, D., and Barcellos, M. (2019). Measuring Web Quality of Experience in Cellular Networks. International Conference on Passive and Active Network Measurement, Springer International Publishing.","DOI":"10.1007\/978-3-030-15986-3"},{"key":"ref_21","unstructured":"Marina, M.K., and Kozat, U.C. (2016, January 3\u20137). OWL: A reliable online watcher for LTE control channel measurements. Proceedings of the 5th Workshop on All Things Cellular-Operations, Applications and Challenges, ATC@MobiCom 2016, New York, NY, USA."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1145\/3103535.3103548","article-title":"MobileInsight: Analyzing Cellular Network Information on Smartphones","volume":"21","author":"Li","year":"2017","journal-title":"GetMobile Mob. Comput. Commun."},{"key":"ref_23","unstructured":"TEMS\u2122 (2020, March 01). TEMS\u00ae |Testing, Monitoring, and Analytics of Radio and Core Networks-Webpage. Available online: http:\/\/www.tems.com\/."},{"key":"ref_24","unstructured":"ROHDE&SCHWARZ (2020, March 01). R&S\u00ae ROMES4 Drive Test Software-Webpage. Available online: https:\/\/www.rohde-schwarz.com\/us\/product\/romes-productstartpage_63493-8650.html."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zafeiropoulos, A., Fotopoulou, E., Peuster, M., Schneider, S., Gouvas, P., Behnke, D., M\u00fcller, M., B\u00f6k, P.B., Trakadas, P., and Karkazis, P. (July, January 29). Benchmarking and Profiling 5G Verticals\u2019 Applications: An Industrial IoT Use Case. Proceedings of the 2020 6th IEEE Conference on Network Softwarization (NetSoft), Ghent, Belgium.","DOI":"10.1109\/NetSoft48620.2020.9165393"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1308","DOI":"10.1109\/TNET.2016.2533612","article-title":"Characterizing and Optimizing Cellular Network Performance During Crowded Events","volume":"24","author":"Shafiq","year":"2016","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1109\/MCOM.2015.7010548","article-title":"Management architecture for location-aware self-organizing LTE\/LTE-A small cell networks","volume":"53","author":"Fortes","year":"2015","journal-title":"Commun. Mag. IEEE"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1109\/MVT.2015.2479657","article-title":"Context-Aware Self-Healing: User Equipment as the Main Source of Information for Small-Cell Indoor Networks","volume":"11","author":"Fortes","year":"2016","journal-title":"IEEE Veh. Technol. Mag."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1109\/MCOM.2018.1700580","article-title":"Applying Social Event Data for the Management of Cellular Networks","volume":"56","author":"Fortes","year":"2018","journal-title":"IEEE Commun. Mag."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1250","DOI":"10.1109\/TWC.2019.2952117","article-title":"User-Centric 5G Cellular Networks: Resource Allocation and Comparison With the Cell-Free Massive MIMO Approach","volume":"19","author":"Buzzi","year":"2020","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Falkenberg, R., and Wietfeld, C. (2019, January 9\u201313). FALCON: An Accurate Real-time Monitor for Client-based Mobile Network Data Analytics. Proceedings of the 2019 IEEE Global Communications Conference (GLOBECOM), Waikoloa, HI, USA.","DOI":"10.1109\/GLOBECOM38437.2019.9014096"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1582","DOI":"10.1109\/TMC.2017.2756937","article-title":"LinkForecast: Cellular Link Bandwidth Prediction in LTE Networks","volume":"17","author":"Yue","year":"2018","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1109\/MCOM.2012.6211483","article-title":"Minimization of drive tests solution in 3GPP","volume":"50","author":"Hapsari","year":"2012","journal-title":"Commun. Mag. IEEE"},{"key":"ref_34","unstructured":"Ayala-Romero, J.A., Garcia-Saavedra, A., Gramaglia, M., Costa-Perez, X., Banchs, A., and Alcaraz, J.J. (2019, January 21\u201325). VrAIn: A Deep Learning Approach Tailoring Computing and Radio Resources in Virtualized RANs. Proceedings of the 25th Annual International Conference on Mobile Computing and Networking, MobiCom 19, Los Cabos, Mexico."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1145\/2677046.2677053","article-title":"OpenAirInterface: A Flexible Platform for 5G Research","volume":"44","author":"Nikaein","year":"2014","journal-title":"SIGCOMM Comput. Commun. Rev."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Gomez-Miguelez, I., Garcia-Saavedra, A., Sutton, P.D., Serrano, P., Cano, C., and Leith, D.J. (2016, January 3\u20137). srsLTE: An open-source platform for LTE evolution and experimentation. Proceedings of the Tenth ACM International Workshop on Wireless Network Testbeds, Experimental Evaluation, and Characterization, New York, NY, USA.","DOI":"10.1145\/2980159.2980163"},{"key":"ref_37","unstructured":"3GPP (2020). System Architecture for the 5G System (5GS), 3rd Generation Partnership Project (3GPP). Technical specification (TS) 23.501."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Midoglu, C., Wimmer, L., Lutu, A., Alay, O., and Griwodz, C. (2018, January 15\u201319). MONROE-Nettest: A configurable tool for dissecting speed measurements in mobile broadband networks. Proceedings of the IEEE INFOCOM 2018-IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Honolulu, HI, USA.","DOI":"10.1109\/INFCOMW.2018.8406836"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.comcom.2018.09.004","article-title":"Results from running an experiment as a service platform for mobile broadband networks in Europe","volume":"133","author":"Mancuso","year":"2019","journal-title":"Comput. Commun."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Alay, O., Lutu, A., Peonn-Quiros, M., Mancuso, V., Hirsch, T., Evensen, K., Hansen, A., Alfredsson, S., Karlsson, J., and Brunstrom, A. (2017, January 16\u201320). Experience: An open platform for experimentation with commercial mobile broadband networks. Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking, Snowbird, UT, USA.","DOI":"10.1145\/3117811.3117812"},{"key":"ref_41","unstructured":"CellMapper\u2122 (2021, February 22). CellMapper\u00ae|Tower and Signal Map Android APP-Webpage. Available online: https:\/\/www.cellmapper.net\/map\/."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"107629","DOI":"10.1016\/j.comnet.2020.107629","article-title":"Large scale speedtest experimentation in Mobile Broadband Networks","volume":"184","author":"Midoglu","year":"2021","journal-title":"Comput. Netw."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Djedouboum, A.C., Abba Ari, A.A., Gueroui, A.M., Mohamadou, A., and Aliouat, Z. (2018). Big data collection in large-scale wireless sensor networks. Sensors, 18.","DOI":"10.3390\/s18124474"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Chen, M., Gao, S., and Wang, X.S. (2016, January 24\u201329). Converting spatiotemporal data Among heterogeneous granularity systems. Proceedings of the 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), Vancouver, BC, Canada.","DOI":"10.1109\/FUZZ-IEEE.2016.7737795"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Yang, C., Yang, C., Chen, Z., and Lo, N. (2019, January 14\u201316). Multivariate Time Series Data Transformation for Convolutional Neural Network. Proceedings of the 2019 IEEE\/SICE International Symposium on System Integration (SII), Paris, France.","DOI":"10.1109\/SII.2019.8700425"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Jiang, Y., Qi, Y., Wang, W.K., Bent, B., Avram, R., Olgin, J., and Dunn, J. (2020). EventDTW: An Improved Dynamic Time Warping Algorithm for Aligning Biomedical Signals of Nonuniform Sampling Frequencies. Sensors, 20.","DOI":"10.3390\/s20092700"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/10\/3404\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:00:26Z","timestamp":1760162426000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/10\/3404"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,13]]},"references-count":46,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,5]]}},"alternative-id":["s21103404"],"URL":"https:\/\/doi.org\/10.3390\/s21103404","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,5,13]]}}}