{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,22]],"date-time":"2025-10-22T10:43:58Z","timestamp":1761129838864,"version":"build-2065373602"},"reference-count":28,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2021,3,25]],"date-time":"2021-03-25T00:00:00Z","timestamp":1616630400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003093","name":"Ministry of Higher Education, Malaysia","doi-asserted-by":"publisher","award":["FRGS\/1\/2018\/TK10\/UNIMAP\/02\/11"],"award-info":[{"award-number":["FRGS\/1\/2018\/TK10\/UNIMAP\/02\/11"]}],"id":[{"id":"10.13039\/501100003093","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Constantly changing electricity demand has made variability and uncertainty inherent characteristics of both electric generation and cellular communication systems. This paper develops an online learning algorithm as a prescheduling mechanism to manage the variability and uncertainty to maintain cost-aware and reliable operation in cloud radio access networks (Cloud-RANs). The proposed algorithm employs a combinatorial multi-armed bandit model and minimizes the long-term energy cost at remote radio heads. The algorithm preschedules a set of cost-efficient energy packages to be purchased from an ancillary energy market for the future time slots by learning both from cooperative energy trading at previous time slots and by exploring new energy scheduling strategies at the current time slot. The simulation results confirm a significant performance gain of the proposed scheme in controlling the available power budgets and minimizing the overall energy cost compared with recently proposed approaches for real-time energy resources and energy trading in Cloud-RANs.<\/jats:p>","DOI":"10.3390\/s21072308","type":"journal-article","created":{"date-parts":[[2021,3,25]],"date-time":"2021-03-25T21:09:45Z","timestamp":1616706585000},"page":"2308","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Online Learning Approach for Predictive Real-Time Energy Trading in Cloud-RANs"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2089-7869","authenticated-orcid":false,"given":"Wan Nur Suryani Firuz Wan","family":"Wan Ariffin","sequence":"first","affiliation":[{"name":"Faculty of Electronic Engineering Technology, Universiti Malaysia Perlis, Arau 02600, Malaysia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1623-1749","authenticated-orcid":false,"given":"Xinruo","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Electronic Engineering, University of Essex, Wivenhoe Park, Colchester CO4 3SQ, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6718-8448","authenticated-orcid":false,"given":"Mohammad Reza","family":"Nakhai","sequence":"additional","affiliation":[{"name":"Department of Informatics, Centre for Telecommunications Research, King\u2019s College London, Aldwych WC2B 4BG, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5662-7158","authenticated-orcid":false,"given":"Hasliza A.","family":"Rahim","sequence":"additional","affiliation":[{"name":"Faculty of Electronic Engineering Technology, Universiti Malaysia Perlis, Arau 02600, Malaysia"},{"name":"Advanced Communication Engineering, Centre of Excellence (ACE), Universiti Malaysia Perlis, Kangar 01000, Malaysia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4862-2728","authenticated-orcid":false,"given":"R. Badlishah","family":"Ahmad","sequence":"additional","affiliation":[{"name":"Faculty of Electronic Engineering Technology, Universiti Malaysia Perlis, Arau 02600, Malaysia"},{"name":"Advanced Computing, Centre of Excellence (AdComp), Universiti Malaysia Perlis, Arau 02600, Malaysia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,3,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1109\/MWC.2014.7000980","article-title":"Heterogeneous Cloud Radio Access Networks: A New Perspective for Enhancing Spectral and Energy Efficiencies","volume":"21","author":"Peng","year":"2014","journal-title":"IEEE Wirel. Commun."},{"key":"ref_2","unstructured":"Tan, Z., Yang, C., Song, J., Liu, Y., and Wang, Z. (2015, January 3\u20135). Energy consumption analysis of C-RAN architecture based on 10G EPON front-haul with daily user behaviour. Proceedings of the 2015 14th International Conference on Optical Communications and Networks (ICOCN), Nanjing, China."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"70371","DOI":"10.1109\/ACCESS.2019.2919657","article-title":"A Comprehensive Survey of RAN Architectures Toward 5G Mobile Communication System","volume":"7","author":"Habibi","year":"2019","journal-title":"IEEE Access"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"686","DOI":"10.1109\/COMST.2015.2490540","article-title":"Energy Efficiency Tradeoff Mechanism towards Wireless Green Communication: A Survey","volume":"18","author":"Mahapatra","year":"2016","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_5","unstructured":"China Mobile Research Institute (2016, March 30). C-RAN: The Road Towards Green RAN. Available online: labs.chinamobile.com\/cran\/."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/MCOM.2011.5978416","article-title":"The Global Footprint of Mobile Communications: The Ecological and Economic Perspective","volume":"49","author":"Fehske","year":"2011","journal-title":"IEEE Commun. Mag."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3014","DOI":"10.1109\/TWC.2012.052512.111766","article-title":"When the smart grid meets energy efficient communications: Green wireless cellular networks powered by the smart grid","volume":"11","author":"Bu","year":"2012","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Chen, S., Shroff, N.B., and Sinha, P. (2013, January 3\u20136). Energy trading in the smart grid: From end-user\u2019s perspective. Proceedings of the 2013 Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA.","DOI":"10.1109\/ACSSC.2013.6810288"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2476","DOI":"10.1109\/TVT.2014.2345415","article-title":"CoMP meets smart grid: A new communication and energy cooperation paradigm","volume":"64","author":"Xu","year":"2015","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Xu, J., and Zhang, R. (2014, January 8\u201312). Cooperative Energy Trading in CoMP Systems Powered by Smart Grids. Proceedings of the 2014 IEEE Global Communications Conference, Austin, TX, USA.","DOI":"10.1109\/GLOCOM.2014.7037215"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1439","DOI":"10.1109\/TSG.2013.2284664","article-title":"A game-theoretic approach to energy trading in the smart grid","volume":"5","author":"Wang","year":"2014","journal-title":"IEEE Trans. Smart Grid"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Leithon, J., Lim, T.J., and Sun, S. (2013, January 21\u201324). Online energy management strategies for base stations powered by the smart grid. Proceedings of the 2013 IEEE International Conference on Smart Grid Communications (SmartGridComm), Vancouver, BC, Canada.","DOI":"10.1109\/SmartGridComm.2013.6687957"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2022","DOI":"10.1109\/TSG.2016.2601718","article-title":"Sparse Beamforming for Real-Time Resource Management and Energy Trading in Green C-RAN","volume":"8","author":"Ariffin","year":"2016","journal-title":"IEEE Trans. Smart Grid"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1464","DOI":"10.1109\/TSG.2013.2248175","article-title":"Distributed Optimal Power Flow for Smart Microgrids","volume":"4","author":"Zhu","year":"2013","journal-title":"IEEE Trans. Smart Grid"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ariffin, W.N.S.F.W., Zhang, X., and Nakhai, M.R. (2016, January 23\u201327). Combinatorial multi-armed bandit algorithms for real-time energy trading in green C-RAN. Proceedings of the 2016 IEEE International Conference on Communications (ICC), Kuala Lumpur, Malaysia.","DOI":"10.1109\/ICC.2016.7511448"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1609","DOI":"10.1109\/LCOMM.2017.2687872","article-title":"A Bandit Approach to Price-Aware Energy Management in Cellular Networks","volume":"21","author":"Zhang","year":"2017","journal-title":"IEEE Commun. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ariffin, W.N.S.F.W., Zhang, X., and Nakhai, M.R. (2016, January 23\u201327). Sparse beamforming for real-time energy trading in CoMP-SWIPT networks. Proceedings of the 2016 IEEE International Conference on Communications (ICC), Kuala Lumpur, Malaysia.","DOI":"10.1109\/ICC.2016.7510865"},{"key":"ref_18","first-page":"1326","article-title":"Sparse Beamforming and User-Centric Clustering for Downlink Cloud Radio Access Network","volume":"2","author":"Dai","year":"2014","journal-title":"IEEE Access Recent Adv. Cloud RAN"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ng, D.W.K., and Schober, R. (2014, January 8\u201312). Resources Allocation for Coordinated Multipoint Networks with Wireless Information and Power Transfer. Proceedings of the 2014 IEEE Global Communications Conference, Austin, TX, USA.","DOI":"10.1109\/GLOCOM.2014.7037480"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1007\/s00041-008-9045-x","article-title":"Enhancing Sparsity by Reweighted \u21131 Minimization","volume":"14","author":"Candes","year":"2008","journal-title":"J. Fourier Anal. Appl."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Boyd, S., and Vandenberghe, L. (2004). Convex Optimization, Cambridge University Press.","DOI":"10.1017\/CBO9780511804441"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"4995","DOI":"10.1137\/1038003","article-title":"Semidefinite programming","volume":"38","author":"Vandenberghe","year":"1996","journal-title":"SIAM Rev."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Nesterov, Y., and Nemirovsky, A. (1994). Interior-Point Polynomial Methods in Convex Programming, Society for Industrial and Applied Mathematics. Studies in Applied Mathematics.","DOI":"10.1137\/1.9781611970791"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Blasco, P., and Gunduz, D. (2014, January 10\u201314). Learning-Based Optimization of Cache Content in a Small Cell Base Station. Proceedings of the 2014 IEEE International Conference on Communications (ICC), Sydney, Australia.","DOI":"10.1109\/ICC.2014.6883600"},{"key":"ref_25","unstructured":"Chen, W., Wang, Y., and Yuan, Y. (2013, January 16\u201321). Combinatorial multi-armed bandit: General framework, results and applications. Proceedings of the International Conference on Machine Learning, Atlanta, GA, USA."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1214\/aos\/1015362186","article-title":"Randomized Allocation with nonparametric estimation for a multi-armed bandit problem with covariates","volume":"30","author":"Yang","year":"2002","journal-title":"Ann. Statist."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ariffin, W.N.S.F.W., Zhang, X., and Nakhai, M.R. (September, January 30). Real-time power balancing in green CoMP network with wireless information and energy transfer. Proceedings of the 2015 IEEE 26th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC), Hong Kong.","DOI":"10.1109\/PIMRC.2015.7343549"},{"key":"ref_28","unstructured":"Grant, M., and Boyd, S. (2014, January 30). CVX: Matlab Software for Disciplined Convex Programming, Version 2.0 (Beta). March 2013. Available online: http:\/\/cvxr.com\/cvx\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/7\/2308\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:41:13Z","timestamp":1760161273000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/7\/2308"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,25]]},"references-count":28,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2021,4]]}},"alternative-id":["s21072308"],"URL":"https:\/\/doi.org\/10.3390\/s21072308","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,3,25]]}}}