{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T09:59:08Z","timestamp":1776765548068,"version":"3.51.2"},"reference-count":24,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2023,8,29]],"date-time":"2023-08-29T00:00:00Z","timestamp":1693267200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"State Grid Corporation of China Technology project","award":["5700-202255476A-2-0-KJ"],"award-info":[{"award-number":["5700-202255476A-2-0-KJ"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>As a key 5G technology, massive multiple-input multiple-output (MIMO) can effectively improve system capacity and reduce latency. This paper proposes a user scheduling and spectrum allocation method based on combinatorial multi-armed bandit (CMAB) for a massive MIMO system. Compared with traditional methods, the proposed CMAB-based method can avoid channel estimation for all users, significantly reduce pilot overhead, and improve spectral efficiency. Specifically, the proposed method is a two-stage method; in the first stage, we transform the user scheduling problem into a CMAB problem, with each user being referred to as a base arm and the energy of the channel being considered a reward. A linear upper confidence bound (UCB) arm selection algorithm is proposed. It is proved that the proposed user scheduling algorithm experiences logarithmic regret over time. In the second stage, by grouping the statistical channel state information (CSI), such that the statistical CSI of the users in the angular domain in different groups is approximately orthogonal, we are able to select one user in each group and allocate a subcarrier to the selected users, so that the channels of users on each subcarrier are approximately orthogonal, which can reduce the inter-user interference and improve the spectral efficiency. The simulation results validate that the proposed method has a high spectral efficiency.<\/jats:p>","DOI":"10.3390\/s23177512","type":"journal-article","created":{"date-parts":[[2023,8,30]],"date-time":"2023-08-30T10:30:52Z","timestamp":1693391452000},"page":"7512","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Spectrum Allocation and User Scheduling Based on Combinatorial Multi-Armed Bandit for 5G Massive MIMO"],"prefix":"10.3390","volume":"23","author":[{"given":"Jian","family":"Dou","sequence":"first","affiliation":[{"name":"China Electric Power Research Institute, Beijing 100192, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuan","family":"Liu","sequence":"additional","affiliation":[{"name":"China Electric Power Research Institute, Beijing 100192, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shuang","family":"Qie","sequence":"additional","affiliation":[{"name":"China Electric Power Research Institute, Beijing 100192, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiayi","family":"Li","sequence":"additional","affiliation":[{"name":"China Electric Power Research Institute, Beijing 100192, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chaoliang","family":"Wang","sequence":"additional","affiliation":[{"name":"State Grid Zhejiang Electric Power Co., Ltd., Hangzhou 311121, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"130302","DOI":"10.1007\/s11432-022-3692-5","article-title":"Spectrum chain: A disruptive dynamic spectrum-sharing framework for 6G","volume":"66","author":"Wu","year":"2023","journal-title":"Sci. China Inf. Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1672","DOI":"10.1109\/OJCOMS.2022.3209368","article-title":"Energy-efficient UAV-relaying 5G\/6G spectrum sharing networks: Interference coordination with power management and trajectory design","volume":"3","author":"Wang","year":"2022","journal-title":"IEEE Open J. Commun. Soc."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Yang, X., Ma, S., and Jin, S. (IEEE Trans. Wirel. Commun., 2023). Antenna selection for asymmetrical uplink and downlink transceivers in massive MIMO systems, IEEE Trans. Wirel. Commun., in press.","DOI":"10.1109\/TWC.2023.3269159"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1109\/MCOM.2014.6736761","article-title":"Massive MIMO for next generation wireless systems","volume":"52","author":"Larsson","year":"2014","journal-title":"IEEE Commun. Mag."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"162","DOI":"10.23919\/JCC.2021.06.013","article-title":"Sparsity-aware channel estimation for mmWave massive MIMO: A deep CNN-based approach","volume":"18","author":"Liu","year":"2021","journal-title":"China Commun."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Yuan, M., Wang, H., Yin, H., and He, D. (IEEE Trans. Wirel. Commun., 2023). Alternating optimization based hybrid transceiver designs for wideband millimeter-wave massive multiuser MIMO-OFDM systems, IEEE Trans. Wirel. Commun., in press.","DOI":"10.1109\/TWC.2023.3269056"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1529","DOI":"10.1109\/COMST.2016.2532458","article-title":"Next generation 5G wireless networks: A comprehensive survey","volume":"18","author":"Agiwal","year":"2016","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Anarakifirooz, E., and Loyka, S. (IEEE Trans. Wirel. Commun., 2023). The robustness of favorable propagation in massive MIMO to location and phase errors, IEEE Trans. Wirel. Commun., in press.","DOI":"10.1109\/ITW55543.2023.10160245"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Baeza, V.M., and Armada, A.G. (2021, January 8\u201311). Orthogonal versus Non-Orthogonal multiplexing in Non-Coherent Massive MIMO Systems based on DPSK. Proceedings of the Joint European Conference on Networks and Communications & 6G Summit (EuCNC\/6G Summit), Porto, Portugal.","DOI":"10.1109\/EuCNC\/6GSummit51104.2021.9482419"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"7831","DOI":"10.1109\/TWC.2016.2608883","article-title":"Energy-based modulation for noncoherent massive SIMO systems","volume":"16","author":"Manolakos","year":"2016","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1809","DOI":"10.1109\/TVT.2017.2750114","article-title":"A noncoherent multiuser large-scale SIMO system relying on M-ary DPSK and BICM-ID","volume":"67","author":"Baeza","year":"2018","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"6145","DOI":"10.1109\/TWC.2020.3000419","article-title":"Multi-user detection based on expectation propagation for the non-coherent SIMO multiple access channel","volume":"19","author":"Ngo","year":"2020","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_13","first-page":"4218","article-title":"Impact of mobility on the uplink sum rate of MIMO-OFDMA cellular systems","volume":"65","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Commun."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"5285","DOI":"10.1109\/TCOMM.2022.3186402","article-title":"Impact of subcarrier allocation and user mobility on the uplink performance of multiuser massive MIMO-OFDM systems","volume":"70","author":"Anand","year":"2022","journal-title":"IEEE Trans. Commun."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Hong, M., Hwang, I., Heo, J., and Hong, D. (2023, January 8\u201311). A new scheduling algorithm for time-varying MIMO channels with a channel aging metric. Proceedings of the IEEE Consumer Communications & Networking Conference (CCNC), Las Vegas, NV, USA.","DOI":"10.1109\/CCNC51644.2023.10059856"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"990","DOI":"10.1049\/iet-com.2010.0358","article-title":"Low-complexity scheduling strategy for wireless multiuser multiple-input multiple-output downlink system","volume":"5","author":"Jin","year":"2023","journal-title":"IET Commun."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Shehata, M., Crussire, M., Hlard, M., and Pajusco, P. (2018, January 9\u201312). Leakage based users selection for hybrid beamforming in millimeter wave MIMO. Proceedings of the Annual International Symposium on Personal, Indoor and Mobile Radio Communications, Bologna, Italy.","DOI":"10.1109\/PIMRC.2018.8580820"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Bu, G., and Jiang, J. (2019, January 11\u201313). Reinforcement learning-Based user scheduling and resource allocation for massive MU-MIMO system. Proceedings of the IEEE\/CIC International Conference on Communications in China, Istanbul, Turkey.","DOI":"10.1109\/ICCChina.2019.8855949"},{"key":"ref_19","unstructured":"Thet, N.M.W., Baykas, T., and Ozdemir, M.K. (2019, January 8\u201311). Performance analysis of user scheduling in massive MIMO with fast moving users. Proceedings of the 30th Annual InternationalSymposium on Personal, Indoor and Mobile Radio Communications, Changchun, China."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2095","DOI":"10.1109\/LWC.2022.3193877","article-title":"Improved Hierarchical Codebook-Based Channel Estimation for mmWave Massive MIMO Systems","volume":"11","author":"Yoon","year":"2022","journal-title":"IEEE Wirel. Commun. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3403","DOI":"10.1109\/TMTT.2018.2829702","article-title":"Digital beamforming-based massive MIMO transceiver for 5G millimeter-wave communications","volume":"66","author":"Yang","year":"2018","journal-title":"IEEE Trans. Microw. Theory Tech."},{"key":"ref_22","unstructured":"Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, The MIT Press Cambridge."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"6794","DOI":"10.1109\/TVT.2022.3229312","article-title":"Two stage beamforming in massive MIMO: A combinatorial multi-armed bandit based approach","volume":"72","author":"Song","year":"2023","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_24","unstructured":"Vershynin, R. (2020). High-Dimensional Probability\u2014An Introduction with Applications in Data Science, University of California."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/17\/7512\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:42:07Z","timestamp":1760128927000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/17\/7512"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,29]]},"references-count":24,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["s23177512"],"URL":"https:\/\/doi.org\/10.3390\/s23177512","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,29]]}}}