{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,9,26]],"date-time":"2024-09-26T04:32:12Z","timestamp":1727325132053},"reference-count":27,"publisher":"Institute of Electrical and Electronics Engineers (IEEE)","issue":"11","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IEICE Trans. Commun."],"published-print":{"date-parts":[[2022,11,1]]},"DOI":"10.1587\/transcom.2021tmp0011","type":"journal-article","created":{"date-parts":[[2022,5,26]],"date-time":"2022-05-26T22:10:55Z","timestamp":1653603055000},"page":"1332-1341","source":"Crossref","is-referenced-by-count":0,"title":["Reinforcement Learning for QoS-Constrained Autonomous Resource Allocation with H2H\/M2M Co-Existence in Cellular Networks"],"prefix":"10.23919","volume":"E105.B","author":[{"given":"Xing","family":"WEI","sequence":"first","affiliation":[{"name":"Key Laboratory of Modern Measurement and Control Technology, Ministry of Education, Beijing Information Science and Technology University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuehua","family":"LI","sequence":"additional","affiliation":[{"name":"Key Laboratory of Modern Measurement and Control Technology, Ministry of Education, Beijing Information Science and Technology University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shuo","family":"CHEN","sequence":"additional","affiliation":[{"name":"Key Laboratory of Modern Measurement and Control Technology, Ministry of Education, Beijing Information Science and Technology University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Na","family":"LI","sequence":"additional","affiliation":[{"name":"Baicells Technologies, Co., Ltd."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"263","reference":[{"key":"1","unstructured":"[1] C.E.t.E.I. Analytics, \u201cFor electric utilities solution overview,\u201d URL https:\/\/www.cisco.com\/c\/en\/us\/solutions\/collateral\/data-center-virtualization\/big-data\/solution-overview-c22-740248.html, 2018."},{"key":"2","doi-asserted-by":"publisher","unstructured":"[2] F. Boccardi, R.W. Heath, A. Lozano, T.L. Marzetta, and P. Popovski, \u201cFive disruptive technology directions for 5G,\u201d IEEE Commun. Mag., vol.52, no.2, pp.74-80, 2014. 10.1109\/mcom.2014.6736746","DOI":"10.1109\/MCOM.2014.6736746"},{"key":"3","doi-asserted-by":"crossref","unstructured":"[3] M.K. Giluka, N.S. Kumar, N. Rajoria, and B.R. Tamma, \u201cClass based priority scheduling to support machine to machine communications in LTE systems,\u201d 2014 Twentieth National Conference on Communications (NCC), pp.1-6, IEEE, 2014. 10.1109\/ncc.2014.6811381","DOI":"10.1109\/NCC.2014.6811381"},{"key":"4","doi-asserted-by":"crossref","unstructured":"[4] Z.J. Yang, J.C. Huang, C.T. Chou, H.Y. Hsieh, C.W. Hsu, P.C. Yeh, and C.C.A. Hsu, \u201cPeer discovery for device-to-device (D2D) communication in LTE-A networks,\u201d 2013 IEEE Globecom Workshops (GC Wkshps), pp.665-670, IEEE, 2013. 10.1109\/glocomw.2013.6825064","DOI":"10.1109\/GLOCOMW.2013.6825064"},{"key":"5","doi-asserted-by":"publisher","unstructured":"[5] F. Ghavimi and H.H. Chen, \u201cM2M communications in 3GPP LTE\/LTE-A networks: Architectures, service requirements, challenges, and applications,\u201d IEEE Commun. Surveys Tuts., vol.17, no.2, pp.525-549, 2014. 10.1109\/comst.2014.2361626","DOI":"10.1109\/COMST.2014.2361626"},{"key":"6","doi-asserted-by":"publisher","unstructured":"[6] N. Abu-Ali, A.E.M. Taha, M. Salah, and H. Hassanein, \u201cUplink scheduling in lte and LTE-advanced: Tutorial, survey and evaluation framework,\u201d IEEE Commun. Surveys Tuts., vol.16, no.3, pp.1239-1265, 2013. 10.1109\/surv.2013.1127.00161","DOI":"10.1109\/SURV.2013.1127.00161"},{"key":"7","doi-asserted-by":"publisher","unstructured":"[7] A. Aijaz, M. Tshangini, M.R. Nakhai, X. Chu, and A.H. Aghvami, \u201cEnergy-efficient uplink resource allocation in LTE networks with M2M\/H2H co-existence under statistical QoS guarantees,\u201d IEEE Trans. Commun., vol.62, no.7, pp.2353-2365, 2014. 10.1109\/tcomm.2014.2328338","DOI":"10.1109\/TCOMM.2014.2328338"},{"key":"8","doi-asserted-by":"publisher","unstructured":"[8] M.Y. Abdelsadek, Y. Gadallah, and M.H. Ahmed, \u201cOptimal cross-layer resource allocation for critical MTC traffic in mixed LTE networks,\u201d IEEE Trans. Veh. Technol., vol.68, no.6, pp.5944-5956, 2019. 10.1109\/tvt.2019.2909689","DOI":"10.1109\/TVT.2019.2909689"},{"key":"9","doi-asserted-by":"publisher","unstructured":"[9] J. Shi, C. Liu, X. Hong, and C.X. Wang, \u201cCoexistence of delay-sensitive MTC\/HTC traffic in large scale networks,\u201d Science China Information Sciences, vol.60, no.10, pp.1-15, 2017. 10.1007\/s11432-017-9183-2","DOI":"10.1007\/s11432-017-9183-2"},{"key":"10","doi-asserted-by":"crossref","unstructured":"[10] M.J. Shih, C.Y. Yeh, K.D. Huang, and H.Y. Wei, \u201cEnergy-aware waiting-line based resource allocation in cellular network with M2M\/H2H co-existence,\u201d 2015 IEEE International Conference on Communications (ICC), pp.2979-2984, IEEE, 2015. 10.1109\/icc.2015.7248780","DOI":"10.1109\/ICC.2015.7248780"},{"key":"11","doi-asserted-by":"publisher","unstructured":"[11] Y.C. Pang, S.L. Chao, G.Y. Lin, and H.Y. Wei, \u201cNetwork access for M2M\/H2H hybrid systems: A game theoretic approach,\u201d IEEE Commun. Lett., vol.18, no.5, pp.845-848, 2014. 10.1109\/coml.2014.6845397","DOI":"10.1109\/COML.2014.6845397"},{"key":"12","doi-asserted-by":"publisher","unstructured":"[12] G. Wang and T. Liu, \u201cResource allocation for M2M-enabled cellular network using nash bargaining game theory,\u201d Peer-to-Peer Netw. Appl., vol.11, no.1, pp.110-123, 2018. 10.1007\/s12083-016-0477-9","DOI":"10.1007\/s12083-016-0477-9"},{"key":"13","doi-asserted-by":"publisher","unstructured":"[13] R.S. Sutton and A.G. Barto, \u201cReinforcement learning: An introduction,\u201d Robotica, vol.17, no.2, pp.229-235, 1999. 10.1017\/s0263574799211174","DOI":"10.1017\/S0263574799211174"},{"key":"14","doi-asserted-by":"publisher","unstructured":"[14] M. Hasan, E. Hossain, and D. Niyato, \u201cRandom access for machine-to-machine communication in LTE-advanced networks: Issues and approaches,\u201d IEEE Commun. Mag., vol.51, no.6, pp.86-93, 2013. 10.1109\/mcom.2013.6525600","DOI":"10.1109\/MCOM.2013.6525600"},{"key":"15","unstructured":"[15] L.M. Bello, P. Mitchell, and D. Grace, \u201cApplication of Q-learning for rach access to support M2M traffic over a cellular network,\u201d 20th European Wireless Conference, pp.1-6, 2014."},{"key":"16","doi-asserted-by":"crossref","unstructured":"[16] L.M. Bello, P. Mitchell, and D. Grace, \u201cFrame based back-off for Q-learning RACH access in LTE networks,\u201d 2014 Australasian Telecommunication Networks and Applications Conference (ATNAC), pp.176-181, IEEE, 2014. 10.1109\/atnac.2014.7020894","DOI":"10.1109\/ATNAC.2014.7020894"},{"key":"17","doi-asserted-by":"crossref","unstructured":"[17] K. Zia, N. Javed, M.N. Sial, S. Ahmed, and F. Pervez, \u201cMulti-agent RL based user-centric spectrum allocation scheme in D2D enabled hetnets,\u201d 2018 IEEE 23rd International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD), pp.1-6, IEEE, 2018. 10.1109\/camad.2018.8514983","DOI":"10.1109\/CAMAD.2018.8514983"},{"key":"18","doi-asserted-by":"publisher","unstructured":"[18] S. Kandukuri and S. Boyd, \u201cOptimal power control in interference-limited fading wireless channels with outage-probability specifications,\u201d IEEE Trans. Wireless Commun., vol.1, no.1, pp.46-55, 2002. 10.1109\/7693.975444","DOI":"10.1109\/7693.975444"},{"key":"19","doi-asserted-by":"publisher","unstructured":"[19] J. Papandriopoulos, J. Evans, and S. Dey, \u201cOptimal power control for Rayleigh-faded multiuser systems with outage constraints,\u201d IEEE Trans. Wireless Commun., vol.4, no.6, pp.2705-2715, 2005. 10.1109\/twc.2005.858019","DOI":"10.1109\/TWC.2005.858019"},{"key":"20","doi-asserted-by":"publisher","unstructured":"[20] C.J. Watkins and P. Dayan, \u201cQ-learning,\u201d Machine learning, vol.8, no.3-4, pp.279-292, 1992. 10.1023\/a:1022676722315","DOI":"10.1023\/A:1022676722315"},{"key":"21","unstructured":"[21] C.E. Guestrin, D. Koller, and R.E. Parr, \u201cMultiagent planning with factored MDPs,\u201d Advances in Neural Information Processing Systems, 2002."},{"key":"22","unstructured":"[22] C. Guestrin, M. Lagoudakis, and R. Parr, \u201cCoordinated reinforcement learning,\u201d ICML, pp.227-234, 2002."},{"key":"23","doi-asserted-by":"publisher","unstructured":"[23] M. Harounabadi, D.M. Soleymani, S. Bhadauria, M. Leyh, and E. Roth-Mandutz, \u201cV2X in 3GPP standardization: NR sidelink in Rel-16 and beyond,\u201d IEEE Commun. Stand. Mag., vol.5, no.1, pp.12-21, 2021. 10.1109\/mcomstd.001.2000070","DOI":"10.1109\/MCOMSTD.001.2000070"},{"key":"24","doi-asserted-by":"publisher","unstructured":"[24] N. Alhussien and T.A. Gulliver, \u201cOptimal resource allocation in cellular networks with H2H\/M2M coexistence,\u201d IEEE Trans. Veh. Technol., vol.69, no.11, pp.12951-12962, 2020. 10.1109\/tvt.2020.3016239","DOI":"10.1109\/TVT.2020.3016239"},{"key":"25","doi-asserted-by":"crossref","unstructured":"[25] S. Hamdoun, A. Rachedi, and Y. Ghamri-Doudane, \u201cA flexible M2M radio resource sharing scheme in LTE networks within an H2H\/M2M coexistence scenario,\u201d 2016 IEEE international conference on communications (ICC), pp.1-7, IEEE, 2016. 10.1109\/icc.2016.7511237","DOI":"10.1109\/ICC.2016.7511237"},{"key":"26","doi-asserted-by":"publisher","unstructured":"[26] L. Liang, S. Xie, G.Y. Li, Z. Ding, and X. Yu, \u201cGraph-based resource sharing in vehicular communication,\u201d IEEE Trans. Wireless Commun., vol.17, no.7, pp.4579-4592, 2018. 10.1109\/twc.2018.2827958","DOI":"10.1109\/TWC.2018.2827958"},{"key":"27","doi-asserted-by":"crossref","unstructured":"[27] S. Hamdoun, A. Rachedi, and Y. Ghamri-Doudane, \u201cRadio resource sharing for MTC in LTE-A: An interference-aware bipartite graph approach,\u201d 2015 IEEE Global Communications Conference (GLOBECOM), pp.1-7, IEEE, 2015. 10.1109\/glocom.2015.7417719","DOI":"10.1109\/GLOCOM.2015.7417719"}],"container-title":["IEICE Transactions on Communications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transcom\/E105.B\/11\/E105.B_2021TMP0011\/_pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,25]],"date-time":"2024-09-25T23:18:53Z","timestamp":1727306333000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transcom\/E105.B\/11\/E105.B_2021TMP0011\/_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,1]]},"references-count":27,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2022]]}},"URL":"https:\/\/doi.org\/10.1587\/transcom.2021tmp0011","relation":{},"ISSN":["0916-8516","1745-1345"],"issn-type":[{"type":"print","value":"0916-8516"},{"type":"electronic","value":"1745-1345"}],"subject":[],"published":{"date-parts":[[2022,11,1]]},"article-number":"2021TMP0011"}}