{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T14:19:29Z","timestamp":1761401969631,"version":"build-2065373602"},"reference-count":54,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2019,1,17]],"date-time":"2019-01-17T00:00:00Z","timestamp":1547683200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Long Term Evolution networks, which are cellular networks, are subject to many impairments due to the nature of the transmission channel used, i.e. the air. Intercell interference is the main impairment faced by Long Term Evolution networks as it uses frequency reuse one scheme, where the whole bandwidth is used in each cell. In this paper, we propose a full dynamic intercell interference coordination scheme with no bandwidth partitioning for downlink Long Term Evolution networks. We use a reinforcement learning approach. The proposed scheme is a joint resource allocation and power allocation scheme and its purpose is to minimize intercell interference in Long Term Evolution networks. Performances of proposed scheme shows quality of service improvement in terms of SINR, packet loss and delay compared to other algorithms.<\/jats:p>","DOI":"10.3390\/fi11010019","type":"journal-article","created":{"date-parts":[[2019,1,17]],"date-time":"2019-01-17T11:30:27Z","timestamp":1547724627000},"page":"19","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["A Reinforcement Learning Based Intercell Interference Coordination in LTE Networks"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6035-8202","authenticated-orcid":false,"given":"Djorw\u00e9","family":"T\u00e9moa","sequence":"first","affiliation":[{"name":"Department of Computer Science and Telecommunications, National Advanced Engineering School, University of Maroua, 46 Maroua, Cameroon"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5755-2672","authenticated-orcid":false,"given":"Anna","family":"F\u00f6rster","sequence":"additional","affiliation":[{"name":"Communication Networks, University of Bremen, 28359 Bremen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"family":"Kolyang","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Higher Teachers\u2019 Training College, University of Maroua, 46 Maroua, Cameroon"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Serge","family":"Doka Yamigno","sequence":"additional","affiliation":[{"name":"Faculty of Science, University of Ngaoundere, 454 Ngaoundere, Cameroon"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Holma, H., and Toskala, A. (2011). LTE for UMTS: Evolution to LTE-Advanced, John Wiley & Sons.","DOI":"10.1002\/9781119992943"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1007\/s11276-015-1165-z","article-title":"Survey of ICIC techniques in LTE networks under various mobile environment parameters","volume":"23","author":"Yassin","year":"2017","journal-title":"Wirel. Netw."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Dahlman, E., Parkvall, S., Skold, J., and Beming, P. (2010). 3G Evolution: HSPA and LTE for Mobile Broadband, Academic Press.","DOI":"10.1587\/transcom.E92.B.1432"},{"key":"ref_4","unstructured":"3GPP (2006). TR 25.814, Radio Access Network, Physical layer aspects for evolved Universal Terrestrial Radio Access (UTRA) (Release 7) v7.1.0. Etsi, 1\u2013132."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Lescuyer, P., and Lucidarme, T. (2008). Evolved Packet System (EPS): The LTE and SAE Evolution of 3G UMTS, John Wiley & Sons.","DOI":"10.1002\/9780470723678"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Hassan, N.U., and Assaad, M. (2009, January 15\u201316). Optimal fractional frequency reuse (FFR) and resource allocation in multiuser OFDMA system. Proceedings of the International Conference on Information and Communication Technologies, ICICT\u201909, Karachi, Pakistan.","DOI":"10.1109\/ICICT.2009.5267207"},{"key":"ref_7","unstructured":"Mao, X., Maaref, A., and Teo, K.H. (December, January 30). Adaptive Soft Frequency Reuse for Inter-Cell Interference Coordination in SC-FDMA Based 3GPP LTE Uplinks. Proceedings of the GLOBECOM, New Orleans, LA, USA."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Sternad, M., Ottosson, T., Ahl\u00e9n, A., and Svensson, A. (2003, January 6\u20139). Attaining both coverage and high spectral efficiency with adaptive OFDM downlinks. Proceedings of the 58th IEEE Vehicular Technology Conference, VTC 2003-Fall, Orlando, FL, USA.","DOI":"10.1109\/VETECF.2003.1285981"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Rahman, M., Yanikomeroglu, H., and Wong, W. (2009, January 5\u20138). Interference avoidance with dynamic inter-cell coordination for downlink LTE system. Proceedings of the Wireless Communications and Networking Conference, WCNC 2009, Budapest, Hungary.","DOI":"10.1109\/WCNC.2009.4917761"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1558","DOI":"10.1109\/49.634794","article-title":"Application of dynamic channel allocation strategies to the GSM cellular network","volume":"15","author":"Priscoli","year":"1997","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Krasniqi, B., Wrulich, M., and Mecklenbrauker, C.F. (2009, January 28\u201330). Network-load dependent partial frequency reuse for LTE. Proceedings of the 9th International Symposium on Communications and Information Technology, ISCIT 2009, Icheon, Korea.","DOI":"10.1109\/ISCIT.2009.5341160"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Sawahashi, M., Kishiyama, Y., Morimoto, A., Nishikawa, D., and Tanno, M. (2010). Coordinated multipoint transmission\/reception techniques for LTE-advanced [Coordinated and Distributed MIMO]. IEEE Wirel. Commun., 17.","DOI":"10.1109\/MWC.2010.5490976"},{"key":"ref_13","unstructured":"Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"F\u00f6rster, A., Udugama, A., G\u00f6rg, C., Kuladinithi, K., Timm-Giel, A., and Cama-Pinto, A. (2015, January 16\u201318). A novel data dissemination model for organic data flows. Proceedings of the International Conference on Mobile Networks and Management, Santander, Spain.","DOI":"10.1007\/978-3-319-26925-2_18"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1109\/SURV.2011.040310.00002","article-title":"Computational intelligence in wireless sensor networks: A survey","volume":"13","author":"Kulkarni","year":"2011","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Daeinabi, A., Sandrasegaran, K., and Zhu, X. (2012, January 7\u20139). Survey of intercell interference mitigation techniques in LTE downlink networks. Proceedings of the 2012 IEEE Australasian Telecommunication Networks and Applications Conference (ATNAC), Brisbane, QLD, Australia.","DOI":"10.1109\/ATNAC.2012.6398059"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1109\/MCOM.2015.7010522","article-title":"Interference coordination for dense wireless networks","volume":"53","author":"Soret","year":"2015","journal-title":"IEEE Commun. Mag."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1642","DOI":"10.1109\/SURV.2013.013013.00028","article-title":"A survey on inter-cell interference coordination techniques in OFDMA-based cellular networks","volume":"15","author":"Hamza","year":"2013","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_19","first-page":"1","article-title":"A survey of scheduling and interference mitigation in LTE","volume":"2010","author":"Kwan","year":"2010","journal-title":"J. Electr. Comput. Eng."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Aboulhassan, M.A., Yassin, M., Lahoud, S., Ibrahim, M., Mezher, D., Cousin, B., and Sourour, E.A. (2015, January 27\u201329). Classification and comparative analysis of inter-cell interference coordination techniques in LTE networks. Proceedings of the 2015 7th International Conference on New Technologies, Mobility and Security\u2014NTMS 2015 Conference and Workshops, Paris, France.","DOI":"10.1109\/NTMS.2015.7266476"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1088","DOI":"10.3390\/s17051088","article-title":"An Interference Mitigation Scheme of Device-to-Device Communications for Sensor Networks Underlying LTE-A","volume":"17","author":"Kim","year":"2017","journal-title":"Sensors"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Katsinis, G., Tsiropoulou, E.E., and Papavassiliou, S. (2017). Multicell Interference Management in Device to Device Underlay Cellular Networks. Future Internet, 9.","DOI":"10.3390\/fi9030044"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kim, W.C., Paek, M.J., Ro, J.H., and Song, H.K. (2018). Adaptive CoMP with Spatial Phase Coding for Interference Mitigation in the Heterogeneous Network. Appl. Sci., 8.","DOI":"10.3390\/app8040631"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Fan, X., Chen, S., and Zhang, X. (2007, January 21\u201325). An inter-cell interference coordination technique based on users\u2019 ratio and multi-level frequency allocations. Proceedings of the International Conference on Wireless Communications, Networking and Mobile Computing, WiCom 2007, Shanghai, China.","DOI":"10.1109\/WICOM.2007.206"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1414","DOI":"10.1109\/TWC.2010.04.090256","article-title":"Enhancing cell-edge performance: A downlink dynamic interference avoidance scheme with inter-cell coordination","volume":"9","author":"Rahman","year":"2010","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Al-Rawi, M., Jantti, R., Torsner, J., and Sagfors, M. (2009, January 22\u201324). Channel-aware inter-cell interference coordination for the uplink of 3G LTE networks. Proceedings of the Wireless Telecommunications Symposium, WTS 2009, Prague, Czech Republic.","DOI":"10.1109\/WTS.2009.5068967"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"49","DOI":"10.5121\/ijwmn.2013.5404","article-title":"An intercell interference coordination scheme in LTE downlink networks based on user priority and fuzzy logic system","volume":"5","author":"Daeinabi","year":"2013","journal-title":"Int. J. Wirel. Mob. Netw."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Yassin, M., Lahoud, S., Ibrahim, M., Khawam, K., Mezher, D., and Cousin, B. (2015, January 11\u201314). Non-Cooperative Inter-Cell Interference Coordination Technique for Increasing Throughput Fairness in LTE Networks. Proceedings of the 2015 IEEE 81st Vehicular Technology Conference (VTC Spring), Glasgow, Scotland.","DOI":"10.1109\/VTCSpring.2015.7145955"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1007\/s11235-013-9803-1","article-title":"Combined power and inter-cell interference control for LTE based on role game approach","volume":"55","author":"Poulkov","year":"2014","journal-title":"Telecommun. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Essassi, S., Cherif, S., and Siala, M. (2013, January 8\u201311). RB allocation based on genetic algorithm and coordination over the X 2 interface in the LTE uplink. Proceedings of the IEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC, London, UK.","DOI":"10.1109\/PIMRC.2013.6666552"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Shahid, A., Aslam, S., Kim, H.S., and Lee, K.G. (2014, January 8\u201311). Genetic algorithm based self-organized resource allocation in LTE-Advanced network. Proceedings of the 2014 Sixth International Conference on Ubiquitous and Future Networks (ICUFN), Shanghai, China.","DOI":"10.1109\/ICUFN.2014.6876766"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Sivanandam, S., and Deepa, S. (2008). Genetic algorithm optimization problems. Introduction to Genetic Algorithms, Springer.","DOI":"10.1007\/978-3-540-73190-0_7"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Dorigo, M., and Birattari, M. (2011). Ant colony optimization. Encyclopedia of Machine Learning, Springer.","DOI":"10.1002\/9780470400531.eorms0030"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Blum, C., and Li, X. (2008). Swarm intelligence in optimization. Swarm Intelligence, Springer.","DOI":"10.1007\/978-3-540-74089-6"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Van Laarhoven, P.J., and Aarts, E.H. (1987). Simulated annealing. Simulated Annealing: Theory and Applications, Springer.","DOI":"10.1007\/978-94-015-7744-1"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/BF00116251","article-title":"Induction of decision trees","volume":"1","author":"Quinlan","year":"1986","journal-title":"Mach. Learn."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Sesia, S., Baker, M., and Toufik, I. (2011). LTE-the UMTS Long Term Evolution: From Theory to Practice, John Wiley & Sons.","DOI":"10.1002\/9780470978504"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Poikselk\u00e4, M., Holma, H., Hongisto, J., Kallio, J., and Toskala, A. (2012). Voice over LTE: VoLTE, John Wiley & Sons.","DOI":"10.1002\/9781119944935"},{"key":"ref_39","unstructured":"3GPP (2019, January 15). TS 23.203 Policy and Charging Control Architecture 2012. Available online: http:\/\/www.qtc.jp\/3GPP\/Specs\/23203-a70.pdf."},{"key":"ref_40","unstructured":"Randy, L.H., and Sue, E.H. (2004). Practical Genetic Algorithms, John Wiley and Sons."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1613\/jair.613","article-title":"Evolutionary algorithms for reinforcement learning","volume":"11","author":"Moriarty","year":"1999","journal-title":"J. Artif. Intell. Res."},{"key":"ref_42","unstructured":"Glickman, M.G., and Sycara, K. (July, January 28). Evolutionary search, stochastic policies with memory, and reinforcement learning with hidden state. Proceedings of the Eighteenth International Conference on Machine Learning, Williamstown, MA, USA."},{"key":"ref_43","first-page":"51","article-title":"Reinforcement learning","volume":"12","author":"Wiering","year":"2012","journal-title":"Adapt. Learn. Optim."},{"key":"ref_44","unstructured":"Castillo, C., Lurgi, M., and Martinez, I. (2003, January 5\u20138). Chimps: An evolutionary reinforcement learning approach for soccer agents. Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Washington, DC, USA."},{"key":"ref_45","first-page":"171","article-title":"Evolutionary reinforcement learning of artificial neural networks","volume":"4","author":"Siebel","year":"2007","journal-title":"Int. J. Hybrid Intell. Syst."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"6995","DOI":"10.1016\/j.eswa.2008.08.026","article-title":"Study of genetic algorithm with reinforcement learning to solve the TSP","volume":"36","author":"Liu","year":"2009","journal-title":"Expert Syst. Appl."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"879","DOI":"10.1109\/70.736772","article-title":"Genetic reinforcement learning approach to the heterogeneous machine scheduling problem","volume":"14","author":"Kim","year":"1998","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_48","unstructured":"Metzen, J.H., Edgington, M., Kassahun, Y., and Kirchner, F. (2008, January 12\u201316). Analysis of an evolutionary reinforcement learning method in a multiagent domain. Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems, Estoril, Portugal."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Chen, G., and Zelinka, I. (2018). Evolutionary Algorithms, Swarm Dynamics and Complex Networks, Springer.","DOI":"10.1007\/978-3-662-55663-4"},{"key":"ref_50","first-page":"322","article-title":"Reinforcement learning","volume":"3","author":"Sutton","year":"2012","journal-title":"Learning"},{"key":"ref_51","unstructured":"Goldberg, D.E. (1989). Genetic algorithms in search, optimization, and machine learning, Addison-Wesley Professional."},{"key":"ref_52","unstructured":"Haupt, R.L., Haupt, S.E., and Haupt, S.E. (1998). Practical Genetic Algorithms, Wiley."},{"key":"ref_53","unstructured":"Com\u015fa, I.S., Aydin, M., Zhang, S., Kuonen, P., and Wagen, J.F. (2011, January 14\u201318). Reinforcement learning based radio resource scheduling in LTE-advanced. Proceedings of the 2011 17th IEEE International Conference on Automation and Computing (ICAC), Karlsruhe, Germany."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"678","DOI":"10.1109\/SURV.2012.060912.00100","article-title":"Downlink packet scheduling in LTE cellular networks: Key design issues and a survey","volume":"15","author":"Capozzi","year":"2013","journal-title":"IEEE Commun. Surv. Tutor."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/11\/1\/19\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:26:43Z","timestamp":1760185603000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/11\/1\/19"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,17]]},"references-count":54,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,1]]}},"alternative-id":["fi11010019"],"URL":"https:\/\/doi.org\/10.3390\/fi11010019","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2019,1,17]]}}}