{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T02:36:21Z","timestamp":1773801381037,"version":"3.50.1"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2014,4,12]],"date-time":"2014-04-12T00:00:00Z","timestamp":1397260800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/2.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Wireless Com Network"],"published-print":{"date-parts":[[2014,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Self-organization is a key concept in long-term evolution (LTE) systems to reduce capital and operational expenditures (CAPEX and OPEX). Self-optimization of coverage and capacity, which allows the system to periodically and automatically adjust the key radio frequency (RF) parameters through intelligent algorithms, is one of the most important tasks in the context of self-organizing networks (SON). In this paper, we propose self-optimization of antenna tilt and power using a fuzzy neural network optimization based on reinforcement learning (RL-FNN). In our approach, a central control mechanism enables cooperation-based learning by allowing distributed SON entities to share their optimization experience, represented as the parameters of learning method. Specifically, SON entities use cooperative Q-learning and reinforced back-propagation method to acquire and adjust their optimization experience. To evaluate the coverage and capacity performance of RL-FNN, we analyze cell-edge performance and cell-center performance indicators jointly across neighboring cells and specifically consider the difference in load distribution in a given region. The simulation results show that RL-FNN performs significantly better than the best fixed configuration proposed in the literature. Furthermore, this is achieved with significantly lower energy consumption. Finally, since each self-optimization round completes in less than a minute, RL-FNN can meet the need of practical applications of self-optimization in a dynamic environment.<\/jats:p>","DOI":"10.1186\/1687-1499-2014-57","type":"journal-article","created":{"date-parts":[[2014,4,12]],"date-time":"2014-04-12T01:02:00Z","timestamp":1397264520000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":38,"title":["Self-optimization of coverage and capacity based on a fuzzy neural network with cooperative reinforcement learning"],"prefix":"10.1186","volume":"2014","author":[{"given":"Shaoshuai","family":"Fan","sequence":"first","affiliation":[]},{"given":"Hui","family":"Tian","sequence":"additional","affiliation":[]},{"given":"Cigdem","family":"Sengul","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2014,4,12]]},"reference":[{"issue":"6","key":"892_CR1","doi-asserted-by":"publisher","first-page":"1251","DOI":"10.1007\/s11276-012-0531-3","volume":"19","author":"ON ON Yilmaz","year":"2013","unstructured":"ON Yilmaz ON, J H\u00e4m\u00e4l\u00e4inen: Optimization of adaptive antenna system parameters in self-organizing LTE networks. Wireless Netw 2013, 19(6):1251-1267. 10.1007\/s11276-012-0531-3","journal-title":"Wireless Netw"},{"key":"892_CR2","unstructured":"4G Americas, White Paper: Self-optimizing networks: the benefits of SON in LTE 2013.http:\/\/www.4gamericas.org . Accessed on 7 October"},{"key":"892_CR3","unstructured":"SOCRATES: Self-optimisation and self-configuration in wireless networks . Accessed on 6\u20138 February 2008 http:\/\/www.fp7-socrates.eu.org . Accessed on 6\u20138 February 2008"},{"key":"892_CR4","unstructured":"3GPP TS 32.500 Vb.1.0, Self-organizing networks (SON); Concepts and requirements . Accessed on 22 December 2011 http:\/\/www.3gpp.org"},{"key":"892_CR5","unstructured":"3GPP TR 36.902 V9.3.1, E-UTRA; Self-configuring and self-optimizing network (SON) use cases and solutions . Accessed on 7 April 2011 http:\/\/www.3gpp.org"},{"key":"892_CR6","unstructured":"3GPP TS 32.541 Vb.0.0: SON; Self-healing concepts and requirements . Accessed on 7 April 2011 http:\/\/www.3gpp.org"},{"issue":"4","key":"892_CR7","doi-asserted-by":"publisher","first-page":"1145","DOI":"10.1109\/TNET.2012.2218124","volume":"21","author":"D Lopez-Perez","year":"2013","unstructured":"Lopez-Perez D, Chu X, Vasilakos AV, Claussen H: On distributed and coordinated resource allocation for interference mitigation in self-organizing LTE networks. IEEE\/ACM Trans. Netw 2013, 21(4):1145-1158.","journal-title":"IEEE\/ACM Trans. Netw"},{"issue":"6","key":"892_CR8","doi-asserted-by":"publisher","first-page":"1093","DOI":"10.1109\/TSMCC.2012.2196996","volume":"42","author":"S Sengupta","year":"2012","unstructured":"Sengupta S, Das S, Nasir M, Vasilakos AV, Pedrycz W: An evolutionary multiobjective sleep-scheduling scheme for differentiated coverage in wireless sensor networks. Syst. Man Cybernet. Part C: Appl. Rev. IEEE Trans 2012, 42(6):1093-1102.","journal-title":"Syst. Man Cybernet. Part C: Appl. Rev. IEEE Trans"},{"key":"892_CR9","volume-title":"Self-optimization of coverage and capacity in LTE networks based on central control and decentralized fuzzy Q-learning. Int. J. Distributed Sensor Netw","author":"J Li","year":"2012","unstructured":"J Li: Self-optimization of coverage and capacity in LTE networks based on central control and decentralized fuzzy Q-learning. Int. J. Distributed Sensor Netw. 2012., 2012:"},{"key":"892_CR10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/VETECS.2011.5956370","volume-title":"Vehicular Technology Conference (VTC Spring) 2011 IEEE 73rd","author":"H Eckhardt","year":"2011","unstructured":"Eckhardt H, Klein S, Gruber M: Vertical antenna tilt optimization for LTE base stations. In Vehicular Technology Conference (VTC Spring) 2011 IEEE 73rd. Yokohama; May 2011:1-5."},{"issue":"6","key":"892_CR11","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1109\/MWC.2006.275194","volume":"13","author":"I Siomina","year":"2006","unstructured":"Siomina I, Varbrand P, Yuan D: Automated optimization of service coverage and base station antenna configuration in UMTS networks. Wireless Commun. IEEE 2006, 13(6):16-25.","journal-title":"Wireless Commun. IEEE"},{"key":"892_CR12","first-page":"1","volume-title":"Vehicular Technology Conference (VTC 2010-Spring), 2010 IEEE 71st, Taipei","author":"T Cai","year":"2010","unstructured":"Cai T, Koudouridis GP, Qvarfordt C, Johansson J, Legg P: Coverage and capacity optimization in E-UTRAN based on central coordination and distributed Gibbs sampling. In Vehicular Technology Conference (VTC 2010-Spring), 2010 IEEE 71st, Taipei. 16\u201319; May 2010:1-5."},{"issue":"8","key":"892_CR13","doi-asserted-by":"publisher","first-page":"3825","DOI":"10.1109\/TVT.2011.2163326","volume":"60","author":"A Awada","year":"2011","unstructured":"Awada A, Wegmann B, Viering I, Klein A: Optimizing the radio network parameters of the long term evolution system using Taguchi\u2019s method. Vehicular Technol. IEEE Trans 2011, 60(8):3825-3839.","journal-title":"Vehicular Technol. IEEE Trans"},{"issue":"2","key":"892_CR14","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1007\/s11276-012-0457-9","volume":"19","author":"Y Zeng","year":"2013","unstructured":"Zeng Y, Xiang K, Li D, Vasilakos AV: Directional routing and scheduling for green vehicular delay tolerant networks. Wireless Netw 2013, 19(2):161-173. 10.1007\/s11276-012-0457-9","journal-title":"Wireless Netw"},{"issue":"3","key":"892_CR15","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1016\/0925-2312(94)00027-P","volume":"7","author":"AV Vasilakos","year":"1995","unstructured":"Vasilakos AV, Papadimitriou GI: A new approach to the design of reinforcement schemes for learning automata: stochastic estimator learning algorithm. Neurocomputing 1995, 7(3):275-297. 10.1016\/0925-2312(94)00027-P","journal-title":"Neurocomputing"},{"issue":"1","key":"892_CR16","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1016\/0165-0114(95)00296-0","volume":"83","author":"KC Zikidis","year":"1996","unstructured":"Zikidis KC, Vasilakos AV: ASAFES2: A novel, neuro-fuzzy architecture for fuzzy computing, based on functional reasoning. Fuzzy Sets Syst 1996, 83(1):63-84. 10.1016\/0165-0114(95)00296-0","journal-title":"Fuzzy Sets Syst"},{"issue":"1","key":"892_CR17","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1109\/JSAC.2012.120118","volume":"30","author":"MA Khan","year":"2012","unstructured":"Khan MA, Tembine H, Vasilakos AV: Game dynamics and cost of learning in heterogeneous 4G networks. Select. Areas Commun. IEEE J 2012, 30(1):198-213.","journal-title":"Select. Areas Commun. IEEE J"},{"key":"892_CR18","first-page":"1128","volume-title":"Personal Indoor and Mobile Radio Communications (PIMRC) 2010 IEEE 21st International Symposium On","author":"ON Yilmaz","year":"2010","unstructured":"Yilmaz ON, Hamalainen J, Hamalainen S: Self-optimization of remote electrical tilt. In Personal Indoor and Mobile Radio Communications (PIMRC) 2010 IEEE 21st International Symposium On. Instanbul; September 2010:1128-1132."},{"key":"892_CR19","first-page":"1865","volume-title":"Personal Indoor and Mobile Radio Communications (PIMRC) 2010 IEEE 21st International Symposium On","author":"R Razavi","year":"2010","unstructured":"Razavi R, Klein S, Claussen H: Self-optimization of capacity and coverage in LTE networks using a fuzzy reinforcement learning approach. In Personal Indoor and Mobile Radio Communications (PIMRC) 2010 IEEE 21st International Symposium On. Instanbul; 26\u201330 September 2010:1865-1870."},{"issue":"3","key":"892_CR20","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1002\/bltj.20463","volume":"15","author":"R Razavi","year":"2010","unstructured":"Razavi R, Klein S, Claussen H: A fuzzy reinforcement learning approach for self-optimization of coverage in LTE networks. Bell Labs Tech. J 2010, 15(3):153-175. 10.1002\/bltj.20463","journal-title":"Bell Labs Tech. J"},{"key":"892_CR21","first-page":"2818","volume-title":"Wireless Communications and Networking Conference (WCNC) 2012 IEEE","author":"M Naseer ul","year":"2012","unstructured":"Naseer ul M, Mitschele-Thiel A: Reinforcement learning strategies for self-organized coverage and capacity optimization. In Wireless Communications and Networking Conference (WCNC) 2012 IEEE. Shanghai; 1\u20134 April 2012:2818-2823."},{"key":"892_CR22","first-page":"1406","volume-title":"Personal Indoor and Mobile Radio Communications (PIMRC) 2012 IEEE 23rd International Symposium On","author":"M Naseer ul","year":"2012","unstructured":"Naseer ul M, Mitschele-Thiel A: Cooperative fuzzy Q-learning for self-organized coverage and capacity optimization. In Personal Indoor and Mobile Radio Communications (PIMRC) 2012 IEEE 23rd International Symposium On. Sydney, NSW; 9\u201312 September 2012:1406-1411."},{"key":"892_CR23","unstructured":"3GPP TR 36.814 V9.0.0, Evolved universal terrestrial radio access (E-UTRA); Further advancements for E-UTRA physical layer aspects . Accessed on 30 March 2010 http:\/\/www.3gpp.org"},{"issue":"17","key":"892_CR24","doi-asserted-by":"publisher","first-page":"12759","DOI":"10.1016\/j.eswa.2012.02.056","volume":"39","author":"SW Tung","year":"2012","unstructured":"Tung SW, Quek C, Guan C: Sohyfis-yager: A self-organizing Yager based hybrid neural fuzzy inference system. Expert Syst. Appl 2012, 39(17):12759-12771. 10.1016\/j.eswa.2012.02.056","journal-title":"Expert Syst. Appl"},{"issue":"9","key":"892_CR25","first-page":"151","volume":"31","author":"WX Shi","year":"2010","unstructured":"Shi WX, Fan SS, Wang N, Xia CJ: Fuzzy neural network based access selection algorithm in heterogeneous wireless networks. J. China Inst. Commun 2010, 31(9):151-156.","journal-title":"J. China Inst. Commun"},{"key":"892_CR26","volume-title":"Reinforcement Learning: An Introduction","author":"RS Sutton","year":"1998","unstructured":"Sutton RS, Barto AG: Reinforcement Learning: An Introduction. MIT Press Cambridge; 1998."},{"issue":"2","key":"892_CR27","first-page":"170","volume":"39","author":"L Giupponi","year":"2009","unstructured":"Giupponi L, P\u00e9rez-Romero J, Sallent O, Agust\u00ed R: Fuzzy neural control for economic-driven radio resource management in beyond 3G networks. Syst. Man, Cybernet. Part C: Appl. Rev. IEEETrans 2009, 39(2):170-189.","journal-title":"Part C: Appl. Rev. IEEETrans"},{"key":"892_CR28","unstructured":"3GPP TR 25.814 V7.1.0, Physical layer aspect for evolved universal terrestrial radio access (UTRA) . Accessed on 13 Octorber 2006 http:\/\/www.3gpp.org"}],"container-title":["EURASIP Journal on Wireless Communications and Networking"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/1687-1499-2014-57.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/1687-1499-2014-57\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1687-1499-2014-57.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,2]],"date-time":"2021-09-02T03:26:05Z","timestamp":1630553165000},"score":1,"resource":{"primary":{"URL":"https:\/\/jwcn-eurasipjournals.springeropen.com\/articles\/10.1186\/1687-1499-2014-57"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,4,12]]},"references-count":28,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2014,12]]}},"alternative-id":["892"],"URL":"https:\/\/doi.org\/10.1186\/1687-1499-2014-57","relation":{},"ISSN":["1687-1499"],"issn-type":[{"value":"1687-1499","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,4,12]]},"assertion":[{"value":"5 September 2013","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 April 2014","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 April 2014","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"57"}}