{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T14:15:28Z","timestamp":1761401728492,"version":"3.41.0"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2015,3,20]],"date-time":"2015-03-20T00:00:00Z","timestamp":1426809600000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Wireless Com Network"],"published-print":{"date-parts":[[2015,12]]},"DOI":"10.1186\/s13638-015-0312-7","type":"journal-article","created":{"date-parts":[[2015,3,19]],"date-time":"2015-03-19T17:55:11Z","timestamp":1426787711000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Self-coordination of parameter conflicts in D-SON architectures: a Markov decision process framework"],"prefix":"10.1186","volume":"2015","author":[{"given":"Jessica","family":"Moysen","sequence":"first","affiliation":[]},{"given":"Lorenza","family":"Giupponi","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2015,3,20]]},"reference":[{"key":"312_CR1","unstructured":"M Amirijoo, L Jorguseski, T Kurner, R Litjens, M Neuland, L Schmelz, U Turke, in 6th International Symposium on Wireless Communication Systems ISWCS. Cell outage management in LTE networks (Tuscany, 7-10 Sept. 2009), pp. 600\u2013604."},{"key":"312_CR2","unstructured":"M Amirijoo, L Jorguseski, R Litjens, R Nascimento, in IEEE Consumer Communications and Networking Conference (CCNC). Effectiveness of cell outage compensation in LTE networks (Las Vegas, NV, 9-12 Jan. 2011), pp. 642\u2013647."},{"key":"312_CR3","unstructured":"SOCRATES-Self-Optimisation and self-ConfiguRATion in wirelEss networkS. http:\/\/www.fp7-socrates.eu\/index.html@q=node%252F35.html ."},{"key":"312_CR4","doi-asserted-by":"crossref","unstructured":"LC Schmelz, M Amirijoo, A Eisenblaetter, R Litjens, M Neuland, J Turk, in IFIP\/IEEE International Symposium on Integrated Network Management (IM). A coordination framework for self-organisation in LTE networks (Dublin, 23-27 May 2011), pp. 193\u2013200.","DOI":"10.1109\/INM.2011.5990691"},{"key":"312_CR5","unstructured":"MMS Marwangi, N Fisal, SKS Yusof, RA Rashid, ASA Ghafar, FA Saparudin, N Katiran. Challenges and practical implementation of self-organizing networks in LTE\/LTE-Advanced systems (Kuala Lumpur, 14-16 Nov. 2011), pp. 1\u20135."},{"key":"312_CR6","doi-asserted-by":"crossref","unstructured":"T Jansen, M Amirijoo, U Turke, L Jorguseski, K Zetterberg, R Nascimiento, LC Schelz, J Turk, I Balan, in IEEE 69th Vehicular Technology Conference (VTC, Spring). Embedding multiple self-organisation functionalities in future radio access networks (Barcelona, 26-29 April 2009), pp. 1\u20135.","DOI":"10.1109\/VETECS.2009.5073530"},{"key":"312_CR7","unstructured":"HY Lateef, A Imran, A Abu-dayya, in IEEE 24th International Symposium on Personal Indoor and Mobile Radio Communications (PIMRC). A framework for classification of self-organising network conflicts and coordination algorithms (London, United Kingdom, 8-11 Sept. 2013), pp. 2898\u20132903."},{"key":"312_CR8","doi-asserted-by":"crossref","unstructured":"O Iacoboaeia, B Sayrac, S Ben, in IEEE Wireless Communications and Networking Conference Workshops (WCNCW). Jemaa, Bianchi, P, SON coordination for parameter conflict resolution: a reinforcement learning framework (Istanbul, 6-9 April 2014), pp. 196\u2013201.","DOI":"10.1109\/WCNCW.2014.6934885"},{"key":"312_CR9","unstructured":"R Combes, Z Altman, E Altman, in 11th International Symposium on Modeling & Optimization in Mobile, Ad Hoc & Wireless Networks (WiOpt). Coordination of autonomic functionalities in communications networks (Tsukuba Science City, 13-17 May 2013), pp. 364\u2013371."},{"key":"312_CR10","doi-asserted-by":"crossref","unstructured":"T Bandh, H Sanneck, R Romeikat, in IEEE 73rd Vehicular Technology Conference (VTC Spring). An experimental system for SON function coordination (Yokohama, 15-18 May 2011), pp. 1\u20132.","DOI":"10.1109\/VETECS.2011.5956708"},{"key":"312_CR11","unstructured":"CA Coello, GB Lamont, DA Van Veldhuizen, Evolutionary Algorithms for Solving Multi-Objective Problems, 2nd ed (Springer, Genetic and Evolutionary Computation Series, New York, NY, 2007)."},{"key":"312_CR12","doi-asserted-by":"crossref","unstructured":"H Claussen, LTW Ho, LG Samuel, in Wireless Telecommunications Symposium (WTS). Self-optimization of coverage for femtocell deployments (Pomona, CA, 24-26 April 2008), pp. 278\u2013285.","DOI":"10.1109\/WTS.2008.4547576"},{"key":"312_CR13","doi-asserted-by":"crossref","unstructured":"E Corona-Xelhuantzi, LE Sucar, EF Morales, in IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL). Executing concurrent actions with multiple Markov decision processes (Nashville, TN, April 2 2009 March 30 2009), pp. 82\u201389.","DOI":"10.1109\/ADPRL.2009.4927529"},{"key":"312_CR14","doi-asserted-by":"crossref","unstructured":"A Rocha-Rocha, EM de Cote, SP Hernandez, ES Succar, Conflict resolution in multiagent systems: balancing optimality and learning speed. Artificial Intelligence (MICAI), 2012 11th Mexican International Conference on, 32\u201337.","DOI":"10.1109\/MICAI.2012.16"},{"key":"312_CR15","doi-asserted-by":"crossref","unstructured":"S H\u00e4m\u00e4l\u00e4inen, H Sanneck, C Sartori, LTE Self-Organising Networks (SON): Network Management Automation for Operational Efficiency (John Wiley & Sons Ltd, The Atrium, Southern Gate, Chichester, West Sussex, PO19 8SQ, United Kingdom, 2012).","DOI":"10.1002\/9781119961789"},{"issue":"4","key":"312_CR16","doi-asserted-by":"publisher","first-page":"551","DOI":"10.3390\/g1040551","volume":"1","author":"S Weidenholzer","year":"2010","unstructured":"S Weidenholzer, Coordination Games and Local Interactions: A Survey, of the Game Theoretic Literature. In Games. 1(4), 551\u2013585 (2010).","journal-title":"In Games"},{"key":"312_CR17","unstructured":"3GPP TSG SA WG5 (Telecom Management), Meeting 85, Study of implementation alternative for SON coordination. Tech. Rep. S5-122330."},{"key":"312_CR18","doi-asserted-by":"crossref","unstructured":"J Chen, H Zhuang, B Andrian, Y Li, in IEEE 75th Vehicular Technology Conference (VTC Spring). Difference-based joint parameter configuration for MRO and MLB (Yokohama, 6-9 May 2012), pp. 1\u20135.","DOI":"10.1109\/VETECS.2012.6240111"},{"key":"312_CR19","doi-asserted-by":"crossref","unstructured":"A Tall, R Combes, Z Altman, E Altman, Distributed coordination of self-organizing mechanisms in communication networks. Orange labs (2013).","DOI":"10.1109\/TCNS.2014.2357511"},{"key":"312_CR20","doi-asserted-by":"crossref","unstructured":"R Romeikat, B Bauer, T Bandh, G Carle, H Sanneck, L-C Schmelz, in Next Generation Mobile Networks (NGMN 2010). Policy-driven workflows for mobile network management automation (Caen, France, June 2010), pp. 1111\u20131115.","DOI":"10.1145\/1815396.1815650"},{"key":"312_CR21","unstructured":"3GPP TS 36.213, Technical Specification Group Radio Access Network; Evolved Universal Terrestrial Radio Access (E-UTRA); Physical layer procedures, Release 12, Sep. 2014. Tech. Rep."},{"key":"312_CR22","unstructured":"RS Sutton, AG Barto, Reinforcement Learning: An Introduction (The Press, MIT, Cambridge, Massachusetts London, England, 1998). [Online]. Available: http:\/\/webdocs.cs.ualberta.ca\/~sutton\/book\/ebook\/the-book.html ."},{"key":"312_CR23","unstructured":"R Bellman, Dynamic Programming (Princeton University Press, 1957)."},{"key":"312_CR24","unstructured":"C Boutilier, R Dearden, M Goldzmidt, in Inter Joint Conference on Artificial Intelligence (IJCAI). Exploting structure in policy construction (Montreal, August, 1995), pp. 1104\u20131113."},{"key":"312_CR25","unstructured":"NK Jong, P Stone, in Joint Conference on Artificial Intelligence. State abstraction discovery from irrelevant state variables (Edinburgh, Scotland, UK, 2005), pp. 752\u2013757."},{"key":"312_CR26","doi-asserted-by":"crossref","unstructured":"P Laroche, Y Boniface, R Schott, in SAC \u201901 Proceedings of the 2001 ACM symposium on Applied computing. A new decomposition technique for solving Markov decision process. (New York, NY, USA), pp. 12\u201316.","DOI":"10.1145\/372202.372205"},{"key":"312_CR27","unstructured":"T Dean, R Givan, in AAAI of the Fourteenth National Conference on Artificial Intelligence. Model minimization in Markov decision process (Rhode Island, 1997, pp. 106\u2013111."},{"key":"312_CR28","doi-asserted-by":"crossref","unstructured":"C Watkins, P Dayan, in Machine Learning, vol. 8. Q-LearningMachine Learning, Kluwer Academic PublishersBoston, 1992), pp. 279\u2013292.","DOI":"10.1023\/A:1022676722315"},{"key":"312_CR29","unstructured":"RH Crites, AG Barto, An actor\/critic algorithm that is equivalent to Q-Learning Advances in Neural Information Processing Systems 7 (Press, MIT, Cambridge MA, 1995)."},{"key":"312_CR30","doi-asserted-by":"crossref","unstructured":"LP Kaelbling, ML Littman, AW Moore, Reinforcement learning a survey. J Artif. Intelligence Res. (1996).","DOI":"10.1613\/jair.301"},{"key":"312_CR31","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1007\/s10458-005-2631-2","volume":"11","author":"L Panait","year":"2005","unstructured":"L Panait, S Luke, Cooperative multi-agent learning: the state of the art, autonomous agents and multi-agent systems. Autonomous Agents Multi-Agent Syst. Arch. 11, 387\u2013434 (2005).","journal-title":"Autonomous Agents Multi-Agent Syst. Arch"},{"key":"312_CR32","doi-asserted-by":"crossref","unstructured":"Y Shoham, K Leyton-Brown, Multiagent Systems: Algorithmic, Game-Theoretic, and Logical Foundations (Cambridge University Press 32 Avenue of the Americas, New York NY 10013-2473, USA, 2008).","DOI":"10.1017\/CBO9780511811654"},{"key":"312_CR33","unstructured":"3GPP TS 36.423, Evolved Universal Terrestrial Radio Access Network (E-UTRAN); X2 Application Protocol (X2AP) (Realease 11, Sep 2013). Tech. Rep."},{"key":"312_CR34","doi-asserted-by":"crossref","unstructured":"MN ul Islam, A Mitschele-Thiel, Reinforcement learning strategies for self-organized coverage and capacity optimization (Wireless Commun. Networking Conference (WCNC), Shangai, 2012).","DOI":"10.1109\/WCNC.2012.6214281"},{"key":"312_CR35","doi-asserted-by":"crossref","unstructured":"A Galindo, L Giupponi, in IEEE 71st Vehicular Technology Conference (VTC Spring). Distributed Q-learning for interference control in OFDMA-based femtocell networks (Taipei, 16-19, May 2010), pp. 1\u20135.","DOI":"10.1109\/VETECS.2010.5493950"},{"key":"312_CR36","unstructured":"J Moysen, L Giupponi, in IEEE 80th Vehicular Technology Conference (VTC Fall). A reinforcement learning based solution for self-healing in LTE networks (VancouverCanada, 14-17 Sept. 2014), pp. 1\u20136."},{"key":"312_CR37","doi-asserted-by":"crossref","unstructured":"M Miozo, L Giupponi, M Rossi, P Dini, in IEEE ICC 2015 Workshop on Green Communications and Networks with Energy Harvesting, Smart Grids, and Renewable Energies. Distributed Q-Learning for Energy Harvesting Heterogeneous Networks (London (UK), 8-12 June 2015).","DOI":"10.1109\/ICCW.2015.7247475"},{"key":"312_CR38","doi-asserted-by":"crossref","unstructured":"LM Bello, PD Mitchell, D Grace, Frame based back-off for Q-learning RACH access in LTE networks (VIC, Australasian, Southbank, 2014).","DOI":"10.1109\/ATNAC.2014.7020894"},{"key":"312_CR39","unstructured":"3GPP TR 32.521, Technical Specification Group Services and System Aspects; Telecommunication Management; Self-Organizing Networks (SON) Policy Network Resource Model (NRM) Integration Reference Point (IRP); Requirements, (Release 10 Dec 2010). Tech. Rep."},{"key":"312_CR40","unstructured":"Centre Tecnol\u00f2gic de Telecomunicacions de Catalunya (CTTC), The LENA ns-3 Module, LTE, Documentation Release v8. [Online]. Available: http:\/\/lena.cttc.es\/manual\/ ."},{"key":"312_CR41","unstructured":"3GPP TS 36.331, Evolved Universal Terrestrial Radio Access (E-UTRA); Radio Resource Control (RRC); Protocol specification, (Release 12 Sep. 2014). Tech. Rep."}],"container-title":["EURASIP Journal on Wireless Communications and Networking"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s13638-015-0312-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13638-015-0312-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13638-015-0312-7","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s13638-015-0312-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,21]],"date-time":"2025-05-21T04:22:47Z","timestamp":1747801367000},"score":1,"resource":{"primary":{"URL":"https:\/\/jwcn-eurasipjournals.springeropen.com\/articles\/10.1186\/s13638-015-0312-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,3,20]]},"references-count":41,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2015,12]]}},"alternative-id":["312"],"URL":"https:\/\/doi.org\/10.1186\/s13638-015-0312-7","relation":{},"ISSN":["1687-1499"],"issn-type":[{"type":"electronic","value":"1687-1499"}],"subject":[],"published":{"date-parts":[[2015,3,20]]},"assertion":[{"value":"1 August 2014","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 March 2015","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 March 2015","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"82"}}