{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,25]],"date-time":"2025-12-25T07:25:04Z","timestamp":1766647504949},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2013,1,31]],"date-time":"2013-01-31T00:00:00Z","timestamp":1359590400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Wireless Pers Commun"],"published-print":{"date-parts":[[2013,9]]},"DOI":"10.1007\/s11277-013-1028-9","type":"journal-article","created":{"date-parts":[[2013,1,30]],"date-time":"2013-01-30T18:19:37Z","timestamp":1359569977000},"page":"535-547","source":"Crossref","is-referenced-by-count":5,"title":["Reinforcement Learning for Multiple Access Control in Wireless Sensor Networks: Review, Model, and Open Issues"],"prefix":"10.1007","volume":"72","author":[{"given":"Mohammad","family":"Fathi","sequence":"first","affiliation":[]},{"given":"Vafa","family":"Maihami","sequence":"additional","affiliation":[]},{"given":"Parham","family":"Moradi","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2013,1,31]]},"reference":[{"issue":"18","key":"1028_CR1","doi-asserted-by":"crossref","first-page":"3076","DOI":"10.1016\/j.comnet.2009.07.015","volume":"53","author":"M Boushaba","year":"2009","unstructured":"Boushaba, M., Hafid, A., & Benslimane, A. (2009). High accuracy localization method using AoA in sensor networks. Computer Networks, 53(18), 3076\u20133088.","journal-title":"Computer Networks"},{"issue":"4","key":"1028_CR2","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1016\/S1389-1286(01)00302-4","volume":"38","author":"IF Akyildiz","year":"2002","unstructured":"Akyildiz, I. F., Su, W., Sankarasubramaniam, Y., & Cayirci, E. (2002). Wireless sensor networks: A survey. Computer Networks, 38(4), 393\u2013422.","journal-title":"Computer Networks"},{"key":"1028_CR3","doi-asserted-by":"crossref","DOI":"10.1002\/9780470515181","volume-title":"Wireless sensor networks","author":"IF Akyildiz","year":"2010","unstructured":"Akyildiz, I. F., & Vuran, M. (2010). Wireless sensor networks. London: Wiley."},{"issue":"4","key":"1028_CR4","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1109\/MSP.2006.1657817","volume":"23","author":"JB Predd","year":"2006","unstructured":"Predd, J. B., Kulkarni, S. R., & Poor, H. V. (2006). Distributed learning in wireless sensor networks. IEEE Signal Processing Magazine, 23(4), 56\u201369.","journal-title":"IEEE Signal Processing Magazine"},{"issue":"11","key":"1028_CR5","doi-asserted-by":"crossref","first-page":"4053","DOI":"10.1109\/TSP.2005.857020","volume":"53","author":"X Nguyen","year":"2005","unstructured":"Nguyen, X., Wainwright, M. J., & Jordan, M. I. (2005). Nonparametric decentralized detection using kernel methods. IEEE Transactions on Signal Processing, 53(11), 4053\u20134066.","journal-title":"IEEE Transactions on Signal Processing"},{"key":"1028_CR6","doi-asserted-by":"crossref","unstructured":"Akkarajitsakul, K., Hossain, E., Niyato, D., & Kim, D. (2011). Game theoretic approaches for multiple access in wireless networks: A survey. IEEE Communications Surveys and Tutorials, 13(3), 372\u2013395.","DOI":"10.1109\/SURV.2011.122310.000119"},{"issue":"3","key":"1028_CR7","doi-asserted-by":"crossref","first-page":"493","DOI":"10.1109\/TNET.2004.828953","volume":"12","author":"W Ye","year":"2004","unstructured":"Ye, W., Heidemann, J., & Estrin, D. (2004). Medium access control with coordinated adaptive sleeping for wireless sensor networks. IEEE\/ACM Transactions on Networking, 12(3), 493\u2013506.","journal-title":"IEEE\/ACM Transactions on Networking"},{"key":"1028_CR8","unstructured":"Dam, T. V., & Langendoen, K. (2003, November). An adaptive energy-efficient MAC protocol for wireless sensor networks. 1st ACM Conference on Embedded Networked Sensor Systems. CA: LosAngeles."},{"issue":"4","key":"1028_CR9","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1109\/MCOM.2006.1632658","volume":"44","author":"I Demirkol","year":"2006","unstructured":"Demirkol, I., Ersoy, C., & Alag\u00f6z, F. (2006). MAC protocols for wireless sensor networks: A survey. IEEE Communications Magazine, 44(4), 115\u2013121.","journal-title":"IEEE Communications Magazine"},{"issue":"99","key":"1028_CR10","first-page":"1","volume":"PP","author":"P Huang","year":"2012","unstructured":"Huang, P., Xiao, L., Soltani, S., Mutka, M., & Xi, N. (2012). The evolution of MAC protocols in wireless sensor networks: A survey. IEEE Communications Surveys Tutorials, PP(99), 1\u201320.","journal-title":"IEEE Communications Surveys Tutorials"},{"key":"1028_CR11","doi-asserted-by":"crossref","unstructured":"Niu, J., & Deng, Z. (2011, in press). Distributed self-learning scheduling approach for wireless sensor network. Ad Hoc Networks.","DOI":"10.1109\/ICICTA.2010.739"},{"key":"1028_CR12","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1613\/jair.301","volume":"4","author":"LP Kaelbling","year":"1996","unstructured":"Kaelbling, L. P., & Littman, M. L. (1996). Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4, 237\u2013285.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"1028_CR13","doi-asserted-by":"crossref","unstructured":"Kulkarni, R. V., Forster, A., & Venayagamoorthy, G. K. (2011). Computational intelligence in wireless sensor networks: a survey. IEEE Communications Surveys and Tutorials, 13(1), 68\u201396.","DOI":"10.1109\/SURV.2011.040310.00002"},{"issue":"4","key":"1028_CR14","doi-asserted-by":"crossref","first-page":"788","DOI":"10.1109\/JSAC.2005.843547","volume":"23","author":"C Pandana","year":"2005","unstructured":"Pandana, C., & Liu, K. J. R. (2005). Near-optimal reinforcement learning framework for energy-aware sensor communications. IEEE Journal on Selected Areas in Communications, 23(4), 788\u2013797.","journal-title":"IEEE Journal on Selected Areas in Communications"},{"key":"1028_CR15","unstructured":"Chang, Y. H., Ho, T., & Kaelbling, L. P. (2004). Mobilized ad-hoc networks: A reinforcement learning approach. In Proceedings of International Conference on Autonomic Computing."},{"key":"1028_CR16","doi-asserted-by":"crossref","unstructured":"Dong, S., Agrawal, P., & Sivalingam, K. (2007). Reinforcement learning based geographic routing protocol for UWB wireless sensor network. In Proceedings of global telecommunications conference.","DOI":"10.1109\/GLOCOM.2007.127"},{"key":"1028_CR17","doi-asserted-by":"crossref","unstructured":"F\u00f6rster, A., & Murphy, A. L. (2007). FROMS: Feedback routing for optimizing multiple sinks in WSN with reinforcement learning. In Proceedings of international conference intelligent sensors, sensor Network Information Processing (ISSNIP).","DOI":"10.1109\/ISSNIP.2007.4496872"},{"issue":"3","key":"1028_CR18","doi-asserted-by":"crossref","first-page":"1899","DOI":"10.1109\/TVT.2007.907023","volume":"57","author":"FR Yu","year":"2008","unstructured":"Yu, F. R., Wong, V., & Leong, V. (2008). A new QoS provisioning method for adaptive multimedia in wireless networks. IEEE Transactions on Vehicular Technology, 57(3), 1899\u20131909.","journal-title":"IEEE Transactions on Vehicular Technology"},{"key":"1028_CR19","unstructured":"Alexandri, E., Martinez, G., & Zeghlache, D. (2002). A distributed reinforcement learning approach to maximize resource utilization and control hand over dropping in multimedia wireless networks. In Proceedings of indoor and mobile radio communication: International symposium on personal."},{"key":"1028_CR20","doi-asserted-by":"crossref","unstructured":"Yau, K., Komisarczuk, P., & Teal, P. (2010). Enhancing network performance in distributed cognitive radio networks using single-agent and multi-agent reinforcement learning. In Proceedings of conference on local computer networks.","DOI":"10.1109\/LCN.2010.5735689"},{"issue":"1","key":"1028_CR21","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1109\/TIT.2005.860420","volume":"52","author":"JB Predd","year":"2006","unstructured":"Predd, J. B., Kulkarni, S. R., & Poor, H. V. (2006). Consistency in models for distributed learning under communication constraints. IEEE Transactions on Information Theory, 52(1), 52\u201363.","journal-title":"IEEE Transactions on Information Theory"},{"key":"1028_CR22","doi-asserted-by":"crossref","unstructured":"Gummeson, J., Ganesan, D., Corner, M. D., & Shenoy, P. (2010). An adaptive link layer for hetrogeneous multi-radio mobile sensor networks. IEEE Journal on Selected Areas in Communications, 28(7), 1094\u20131104.","DOI":"10.1109\/JSAC.2010.100914"},{"issue":"1","key":"1028_CR23","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1016\/j.jnca.2011.08.007","volume":"35","author":"KA Yau","year":"2012","unstructured":"Yau, K. A., Komisarczuk, P., & Teal, P. D. (2012). Reinforcement learning for context awareness and intelligence in wireless networks: Review, new features and open issues. Journal of Network and Computer Applications, 35(1), 253\u2013267.","journal-title":"Journal of Network and Computer Applications"},{"issue":"3\/4","key":"1028_CR24","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1504\/IJSNET.2006.012027","volume":"1","author":"Z Liu","year":"2006","unstructured":"Liu, Z., & Elahanany, I. (2006). RL-MAC: A reinforcement learning based MAC protocol for wireless sensor networks. Internationa Journal on Sensor Networks, 1(3\/4), 117\u2013124.","journal-title":"Internationa Journal on Sensor Networks"},{"key":"1028_CR25","unstructured":"Mihaylov, M., Tuyls, K., & Now\u00e9, A. (2009). Decentralized learning in wireless sensor networks. In Proceedings of adaptive and learning agents workshop Budapest, Hungary."},{"key":"1028_CR26","volume-title":"Reinforcement learning: An introduction","author":"Sutton","year":"1998","unstructured":"Sutton, & Barto, (1998). Reinforcement learning: An introduction. Cambridge: MIT Press."},{"issue":"4","key":"1028_CR27","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1109\/TNET.2002.801403","volume":"10","author":"W Ye","year":"2002","unstructured":"Ye, W., Heidemann, J., & Estrin, D. (2002). Mobility increases the capacity of ad hoc wireless networks. IEEE\/ACM Transactions on Networking, 10(4), 477\u2013486.","journal-title":"IEEE\/ACM Transactions on Networking"}],"container-title":["Wireless Personal Communications"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11277-013-1028-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11277-013-1028-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11277-013-1028-9","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,2,7]],"date-time":"2022-02-07T00:53:07Z","timestamp":1644195187000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11277-013-1028-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,1,31]]},"references-count":27,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2013,9]]}},"alternative-id":["1028"],"URL":"https:\/\/doi.org\/10.1007\/s11277-013-1028-9","relation":{},"ISSN":["0929-6212","1572-834X"],"issn-type":[{"value":"0929-6212","type":"print"},{"value":"1572-834X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,1,31]]}}}