{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,29]],"date-time":"2025-09-29T15:44:21Z","timestamp":1759160661929},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2014,10,9]],"date-time":"2014-10-09T00:00:00Z","timestamp":1412812800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Wireless Netw"],"published-print":{"date-parts":[[2015,4]]},"DOI":"10.1007\/s11276-014-0817-8","type":"journal-article","created":{"date-parts":[[2014,10,8]],"date-time":"2014-10-08T04:51:36Z","timestamp":1412743896000},"page":"931-948","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Experimental validation of a reinforcement learning based approach for a service-wise optimisation of heterogeneous wireless sensor networks"],"prefix":"10.1007","volume":"21","author":[{"given":"Milos","family":"Rovcanin","sequence":"first","affiliation":[]},{"given":"Eli","family":"De Poorter","sequence":"additional","affiliation":[]},{"given":"Daniel","family":"van den Akker","sequence":"additional","affiliation":[]},{"given":"Ingrid","family":"Moerman","sequence":"additional","affiliation":[]},{"given":"Piet","family":"Demeester","sequence":"additional","affiliation":[]},{"given":"Chris","family":"Blondia","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2014,10,9]]},"reference":[{"key":"817_CR1","doi-asserted-by":"crossref","unstructured":"van den Akker, D., & Blondia, C. (2011). On the effects of interference between heterogeneous sensor network MAC protocols. In IEEE international conference on mobile ad-hoc and sensor systems (IEEE MASS), pp. 560\u2013569, IEEE Computer Society.","DOI":"10.1109\/MASS.2011.59"},{"key":"817_CR2","doi-asserted-by":"crossref","unstructured":"Wakamiya, N., Arakawa, S., & Murata, M. (2009). Self-organization based network architecture for new generation networks. In 2009 First international conference on emerging network intelligence, pp. 61\u201368.","DOI":"10.1109\/EMERGING.2009.8"},{"key":"817_CR3","doi-asserted-by":"crossref","unstructured":"De Poorter, E., Latre, B., Moerman, I., & Demeester, P. (2008). Symbiotic networks: Towards a new level of cooperation between wireless networks. In Published in special issue of the wireless personal communications journal, Springer, Netherlands, 45(4), 479\u2013495.","DOI":"10.1007\/s11277-008-9490-5"},{"key":"817_CR4","unstructured":"Lanza-Gutierrez, J. M., Gomez-Pulido, J. A., Vega-Rodriguez, M. A., & Sanchez-Perez, J. M. (2012). Multi-objective evolutionary algorithms for energy-efficiency in heterogeneous wireless sensor networks. In SAS 2012: IEEE Sensors Applications Symposium, Feb 7, 2012\u2013Feb 9, 2012, Brescia, Italy."},{"key":"817_CR5","doi-asserted-by":"crossref","unstructured":"Deb, K., Agrawal, S., Pratap, A., & Meyarivan, T. (2000). A fast elitist non-dominated sorting genetic algorithm for multi-objective optimization: NSGA-II. In Parallel problem solving from nature PPSN VI.","DOI":"10.1007\/3-540-45356-3_83"},{"key":"817_CR6","unstructured":"Zitzler, E., Laumanns, M., & Thiele, L. (2001). SPEA2: Improving the strength Pareto evolutionary algorithm. In EUROGEN."},{"key":"817_CR7","unstructured":"\u00d6zdemir, S., Bara, A. A., & Khalil, \u00d6. A. Multi-objective evolutionary algorithm based on decomposition for energy efficient coverage in wireless sensor networks."},{"key":"817_CR8","volume-title":"Evolutionary algorithms for solving multi-objective problems","author":"CAC Coello","year":"2007","unstructured":"Coello, C. A. C., Lamont, G. B., & Van Veldhuizen, D. A. (2007). Evolutionary algorithms for solving multi-objective problems (2nd ed.). Berlin: Springer.","edition":"2"},{"key":"817_CR9","doi-asserted-by":"crossref","unstructured":"Martins, F. V. C., Carrano, E. G., Wanner, E. F., Takahashi, R. H., & Mateus, G. R. (2011). A hybrid multi-objective evolutionary approach for improving the performance of wireless sensor networks. IEEE Sensors Journal, 11(3), 361\u2013403.","DOI":"10.1109\/JSEN.2010.2048897"},{"key":"817_CR10","unstructured":"http:\/\/www.me.utexas.edu\/bard\/LP\/LP20Handouts\/CPLEX20Tutorial20Handout ."},{"key":"817_CR11","doi-asserted-by":"crossref","unstructured":"Wang, P., & Wang, T. (2006). Adaptive routing for sensor networks using reinforcement learning. In CIT \u201906 proceedings of the sixth IEEE international conference on computer and information technology, Charlotte Convention Center Charlotte, NC.","DOI":"10.1109\/CIT.2006.34"},{"key":"817_CR12","unstructured":"Ye, Z., & Abouzeid, A. A. (2010). Layered sequential decision policies for cross-layer design of multihop wireless networks. In Information theory and applications workshop (ITA\u201910), San Diego, CA."},{"key":"817_CR13","unstructured":"Lee, M., Marconett, D., Ye, X., & Yoo, S. (2007). Cognitive network management with reinforcement learning for wireless mesh networks. In IP operations and management, pp. 168\u2013179, doi: 10.1007\/978-3-540-75853-2-15 ."},{"key":"817_CR14","doi-asserted-by":"crossref","unstructured":"Watkins, C. J. C. H., & Dayan, P. (1992). Technical note Q-learning. Machine Learning, 8, 279\u2013292.","DOI":"10.1007\/BF00992698"},{"key":"817_CR15","unstructured":"Ad hoc on-demand distance vector (AODV) routing. Networking group request for comments (rfc): 3561, http:\/\/tools.ietf.org\/html\/rfc3561 (2003)."},{"key":"817_CR16","unstructured":"Bertsekas, D. P. (2010). Approximate policy iteration: A survey and some new methods. Journal of Control Theory and Applications, MIT, 9, 310\u2013335, Report LIDS\u20142833."},{"key":"817_CR17","unstructured":"Perkins, T. J., & Precup, D. (2002). A convergent form of approximate policy iteration. In Advance in neural information processing Systems 15, NIPS 2002, Decembre 9\u201314. Vancouver, British, Columbia, Canada."},{"key":"817_CR18","unstructured":"www.eecs.harvard.edu\/tmote-sky-datasheet ."},{"key":"817_CR19","doi-asserted-by":"crossref","unstructured":"Falconer, D. D., Adachi, F., & Gudmundson, B. (1995). Time division multiple access methods for wireless personal communications. IEEE Communications Magazine. doi: 10.1109\/35.339881 .","DOI":"10.1109\/35.339881"},{"key":"817_CR20","doi-asserted-by":"crossref","unstructured":"Jurdak, R., Baldi, P., & Lopes, C. V. (2007). Adaptive low power listening for wireless sensor networks. IEEE Transactions on Mobile Computing, 6(8). doi: 10.1109\/TMC.2007.1037 .","DOI":"10.1109\/TMC.2007.1037"},{"key":"817_CR21","doi-asserted-by":"crossref","first-page":"1400","DOI":"10.1109\/TCOM.1975.1092768","volume":"23","author":"L Kleinrock","year":"1975","unstructured":"Kleinrock, L., & Tobagi, F. A. (1975). Packetswitching in radio channels: carrier sense multiple-access modes and their throughput-delay characteristics. IEEE Transactions on Communications, 23, 1400\u20131416.","journal-title":"IEEE Transactions on Communications"},{"issue":"3","key":"817_CR22","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1016\/j.adhoc.2010.07.017","volume":"9","author":"E Poorter De","year":"2011","unstructured":"De Poorter, E., Bouckaert, S., Moerman, I., & Demeester, P. (2011). Non-intrusive aggregation in wireless sensor networks. Ad Hoc Networks, 9(3), 324\u2013340.","journal-title":"Ad Hoc Networks"},{"key":"817_CR23","doi-asserted-by":"crossref","unstructured":"Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. In A bradford book. MIT Press, Cambridge, MA.","DOI":"10.1109\/TNN.1998.712192"},{"key":"817_CR24","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1613\/jair.301","volume":"4","author":"LP Kaelblign","year":"1996","unstructured":"Kaelblign, L. P., Littman, M. L., & Moore, A. W. (1996). Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4, 237\u2013285.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"817_CR25","doi-asserted-by":"crossref","unstructured":"Dietterich, T. G., & Langley, O. (2007). Machine learning for cognitive networks: Technology assessment and research challenges in cognitive networks: Towards self aware networks. Wiley, Chichester, UK. doi: 10.1002\/9780470515143.ch5 .","DOI":"10.1002\/9780470515143.ch5"},{"key":"817_CR26","unstructured":"Lagoudakis, M., & Parr, R. (2001). Model-free least-squares policy iteration. In Proceedings of NIPS."},{"key":"817_CR27","first-page":"1107","volume":"4","author":"MG Lagoudakis","year":"2003","unstructured":"Lagoudakis, M. G., & Parr, R. (2003). Least-squares policy iteration. Journal of Machine Learning Research, 4, 1107\u20131149.","journal-title":"Journal of Machine Learning Research"},{"key":"817_CR28","doi-asserted-by":"crossref","unstructured":"Rovcanin, M., Poorter, E. D., Moerman, I., & Demeester, P. (2014). A reinforcement learning based solution for cognitive network cooperation between co-located, heterogeneous wireless sensor networks. AD Hoc Networks, 17, 98\u2013113.","DOI":"10.1016\/j.adhoc.2014.01.009"},{"key":"817_CR29","doi-asserted-by":"crossref","unstructured":"Akker, D. V. D., & Blondia, C. (2013). Virtual gateways: enabling connectivity between MAC heterogeneous sensor networks. International Journal of Sensor Networks, 14(3), 133\u2013143 Inderscience.","DOI":"10.1504\/IJSNET.2013.057514"},{"issue":"6","key":"817_CR30","doi-asserted-by":"crossref","first-page":"1423","DOI":"10.1007\/s11276-011-0356-5","volume":"17","author":"E Poorter De","year":"2011","unstructured":"De Poorter, E., Troubleyn, E., Moerman, I., & Demeester, P. (2011). IDRA: A flexible system architecture for next generation wireless sensor networks. Wireless Networks, 17(6), 1423\u20131440.","journal-title":"Wireless Networks"},{"key":"817_CR31","unstructured":"Tytgat, L., Jooris, B., De Mil, P., Latr, B., Moerman, I., & Demeester, P. UGentWiLab, a real-life wireless sensor testbed with environment emulation. In 6th European conference on wireless sensor networks (EWSN 2009), URL: https:\/\/biblio.ugent.be\/publication\/676545 ."}],"container-title":["Wireless Networks"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11276-014-0817-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11276-014-0817-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11276-014-0817-8","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,8,15]],"date-time":"2019-08-15T19:46:44Z","timestamp":1565898404000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11276-014-0817-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,10,9]]},"references-count":31,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2015,4]]}},"alternative-id":["817"],"URL":"https:\/\/doi.org\/10.1007\/s11276-014-0817-8","relation":{},"ISSN":["1022-0038","1572-8196"],"issn-type":[{"value":"1022-0038","type":"print"},{"value":"1572-8196","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,10,9]]}}}