{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:23:09Z","timestamp":1760242989942,"version":"build-2065373602"},"reference-count":55,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2015,4,21]],"date-time":"2015-04-21T00:00:00Z","timestamp":1429574400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Technological advances have led to the emergence of wireless sensor nodes in wireless networks. Sensor nodes are usually battery powered and hence have strict energy constraints. As a result, energy conservation is very important in the wireless sensor network protocol design and the limited power resources are the biggest challenge in wireless network channels. Link adaptation techniques improve the link quality by adjusting medium access control (MAC) parameters such as frame size, data rate, and sleep time, thereby improving energy efficiency. In this paper we present an adaptive packet size strategy for energy efficient wireless sensor networks. The main goal is to reduce power consumption and extend the whole network life. In order to achieve this goal, the paper introduces the concept of a bounded MAB to find the optimal packet size to transfer by formulating different packet sizes for different arms under the channel condition. At the same time, in achieve fast convergence, we consider the bandwidth evaluation according to ACK. The experiment shows that the packet size is adaptive when the channel quality changes and our algorithm can obtain the optimal packet size. We observe that the MAB packet size adaptation scheme achieves the best energy ef\ufb01ciency across the whole simulation duration in comparison with the \ufb01xed frame size scheme, the random packet size and the extended Kalman filter (EKF).<\/jats:p>","DOI":"10.3390\/s150409360","type":"journal-article","created":{"date-parts":[[2015,4,22]],"date-time":"2015-04-22T04:41:53Z","timestamp":1429677713000},"page":"9360-9387","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Study of Multi-Armed Bandits for Energy Conservation in Cognitive Radio Sensor Networks"],"prefix":"10.3390","volume":"15","author":[{"given":"Juan","family":"Zhang","sequence":"first","affiliation":[{"name":"Open Fund of Robot Technology Used for Special Environment Key Laboratory of Sichuan, Mianyang 621010, China"},{"name":"School of Information Engineering, Southwest University of Science and Technology, Mianyang 621010, China"}]},{"given":"Hong","family":"Jiang","sequence":"additional","affiliation":[{"name":"Open Fund of Robot Technology Used for Special Environment Key Laboratory of Sichuan, Mianyang 621010, China"},{"name":"School of Information Engineering, Southwest University of Science and Technology, Mianyang 621010, China"}]},{"given":"Zhenhua","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Electronics and Information, Tongji University, Shanghai 201804, China"}]},{"given":"Chunmei","family":"Chen","sequence":"additional","affiliation":[{"name":"Open Fund of Robot Technology Used for Special Environment Key Laboratory of Sichuan, Mianyang 621010, China"},{"name":"School of Information Engineering, Southwest University of Science and Technology, Mianyang 621010, China"}]},{"given":"Hesong","family":"Jiang","sequence":"additional","affiliation":[{"name":"Open Fund of Robot Technology Used for Special Environment Key Laboratory of Sichuan, Mianyang 621010, China"},{"name":"School of Information Engineering, Southwest University of Science and Technology, Mianyang 621010, China"}]}],"member":"1968","published-online":{"date-parts":[[2015,4,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1002","DOI":"10.1109\/JPROC.2003.814620","article-title":"Real-time communication and coordination in embedded sensor etworks","volume":"91","author":"Stankovic","year":"2003","journal-title":"IEEE Proc."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1247","DOI":"10.1109\/JPROC.2003.814918","article-title":"Sensor networks: Evolution, opportunities,and challenges","volume":"91","author":"Chong","year":"2003","journal-title":"IEEE Proc."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1109\/JSAC.2004.839400","article-title":"Study of an Adaptive Frame Size Predictor to Enhance Energy onservation in Wireless Sensor Networks","volume":"23","author":"Ci","year":"2005","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/j.jnca.2013.11.001","article-title":"Dynamic spectrum access with packet size adaptation and residual energy balancing for energy-constrained cognitive radio sensor networks","volume":"41","author":"Li","year":"2014","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"22737","DOI":"10.3390\/s141222737","article-title":"Virtualization of Event Sources in Wireless Sensor Networks for the Internet of Things","volume":"14","year":"2014","journal-title":"Sensors"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TC.2002.1047758","article-title":"Dynamic power management for nonstationary service requests","volume":"51","author":"Chung","year":"2002","journal-title":"IEEE Trans. Comput."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"5202","DOI":"10.1109\/TWC.2009.081323","article-title":"Distributed energy efficient spectrum access in cognitive radio wireless ad hoc networks","volume":"8","author":"Gao","year":"2009","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"976","DOI":"10.1109\/LCOMM.2005.11010","article-title":"On the lifetime of wireless sensor networks","volume":"9","author":"Chen","year":"2005","journal-title":"IEEE Commun. Lett."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Wang, Q., Hempstead, M., and Yang, W. (2006, January 28). A realistic power consumption model for wireless sensor network devices. Proceedings of the Third Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks, Reston, VA, USA.","DOI":"10.1109\/SAHCN.2006.288433"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1109\/TCOMM.2011.112811.100349","article-title":"Optimal packet scheduling in an energy harvesting communication system","volume":"60","author":"Yang","year":"2012","journal-title":"IEEE Trans. Commun."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/MNET.2009.5191144","article-title":"Cognitive radio sensor networks","volume":"23","author":"Akan","year":"2009","journal-title":"IEEE Netw."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Goh, H.G., Kwong, K.H., Shen, C., Michie, C., and Andonovic, I. (2010, January 9\u201312). CogSeNet: A concept of cognitive wireless sensor network. Proceedings of 2010 7th IEEE consumer communications and networking conference (CCNC), Las Vegas, NV, USA.","DOI":"10.1109\/CCNC.2010.5421630"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"582","DOI":"10.1109\/JSEN.2010.2052033","article-title":"Cognition in wireless sensor networks: A Perspective","volume":"11","author":"Vijayand","year":"2011","journal-title":"IEEE Sens. J."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhang, H., Zhang, Z., Chen, X., and Yin, R. (2011, January 5\u20139). Energy Efficient Joint Source and Channel Sensing in Cognitive Radio Sensor Networks. Proceedings of the IEEE International Conference on Communications (ICC 2011), Kyoto, Japan.","DOI":"10.1109\/icc.2011.5962941"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1109\/JSEN.2010.2051327","article-title":"Energy-efficient distributed spectrum sensing for cognitive sensor networks","volume":"11","author":"Maleki","year":"2011","journal-title":"IEEE Sens. J."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1109\/TWC.2010.111910.100804","article-title":"Delay performance analysis for supporting realtime traffic in a cognitive radio sensor network","volume":"10","author":"Liang","year":"2011","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Tian, X., Tian, Z., Pham, K., Blasch, E., and Chen, G. (2013). QoS-aware dynamic spectrum access for cognitive radio networks. Proc. SPIE, 8739.","DOI":"10.1117\/12.2015205"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/s11235-009-9174-9","article-title":"Adaptive transmission scheduling over fading channels for energy-efficient cognitive radio networks by reinforcement learning","volume":"42","author":"Zhu","year":"2009","journal-title":"Telecommun. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2337","DOI":"10.12733\/jics20101760","article-title":"Strategic learning of cross-layer design for channel access and transmission rate adaptation in energy-constrained cognitive radio networks","volume":"10","author":"He","year":"2013","journal-title":"J. Inf. Comput. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.phycom.2010.03.002","article-title":"Energy efficient collaborative communication with imperfect phase synchronization and rayleigh fading in wireless sensor networks","volume":"3","author":"Naqvi","year":"2010","journal-title":"Phys. Commun."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Sankarasubramaniam, Y., Akyildiz, I., and McLaughlin, S. (2003, January 11). Energy efficiency-based packet size optimization in wireless sensor network. Proceedings of 1st IEEE International Workshop on Sensor Network Protocols and Applications, Anchorage, AK, USA.","DOI":"10.1109\/SNPA.2003.1203351"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"6262","DOI":"10.1109\/TSP.2011.2165211","article-title":"Fast reinforcement learning for energy-efficient wireless communication","volume":"59","author":"Mastronarde","year":"2011","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Woo, A., and Culler, D. (2001, January 16\u201321). A transmission control scheme for media access in sensor networks. Proceedings of the 7th annual international conference on Mobile computing and networking, Rome, Italy.","DOI":"10.1145\/381677.381699"},{"key":"ref_24","unstructured":"Ho, C.J., and Vaughan, J.W. (2012, January 22\u201326). On line task assignment incrowd sourcing markets. Proceedings of the 26th Conference on Artificial Intelligence, AAAI2012, Toronto, ON, Canada."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Bubeck, S., Munos, R., and Stoltz, G. (2009, January 3\u20135). Pure exploration for multi-armed bandit problems. Proceedings of the Twentieth international conference on Algorithmic Learning Theory, Porto, Portugal.","DOI":"10.1007\/978-3-642-04414-4_7"},{"key":"ref_26","unstructured":"Audibert, J.-Y., Bubeck, S., and Munos, R. (2010, January 27\u201329). Best arm identification in multi-armed bandits. Proceedings of the Twenty-Third Annual Conference on Learning Theory, Haifa, Israel."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1023\/A:1013689704352","article-title":"Finite-time analysis of the multiarmed bandit problem","volume":"47","author":"Auer","year":"2002","journal-title":"Mach. Learn."},{"key":"ref_28","unstructured":"Beygelzimer, A., Langford, J., Li, L., Reyzin, L., and Schapire, R. (2011, January 11\u201313). Contextual bandit algorithms with supervised learning guarantees. Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, Ft. Lauderdale, FL, USA."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.artint.2014.04.005","article-title":"Efficient crowdsourcing of unknown experts using bounded multi-armed bandits","volume":"214","author":"Stein","year":"2014","journal-title":"Artif. Intell."},{"key":"ref_30","first-page":"1","article-title":"Energy-Efficient Policy Based on Cross-Layer Cooperation in Wireless Communication","volume":"14","author":"Zhang","year":"2014","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1109\/TVT.2008.925314","article-title":"Multiuser detection using hidden Markov model","volume":"58","author":"Chen","year":"2009","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1109\/JSAC.2011.110212","article-title":"Decentralized cognitive radio control based on inference from primary link control information","volume":"29","author":"Huang","year":"2011","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"21281","DOI":"10.3390\/s141121281","article-title":"Online Variational Bayesian Filtering-Based Mobile Target Tracking in Wireless Sensor","volume":"14","author":"Zhou","year":"2014","journal-title":"Netw. Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"20910","DOI":"10.3390\/s141120910","article-title":"A Real-Time Localization System for an Endoscopic Capsule Using Magnetic Sensors","volume":"14","author":"Pham","year":"2014","journal-title":"Sensors"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1090\/S0002-9904-1952-09620-8","article-title":"Some aspects of the sequential design of experiments","volume":"55","author":"Robbins","year":"1952","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1158","DOI":"10.1109\/TMC.2007.1012","article-title":"Energy-efficient wireless packet scheduling with quality of service control","volume":"6","author":"Zhong","year":"2007","journal-title":"IEEE Trans. Mobile Comput."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"23697","DOI":"10.3390\/s141223697","article-title":"Deployment-Based Lifetime Optimization Model for Homogeneous Wireless Sensor Network under Retransmission","volume":"14","author":"Li","year":"2014","journal-title":"Sensors"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"732","DOI":"10.1109\/JSAC.2008.080514","article-title":"An online learning algorithm for energy-efficient delay-constrained scheduling over a fading channel","volume":"26","author":"Salodkar","year":"2008","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1142","DOI":"10.1109\/TWC.2005.847005","article-title":"Queueing with adaptive modulation and coding over wireless links: corss-layer analysis and design","volume":"4","author":"Liu","year":"2005","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1109\/TEVC.2007.900837","article-title":"A simulated annealing-based multiobjective optimization algorithm: AMOSA","volume":"12","author":"Bandyopadhyay","year":"2008","journal-title":"IEEE Trans. Evolut. Comput."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Mnih, V., Szepesvari, C., and Audibert, J. (2008, January 5\u20139). Empirical Bernstein stopping. Proceedings of the 25th International Conference on Machine Learning, Helsinki, Finland.","DOI":"10.1145\/1390156.1390241"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Gungor, O., Tan, J., Koksal, C.E., Gamal, H.E., and Shroff, N.B. (2010, January 14\u201319). Joint power and secret key queue management for delay limited secure communication. Proceedings of the 2010 IEEE INFOCOM, San Diego, CA, USA.","DOI":"10.1109\/INFCOM.2010.5462158"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Tran-Thanh, L., Chapman, A., de Cote, J.E.M., Rogers, A., and Jennings, N.R. (2010, January 11\u201315). Epsilon-first policies for budget-limited multi-armed bandits. Proceedings of the 24th Conference on Artificial Intelligence, Atlanta, GA, USA.","DOI":"10.1609\/aaai.v24i1.7758"},{"key":"ref_44","unstructured":"Tran-Thanh, L. (2012). Budget-Limited Multi-Armed Bandits. [Ph.D. Thesis, University of Southampton]."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Tran-Thanh, L., Stein, S., Rogers, A., and Jennings, N.R. (, January August). Efficient crowdsourcing of unknown experts using multi-armed bandits. Proceedings of 20th European Conference on Artificial Intelligence, ECAI 2012, Montpellier, France.","DOI":"10.3233\/978-1-61499-098-7-768"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1023\/A:1007678930559","article-title":"Convergence results for single-step on-policy reinforcement learning algorithms","volume":"38","author":"Singh","year":"2000","journal-title":"Mach. Learn."},{"key":"ref_47","first-page":"494","article-title":"Crosslayer parameter configuration for TCP throughput improvement in cognitive radio networks","volume":"62","author":"Jiang","year":"2013","journal-title":"Acta Phys. Sin"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1109\/MCOM.2011.5783982","article-title":"Fundamental trade-offs on green wireless networks","volume":"49","author":"Chen","year":"2011","journal-title":"IEEE Commun. Mag."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"22811","DOI":"10.3390\/s141222811","article-title":"On the MAC\/Network\/Energy Performance Evaluation of Wireless Sensor Networks: Contrasting MPH, AODV, DSR and ZTR Routing Protocols","volume":"14","author":"Lara","year":"2014","journal-title":"Sensors"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1016\/j.phycom.2012.03.002","article-title":"Performance analysis of selective cooperation with fixed gain relays in Nakagamim channels","volume":"5","author":"Hussain","year":"2012","journal-title":"Phys. Commun."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Xu, G., Jiang, H., Liu, C., and Wang, Y. (2012, January 10\u201315). A heuristic evaluation PDS algorithm for energy-efficient delay constrained scheduling over wireless communication. Proceedings of 2012 IEEE International Conference on Communications (ICC), Ottawa, ON, Canada.","DOI":"10.1109\/ICC.2012.6364901"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1254","DOI":"10.1109\/TPDS.2010.29","article-title":"A distributed efficient flow control scheme for multirate multicast networks","volume":"21","author":"Xiong","year":"2010","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"715","DOI":"10.3390\/s150100715","article-title":"Fusion of WiFi, Smartphone Sensors and Landmarks Using the Kalman Filter for Indoor Localization","volume":"15","author":"Chen","year":"2015","journal-title":"Sensors"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Vermorel, J., and Mohri, M. (2005, January 3\u20137). Multi-armed bandit algorithms and empirical evaluation. Proceedings of the 16th European Conference on Machine Learning, Porto, Portugal.","DOI":"10.1007\/11564096_42"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Zhang, H., and Li, J. (2015). Modeling and dynamical topology properties of VANET based on complex networks theory. AIP Adv., 5.","DOI":"10.1063\/1.4907245"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/4\/9360\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:45:04Z","timestamp":1760215504000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/4\/9360"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,4,21]]},"references-count":55,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2015,4]]}},"alternative-id":["s150409360"],"URL":"https:\/\/doi.org\/10.3390\/s150409360","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2015,4,21]]}}}