{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,19]],"date-time":"2026-09-19T14:40:24Z","timestamp":1789828824329,"version":"4.0.1"},"reference-count":43,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2015,4,28]],"date-time":"2015-04-28T00:00:00Z","timestamp":1430179200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Wireless sensor networks (WSNs) have been widely investigated in recent years. One of the fundamental issues in WSNs is packet routing, because in many application domains, packets have to be routed from source nodes to destination nodes as soon and as energy efficiently as possible. To address this issue, a large number of routing approaches have been proposed. Although every existing routing approach has advantages, they also have some disadvantages. In this paper, a multi-agent framework is proposed that can assist existing routing approaches to improve their routing performance. This framework enables each sensor node to build a cooperative neighbour set based on past routing experience. Such cooperative neighbours, in turn, can help the sensor to effectively relay packets in the future. This framework is independent of existing routing approaches and can be used to assist many existing routing approaches. Simulation results demonstrate the good performance of this framework in terms of four metrics: average delivery latency, successful delivery ratio, number of live nodes and total sensing coverage.<\/jats:p>","DOI":"10.3390\/s150510026","type":"journal-article","created":{"date-parts":[[2015,4,29]],"date-time":"2015-04-29T04:42:57Z","timestamp":1430282577000},"page":"10026-10047","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":60,"title":["A Multi-Agent Framework for Packet Routing in Wireless Sensor Networks"],"prefix":"10.3390","volume":"15","author":[{"given":"Dayong","family":"Ye","sequence":"first","affiliation":[{"name":"School of Software and Electrical Engineering, Swinburne University of Technology, Melbourne 3122, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Minjie","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Software Engineering, University of Wollongong, Wollongong 2522, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yun","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Software and Electrical Engineering, Swinburne University of Technology, Melbourne 3122, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2015,4,28]]},"reference":[{"key":"ref_1","first-page":"37","article-title":"Theoretical and practical aspects of military wireless sensor networks","volume":"2","author":"Winkler","year":"2008","journal-title":"J. Telecommun. Inf. Technol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1109\/SURV.2011.102910.00098","article-title":"Towards efficient wireless video sensor networks: A survey of existing node architectures and proposal for a flexi-wvsnp design","volume":"13","author":"Seema","year":"2011","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1007\/s11042-011-0840-z","article-title":"A survey of visual sensor network platforms","volume":"60","author":"Tavli","year":"2012","journal-title":"Multimed. Tools Appl."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1016\/j.adhoc.2003.09.010","article-title":"A survey on routing protocols for wireless sensor networks","volume":"3","author":"Akkaya","year":"2005","journal-title":"Ad Hoc Netw."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3498","DOI":"10.3390\/s110403498","article-title":"A Survey on Routing Protocols for Large-Scale Wireless Sensor Networks","volume":"11","author":"Li","year":"2011","journal-title":"Sensors"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3964","DOI":"10.3390\/s120403964","article-title":"An Overview of Data Routing Approaches for Wireless Sensor Networks","volume":"12","author":"Anisi","year":"2012","journal-title":"Sensors"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MWC.2004.1368893","article-title":"Routing Techniques in Wireless Sensor Networks: A Survey","volume":"11","author":"Kamal","year":"2004","journal-title":"IEEE Wirel. Commun."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1109\/98.878532","article-title":"Protocols for Self-organization of a Wireless Sensor Network","volume":"7","author":"Sohrabi","year":"2000","journal-title":"IEEE Pers. Commun."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Polastre, J., Hui, J., Levis, P., Zhao, J., Culler, D., Shenker, S., and Stoica, I. (2005, January 2\u20134). A unifying link abstraction for wireless sensor networks. San Diego, CA, USA.","DOI":"10.1145\/1098918.1098928"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1228","DOI":"10.1109\/TNET.2008.2008002","article-title":"Virtual-Coordinate-Based Delivery-Guaranteed Routing Protocol in Wireless Sensor Networks","volume":"17","author":"Tsai","year":"2009","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1002\/net.3230180406","article-title":"A Survey of gossiping and broadcasting in communication networks","volume":"18","author":"Hedetniemi","year":"1988","journal-title":"Networks"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Heinzelman, W., Kulik, J., and Balakrishnan, H. (1999, January 15\u201319). Adaptive protocols for information dissemination in wireless sensor networks. Seattle, WA, USA.","DOI":"10.1145\/313451.313529"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1023\/A:1013715909417","article-title":"Negotiation-Based Protocols for Disseminating Information in Wireless Sensor Networks","volume":"8","author":"Kulik","year":"2002","journal-title":"Wirel. Netw."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1109\/TSMCA.2005.846382","article-title":"Self-organized routing for wireless microsensor networks","volume":"35","author":"Rogers","year":"2005","journal-title":"IEEE Trans. Syst. Man Cybern. Part A Syst. Hum."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1649","DOI":"10.1109\/TMC.2010.131","article-title":"A biased random walk routing protocol for wireless sensor networks: The lukewarm potato protocol","volume":"9","author":"Beraldi","year":"2010","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_16","first-page":"61","article-title":"Enhancing Real-Time Delivery of Gradient Routing for Industrial Wireless Sensor Networks","volume":"8","author":"Quang","year":"2012","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_17","first-page":"113","article-title":"Enhancing realtime delivery in wireless sensor networks with two-hop information","volume":"5","author":"Li","year":"2009","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"784","DOI":"10.1109\/TII.2013.2261082","article-title":"R3E: Reliable Reactive Routing Enhancement for Wireless Sensor Networks","volume":"10","author":"Niu","year":"2014","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_19","unstructured":"Heinzelman, W., Chandrakasan, A., and Balakrishnan, H. (2000, January 4\u20137). Enerty efficient communication protocol for wireless sensor networks. Maui, HI, USA."},{"key":"ref_20","first-page":"1125","article-title":"PEGASIS: Power-Efficient Gathering in Sensor Information Systems","volume":"3","author":"Lindsey","year":"2002","journal-title":"IEEE Aerosp. Conf. Proc."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1240","DOI":"10.1109\/TWC.2007.348320","article-title":"Coverage-Preserving Routing Protocol for Randomly Distributed Wireless Sensor Networks","volume":"6","author":"Tsai","year":"2007","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1732","DOI":"10.1049\/iet-com.2009.0805","article-title":"Dynamic Multi-Objective Routing Algorithm: A Multi-Objective Routing Algorithm for the Simple Hybrid Routing Protocol on Wireless Sensor Networks","volume":"4","author":"Valentini","year":"2010","journal-title":"IET Commun."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"8399","DOI":"10.3390\/s91108399","article-title":"Routing protocols in wireless sensor networks","volume":"9","author":"Villalba","year":"2009","journal-title":"Sensors"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1694","DOI":"10.1109\/TMC.2010.250","article-title":"MUSTER: Adaptive Energy-Aware Multisink Routing in Wireless Sensor Networks","volume":"10","author":"Mottola","year":"2011","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Xu, Y., Heidemann, J., and Estrin, D. (2001, January 16\u201321). Geography-informed energy conservation for ad hoc routing. Rome, Italy.","DOI":"10.1145\/381677.381685"},{"key":"ref_26","unstructured":"Yu, Y., Estrin, D., and Govindan, R. (2001). Geographical and Energy-Aware Routing: A Recursive Data Dissemination Protocol for Wireless Sensor Networks; Technical Report, UCLA Computer Science Department."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2692","DOI":"10.1049\/iet-com.2011.0154","article-title":"Energy-aware interference-sensitive geographic routing in wireless sensor networks","volume":"5","author":"Huang","year":"2011","journal-title":"IET Commun."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1214","DOI":"10.1109\/TMC.2010.218","article-title":"Exploiting Virtual Coordinates for Improved Routing Performance in Sensor Networks","volume":"10","author":"Awad","year":"2011","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1109\/TPDS.2013.60","article-title":"ALBA-R: Load-Balancing Geographic Routing Around Connectivity Holes in Wireless Sensor Networks","volume":"25","author":"Petrioli","year":"2014","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Sutton, R.S., and Barto, A.G. (1998). Reinforcement Learning: An Introduction, MIT Press.","DOI":"10.1109\/TNN.1998.712192"},{"key":"ref_31","first-page":"89","article-title":"Learning teaching strategies in an Adaptive and Intelligent Educational System through Reinforcement Learning","volume":"31","author":"Iglesias","year":"2009","journal-title":"Artif. Intell."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1007\/s11263-008-0161-5","article-title":"Optimal Local Basis: A Reinforcement Learning Approach for Face Recognition","volume":"81","author":"Harandi","year":"2008","journal-title":"Int.J. Comput. Vis."},{"key":"ref_33","unstructured":"Gomes, E.R., and Kowalczyk, R. (, January June). Dynamic Analysis of Multiagent Q-Learning with E-Greedy Exploration. QC, Canada."},{"key":"ref_34","unstructured":"Galstyan, A., Czajkowski, K., and Lerman, K. (, January July). Resource allocation in the grid using reinforcement learning. New York, NY, USA."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Gomes, E.R., and Kowalczyk, R. (2007, January 2\u20135). Learning the IPA Market with Individual and Social Rewards. Fremont, CA, USA.","DOI":"10.1109\/IAT.2007.49"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Ziogos, N.P., Tellidou, A.C., Gountis, V.P., and Bakirtzis, A.G. (2007, January 1\u20135). A reinforcement learning algorithm for market participants in FTR auctions. Lausanne, Switzerland.","DOI":"10.1109\/PCT.2007.4538442"},{"key":"ref_37","first-page":"237","article-title":"Reinforcement Learning: A Survey","volume":"4","author":"Kaelbling","year":"1996","journal-title":"J. AI Res."},{"key":"ref_38","unstructured":"Zhang, C., Lesser, V., and Shenoy, P. (, January July). Multi-Agent Learning Approach to Online Distributed Resource Allocation. Pasadena, CA, USA."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1023\/A:1007678930559","article-title":"Convergence Results for Single-Step On-Policy Reinforcement Learning Algorithms","volume":"38","author":"Singh","year":"2000","journal-title":"Mach. Learn"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1016\/S1389-1286(01)00302-4","article-title":"Wireless sensor networks: A survey","volume":"38","author":"Akyildiz","year":"2002","journal-title":"Comput. Netw."},{"key":"ref_41","first-page":"350","article-title":"Energy Aware Routing for Low Energy Ad Hoc Sensor Networks","volume":"1","author":"Shah","year":"2002","journal-title":"Proc. IEEE Wirel. Commun. Netw. Conf."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"3069","DOI":"10.1109\/TWC.2007.06003","article-title":"A Dynamic Clustering and Energy Efficient Routing Technique for Sensor Neworks","volume":"6","author":"Yu","year":"2007","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_43","unstructured":"The Network Simulator. Available online: http:\/\/www.isi.edu\/nsnam\/ns\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/5\/10026\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:45:28Z","timestamp":1760215528000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/15\/5\/10026"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,4,28]]},"references-count":43,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2015,5]]}},"alternative-id":["s150510026"],"URL":"https:\/\/doi.org\/10.3390\/s150510026","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,4,28]]}}}