{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,16]],"date-time":"2026-05-16T07:27:02Z","timestamp":1778916422321,"version":"3.51.4"},"publisher-location":"Berlin, Heidelberg","reference-count":28,"publisher":"Springer Berlin Heidelberg","isbn-type":[{"value":"9783540433705","type":"print"},{"value":"9783540459415","type":"electronic"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2002]]},"DOI":"10.1007\/3-540-45941-3_21","type":"book-chapter","created":{"date-parts":[[2007,6,6]],"date-time":"2007-06-06T21:54:58Z","timestamp":1181166898000},"page":"197-206","source":"Crossref","is-referenced-by-count":2,"title":["An Improved Q-Learning Algorithm Using Synthetic Pheromones"],"prefix":"10.1007","author":[{"given":"Ndedi","family":"Monekosso","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paolo","family":"Remagnino","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adam","family":"Szarowicz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2002,3,14]]},"reference":[{"key":"21_CR1","unstructured":"C. Anderson, P.G. Blacwell, and C. Cannings. Simulating ants that forage by expectation. In Proc. 4Th Conf. on Artificial Life, pages 531\u2013538, 1997."},{"key":"21_CR2","doi-asserted-by":"publisher","first-page":"258","DOI":"10.1007\/BF02224053","volume":"37","author":"R. Beckers","year":"1990","unstructured":"R. Beckers, J. L. Deneubourg, S. Goss, and J. M. Pasteels. Collective decision making through food recruitment. Ins. Soc., 37:258\u2013267, 1990.","journal-title":"Ins. Soc."},{"key":"21_CR3","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1016\/S0022-5193(05)80686-1","volume":"159","author":"R. Beckers","year":"1992","unstructured":"R. Beckers, J.L. Deneubourg, and S. Goss. Trails and u-turns in the selection of the shortest path by the ant lasius niger. Journal of Theoretical Biology, 159:397\u20134151, 1992.","journal-title":"Journal of Theoretical Biology"},{"key":"21_CR4","unstructured":"D.P. Bertsekas and J.N. Tsitsiklis. Neuro-Dynamic Programming. Athena Scientific, 1996."},{"key":"21_CR5","doi-asserted-by":"crossref","unstructured":"E. Bonabeau, M. Dorigo, and G. Theraulaz. Swarm intelligence, From Natural to Artificial Systems. Oxford University Press, 1999.","DOI":"10.1093\/oso\/9780195131581.001.0001"},{"key":"21_CR6","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1007\/BF00694700","volume":"88","author":"M. C. Cammaerts-Tricot","year":"1974","unstructured":"M. C. Cammaerts-Tricot. Piste et pheromone attraction chez la fourmi myrmica ruba. Journal of Computational Physiology, 88:373\u2013382, 1974.","journal-title":"Journal of Computational Physiology"},{"key":"21_CR7","unstructured":"G. Di Caro and M. Dorigo. Antnet: a mobile agents approach to adaptive routing."},{"key":"21_CR8","first-page":"39","volume":"34","author":"A. Colorni","year":"1993","unstructured":"A. Colorni, M. Dorigo, and V. Maniezzo. Ant system for job-shop scheduling. Belgian Journal of OR, statistics and computer science, 34:39\u201353, 1993.","journal-title":"Belgian Journal of OR, statistics and computer science"},{"key":"21_CR9","unstructured":"A. Colorni, M. Dorigo, and G. Theraulaz. Distributed optimzation by ant colonies. In Proceedings First European Conf. on Artificial Life, pages 134\u2013142, 1991."},{"key":"21_CR10","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1016\/S0022-5193(05)80686-1","volume":"159","author":"J.L. Deneubourg","year":"1992","unstructured":"J.L. Deneubourg, R. Beckers, and S. Goss. Trails and u-turns in the selection of a path by the ant lasius niger. Journal of Theoretical Biology, 159:397\u2013415, 1992.","journal-title":"Journal of Theoretical Biology"},{"key":"21_CR11","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1080\/08927014.1989.9525500","volume":"1","author":"J.L. Deneubourg","year":"1993","unstructured":"J.L. Deneubourg and S. Goss. Collective patterns and decision making. Ethol. Ecol. and Evol., 1:295\u2013311, 1993.","journal-title":"Ethol. Ecol. and Evol."},{"key":"21_CR12","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1109\/4235.585892","volume":"1","author":"M. Dorigo","year":"1997","unstructured":"M. Dorigo and L. M. Gambardella. Ant colony system: A cooperative learning approach to the travelling salesman problem. IEEE Trans. on Evol. Comp., 1:53\u201366, 1997.","journal-title":"IEEE Trans. on Evol. Comp."},{"key":"21_CR13","first-page":"1","volume":"26","author":"M. Dorigo","year":"1996","unstructured":"M. Dorigo, V. Maniezzo, and A. Colorni. The ant system: Optimization by a colony of cooperatin agents. IEEE Trans. on Systems, Man, and Cybernetics, 26:1\u201313, 1996.","journal-title":"IEEE Trans. on Systems, Man, and Cybernetics"},{"key":"21_CR14","unstructured":"M. Kisiel-Dorohinicki E. Nawarecki, G. Dobrowolski. Organisations in the particular class of multi-agent systems. In in this volume, 2001."},{"key":"21_CR15","doi-asserted-by":"crossref","unstructured":"L. M. Gambardella and M. Dorigo. Ant-q: A reinforcement learning approach to the traveling salesman problem. In Proc. 12Th ICML, pages 252\u2013260, 1995.","DOI":"10.1016\/B978-1-55860-377-6.50039-6"},{"key":"21_CR16","unstructured":"L. M. Gambardella, E. D. Taillard, and M. Dorigo. Ant colonies for the qap. Journal of Operational Research society, 1998."},{"key":"21_CR17","doi-asserted-by":"crossref","unstructured":"S. Goss, S. Aron, J.L. Deneubourg, and J. M. Pasteels. Self-organized shorcuts in the argentine ants. Naturwissenschaften, pages 579\u2013581, 1989.","DOI":"10.1007\/BF00462870"},{"key":"21_CR18","unstructured":"L. R. Leerink, S. R. Schultz, and M. A. Jabri. A reinforcement learning exploration strategy based on ant foraging mechanisms. In Proc. 6Th Australian Conference on Neural Nets, 1995."},{"key":"21_CR19","doi-asserted-by":"crossref","unstructured":"J-P. Sansonnet N. Sabouret. Learning collective behaviour from local interaction. In in this volume, 2001.","DOI":"10.1007\/3-540-45941-3_29"},{"key":"21_CR20","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1016\/0040-5809(80)90039-8","volume":"18","author":"J.G. Ollason","year":"1980","unstructured":"J.G. Ollason. Learning to forage-optimally? Theoretical Population Biology, 18:44\u201356, 1980.","journal-title":"Theoretical Population Biology"},{"key":"21_CR21","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1016\/0040-5809(87)90020-7","volume":"31","author":"J.G. Ollason","year":"1987","unstructured":"J.G. Ollason. Learning to forage in a regenerating patchy environment: can it fail to be optimal? Theoretical Population Biology, 31:13\u201332, 1987.","journal-title":"Theoretical Population Biology"},{"key":"21_CR22","doi-asserted-by":"crossref","unstructured":"H. Van Dyke Parunak and S. Brueckner. Ant-like missionnaries and cannibals: Synthetic pheromones for distributed motion control. In Proc. of ICMAS\u201900, 2000.","DOI":"10.1145\/336595.337572"},{"key":"21_CR23","unstructured":"H. Van Dyke Parunak, S. Brueckner, J. Sauter, and J. Posdamer. Mechanisms and military applications for synthetic pheromones. In Proc. 5Th International Conference Autonomous Agents, Montreal, Canada, 2001."},{"key":"21_CR24","unstructured":"L. Sheremetov R. Romero Cortes. Model of cooperation in multi-agent systems with fuzzy coalitions. In in this volume, 2001."},{"key":"21_CR25","unstructured":"R. S. Sutton and A.G. Barto. Reinforcement Learning. MITPress, 1998."},{"key":"21_CR26","doi-asserted-by":"crossref","unstructured":"Ming Tan. Multi-agent reinforcement learning: Independent vs. cooperative agents. In Proceedings of the Tenth International Conference on Machine Learning, pages 330\u2013337, 1993.","DOI":"10.1016\/B978-1-55860-307-3.50049-6"},{"key":"21_CR27","doi-asserted-by":"crossref","unstructured":"R. T. Vaughan, K. Stoy, G. S. Sukhatme, and M. J. Mataric. Whistling in the dark: Cooperative trail following in uncertain localization space. In Proc. 4Th International Conference on Autonomous Agents, Barcelona, Spain, 2000.","DOI":"10.1145\/336595.337351"},{"key":"21_CR28","unstructured":"C. J. C. H. Watkins. Learning with delayed rewards. PhD thesis, University of Cambridge, 1989."}],"container-title":["Lecture Notes in Computer Science","From Theory to Practice in Multi-Agent Systems"],"original-title":[],"link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/3-540-45941-3_21","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,12]],"date-time":"2023-05-12T03:19:44Z","timestamp":1683861584000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/3-540-45941-3_21"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2002]]},"ISBN":["9783540433705","9783540459415"],"references-count":28,"URL":"https:\/\/doi.org\/10.1007\/3-540-45941-3_21","relation":{},"ISSN":["0302-9743"],"issn-type":[{"value":"0302-9743","type":"print"}],"subject":[],"published":{"date-parts":[[2002]]}}}