{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T04:05:03Z","timestamp":1777521903304,"version":"3.51.4"},"reference-count":51,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2009,2,1]],"date-time":"2009-02-01T00:00:00Z","timestamp":1233446400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Adaptive Behavior"],"published-print":{"date-parts":[[2009,2]]},"abstract":"<jats:p>A behavior-based architecture ( ConAg) with a connectionist action selection mechanism is introduced that enables a society of autonomous agents to construct arbitrary structures in their simulated two-dimensional world. Construction in this environment involves the agents picking up colored discs and dropping them at incomplete parts of the structure being built.<\/jats:p>\n                  <jats:p>The ConAg architecture provides both reactive behaviors which are used to maintain the viability of the agent and navigational planning behaviors that are used for construction. The action selection mechanism enables learning the sequence of behaviors required for construction by reinforcement learning. The navigational planning behaviors use a grid-based representation of the world. The shape of the structure to be built is also encoded on an internal spatial map. Path planning is implemented by spreading activations on sets of grid-based maps so that the agents perform the construction task efficiently. Construction of arbitrary structures is supported by temporal sequencing of goals. We present simulation results that demonstrate the performance of the architecture and algorithms.<\/jats:p>","DOI":"10.1177\/1059712308101787","type":"journal-article","created":{"date-parts":[[2009,3,9]],"date-time":"2009-03-09T11:28:10Z","timestamp":1236598090000},"page":"81-104","source":"Crossref","is-referenced-by-count":8,"title":["Construction in a Simulated Environment Using Temporal Goal Sequencing and Reinforcement Learning"],"prefix":"10.1177","volume":"17","author":[{"given":"Anand","family":"Panangadan","sequence":"first","affiliation":[{"name":"Saban Research Institute, Childrens Hospital of Los Angeles,"}]},{"given":"Michael G.","family":"Dyer","sequence":"additional","affiliation":[{"name":"Computer Science Department, University of California Los Angeles,"}]}],"member":"179","published-online":{"date-parts":[[2009,3,9]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1145\/380752.380881"},{"key":"atypb2","volume-title":"Behavior-based robotics","author":"Arkin, R.","year":"1998"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1016\/S0303-2647(00)00067-8"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-5347(97)01048-3"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.1998.0310"},{"key":"atypb6","doi-asserted-by":"publisher","DOI":"10.1109\/JRA.1986.1087032"},{"key":"atypb7","volume-title":"Proceedings of the IEEE International Workshop on Intelligent Robots and Systems (IROS)","author":"Brooks, R.A."},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1613\/jair.530"},{"key":"atypb9","doi-asserted-by":"publisher","DOI":"10.1109\/TMECH.2002.806233"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008985810481"},{"key":"atypb11","volume-title":"Proceedings of the 9th International Conference on Artificial Neural Networks","author":"Chao, G."},{"key":"atypb12","volume-title":"Introduction to algorithms","author":"Cormen, T.H.","year":"1990"},{"key":"atypb13","volume-title":"Proceedings of the International Joint Conference on Neural Networks","author":"Crabbe, F."},{"key":"atypb14","volume-title":"From Animals to Animats 6: Proceedings of the 6th International Conference on Simulation of Adaptive Behavior","author":"Crabbe, F."},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1177\/105971230000800204"},{"key":"atypb16","volume-title":"From Animals to Animats: Proceedings of the 1st International Conference on Simulation of Adaptive Behavior","author":"Deneubourg, J.L."},{"key":"atypb17","volume-title":"Proceedings of the 1st European Conference on Artificial Life","author":"Deneubourg, J.-L."},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1109\/3477.484436"},{"key":"atypb19","doi-asserted-by":"publisher","DOI":"10.1057\/palgrave.jors.2600676"},{"key":"atypb20","volume-title":"Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems","author":"Gaussier, P."},{"key":"atypb21","doi-asserted-by":"publisher","DOI":"10.1016\/0921-8890(95)00052-6"},{"key":"atypb22","doi-asserted-by":"publisher","DOI":"10.1162\/106454699568737"},{"key":"atypb23","doi-asserted-by":"crossref","unstructured":"Howsman, T.G., O'Neil, D. & Craft, M.A. (2004). A stigmergic cooperative multi-robot control architecture . In J. Pollack, M. Bedau, P. Husbands, T. Ikegami, & R. A. Watson (Eds.), Artificial life IX: Proceedings of the 9th International Conference on the Simulation and Synthesis of Living Systems (pp. 88-93). Cambridge, Massachusetts: MIT Press.","DOI":"10.7551\/mitpress\/1429.003.0016"},{"key":"atypb24","doi-asserted-by":"publisher","DOI":"10.1145\/345910.345920"},{"key":"atypb25","volume-title":"Proceedings of IEEE International Conference on Robotics and Automation (ICRA)","author":"Jones, C."},{"key":"atypb26","volume-title":"Proceedings of the IEEE International Conference on Robotics and Automation","author":"Kawauchi, Y."},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1016\/S0921-8890(98)00067-0"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.1016\/S0921-8890(98)00070-0"},{"key":"atypb29","volume-title":"Proceedings of IEEE International Conference on Robotics and Automation (ICRA)","author":"Kotay, K."},{"key":"atypb30","doi-asserted-by":"publisher","DOI":"10.1016\/j.jtbi.2004.12.012"},{"key":"atypb31","volume-title":"Mobile robot local navigation with a polar neural map. Unpublished master's thesis","author":"Lagoudakis, M.G.","year":"1998"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1016\/S0921-8890(05)80028-4"},{"key":"atypb33","volume-title":"From Animals to Animats: Proceedings of the 1st International Conference on Simulation of Adaptive Behavior","author":"Maes, P."},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1109\/70.143349"},{"key":"atypb35","volume-title":"Proceedings of the 1995 IEEE\/RSJ International Conference on Intelligent Robots and Systems","author":"Mataric, M.J."},{"key":"atypb36","volume-title":"The Oxford companion to animal behaviour","author":"McFarland, D.","year":"1981"},{"key":"atypb37","volume-title":"Proceedings of the 11th International Conference on Machine Learning","author":"Panangadan, A."},{"key":"atypb38","doi-asserted-by":"publisher","DOI":"10.1117\/12.403721"},{"key":"atypb39","volume-title":"From Animals to Animats 5: Proceedings of the 5th International Conference on Simulation of Adaptive Behavior","author":"Revel, A."},{"key":"atypb40","volume-title":"Proceedings of the 32nd Annual ACM Symposium on Theory of Computing","author":"Rothemund, P.W.K."},{"key":"atypb41","doi-asserted-by":"publisher","DOI":"10.1117\/12.403720"},{"key":"atypb42","doi-asserted-by":"publisher","DOI":"10.1177\/105971230601400104"},{"key":"atypb43","volume-title":"Proceedings of the 2004 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS)","author":"Terada, Y."},{"key":"atypb44","doi-asserted-by":"publisher","DOI":"10.1126\/science.269.5224.686"},{"key":"atypb45","doi-asserted-by":"publisher","DOI":"10.1006\/jtbi.1995.0255"},{"key":"atypb46","volume-title":"Computational mechanisms for action selection","author":"Tyrrell, T.","year":"1993"},{"key":"atypb47","doi-asserted-by":"publisher","DOI":"10.1177\/105971239300100401"},{"key":"atypb48","volume-title":"Learning from delayed rewards","author":"Watkins, C.J.C.H.","year":"1989"},{"key":"atypb49","volume-title":"Proceedings of the 2002 IEEE\/RSJ International Conference on Intelligent Robots and Systems","author":"Wawerla, J."},{"key":"atypb50","volume-title":"Proceedings of the 7th International Symposium on Distributed Autonomous Robotic Systems (DARS)","author":"Werfel, J."},{"key":"atypb51","volume-title":"Proceedings of IEEE International Conference on Robotics and Automation (ICRA)","author":"Werfel, J."}],"container-title":["Adaptive Behavior"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1059712308101787","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1059712308101787","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T16:15:44Z","timestamp":1777392944000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1059712308101787"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,2]]},"references-count":51,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2009,2]]}},"alternative-id":["10.1177\/1059712308101787"],"URL":"https:\/\/doi.org\/10.1177\/1059712308101787","relation":{},"ISSN":["1059-7123","1741-2633"],"issn-type":[{"value":"1059-7123","type":"print"},{"value":"1741-2633","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,2]]}}}