{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,24]],"date-time":"2025-05-24T07:40:09Z","timestamp":1748072409809,"version":"3.41.0"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"3-4","license":[{"start":{"date-parts":[[1998,7,1]],"date-time":"1998-07-01T00:00:00Z","timestamp":899251200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[1998,7,1]],"date-time":"1998-07-01T00:00:00Z","timestamp":899251200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Autonomous Robots"],"published-print":{"date-parts":[[1998,7]]},"DOI":"10.1023\/a:1008814507256","type":"journal-article","created":{"date-parts":[[2002,12,22]],"date-time":"2002-12-22T16:51:56Z","timestamp":1040575916000},"page":"335-354","source":"Crossref","is-referenced-by-count":15,"title":["Learning from History for Behavior-Based Mobile Robots in Non-Stationary Conditions"],"prefix":"10.1007","volume":"5","author":[{"given":"Fran\u00e7ois","family":"Michaud","sequence":"first","affiliation":[]},{"given":"Maja J.","family":"Matari\u0107","sequence":"additional","affiliation":[]}],"member":"297","reference":[{"key":"164034_CR1","volume-title":"The dynamic structure of everyday life","author":"P.E. Agre","year":"1988","unstructured":"Agre, P.E. 1988. The dynamic structure of everyday life. Ph.D. Thesis, Massachusetts Institute of Technology, Cambridge, MA."},{"issue":"3","key":"164034_CR2","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1109\/21.97471","volume":"21","author":"J.S. Albus","year":"1991","unstructured":"Albus, J.S. 1991. Outline for a theory of intelligence. IEEE Trans. on Systems, Man, and Cybernetics, 21(3):473-509.","journal-title":"IEEE Trans. on Systems, Man, and Cybernetics"},{"key":"164034_CR3","unstructured":"Asada, M., Uchibe, E., Noda, S., Tawaratsumida, S., and Hosoda, K. 1994. Coordination of multiple behaviors acquired by a vision-based reinforcement learning. In Proc. IEEE\/RSJ\/GI Int'l Conf. on Intelligent Robots and Systems, Munich, Germany."},{"issue":"1","key":"164034_CR4","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/JRA.1986.1087032","volume":"RA-2","author":"R.A. Brooks","year":"1986","unstructured":"Brooks, R.A. 1986. A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation, RA-2(1):14- 23.","journal-title":"IEEE Journal of Robotics and Automation"},{"key":"164034_CR5","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/0004-3702(91)90053-M","volume":"47","author":"R.A. Brooks","year":"1991","unstructured":"Brooks, R.A. 1991. Intelligence without representation. Artificial Intelligence, 47:139-159.","journal-title":"Artificial Intelligence"},{"key":"164034_CR6","series-title":"Technical Report","volume-title":"MARS: Multiple agency reactivity system","author":"R.A. Brooks","year":"1996","unstructured":"Brooks, R.A. 1996. MARS: Multiple agency reactivity system. Technical Report IS Robotics, Cambridge, MA."},{"issue":"3","key":"164034_CR7","doi-asserted-by":"crossref","first-page":"408","DOI":"10.1109\/3477.499792","volume":"26","author":"J.R. Mill\u00e1n","year":"1996","unstructured":"del R. Mill\u00e1n, J. 1996. Rapid, safe, and incremental learning of navigation strategies, IEEE Trans. on Systems, Man, and Cybernetics\u2014Part B: Cybernetics, 26(3):408-420.","journal-title":"IEEE Trans. on Systems, Man, and Cybernetics\u2014Part B: Cybernetics"},{"issue":"4","key":"164034_CR8","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/0004-3702(94)90047-7","volume":"71","author":"M. Dorigo","year":"1994","unstructured":"Dorigo, M. and Colombetti, M. 1994. Robot shaping: Developing autonomous agents through learning. Artificial Intelligence, 71(4):321-370.","journal-title":"Artificial Intelligence"},{"issue":"3","key":"164034_CR9","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1109\/3477.499791","volume":"26","author":"D. Floreano","year":"1996","unstructured":"Floreano, D. and Mondada, F. 1996. Evolution of homing navigation in a real mobile robot. IEEE Trans. on Systems, Man, and Cybernetics\u2014Part B: Cybernetics, 26(3):396-407.","journal-title":"IEEE Trans. on Systems, Man, and Cybernetics\u2014Part B: Cybernetics"},{"key":"164034_CR10","volume-title":"From Animals to Animats: Proc. 4th Int'l Conf. on Simulation of Adaptive Behavior","author":"M.S. Font\u00e1n","year":"1996","unstructured":"Font\u00e1n, M.S. and Matari\u0107, M.J. 1996. A study of territoriality: the role of critical mass in adaptive task division. In From Animals to Animats: Proc. 4th Int'l Conf. on Simulation of Adaptive Behavior, P. Maes, M.J. Matari\u0107, J.-A. Meyer, J. Pollack, and S. Wilson (Eds.), Cape Cod, The MIT Press."},{"key":"164034_CR11","unstructured":"Goldberg, D. and Matari\u0107, M.J. 1997. Interference as a tool for designing and evaluating multirobot controllers. In Proc. National Conf. on Artificial Intelligence (AAAI), Providence, RI, pp. 637- 642."},{"key":"164034_CR12","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1613\/jair.301","volume":"4","author":"L.P. Kaelbling","year":"1996","unstructured":"Kaelbling, L.P., Littman, M.L., and Moore, A.W. 1996. Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4:237-285.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"164034_CR13","unstructured":"Maes, P. 1989. The dynamics of action selection. In Proc. Int'l Joint Conf. on Artificial Intelligence (IJCAI), Detroit, MI, pp. 991-997."},{"key":"164034_CR14","first-page":"796","volume":"2","author":"P. Maes","year":"1990","unstructured":"Maes, P. and Brooks, R.A. 1990. Learning to coordinate behaviors. In Proc. Nat'l Conf. on Artificial Intelligence (AAAI), vol. 2, pp. 796- 802.","journal-title":"Proc. Nat'l Conf. on Artificial Intelligence (AAAI)"},{"key":"164034_CR15","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1016\/0004-3702(92)90058-6","volume":"55","author":"S. Mahadevan","year":"1992","unstructured":"Mahadevan, S. and Connell, J. 1992. Automatic programming of behavior-based robots using reinforcement learning. Artificial Intelligence, 55:311-365.","journal-title":"Artificial Intelligence"},{"key":"164034_CR16","doi-asserted-by":"crossref","unstructured":"Mahadevan, S. and Kaelbling, L.P. 1996. The NSF workshop on reinforcement learning: Summary and observations. AIMagazine.","DOI":"10.1007\/b102434"},{"issue":"3","key":"164034_CR17","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1109\/70.143349","volume":"8","author":"M.J. Matari\u0107","year":"1992","unstructured":"Matari\u0107, M.J. 1992a. Integration of representation into goal-driven behavior-based robots. IEEE Transactions on Robotics and Automation, 8(3):46-54.","journal-title":"IEEE Transactions on Robotics and Automation"},{"key":"164034_CR18","unstructured":"Matari\u0107, M.J. 1992b. Behavior-based systems: Key properties and implications. In Proc. IEEE Int'l Conf. on Robotics and Automation, Workshop on Architectures for Intelligent Control Systems, Nice, France, pp. 46-54."},{"key":"164034_CR19","doi-asserted-by":"crossref","DOI":"10.21236\/ADA290049","volume-title":"Interaction and intelligent behavior","author":"M.J. Matari\u0107","year":"1994","unstructured":"Matari\u0107, M.J. 1994a. Interaction and intelligent behavior. MIT AI Lab AI-TR 1495, Massachusetts Institute of Technology, Cambridge, MA."},{"key":"164034_CR20","first-page":"181","volume-title":"Proc. 11th Int'l Conf. on Machine Learning","author":"M.J. Matari\u0107","year":"1994","unstructured":"Matari\u0107, M.J. 1994b. Reward functions for accelerated learning. In Proc. 11th Int'l Conf. on Machine Learning, W.W. Cohen and H. Hirsh (Eds.), New Brunswick, NJ, Morgan Kauffman Publishers, pp. 181-189."},{"key":"164034_CR21","doi-asserted-by":"crossref","unstructured":"Matari\u0107, M.J. 1997. Reinforcement learning in the multi-robot domain. Autonomous Robots, 4(1).","DOI":"10.1023\/A:1008819414322"},{"issue":"3","key":"164034_CR22","doi-asserted-by":"crossref","first-page":"464","DOI":"10.1109\/3477.499796","volume":"26","author":"A.K. McCallum","year":"1996","unstructured":"McCallum, A.K. 1996a. Hidden state and reinforcement learning with instance-based state identification. IEEE Trans. on Systems, Man, and Cybernetics\u2014Part B: Cybernetics, 26(3):464- 473.","journal-title":"IEEE Trans. on Systems, Man, and Cybernetics\u2014Part B: Cybernetics"},{"key":"164034_CR23","first-page":"315","volume-title":"From Animals to Animats: Proc. 4th Int'l Conf. on Simulation of Adaptive Behavior","author":"A.K. McCallum","year":"1996","unstructured":"McCallum, A.K. 1996b. Learning to use selective attention and short-term memory in sequential tasks. In From Animals to Animats: Proc. 4th Int'l Conf. on Simulation of Adaptive Behavior, P. Maes, M.J. Matari\u0107, J.-A. Meyer, J. Pollack, and S.W. Wilson (Eds.), Cape Cod, The MIT Press, pp. 315-324."},{"key":"164034_CR24","volume-title":"Reinforcement learning with selective perception and hidden state","author":"A.K. McCallum","year":"1996","unstructured":"McCallum, A.K. 1996c. Reinforcement learning with selective perception and hidden state. Ph.D. Thesis, Department of Computer Science, University of Rochester, USA."},{"key":"164034_CR25","volume-title":"Nouvelle architecture unifi\u00e9e de contr\u00f4le intelligent par s\u00e9lection intentionnelle de comportements","author":"F. Michaud","year":"1996","unstructured":"Michaud, F. 1996. Nouvelle architecture unifi\u00e9e de contr\u00f4le intelligent par s\u00e9lection intentionnelle de comportements. Ph.D. Thesis, Department of Electrical and Computer Engineering, Universit\u00e9 de Sherbrooke, Qu\u00e9bec, Canada."},{"key":"164034_CR26","doi-asserted-by":"crossref","unstructured":"Michaud, F. 1997. Adaptability by behavior selection and observation for mobile robots. In Soft Computing in Engineering Design and Manufacturing, R. Roy, P. Chawdry, and P. Pants (Eds.), Springer-Verlag.","DOI":"10.1007\/978-1-4471-0427-8_40"},{"key":"164034_CR27","first-page":"247","volume-title":"From Animals to Animats: Proc. 4th Int'l Conf. on Simulation of Adaptive Behavior","author":"F. Michaud","year":"1996","unstructured":"Michaud, F., Lachiver, G., and Dinh, C.T.L. 1996. A new control architecture combining reactivity, deliberation and motivation for situated autonomous agent. In From Animals to Animats: Proc. 4th Int'l Conf. on Simulation of Adaptive Behavior, P. Maes, M.J. Matari\u0107, J.-A. Meyer, J. Pollack, and S.W. Wilson (Eds.), Cape Cod, The MIT Press, pp. 247-254."},{"key":"164034_CR28","series-title":"Technical Report","volume-title":"A history-based learning approach for adaptive robot behavior selection","author":"F. Michaud","year":"1997","unstructured":"Michaud, F. and Matari\u0107, M.J. 1997. A history-based learning approach for adaptive robot behavior selection. Technical Report CS-97-192, Computer Science Department, Volen Center for Complex System, Brandeis University, Waltham, MA, USA."},{"issue":"4","key":"164034_CR29","first-page":"347","volume":"17","author":"A. Ram","year":"1993","unstructured":"Ram, A. and Santamaria, J.C. 1993. Multistrategy learning in reactive control systems for autonomous robotic navigation. Informatica, 17(4):347-369.","journal-title":"Informatica"}],"container-title":["Autonomous Robots"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1023\/A:1008814507256.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1023\/A:1008814507256\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1023\/A:1008814507256.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,24]],"date-time":"2025-05-24T07:05:33Z","timestamp":1748070333000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1023\/A:1008814507256"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1998,7]]},"references-count":29,"journal-issue":{"issue":"3-4","published-print":{"date-parts":[[1998,7]]}},"alternative-id":["164034"],"URL":"https:\/\/doi.org\/10.1023\/a:1008814507256","relation":{},"ISSN":["0929-5593","1573-7527"],"issn-type":[{"type":"print","value":"0929-5593"},{"type":"electronic","value":"1573-7527"}],"subject":[],"published":{"date-parts":[[1998,7]]}}}