{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2022,3,30]],"date-time":"2022-03-30T05:54:45Z","timestamp":1648619685992},"reference-count":18,"publisher":"World Scientific Pub Co Pte Lt","issue":"03","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Advs. Complex Syst."],"published-print":{"date-parts":[[2009,6]]},"abstract":"<jats:p> We study an adaptive controller that adjusts its internal parameters by self-organization of its interaction with the environment. We show that the parameter changes that occur in this low-level learning process can themselves provide a source of information to a higher-level context-sensitive learning mechanism. In this way, the context is interpreted in terms of the concurrent low-level learning mechanism. The dual learning architecture is studied in realistic simulations of a foraging robot and of a humanoid hand that manipulated an object. Both systems are driven by the same low-level scheme, but use the second-order information in different ways. While the low-level adaptation continues to follow a set of rigid learning rules, the second-order learning modulates the elementary behaviors and affects the distribution of the sensory inputs via the environment. <\/jats:p>","DOI":"10.1142\/s0219525909002258","type":"journal-article","created":{"date-parts":[[2009,7,13]],"date-time":"2009-07-13T02:50:39Z","timestamp":1247453439000},"page":"273-291","source":"Crossref","is-referenced-by-count":4,"title":["MODULATED EXPLORATORY DYNAMICS CAN SHAPE SELF-ORGANIZED BEHAVIOR"],"prefix":"10.1142","volume":"12","author":[{"given":"FRANK","family":"HESSE","sequence":"first","affiliation":[{"name":"Max-Planck-Institute for Dynamics and Self-Organization, Bernstein Center for Computational Neuroscience G\u00f6ttingen, Bunsenstrasse 10, 37073 G\u00f6ttingen, Germany"},{"name":"Department for Nonlinear Dynamics, Georg-August-University G\u00f6ttingen, Bunsenstrasse 10, 37073 G\u00f6ttingen, Germany"}]},{"given":"RALF","family":"DER","sequence":"additional","affiliation":[{"name":"Max-Planck-Institute for Mathematics in the Sciences, Inselstrasse 22, 04103 Leipzig, Germany"}]},{"given":"J. MICHAEL","family":"HERRMANN","sequence":"additional","affiliation":[{"name":"University of Edinburgh, School of Informatics, 10 Crichton Street, Edinburgh, EH8 9AB, Scotland, UK"}]}],"member":"219","published-online":{"date-parts":[[2011,11,20]]},"reference":[{"key":"rf1","doi-asserted-by":"publisher","DOI":"10.5962\/bhl.title.6969"},{"key":"rf2","doi-asserted-by":"publisher","DOI":"10.1177\/105971230401200104"},{"key":"rf3","doi-asserted-by":"crossref","DOI":"10.1097\/00000441-193907000-00031","volume-title":"The Wisdom of the Body","author":"Cannon W. B.","year":"1939"},{"key":"rf4","doi-asserted-by":"publisher","DOI":"10.1016\/j.neubiorev.2004.09.009"},{"key":"rf8","doi-asserted-by":"publisher","DOI":"10.1177\/105971230601400202"},{"key":"rf11","unstructured":"R.\u00a0Der, U.\u00a0Steinmetz and F.\u00a0Pasemann, Computational Intelligence for Modelling, Control, and Automation, Concurrent Systems Engineering Series\u00a055 (IOS Press, Amsterdam, 1999)\u00a0pp. 43\u201347."},{"key":"rf12","unstructured":"E.\u00a0Di Paolo, Dynamical Systems Approach to Embodiment and Sociality, eds. K.\u00a0Murase and T.\u00a0Asakura (2003)\u00a0pp. 19\u201342."},{"key":"rf13","doi-asserted-by":"publisher","DOI":"10.1007\/s12064-001-0021-0"},{"key":"rf14","volume-title":"The Organization of Behavior: A Neuropsychological Theory","author":"Hebb D.","year":"1949"},{"key":"rf16","doi-asserted-by":"publisher","DOI":"10.1613\/jair.301"},{"key":"rf17","doi-asserted-by":"publisher","DOI":"10.1007\/s00422-006-0127-z"},{"key":"rf18","doi-asserted-by":"publisher","DOI":"10.1016\/0921-8890(92)90004-I"},{"key":"rf20","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton R. S.","year":"1998"},{"key":"rf21","first-page":"562","volume":"25","author":"Tamosiunaite M.","journal-title":"J. Comp. Nsci."},{"key":"rf22","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCA.2003.809171"},{"key":"rf24","first-page":"83","volume":"288","author":"Elizabeth P.","journal-title":"Science"},{"key":"rf25","doi-asserted-by":"publisher","DOI":"10.1093\/beheco\/13.2.182"},{"key":"rf26","doi-asserted-by":"publisher","DOI":"10.1126\/science.288.5463.133"}],"container-title":["Advances in Complex Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0219525909002258","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,8,7]],"date-time":"2019-08-07T00:52:24Z","timestamp":1565139144000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0219525909002258"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,6]]},"references-count":18,"journal-issue":{"issue":"03","published-online":{"date-parts":[[2011,11,20]]},"published-print":{"date-parts":[[2009,6]]}},"alternative-id":["10.1142\/S0219525909002258"],"URL":"https:\/\/doi.org\/10.1142\/s0219525909002258","relation":{},"ISSN":["0219-5259","1793-6802"],"issn-type":[{"value":"0219-5259","type":"print"},{"value":"1793-6802","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,6]]}}}