{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T15:13:35Z","timestamp":1759936415240,"version":"3.37.3"},"reference-count":67,"publisher":"Proceedings of the National Academy of Sciences","issue":"45","license":[{"start":{"date-parts":[[2016,4,26]],"date-time":"2016-04-26T00:00:00Z","timestamp":1461628800000},"content-version":"vor","delay-in-days":183,"URL":"http:\/\/www.pnas.org\/site\/misc\/userlicense.xhtml"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["1527"],"award-info":[{"award-number":["1527"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004963","name":"Seventh Framework Programme","doi-asserted-by":"publisher","award":["291734"],"award-info":[{"award-number":["291734"]}],"id":[{"id":"10.13039\/501100004963","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.pnas.org"],"crossmark-restriction":true},"short-container-title":["Proc. Natl. Acad. Sci. U.S.A."],"published-print":{"date-parts":[[2015,11,10]]},"abstract":"<jats:title>Significance<\/jats:title><jats:p>To find how autonomous behavior and its development can be realized by a brain or an artificial neural network is a fundamental challenge for neuroscience and robotics. Commonly, the self-organized unfolding of behavior is explained by postulating special concepts like internal drives, curiosity, specific reward systems, or selective pressures. We propose a simple, local, and biologically plausible synaptic mechanism that enables an embodied agent to self-organize its individual sensorimotor development without recourse to such higher-level constructs. When applied to robotic systems, a rich spectrum of rhythmic behaviors emerges, ranging from locomotion patterns to spontaneous cooperation between partners. A possible utilization of our novel mechanism in nature would lead to a new understanding of the early stages of sensorimotor development and of saltations in evolution.<\/jats:p>","DOI":"10.1073\/pnas.1508400112","type":"journal-article","created":{"date-parts":[[2015,10,27]],"date-time":"2015-10-27T02:38:47Z","timestamp":1445913527000},"update-policy":"https:\/\/doi.org\/10.1073\/pnas.cm10313","source":"Crossref","is-referenced-by-count":22,"title":["Novel plasticity rule can explain the development of sensorimotor intelligence"],"prefix":"10.1073","volume":"112","author":[{"given":"Ralf","family":"Der","sequence":"first","affiliation":[{"name":"Information Theory of Cognitive Systems, Max Planck Institute for Mathematics in the Sciences, 04103 Leipzig, Germany;"}]},{"given":"Georg","family":"Martius","sequence":"additional","affiliation":[{"name":"Information Theory of Cognitive Systems, Max Planck Institute for Mathematics in the Sciences, 04103 Leipzig, Germany;"},{"name":"Computer Vision and Machine Learning, Institute of Science and Technology Austria, 3400 Klosterneuburg, Austria"}]}],"member":"341","published-online":{"date-parts":[[2015,10,26]]},"reference":[{"key":"e_1_3_3_1_2","volume-title":"Fundamental Neuroscience","author":"Squire L","year":"2013","unstructured":"L Squire, Fundamental Neuroscience (Academic, 4th Ed, Waltham, MA, 2013).","edition":"4"},{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrn3154"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.neuro.26.043002.094940"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrn3170"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2011.09.006"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-30574-0_62"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2005.08.017"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2012.06.006"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrn3578"},{"key":"e_1_3_3_10_2","volume-title":"The Organization of Behavior: A Neuropsychological Theory","author":"Hebb DO","year":"1949","unstructured":"DO Hebb The Organization of Behavior: A Neuropsychological Theory (Wiley, New York, 1949)."},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.79.8.2554"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2004.09.005"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.02-01-00032.1982"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.275.5297.213"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1038\/383076a0"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/3585.001.0001"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1145803"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1254486"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2014.07.058"},{"key":"e_1_3_3_20_2","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1007\/978-3-642-00616-6_5","volume-title":"Creating Brain-Like Intelligence","author":"Pfeifer R","year":"2009","unstructured":"R Pfeifer, G G\u00f3mez, Morphological computation\u2014Connecting brain, body, and environment. Creating Brain-Like Intelligence (Springer, Berlin), pp. 66\u201383 (2009)."},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00422-012-0471-0"},{"key":"e_1_3_3_22_2","unstructured":"G Martius F Hesse F G\u00fcttler R Der L pz R obots : A free and powerful robot simulator. Available at robot.informatik.uni-leipzig.de\/software. (2010)."},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1063\/1.36225"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008910918445"},{"key":"e_1_3_3_25_2","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1007\/978-3-642-21283-3_51","volume-title":"Advances in Artificial Life. Darwin Meets von Neumann","author":"Lowe R","year":"2011","unstructured":"R Lowe, F Mannella, T Ziemke, G Baldassarre, Modelling coordination of learning systems: A reservoir systems approach to dopamine modulated Pavlovian conditioning. Advances in Artificial Life. Darwin Meets von Neumann (Springer, Berlin), pp. 410\u2013417 (2011)."},{"key":"e_1_3_3_26_2","volume-title":"The Playful Machine\u2014Theoretical Foundation and Practical Realization of Self-Organizing Robots","author":"Der R","year":"2012","unstructured":"R Der, G Martius The Playful Machine\u2014Theoretical Foundation and Practical Realization of Self-Organizing Robots (Springer, Berlin, 2012)."},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/0167-2789(90)90064-V"},{"key":"e_1_3_3_28_2","volume-title":"At Home in the Universe: The Search for the Laws of Self-Organization and Complexity","author":"Kauffman S","year":"1995","unstructured":"S Kauffman At Home in the Universe: The Search for the Laws of Self-Organization and Complexity (Oxford Univ Press, Oxford, UK, 1995)."},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1162\/089976604323057443"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrn3136"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1038\/nrn1327"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1088\/0954-898X_6_2_001"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.105.268104"},{"key":"e_1_3_3_34_2","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1007\/978-3-642-53734-9_7","volume-title":"Guided Self-Organization: Inception, Emergence, Complexity and Computation","author":"Der R","year":"2014","unstructured":"R Der, On the role of embodiment for self-organizing robots: behavior as broken symmetry. Guided Self-Organization: Inception, Emergence, Complexity and Computation, ed M Prokopenko (Springer, Berlin) Vol 9, 193\u2013221 (2014)."},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.7551\/978-0-262-31709-2-ch086"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0063400"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12064-011-0137-9"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1140\/epjb\/e2008-00175-0"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1177\/1059712310375314"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1038\/35036191"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1071550"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.23-11-04567.2003"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12064-011-0141-0"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.en.11.010166.000535"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00201854"},{"key":"e_1_3_3_46_2","first-page":"127","volume-title":"Perceiving, Acting, and Knowing. Towards an Ecological Psychology","author":"Gibson JJ","year":"1977","unstructured":"JJ Gibson, The theory of affordances. Perceiving, Acting, and Knowing. Towards an Ecological Psychology (Lawrence Erlbaum, Hillsdale, NJ), pp. 127\u2013143 (1977)."},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1086\/276428"},{"key":"e_1_3_3_48_2","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/2871.001.0001","volume-title":"Evolution and Learning: The Baldwin Effect Reconsidered","author":"Weber BH","year":"2003","unstructured":"BH Weber, DJ Depew Evolution and Learning: The Baldwin Effect Reconsidered (MIT Press, Cambridge, MA, 2003)."},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1098\/rspb.2010.2325"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-03205-9_2"},{"key":"e_1_3_3_51_2","doi-asserted-by":"crossref","unstructured":"C Hartmann A Lazar J Triesch Where\u2019s the noise? Key features of neuronal variability and inference emerge from self-organized learning. bioRxiv 10.1101\/011296. (2014).","DOI":"10.1101\/011296"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature02078"},{"key":"e_1_3_3_53_2","first-page":"2285","volume-title":"Advances in Neural Information Processing Systems","author":"Bourdoukan R","year":"2012","unstructured":"R Bourdoukan, D Barrett, S Deneve, CK Machens, Learning optimal spike-based representations. Advances in Neural Information Processing Systems, eds F Pereira, C Burges, L Bottou, K Weinberger (Curran Assiciates, Inc., Red Hook, NY) Vol 25, 2285\u20132293 (2012)."},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1162\/NECO_a_00313"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1038\/nphys1508"},{"key":"e_1_3_3_56_2","volume-title":"Causality","author":"Pearl J","year":"2000","unstructured":"J Pearl Causality (Cambridge Univ Press, New York, 2000)."},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1198\/016214508000000193"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-2236(97)01149-1"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1016\/0959-4388(94)90137-6"},{"key":"e_1_3_3_60_2","first-page":"1458","volume-title":"1991 IEEE International Joint Conference on Neural Networks","author":"Schmidhuber J","year":"1991","unstructured":"J Schmidhuber, Curious model-building control systems. 1991 IEEE International Joint Conference on Neural Networks (IEEE Press, NY), pp. 1458\u20131463 (1991)."},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2007.11.026"},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1133687"},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnbot.2013.00025"},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.3389\/fncir.2013.00037"},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2006.890271"},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2012.05.008"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00422-013-0563-5"}],"container-title":["Proceedings of the National Academy of Sciences"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.pnas.org\/syndication\/doi\/10.1073\/pnas.1508400112","content-type":"unspecified","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pnas.org\/doi\/pdf\/10.1073\/pnas.1508400112","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,12]],"date-time":"2024-06-12T01:30:34Z","timestamp":1718155834000},"score":1,"resource":{"primary":{"URL":"https:\/\/pnas.org\/doi\/full\/10.1073\/pnas.1508400112"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,10,26]]},"references-count":67,"journal-issue":{"issue":"45","published-print":{"date-parts":[[2015,11,10]]}},"alternative-id":["10.1073\/pnas.1508400112"],"URL":"https:\/\/doi.org\/10.1073\/pnas.1508400112","relation":{},"ISSN":["0027-8424","1091-6490"],"issn-type":[{"type":"print","value":"0027-8424"},{"type":"electronic","value":"1091-6490"}],"subject":[],"published":{"date-parts":[[2015,10,26]]},"assertion":[{"value":"2015-10-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}