{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,31]],"date-time":"2025-10-31T07:09:20Z","timestamp":1761894560474},"reference-count":33,"publisher":"World Scientific Pub Co Pte Lt","issue":"02","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Human. Robot."],"published-print":{"date-parts":[[2007,6]]},"abstract":"<jats:p> The inherent value system of a developmental agent enables autonomous mental development to take place right after the agent's \"birth.\" Biologically, it is not clear what basic components constitute a value system. In the computational model introduced here, we propose that inherent value systems should have at least three basic components: punishment, reward and novelty with decreasing weights from the first component to the last. Punishments and rewards are temporally sparse but novelty is temporally dense. We present a biologically inspired computational architecture that guides development of sensorimotor skills through real-time interactions with the environments, driven by an inborn value system. The inherent value system has been successfully tested on an artificial agent in a simulation environment and a robot in the real world. <\/jats:p>","DOI":"10.1142\/s0219843607001011","type":"journal-article","created":{"date-parts":[[2007,7,5]],"date-time":"2007-07-05T09:38:16Z","timestamp":1183628296000},"page":"407-433","source":"Crossref","is-referenced-by-count":20,"title":["INHERENT VALUE SYSTEMS FOR AUTONOMOUS MENTAL DEVELOPMENT"],"prefix":"10.1142","volume":"04","author":[{"given":"XIAO","family":"HUANG","sequence":"first","affiliation":[{"name":"Embodied Intelligence Lab, Computer Science and Engineering Department, Michigan State University, East Lansing, MI, 48824, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"JUYANG","family":"WENG","sequence":"additional","affiliation":[{"name":"Embodied Intelligence Lab, Computer Science and Engineering Department, Michigan State University, East Lansing, MI, 48824, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2011,11,20]]},"reference":[{"key":"rf1","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/8.4.346"},{"key":"rf2","doi-asserted-by":"publisher","DOI":"10.1016\/S0921-8890(01)00157-9"},{"key":"rf3","first-page":"279","volume":"23","author":"Asada M.","journal-title":"Mach. Learn."},{"key":"rf5","volume-title":"Bayley Scales of Infant Development","author":"Bayley N.","year":"1993"},{"key":"rf6","unstructured":"V.\u00a0Castellugcci and E.\u00a0Kandel, Habituation: Perspective from Child Development, Animal Behavior and Neurophysiology, eds. T.\u00a0Tighe and R.\u00a0Leaton (Lawrence Erlbaum Associates, Hillsdale, NJ, 1976)\u00a0pp. 1\u201348."},{"key":"rf7","unstructured":"L.\u00a0Cohen, Habituation: Perspective from Child Development, Animal Behavior and Neurophysiology, eds. T.\u00a0Tighe and R.\u00a0Leaton (Lawrence Erlbaum Associates, Hillsdale, NJ, 1976)\u00a0pp. 207\u2013238."},{"key":"rf8","volume-title":"The Principles of Learning and Behavior","author":"Domjan M.","year":"1998"},{"key":"rf9","volume-title":"Cognitive Development","author":"Flavell J. H.","year":"1993"},{"key":"rf11","doi-asserted-by":"publisher","DOI":"10.1109\/34.730558"},{"key":"rf12","series-title":"Advances in Neural Information Processing Systems","first-page":"131","author":"Kakade S.","year":"2000"},{"key":"rf13","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(02)00048-5"},{"key":"rf14","unstructured":"P. W.\u00a0Kaplan, J. S.\u00a0Werner and J. W.\u00a0Rudy, Advances in Infancy Research, eds. C.\u00a0Rovee-Collier and L.\u00a0Lipsit (ABLEX Publishing Corporation, Norwood, NJ, 1990)\u00a0pp. 61\u2013110."},{"key":"rf15","first-page":"219","volume":"4","author":"Koch C.","journal-title":"Human Neurobiol."},{"key":"rf16","doi-asserted-by":"publisher","DOI":"10.1080\/09540090310001655110"},{"key":"rf18","unstructured":"H.\u00a0Ogmen, Optimality in Biological and Artificial Networks? eds. D.\u00a0Levine and R.\u00a0Elsberry (Lawrence Erlbaum Associates, Hillsdale, NJ, 1997)\u00a0pp. 363\u2013395."},{"key":"rf21","volume-title":"Habituation","author":"Peeke H.","year":"1973"},{"key":"rf22","doi-asserted-by":"publisher","DOI":"10.1037\/11494-000"},{"key":"rf23","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.17-01-00334.1997"},{"key":"rf24","volume-title":"Artificial Intelligence: A Modern Approach","author":"Russell S.","year":"1995"},{"key":"rf25","doi-asserted-by":"publisher","DOI":"10.1023\/A:1013298507114"},{"key":"rf27","doi-asserted-by":"publisher","DOI":"10.1038\/35044563"},{"key":"rf29","doi-asserted-by":"publisher","DOI":"10.1177\/105971230000800203"},{"key":"rf30","doi-asserted-by":"publisher","DOI":"10.1038\/261146a0"},{"key":"rf31","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4695(199910)41:1<33::AID-NEU6>3.0.CO;2-1"},{"key":"rf32","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.88.2.135"},{"key":"rf33","doi-asserted-by":"crossref","DOI":"10.1109\/TNN.1998.712192","volume-title":"Reinforcement Learning \u2014 An Introduction","author":"Sutton R. S.","year":"1998"},{"key":"rf34","doi-asserted-by":"publisher","DOI":"10.1126\/science.3738519"},{"key":"rf35","volume-title":"Exploration in Active Learning","author":"Thrun S.","year":"1995"},{"key":"rf36","first-page":"279","volume":"8","author":"Watkins C. J.","journal-title":"Mach. Learn."},{"key":"rf37","doi-asserted-by":"publisher","DOI":"10.1142\/S0219843604000149"},{"key":"rf38","doi-asserted-by":"publisher","DOI":"10.1109\/MCI.2006.1672985"},{"key":"rf40","doi-asserted-by":"publisher","DOI":"10.1126\/science.291.5504.599"},{"key":"rf41","unstructured":"D.\u00a0Zeaman, Habituation: Perspective from Child Development, Animal Behavior and Neurophysiology, eds. T.\u00a0Tighe and R.\u00a0Leaton (Lawrence Erlbaum Associates, Hillsdale, NJ, 1976)\u00a0pp. 297\u2013320."}],"container-title":["International Journal of Humanoid Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0219843607001011","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,8,7]],"date-time":"2019-08-07T00:56:46Z","timestamp":1565139406000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0219843607001011"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2007,6]]},"references-count":33,"journal-issue":{"issue":"02","published-online":{"date-parts":[[2011,11,20]]},"published-print":{"date-parts":[[2007,6]]}},"alternative-id":["10.1142\/S0219843607001011"],"URL":"https:\/\/doi.org\/10.1142\/s0219843607001011","relation":{},"ISSN":["0219-8436","1793-6942"],"issn-type":[{"value":"0219-8436","type":"print"},{"value":"1793-6942","type":"electronic"}],"subject":[],"published":{"date-parts":[[2007,6]]}}}