{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T04:21:05Z","timestamp":1777522865616,"version":"3.51.4"},"reference-count":42,"publisher":"SAGE Publications","issue":"3","license":[{"start":{"date-parts":[[2019,5,31]],"date-time":"2019-05-31T00:00:00Z","timestamp":1559260800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Adaptive Behavior"],"published-print":{"date-parts":[[2020,6]]},"abstract":"<jats:p>For an autonomous agent, the inputs are the sensory data that inform the agent of the state of the world, and the outputs are their actions, which act on the world and consequently produce new sensory inputs. The agent only knows of its own actions via their effect on future inputs; therefore desired states, and error signals, are most naturally defined in terms of the inputs. Most machine learning algorithms, however, operate in terms of desired outputs. For example, backpropagation takes target output values and propagates the corresponding error backwards through the network in order to change the weights. In closed loop settings, it is far more obvious how to define desired sensory inputs than desired actions, however. To train a deep network using errors defined in the input space would call for an algorithm that can propagate those errors forwards through the network, from input layer to output layer, in much the same way that activations are propagated. In this article, we present a novel learning algorithm which performs such \u2018forward-propagation\u2019 of errors. We demonstrate its performance, first in a simple line follower and then in a 1st person shooter game.<\/jats:p>","DOI":"10.1177\/1059712319851070","type":"journal-article","created":{"date-parts":[[2019,5,31]],"date-time":"2019-05-31T05:39:02Z","timestamp":1559281142000},"page":"181-194","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":3,"title":["Forward propagation closed loop learning"],"prefix":"10.1177","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8157-998X","authenticated-orcid":false,"given":"Bernd","family":"Porr","sequence":"first","affiliation":[{"name":"Glasgow Neuro LTD. Glasgow, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paul","family":"Miller","sequence":"additional","affiliation":[{"name":"Glasgow Neuro LTD. Glasgow, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2019,5,31]]},"reference":[{"key":"bibr1-1059712319851070","doi-asserted-by":"publisher","DOI":"10.5962\/bhl.title.5851"},{"key":"bibr2-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1016\/0006-8993(79)91001-1"},{"key":"bibr3-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1016\/S0301-0082(99)00006-4"},{"key":"bibr4-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1016\/j.physbeh.2004.04.034"},{"key":"bibr5-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1113\/jphysiol.1973.sp010273"},{"key":"bibr6-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2010.09.001"},{"key":"bibr7-1059712319851070","volume-title":"Theoretical Neuroscience","author":"Dayan P.","year":"2001"},{"key":"bibr8-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4522(93)90115-V"},{"key":"bibr9-1059712319851070","first-page":"3338","volume-title":"Advances in neural information processing systems","volume":"27","author":"Guo X.","year":"2014"},{"key":"bibr10-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-1599-1_162"},{"key":"bibr11-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.15-07-04851.1995"},{"key":"bibr12-1059712319851070","volume-title":"The organization of behavior: A neuropsychological study","author":"Hebb D. O.","year":"1949"},{"key":"bibr13-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0145288"},{"key":"bibr14-1059712319851070","first-page":"265","volume-title":"Neural networks for computing: Snowbird, Utah, AIP conference proceedings","volume":"151","author":"Klopf A. H.","year":"1986"},{"key":"bibr15-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1007\/s00422-007-0176-y"},{"key":"bibr16-1059712319851070","first-page":"1940","volume":"47","author":"Lettvin J.","year":"1959","journal-title":"Proceedings of the Institute of Radio Engineers"},{"key":"bibr17-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms13276"},{"key":"bibr18-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1222-17.2017"},{"key":"bibr19-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1109\/2.36"},{"key":"bibr20-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1152\/jn.00964.2016"},{"key":"bibr21-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1101\/cshperspect.a005710"},{"key":"bibr22-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1126\/science.285.5435.1870"},{"key":"bibr23-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-009-8947-4"},{"key":"bibr24-1059712319851070","doi-asserted-by":"publisher","DOI":"10.2514\/6.1986-2160"},{"key":"bibr25-1059712319851070","doi-asserted-by":"publisher","DOI":"10.3389\/fnsyn.2017.00002"},{"key":"bibr26-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2007.02.026"},{"key":"bibr27-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1016\/0896-6273(92)90248-C"},{"key":"bibr28-1059712319851070","volume-title":"Feedback control systems","author":"Phillips C. L.","year":"2000"},{"key":"bibr29-1059712319851070","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.2644304."},{"key":"bibr30-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1162\/08997660360581930"},{"key":"bibr31-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1162\/08997660360581921"},{"key":"bibr32-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1108\/03684920510575762"},{"key":"bibr33-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2006.18.6.1380"},{"key":"bibr34-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1038\/nrn.2018.6"},{"key":"bibr35-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1038\/323533a0"},{"key":"bibr36-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1126\/science.275.5306.1593"},{"key":"bibr37-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1038\/78829"},{"key":"bibr38-1059712319851070","volume-title":"Proceedings of the Ninth Annual Conference of the Cognitive Science Society","author":"Sutton R. S.","year":"1987"},{"key":"bibr39-1059712319851070","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton R. S.","year":"1998"},{"key":"bibr40-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1088\/0954-898X_2_2_004"},{"key":"bibr41-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992698"},{"key":"bibr42-1059712319851070","doi-asserted-by":"publisher","DOI":"10.1016\/j.psychres.2017.12.021"}],"container-title":["Adaptive Behavior"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1059712319851070","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/1059712319851070","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1059712319851070","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T16:18:53Z","timestamp":1777393133000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1059712319851070"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,5,31]]},"references-count":42,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,6]]}},"alternative-id":["10.1177\/1059712319851070"],"URL":"https:\/\/doi.org\/10.1177\/1059712319851070","relation":{},"ISSN":["1059-7123","1741-2633"],"issn-type":[{"value":"1059-7123","type":"print"},{"value":"1741-2633","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,5,31]]}}}