{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,6]],"date-time":"2025-11-06T19:51:17Z","timestamp":1762458677959,"version":"3.38.0"},"reference-count":35,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2001,6,1]],"date-time":"2001-06-01T00:00:00Z","timestamp":991353600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Adaptive Behavior"],"published-print":{"date-parts":[[2001,6]]},"abstract":"<jats:p> We present a computational model of learned avoidance behavior in a one-way avoidance experiment. Our model employs the reinforcement learning paradigm and a temporal-difference algorithm to implement both classically conditioned and instrumentally conditioned components. The role of the classically conditioned component is to develop an expectation of future benefit that is a function of the learning system's state and action. Competition among the instrumentally conditioned components determines the overt behavior generated by the learning system. Our model displays, in simulation, the reduced latency of the avoidance behavior during learning with continuing trials and the resistance to extinction of the avoidance response. These results are consistent with experimentally observed animal behavior. Our model extends the traditional two-process learning mechanism of Mowrer by explicitly defining the mechanisms of proprioceptive feedback, an internal clock, and generalization over the action space. <\/jats:p>","DOI":"10.1177\/105971230200900205","type":"journal-article","created":{"date-parts":[[2009,2,7]],"date-time":"2009-02-07T09:07:12Z","timestamp":1233997632000},"page":"91-104","source":"Crossref","is-referenced-by-count":18,"title":["A Computational Model of Learned Avoidance Behavior in a One-Way Avoidance Experiment"],"prefix":"10.1177","volume":"9","author":[{"given":"Jeffrey D.","family":"Johnson","sequence":"first","affiliation":[]},{"given":"Wei","family":"Li","sequence":"additional","affiliation":[]},{"given":"Jinghong","family":"Li","sequence":"additional","affiliation":[{"name":"University of Toledo, Department of Bioengineering"}]},{"given":"A. Harry","family":"Klopf","sequence":"additional","affiliation":[{"name":"Air Force Research Laboratory"}]}],"member":"179","published-online":{"date-parts":[[2001,6,1]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1901\/jeab.1963.6-s477"},{"key":"atypb2","first-page":"215","volume-title":"Models of information processing in the basal ganglia","author":"Barto, A. G.","year":"1995"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.1983.6313077"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1016\/0165-0173(83)90038-3"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1016\/0361-9230(89)90223-2"},{"key":"atypb6","first-page":"265","volume-title":"Aversion avoidance, and anxiety: Perspective on aversively motivated behavior","author":"Beninger, R. J.","year":"1989"},{"key":"atypb7","first-page":"183","volume-title":"Aversive conditioning and learning","author":"Bolles, R. C.","year":"1970"},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1037\/h0033120"},{"key":"atypb9","doi-asserted-by":"publisher","DOI":"10.1016\/S0079-6123(08)60971-1"},{"key":"atypb10","first-page":"85","volume":"16","author":"Klopf, A. H.","year":"1988","journal-title":"Psychology"},{"key":"atypb11","doi-asserted-by":"publisher","DOI":"10.1177\/105971239300100302"},{"key":"atypb12","doi-asserted-by":"publisher","DOI":"10.1007\/BF02476625"},{"key":"atypb13","volume-title":"Learning and behavior","author":"Mazur, J. E.","year":"1994","edition":"3"},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1901\/jeab.1969.12-187"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-4115(97)80107-0"},{"key":"atypb16","doi-asserted-by":"publisher","DOI":"10.1007\/BF00217657"},{"key":"atypb17","first-page":"102","volume":"17","author":"Mowrer, O. H.","year":"1947","journal-title":"Harvard Educational Review"},{"key":"atypb18","volume-title":"Learning theory and behavior","author":"Mowrer, O. H.","year":"1973","edition":"2"},{"issue":"4","key":"atypb19","first-page":"397","volume":"42","author":"Pacut, A.","year":"1982","journal-title":"Acta Neurobiological Experimentalis"},{"volume-title":"Conditioned reflexes","year":"1927","author":"Pavlov, I. P.","key":"atypb20"},{"volume-title":"Introduction to comparative cognition","year":"1987","author":"Roitblat, H.","key":"atypb21"},{"key":"atypb22","first-page":"31","volume-title":"Reticular information of the brain","author":"Schiebel, M. E.","year":"1958"},{"key":"atypb23","first-page":"577","volume-title":"The neurosciences: A study program","author":"Schiebel, M. E.","year":"1967"},{"volume-title":"Third International Conference on Simulation of Adaptive Behavior","author":"Schmajuk, N. A.","key":"atypb24"},{"key":"atypb25","doi-asserted-by":"publisher","DOI":"10.1177\/105971239700600103"},{"volume-title":"Contemporary approaches to conditioning and learning","year":"1973","author":"Seligman, M. E. P.","key":"atypb26"},{"key":"atypb27","first-page":"448","volume-title":"Operant behavior: Areas of research and application","author":"Sidman, M.","year":"1966"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.1037\/h0058943"},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1037\/h0054540"},{"key":"atypb30","doi-asserted-by":"publisher","DOI":"10.1007\/s002130050982"},{"key":"atypb31","doi-asserted-by":"publisher","DOI":"10.1007\/BF00115009"},{"issue":"8","key":"atypb32","volume":"2","author":"Thorndike, E. L.","year":"1898","journal-title":"Psychological Monographs"},{"volume-title":"Purposive behavior in animals and men","year":"1932","author":"Tolman, E. C.","key":"atypb33"},{"key":"atypb34","unstructured":"Watkins, C. H. (1989). Learning from delayed rewards. Unpublished doctoral dissertation, Cambridge University, Cambridge."},{"key":"atypb35","doi-asserted-by":"publisher","DOI":"10.1037\/0735-7044.100.5.764"}],"container-title":["Adaptive Behavior"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/105971230200900205","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/105971230200900205","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,1]],"date-time":"2025-03-01T21:06:04Z","timestamp":1740863164000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/105971230200900205"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2001,6]]},"references-count":35,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2001,6]]}},"alternative-id":["10.1177\/105971230200900205"],"URL":"https:\/\/doi.org\/10.1177\/105971230200900205","relation":{},"ISSN":["1059-7123","1741-2633"],"issn-type":[{"type":"print","value":"1059-7123"},{"type":"electronic","value":"1741-2633"}],"subject":[],"published":{"date-parts":[[2001,6]]}}}