{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T09:17:14Z","timestamp":1774343834712,"version":"3.50.1"},"reference-count":76,"publisher":"Wiley","license":[{"start":{"date-parts":[[2013,1,1]],"date-time":"2013-01-01T00:00:00Z","timestamp":1356998400000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"funder":[{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["N00014-10-1-0177"],"award-info":[{"award-number":["N00014-10-1-0177"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["MH079485"],"award-info":[{"award-number":["MH079485"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["D10PC20021"],"award-info":[{"award-number":["D10PC20021"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["N00014-10-1-0177"],"award-info":[{"award-number":["N00014-10-1-0177"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["MH079485"],"award-info":[{"award-number":["MH079485"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["D10PC20021"],"award-info":[{"award-number":["D10PC20021"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100011039","name":"Intelligence Advanced Research Projects Activity","doi-asserted-by":"crossref","award":["N00014-10-1-0177"],"award-info":[{"award-number":["N00014-10-1-0177"]}],"id":[{"id":"10.13039\/100011039","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100011039","name":"Intelligence Advanced Research Projects Activity","doi-asserted-by":"crossref","award":["MH079485"],"award-info":[{"award-number":["MH079485"]}],"id":[{"id":"10.13039\/100011039","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100011039","name":"Intelligence Advanced Research Projects Activity","doi-asserted-by":"crossref","award":["D10PC20021"],"award-info":[{"award-number":["D10PC20021"]}],"id":[{"id":"10.13039\/100011039","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computational Intelligence and Neuroscience"],"published-print":{"date-parts":[[2013]]},"abstract":"<jats:p>We address strategic cognitive sequencing, the \u201couter loop\u201d of human cognition: how the brain decides what cognitive process to apply at a given moment to solve complex, multistep cognitive tasks. We argue that this topic has been neglected relative to its importance for systematic reasons but that recent work on how individual brain systems accomplish their computations has set the stage for productively addressing how brain regions coordinate over time to accomplish our most impressive thinking. We present four preliminary neural network models. The first addresses how the prefrontal cortex (PFC) and basal ganglia (BG) cooperate to perform trial-and-error learning of short sequences; the next, how several areas of PFC learn to make predictions of likely reward, and how this contributes to the BG making decisions at the level of strategies. The third models address how PFC, BG, parietal cortex, and hippocampus can work together to memorize sequences of cognitive actions from instruction (or \u201cself-instruction\u201d). The last shows how a constraint satisfaction process can find useful plans. The PFC maintains current and goal states and associates from both of these to find a \u201cbridging\u201d state, an abstract plan. We discuss how these processes could work together to produce strategic cognitive sequencing and discuss future directions in this area.<\/jats:p>","DOI":"10.1155\/2013\/149329","type":"journal-article","created":{"date-parts":[[2013,7,8]],"date-time":"2013-07-08T21:02:48Z","timestamp":1373317368000},"page":"1-18","source":"Crossref","is-referenced-by-count":12,"title":["Strategic Cognitive Sequencing: A Computational Cognitive Neuroscience Approach"],"prefix":"10.1155","volume":"2013","author":[{"given":"Seth A.","family":"Herd","sequence":"first","affiliation":[{"name":"Department of Psychology, University of Colorado Boulder, Boulder, CO 80309, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kai A.","family":"Krueger","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Colorado Boulder, Boulder, CO 80309, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Trenton E.","family":"Kriete","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Colorado Boulder, Boulder, CO 80309, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tsung-Ren","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Colorado Boulder, Boulder, CO 80309, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas E.","family":"Hazy","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Colorado Boulder, Boulder, CO 80309, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Randall C.","family":"O'Reilly","sequence":"additional","affiliation":[{"name":"Department of Psychology, University of Colorado Boulder, Boulder, CO 80309, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","reference":[{"issue":"4","key":"60","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/S1364-6613(97)01042-5","volume":"1","year":"1997","journal-title":"Trends in Cognitive Sciences"},{"issue":"1089","key":"68","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1098\/rstb.1982.0082","volume":"298","year":"1982","journal-title":"Philosophical transactions of the Royal Society of London B"},{"issue":"3","key":"8","doi-asserted-by":"crossref","first-page":"439","DOI":"10.5465\/amr.1978.4305717","volume":"3","year":"1978","journal-title":"The Academy of Management Review"},{"key":"71","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1146\/annurev.ps.28.020177.000245","volume":"28","year":"1977","journal-title":"Annual Review of Psychology"},{"issue":"1","key":"12","first-page":"25","volume":"13","year":"2010","journal-title":"Educational Technology & Society"},{"key":"79","doi-asserted-by":"publisher","DOI":"10.1016\/S0926-6410(03)00191-5"},{"key":"49","first-page":"283","volume-title":"You can't play 20 questions with nature and win: projective comments on the papers of this symposium","year":"1973"},{"issue":"1","key":"72","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1037\/0033-295X.96.1.125","volume":"96","year":"1989","journal-title":"Psychological Review"},{"key":"62","doi-asserted-by":"publisher","DOI":"10.1006\/ijhc.2000.0434"},{"key":"77","doi-asserted-by":"publisher","DOI":"10.1152\/physrev.00014.2007"},{"key":"14","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/122.10.1973"},{"key":"80","doi-asserted-by":"publisher","DOI":"10.1016\/S1053-8119(02)00010-1"},{"issue":"5","key":"15","doi-asserted-by":"crossref","first-page":"1020","DOI":"10.1093\/brain\/124.5.1020","volume":"124","year":"2001","journal-title":"Brain"},{"key":"70","doi-asserted-by":"publisher","DOI":"10.1038\/nature05470"},{"key":"55","year":"2000"},{"key":"59","volume-title":"The leabra cognitive architecture: how to play 20 principles with nature and win!"},{"key":"48","year":"1972"},{"key":"2","year":"1993"},{"key":"47","year":"2005"},{"key":"73","doi-asserted-by":"publisher","DOI":"10.1016\/j.bbr.2009.11.044"},{"key":"69","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2010.07.002"},{"key":"41","year":"1987"},{"key":"38","doi-asserted-by":"publisher","DOI":"10.1080\/09528130802319128"},{"key":"3","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.111.4.1036"},{"key":"5","year":"2007"},{"key":"83","doi-asserted-by":"publisher","DOI":"10.1038\/nrn1919"},{"issue":"2","key":"28","doi-asserted-by":"crossref","first-page":"137","DOI":"10.3758\/CABN.1.2.137","volume":"1","year":"2001","journal-title":"Cognitive, Affective and Behavioral Neuroscience"},{"key":"29","doi-asserted-by":"publisher","DOI":"10.1126\/science.1102941"},{"key":"34","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroscience.2005.04.067"},{"key":"35","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2007.2055"},{"key":"54","doi-asserted-by":"publisher","DOI":"10.1162\/089976606775093909"},{"key":"66","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.neuro.31.060407.125642"},{"key":"1","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1146\/annurev.ne.09.030186.002041","volume":"9","year":"1986","journal-title":"Annual Review of Neuroscience"},{"key":"27","doi-asserted-by":"publisher","DOI":"10.1162\/0898929052880093"},{"key":"56","doi-asserted-by":"publisher","DOI":"10.1037\/0735-7044.121.1.31"},{"key":"36","doi-asserted-by":"publisher","DOI":"10.1016\/j.neubiorev.2009.11.019"},{"issue":"4","key":"32","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/0013-4694(71)90111-8","volume":"30","year":"1971","journal-title":"Electroencephalography and Clinical Neurophysiology"},{"issue":"1","key":"46","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1038\/35036228","volume":"1","year":"2000","journal-title":"Nature Reviews Neuroscience"},{"issue":"1","key":"53","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1152\/jn.1986.56.1.63","volume":"56","year":"1986","journal-title":"Journal of Neurophysiology"},{"key":"19","doi-asserted-by":"publisher","DOI":"10.1016\/j.neubiorev.2003.11.011"},{"key":"67","doi-asserted-by":"publisher","DOI":"10.1126\/science.275.5306.1593"},{"key":"74","first-page":"497","volume-title":"Time-derivative models of pavlovian reinforcement","year":"1990"},{"key":"52","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(03)00169-7"},{"key":"75","year":"1998"},{"key":"17","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(02)00963-7"},{"issue":"2","key":"57","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1016\/j.conb.2010.01.008","volume":"20","year":"2010","journal-title":"Current Opinion in Neurobiology"},{"key":"11","doi-asserted-by":"publisher","DOI":"10.1162\/jocn_a_00047"},{"key":"39","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(02)00047-3"},{"key":"31","doi-asserted-by":"publisher","DOI":"10.1007\/s00426-007-0113-7"},{"key":"81","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.neuro.30.051606.094334"},{"key":"51","doi-asserted-by":"publisher","DOI":"10.1111\/j.1460-9568.2012.08023.x"},{"key":"13","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.4515-08.2009"},{"key":"40","doi-asserted-by":"publisher","DOI":"10.1037\/a0023575"},{"key":"30","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.113.2.300"},{"key":"37","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1114415109"},{"key":"16","doi-asserted-by":"publisher","DOI":"10.1016\/j.biopsych.2010.03.026"},{"issue":"5","key":"22","doi-asserted-by":"crossref","first-page":"864","DOI":"10.3758\/s13423-012-0225-y","volume":"19","year":"2012","journal-title":"Psychonomic Bulletin & Review"},{"key":"4","year":"1983"},{"key":"26","year":"1967"},{"key":"61","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2022"},{"issue":"5","key":"24","doi-asserted-by":"crossref","first-page":"1841","DOI":"10.1523\/JNEUROSCI.18-05-01841.1998","volume":"18","year":"1998","journal-title":"The Journal of Neuroscience"},{"key":"43","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2009.07.030"},{"key":"9","doi-asserted-by":"publisher","DOI":"10.1111\/j.1551-6709.2009.01010.x"},{"key":"21","doi-asserted-by":"publisher","DOI":"10.1016\/j.brainres.2009.07.007"},{"key":"45","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1014938108"},{"key":"82","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1117189108"},{"key":"63","year":"2004"},{"key":"64","year":"1995"},{"issue":"3","key":"6","first-page":"47","volume":"22","year":"2001","journal-title":"AI Magazine"},{"issue":"2","key":"65","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/0004-3702(74)90026-5","volume":"5","year":"1974","journal-title":"Artificial Intelligence"},{"key":"20","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(01)00128-X"},{"issue":"1-2","key":"10","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/S0004-3702(96)00047-1","volume":"90","year":"1997","journal-title":"Artificial Intelligence"},{"issue":"1","key":"18","first-page":"1","volume":"1","year":"2007","journal-title":"Frontiers in Computational Neuroscience"},{"key":"78","volume-title":"Learning to learn: introduction and overview","year":"1998"},{"issue":"1","key":"7","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1023\/A:1007327622663","volume":"28","year":"1997","journal-title":"Machine Learning"},{"key":"58","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2013.00124"}],"container-title":["Computational Intelligence and Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/cin\/2013\/149329.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/cin\/2013\/149329.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/cin\/2013\/149329.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,5,8]],"date-time":"2020-05-08T17:50:42Z","timestamp":1588960242000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.hindawi.com\/journals\/cin\/2013\/149329\/"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013]]},"references-count":76,"alternative-id":["149329","149329"],"URL":"https:\/\/doi.org\/10.1155\/2013\/149329","relation":{},"ISSN":["1687-5265","1687-5273"],"issn-type":[{"value":"1687-5265","type":"print"},{"value":"1687-5273","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013]]}}}