{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,8]],"date-time":"2026-03-08T23:29:55Z","timestamp":1773012595137,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1012119","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2024,5,28]],"date-time":"2024-05-28T00:00:00Z","timestamp":1716854400000}}],"reference-count":83,"publisher":"Public Library of Science (PLoS)","issue":"5","license":[{"start":{"date-parts":[[2024,5,15]],"date-time":"2024-05-15T00:00:00Z","timestamp":1715731200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"NIH","award":["R21MH132974"],"award-info":[{"award-number":["R21MH132974"]}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Computational cognitive models have been used extensively to formalize cognitive processes. Model parameters offer a simple way to quantify individual differences in how humans process information. Similarly, model comparison allows researchers to identify which theories, embedded in different models, provide the best accounts of the data. Cognitive modeling uses statistical tools to quantitatively relate models to data that often rely on computing\/estimating the likelihood of the data under the model. However, this likelihood is computationally intractable for a substantial number of models. These relevant models may embody reasonable theories of cognition, but are often under-explored due to the limited range of tools available to relate them to data. We contribute to filling this gap in a simple way using artificial neural networks (ANNs) to map data directly onto model identity and parameters, bypassing the likelihood estimation. We test our instantiation of an ANN as a cognitive model fitting tool on classes of cognitive models with strong inter-trial dependencies (such as reinforcement learning models), which offer unique challenges to most methods. We show that we can adequately perform both parameter estimation and model identification using our ANN approach, including for models that cannot be fit using traditional likelihood-based methods. We further discuss our work in the context of the ongoing research leveraging simulation-based approaches to parameter estimation and model identification, and how these approaches broaden the class of cognitive models researchers can quantitatively investigate.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1012119","type":"journal-article","created":{"date-parts":[[2024,5,15]],"date-time":"2024-05-15T13:51:07Z","timestamp":1715781067000},"page":"e1012119","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":17,"title":["Artificial neural networks for model identification and parameter estimation in computational cognitive models"],"prefix":"10.1371","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2044-048X","authenticated-orcid":true,"given":"Milena","family":"Rmus","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ti-Fen","family":"Pan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liyu","family":"Xia","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anne G. E.","family":"Collins","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2024,5,15]]},"reference":[{"issue":"6","key":"pcbi.1012119.ref001","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1016\/j.tics.2017.03.011","article-title":"The importance of falsification in computational cognitive modeling","volume":"21","author":"S Palminteri","year":"2017","journal-title":"Trends in cognitive sciences"},{"issue":"1","key":"pcbi.1012119.ref002","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.tics.2011.11.018","article-title":"Computational psychiatry","volume":"16","author":"PR Montague","year":"2012","journal-title":"Trends in cognitive sciences"},{"key":"pcbi.1012119.ref003","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/2013.001.0001","volume-title":"Computational developmental psychology","author":"TR Shultz","year":"2003"},{"issue":"4","key":"pcbi.1012119.ref004","doi-asserted-by":"crossref","first-page":"605","DOI":"10.3758\/BF03196751","article-title":"Modeling individual differences in cognition","volume":"12","author":"MD Lee","year":"2005","journal-title":"Psychonomic Bulletin & Review"},{"key":"pcbi.1012119.ref005","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1007\/978-1-4612-1694-0_15","article-title":"Information theory and an extension of the maximum likelihood principle","author":"H Akaike","year":"1998","journal-title":"Selected papers of hirotugu akaike"},{"key":"pcbi.1012119.ref006","article-title":"Estimating parameters of structural models using neural networks","author":"Y Wei","year":"2022","journal-title":"USC Marshall School of Business Research Paper"},{"key":"pcbi.1012119.ref007","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1016\/j.neuroimage.2014.09.018","article-title":"Cognitive flexibility in adolescence: Neural and behavioral mechanisms of reward prediction error processing in adaptive decision making during development","volume":"104","author":"TU Hauser","year":"2015","journal-title":"NeuroImage"},{"issue":"5","key":"pcbi.1012119.ref008","doi-asserted-by":"crossref","first-page":"1601","DOI":"10.1111\/cdev.13791","article-title":"Flexibility in valenced reinforcement learning computations across development","volume":"93","author":"K Nussenbaum","year":"2022","journal-title":"Child development"},{"key":"pcbi.1012119.ref009","doi-asserted-by":"crossref","first-page":"e85243","DOI":"10.7554\/eLife.85243","article-title":"Age-related differences in prefrontal glutamate are associated with increased working memory decay that gives the appearance of learning deficits","volume":"12","author":"M Rmus","year":"2023","journal-title":"Elife"},{"key":"pcbi.1012119.ref010","doi-asserted-by":"crossref","first-page":"253","DOI":"10.3389\/fnins.2013.00253","article-title":"Of goals and habits: age-related and individual differences in goal-directed decision-making","volume":"7","author":"B Eppinger","year":"2013","journal-title":"Frontiers in neuroscience"},{"key":"pcbi.1012119.ref011","doi-asserted-by":"crossref","first-page":"800290","DOI":"10.3389\/fpsyt.2022.800290","article-title":"Impulsivity relates to multi-trial choice strategy in probabilistic reversal learning","volume":"13","author":"AR Zou","year":"2022","journal-title":"Frontiers in Psychiatry"},{"issue":"41","key":"pcbi.1012119.ref012","doi-asserted-by":"crossref","first-page":"13747","DOI":"10.1523\/JNEUROSCI.0989-14.2014","article-title":"Working memory contributions to reinforcement learning impairments in schizophrenia","volume":"34","author":"AG Collins","year":"2014","journal-title":"Journal of Neuroscience"},{"key":"pcbi.1012119.ref013","doi-asserted-by":"crossref","first-page":"e11305","DOI":"10.7554\/eLife.11305","article-title":"Characterizing a psychiatric symptom dimension related to deficits in goal-directed control","volume":"5","author":"CM Gillan","year":"2016","journal-title":"elife"},{"issue":"4","key":"pcbi.1012119.ref014","doi-asserted-by":"crossref","first-page":"1092","DOI":"10.1016\/j.neuroscience.2009.07.033","article-title":"Probabilistic reversal learning is impaired in Parkinson\u2019s disease","volume":"163","author":"DA Peterson","year":"2009","journal-title":"Neuroscience"},{"key":"pcbi.1012119.ref015","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1016\/j.neubiorev.2015.05.005","article-title":"Reinforcement learning in depression: A review of computational research","volume":"55","author":"C Chen","year":"2015","journal-title":"Neuroscience & Biobehavioral Reviews"},{"issue":"7","key":"pcbi.1012119.ref016","doi-asserted-by":"crossref","first-page":"1343","DOI":"10.1080\/02699931.2022.2109600","article-title":"The effects of induced positive and negative affect on Pavlovian-instrumental interactions","volume":"36","author":"I Weber","year":"2022","journal-title":"Cognition and Emotion"},{"key":"pcbi.1012119.ref017","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.bbr.2015.01.033","article-title":"Testing the role of reward and punishment sensitivity in avoidance behavior: a computational modeling approach","volume":"283","author":"J Sheynin","year":"2015","journal-title":"Behavioural Brain Research"},{"issue":"1","key":"pcbi.1012119.ref018","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/S0022-2496(02)00028-7","article-title":"Tutorial on maximum likelihood estimation","volume":"47","author":"IJ Myung","year":"2003","journal-title":"Journal of mathematical Psychology"},{"issue":"2","key":"pcbi.1012119.ref019","doi-asserted-by":"crossref","first-page":"61","DOI":"10.20982\/tqmp.09.2.p061","article-title":"Improving maximum likelihood estimation using prior probabilities: A tutorial on maximum a posteriori estimation and an examination of the weibull distribution","volume":"9","author":"D Cousineau","year":"2013","journal-title":"Tutorials in Quantitative Methods for Psychology"},{"key":"pcbi.1012119.ref020","article-title":"Troubleshooting Bayesian cognitive models","author":"B Baribault","year":"2023","journal-title":"Psychological Methods"},{"issue":"1","key":"pcbi.1012119.ref021","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jmp.2010.08.013","article-title":"How cognitive modeling can benefit from hierarchical Bayesian models","volume":"55","author":"MD Lee","year":"2011","journal-title":"Journal of Mathematical Psychology"},{"key":"pcbi.1012119.ref022","first-page":"461","article-title":"Estimating the dimension of a model","author":"G Schwarz","year":"1978","journal-title":"The annals of statistics"},{"issue":"6","key":"pcbi.1012119.ref023","doi-asserted-by":"crossref","first-page":"e1007043","DOI":"10.1371\/journal.pcbi.1007043","article-title":"Hierarchical Bayesian inference for concurrent model fitting and comparison for group studies","volume":"15","author":"P Piray","year":"2019","journal-title":"PLoS computational biology"},{"key":"pcbi.1012119.ref024","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1016\/j.neuroimage.2013.08.065","article-title":"Bayesian model selection for group studies\u2014revisited","volume":"84","author":"L Rigoux","year":"2014","journal-title":"Neuroimage"},{"issue":"3","key":"pcbi.1012119.ref025","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1093\/cercor\/bhr114","article-title":"Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 1: computational analysis","volume":"22","author":"MJ Frank","year":"2012","journal-title":"Cerebral cortex"},{"issue":"8","key":"pcbi.1012119.ref026","doi-asserted-by":"crossref","first-page":"e1003779","DOI":"10.1371\/journal.pcbi.1003779","article-title":"Optimal behavioral hierarchy","volume":"10","author":"A Solway","year":"2014","journal-title":"PLoS computational biology"},{"issue":"47","key":"pcbi.1012119.ref027","doi-asserted-by":"crossref","first-page":"29381","DOI":"10.1073\/pnas.1912330117","article-title":"Computational evidence for hierarchically structured reinforcement learning in humans","volume":"117","author":"MK Eckstein","year":"2020","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"2","key":"pcbi.1012119.ref028","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1038\/s41593-021-01007-z","article-title":"Mice alternate between discrete strategies during perceptual decision-making","volume":"25","author":"ZC Ashwood","year":"2022","journal-title":"Nature Neuroscience"},{"issue":"1","key":"pcbi.1012119.ref029","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1038\/s41562-020-00971-z","article-title":"Imprecise neural computations as a source of adaptive behaviour in volatile environments","volume":"5","author":"C Findling","year":"2021","journal-title":"Nature Human Behaviour"},{"issue":"12","key":"pcbi.1012119.ref030","doi-asserted-by":"crossref","first-page":"e1008483","DOI":"10.1371\/journal.pcbi.1008483","article-title":"Unbiased and efficient log-likelihood estimation with inverse binomial sampling","volume":"16","author":"B van Opheusden","year":"2020","journal-title":"PLoS computational biology"},{"issue":"5","key":"pcbi.1012119.ref031","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1109\/MSP.2003.1236770","article-title":"Particle filtering","volume":"20","author":"PM Djuric","year":"2003","journal-title":"IEEE signal processing magazine"},{"key":"pcbi.1012119.ref032","unstructured":"Minka TP. Expectation propagation for approximate Bayesian inference. arXiv preprint arXiv:13012294. 2013;."},{"issue":"1","key":"pcbi.1012119.ref033","doi-asserted-by":"crossref","first-page":"e1002803","DOI":"10.1371\/journal.pcbi.1002803","article-title":"Approximate bayesian computation","volume":"9","author":"M Sunn\u00e5ker","year":"2013","journal-title":"PLoS computational biology"},{"key":"pcbi.1012119.ref034","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1016\/j.neuroimage.2013.01.048","article-title":"A Bayesian framework for simultaneously modeling neural and behavioral data","volume":"72","author":"BM Turner","year":"2013","journal-title":"NeuroImage"},{"key":"pcbi.1012119.ref035","doi-asserted-by":"crossref","first-page":"227","DOI":"10.3758\/s13423-013-0530-0","article-title":"A generalized, likelihood-free method for posterior estimation","volume":"21","author":"BM Turner","year":"2014","journal-title":"Psychonomic bulletin & review"},{"key":"pcbi.1012119.ref036","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-72425-6","volume-title":"Likelihood-free methods for cognitive science","author":"JJ Palestro","year":"2018"},{"issue":"1","key":"pcbi.1012119.ref037","first-page":"e66","article-title":"Fundamentals and recent developments in approximate Bayesian computation","volume":"66","author":"J Lintusaari","year":"2017","journal-title":"Systematic biology"},{"key":"pcbi.1012119.ref038","unstructured":"Lavin A, Krakauer D, Zenil H, Gottschlich J, Mattson T, Brehmer J, et al. Simulation intelligence: Towards a new generation of scientific methods. arXiv preprint arXiv:211203235. 2021;."},{"issue":"48","key":"pcbi.1012119.ref039","doi-asserted-by":"crossref","first-page":"30055","DOI":"10.1073\/pnas.1912789117","article-title":"The frontier of simulation-based inference","volume":"117","author":"K Cranmer","year":"2020","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"4","key":"pcbi.1012119.ref040","doi-asserted-by":"crossref","first-page":"1452","DOI":"10.1109\/TNNLS.2020.3042395","article-title":"BayesFlow: Learning complex stochastic models with invertible neural networks","volume":"33","author":"ST Radev","year":"2020","journal-title":"IEEE transactions on neural networks and learning systems"},{"key":"pcbi.1012119.ref041","unstructured":"Radev ST, Voss A, Wieschen EM, B\u00fcrkner PC. Amortized Bayesian Inference for Models of Cognition. arXiv preprint arXiv:200503899. 2020;."},{"key":"pcbi.1012119.ref042","first-page":"1595","article-title":"Learning summary statistic for approximate Bayesian computation via deep neural network","author":"B Jiang","year":"2017","journal-title":"Statistica Sinica"},{"key":"pcbi.1012119.ref043","unstructured":"Chen Y, Zhang D, Gutmann M, Courville A, Zhu Z. Neural approximate sufficient statistics for implicit models. arXiv preprint arXiv:201010079. 2020;."},{"issue":"3","key":"pcbi.1012119.ref044","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1111\/j.1467-9868.2011.01010.x","article-title":"Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation","volume":"74","author":"P Fearnhead","year":"2012","journal-title":"Journal of the Royal Statistical Society Series B: Statistical Methodology"},{"key":"pcbi.1012119.ref045","article-title":"Amortized bayesian model comparison with evidential deep learning","author":"ST Radev","year":"2021","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"pcbi.1012119.ref046","unstructured":"Schmitt M, B\u00fcrkner PC, K\u00f6the U, Radev ST. Detecting model misspecification in amortized Bayesian inference with neural networks. arXiv preprint arXiv:211208866. 2021;."},{"key":"pcbi.1012119.ref047","doi-asserted-by":"crossref","first-page":"e65074","DOI":"10.7554\/eLife.65074","article-title":"Likelihood approximation networks (LANs) for fast inference of simulation models in cognitive neuroscience","volume":"10","author":"A Fengler","year":"2021","journal-title":"Elife"},{"key":"pcbi.1012119.ref048","doi-asserted-by":"crossref","first-page":"e77220","DOI":"10.7554\/eLife.77220","article-title":"Flexible and efficient simulation-based inference for models of decision-making","volume":"11","author":"J Boelts","year":"2022","journal-title":"Elife"},{"key":"pcbi.1012119.ref049","doi-asserted-by":"crossref","first-page":"100418","DOI":"10.1016\/j.jocm.2023.100418","article-title":"How to ask twenty questions and win: Machine learning tools for assessing preferences from small samples of willingness-to-pay prices","volume":"48","author":"K Sokratous","year":"2023","journal-title":"Journal of choice modelling"},{"issue":"3","key":"pcbi.1012119.ref050","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1007\/s42113-023-00167-4","article-title":"A general integrative neurocognitive modeling framework to jointly describe EEG and decision-making on single trials","volume":"6","author":"A Ghaderi-Kangavari","year":"2023","journal-title":"Computational Brain & Behavior"},{"key":"pcbi.1012119.ref051","doi-asserted-by":"crossref","first-page":"107762","DOI":"10.1016\/j.csda.2023.107762","article-title":"Neural networks for parameter estimation in intractable models","volume":"185","author":"A Lenzi","year":"2023","journal-title":"Computational Statistics & Data Analysis"},{"key":"pcbi.1012119.ref052","article-title":"Disentangled behavioural representations","volume":"32","author":"A Dezfouli","year":"2019","journal-title":"Advances in neural information processing systems"},{"issue":"32","key":"pcbi.1012119.ref053","doi-asserted-by":"crossref","first-page":"8360","DOI":"10.1523\/JNEUROSCI.1010-06.2006","article-title":"The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans","volume":"26","author":"AN Hampton","year":"2006","journal-title":"Journal of Neuroscience"},{"issue":"2","key":"pcbi.1012119.ref054","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1093\/cercor\/bhn098","article-title":"Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making","volume":"19","author":"J Gl\u00e4scher","year":"2009","journal-title":"Cerebral cortex"},{"key":"pcbi.1012119.ref055","doi-asserted-by":"crossref","DOI":"10.1017\/9781108917407","volume-title":"Bayesian filtering and smoothing","author":"S S\u00e4rkk\u00e4","year":"2023"},{"issue":"6","key":"pcbi.1012119.ref056","doi-asserted-by":"crossref","first-page":"2407","DOI":"10.1523\/JNEUROSCI.1989-14.2015","article-title":"Reversal learning and dopamine: a bayesian perspective","volume":"35","author":"VD Costa","year":"2015","journal-title":"Journal of Neuroscience"},{"issue":"3","key":"pcbi.1012119.ref057","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1016\/j.cognition.2010.11.015","article-title":"A tutorial introduction to Bayesian models of cognitive development","volume":"120","author":"A Perfors","year":"2011","journal-title":"Cognition"},{"key":"pcbi.1012119.ref058","first-page":"14927","article-title":"Deep evidential regression","volume":"33","author":"A Amini","year":"2020","journal-title":"Advances in Neural Information Processing Systems"},{"key":"pcbi.1012119.ref059","doi-asserted-by":"crossref","unstructured":"Nguyen A, Yosinski J, Clune J. Deep neural networks are easily fooled: High confidence predictions for unrecognizable images. In: Proceedings of the IEEE conference on computer vision and pattern recognition; 2015. p. 427\u2013436.","DOI":"10.1109\/CVPR.2015.7298640"},{"key":"pcbi.1012119.ref060","unstructured":"Szegedy C, Zaremba W, Sutskever I, Bruna J, Erhan D, Goodfellow I, et al. Intriguing properties of neural networks. arXiv preprint arXiv:13126199. 2013;."},{"key":"pcbi.1012119.ref061","unstructured":"Liang S, Li Y, Srikant R. Enhancing the reliability of out-of-distribution image detection in neural networks. arXiv preprint arXiv:170602690. 2017;."},{"key":"pcbi.1012119.ref062","doi-asserted-by":"crossref","unstructured":"Moosavi-Dezfooli SM, Alhussein Fawzi OF. Pascal Frossard.\u201d. In: Universal adversarial perturbations.\u201d 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2017.","DOI":"10.1109\/CVPR.2017.17"},{"issue":"1","key":"pcbi.1012119.ref063","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40537-019-0197-0","article-title":"A survey on image data augmentation for deep learning","volume":"6","author":"C Shorten","year":"2019","journal-title":"Journal of big data"},{"issue":"7","key":"pcbi.1012119.ref064","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pone.0254841","article-title":"An empirical survey of data augmentation for time series classification with neural networks","volume":"16","author":"BK Iwana","year":"2021","journal-title":"PLOS ONE"},{"key":"pcbi.1012119.ref065","article-title":"Flexible statistical inference for mechanistic models of neural dynamics","volume":"30","author":"JM Lueckmann","year":"2017","journal-title":"Advances in neural information processing systems"},{"issue":"6588","key":"pcbi.1012119.ref066","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1126\/science.abn0915","article-title":"Complex cognitive algorithms preserved by selective social learning in experimental populations","volume":"376","author":"B Thompson","year":"2022","journal-title":"Science"},{"key":"pcbi.1012119.ref067","first-page":"2023","article-title":"Harnessing the flexibility of neural networks to predict dynamic theoretical parameters underlying human choice behavior","author":"Y Ger","year":"2023","journal-title":"bioRxiv"},{"key":"pcbi.1012119.ref068","first-page":"2023","article-title":"Automatic Discovery of Cognitive Strategies with Tiny Recurrent Neural Networks","author":"L Ji-An","year":"2023","journal-title":"bioRxiv"},{"key":"pcbi.1012119.ref069","first-page":"2023","article-title":"Predictive and Interpretable: Combining Artificial Neural Networks and Classic Cognitive Models to Understand Human Learning and Decision Making","author":"MK Eckstein","year":"2023","journal-title":"bioRxiv"},{"key":"pcbi.1012119.ref070","doi-asserted-by":"crossref","DOI":"10.1201\/9781315117195","volume-title":"Handbook of approximate Bayesian computation","author":"SA Sisson","year":"2018"},{"key":"pcbi.1012119.ref071","article-title":"Practical Bayesian optimization for model fitting with Bayesian adaptive direct search","volume":"30","author":"L Acerbi","year":"2017","journal-title":"Advances in neural information processing systems"},{"key":"pcbi.1012119.ref072","unstructured":"Devlin J, Chang MW, Lee K, Toutanova K. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:181004805. 2018;."},{"issue":"11","key":"pcbi.1012119.ref073","doi-asserted-by":"crossref","first-page":"4563","DOI":"10.1523\/JNEUROSCI.22-11-04563.2002","article-title":"Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging","volume":"22","author":"R Cools","year":"2002","journal-title":"Journal of Neuroscience"},{"issue":"12","key":"pcbi.1012119.ref074","doi-asserted-by":"crossref","first-page":"1359","DOI":"10.1016\/S0028-3932(99)00035-4","article-title":"Discrimination, reversal, and shift learning in Huntington\u2019s disease: mechanisms of impaired response selection","volume":"37","author":"AD Lawrence","year":"1999","journal-title":"Neuropsychologia"},{"key":"pcbi.1012119.ref075","volume-title":"Reinforcement learning: An introduction","author":"RS Sutton","year":"2018"},{"key":"pcbi.1012119.ref076","doi-asserted-by":"crossref","first-page":"101106","DOI":"10.1016\/j.dcn.2022.101106","article-title":"Reinforcement learning and Bayesian inference provide complementary models for the unique advantage of adolescents in stochastic reversal","volume":"55","author":"MK Eckstein","year":"2022","journal-title":"Developmental Cognitive Neuroscience"},{"issue":"2","key":"pcbi.1012119.ref077","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1523\/JNEUROSCI.5498-10.2012","article-title":"Neural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain","volume":"32","author":"Y Niv","year":"2012","journal-title":"Journal of Neuroscience"},{"key":"pcbi.1012119.ref078","unstructured":"Li JJ, Shi C, Li L, Collins AG. A generalized method for dynamic noise inference in modeling sequential decision-making. In: Proceedings of the Annual Meeting of the Cognitive Science Society. vol. 45; 2023."},{"key":"pcbi.1012119.ref079","first-page":"2023","article-title":"Dynamic noise estimation: A generalized method for modeling noise in sequential decision-making behavior","author":"JJ Li","year":"2023","journal-title":"bioRxiv"},{"issue":"2021.05","key":"pcbi.1012119.ref080","first-page":"13","article-title":"Efficient and stochastic mouse action switching during probabilistic decision making","volume":"10","author":"C Beron","year":"2021","journal-title":"Neuroscience"},{"key":"pcbi.1012119.ref081","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In: Proceedings of the IEEE international conference on computer vision; 2015. p. 1026\u20131034.","DOI":"10.1109\/ICCV.2015.123"},{"key":"pcbi.1012119.ref082","unstructured":"Bergstra J, Yamins D, Cox D. Making a science of model search: Hyperparameter optimization in hundreds of dimensions for vision architectures. In: International conference on machine learning. PMLR; 2013. p. 115\u2013123."},{"key":"pcbi.1012119.ref083","unstructured":"Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, et al. {TensorFlow}: a system for {Large-Scale} machine learning. In: 12th USENIX symposium on operating systems design and implementation (OSDI 16); 2016. p. 265\u2013283."}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1012119","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2024,5,28]],"date-time":"2024-05-28T00:00:00Z","timestamp":1716854400000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012119","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,18]],"date-time":"2024-11-18T22:22:09Z","timestamp":1731968529000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1012119"}},"subtitle":[],"editor":[{"given":"Ming Bo","family":"Cai","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2024,5,15]]},"references-count":83,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,5,15]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1012119","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2023.09.14.557793","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,15]]}}}