{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T18:41:49Z","timestamp":1776883309120,"version":"3.51.2"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1014108","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T00:00:00Z","timestamp":1776816000000}}],"reference-count":42,"publisher":"Public Library of Science (PLoS)","issue":"3","license":[{"start":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T00:00:00Z","timestamp":1774915200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Max Planck Society"},{"DOI":"10.13039\/100005156","name":"Humboldt Foundation","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100005156","id-type":"DOI","asserted-by":"crossref"}]},{"name":"KU Leuven University"}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Metacognition, the ability to assess the quality of our own decisions, is a critical form of higher-order information processing. Metacognitive efficiency is therefore an essential measure of cognitive capability. When making decisions is simple, metacognitive judgments are also straightforward; thus, assessing metacognitive efficiency requires normalizing for the quality of underlying task performance. This is duly common in measures of efficiency popular in perceptual decision-making such as the M-ratio. However, such normalization is hard in reinforcement learning problems, because task difficulty changes dynamically. We therefore repurposed the central idea underlying the M-ratio, using confidence judgments to fashion a notional decision-maker (which we call a Backward model), assessing metacognitive sensitivity according to the quality of its virtual decisions, and quantifying metacognitive efficiency by comparing virtual and modelled actual qualities in the original decision-making task. We used simulated and empirical data to show that our measure of metacognitive sensitivity, the Backward performance, has comparable properties to other measures such as quadratic scoring, and that our measure of efficiency, the MetaRL.Ratio, is independent of empirical performance and is preserved across levels of task difficulty. We suggest that the MetaRL.Ratio as a promising tool for assessing metacognitive efficiency in value-based learning\/decision-making.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1014108","type":"journal-article","created":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T17:35:42Z","timestamp":1774978542000},"page":"e1014108","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["Metacognitive efficiency in learned value-based choice"],"prefix":"10.1371","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2637-1953","authenticated-orcid":true,"given":"Sara","family":"Ershadmanesh","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ali","family":"Gholamzadeh","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kobe","family":"Desender","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Dayan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2026,3,31]]},"reference":[{"issue":"1594","key":"pcbi.1014108.ref001","doi-asserted-by":"crossref","first-page":"1310","DOI":"10.1098\/rstb.2011.0416","article-title":"Metacognition in human decision-making: confidence and error monitoring","volume":"367","author":"N Yeung","year":"2012","journal-title":"Philos Trans R Soc Lond B Biol Sci"},{"key":"pcbi.1014108.ref002","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.12192","article-title":"A common mechanism underlies changes of mind about decisions and confidence","volume":"5","author":"R van den Berg","year":"2016","journal-title":"Elife"},{"key":"pcbi.1014108.ref003","doi-asserted-by":"crossref","unstructured":"Fleming SM, Dolan RJ, Frith CD. Metacognition: computation, biology and function. 2012.","DOI":"10.1098\/rstb.2012.0021"},{"key":"pcbi.1014108.ref004","doi-asserted-by":"crossref","unstructured":"Efklides A, Misailidi P. Introduction: The present and the future in metacognition. Trends and prospects in metacognition research. 2010. 1\u201318.","DOI":"10.1007\/978-1-4419-6546-2_1"},{"issue":"18","key":"pcbi.1014108.ref005","doi-asserted-by":"crossref","first-page":"6117","DOI":"10.1523\/JNEUROSCI.6489-11.2012","article-title":"Prefrontal contributions to metacognition in perceptual decision making","volume":"32","author":"SM Fleming","year":"2012","journal-title":"J Neurosci"},{"key":"pcbi.1014108.ref006","doi-asserted-by":"crossref","DOI":"10.1017\/pen.2018.16","article-title":"Human metacognition across domains: insights from individual differences and neuroimaging","volume":"1","author":"M Rouault","year":"2018","journal-title":"Personal Neurosci"},{"issue":"22","key":"pcbi.1014108.ref007","doi-asserted-by":"crossref","first-page":"5078","DOI":"10.1523\/JNEUROSCI.3484-17.2018","article-title":"Distinguishing the Roles of Dorsolateral and Anterior PFC in Visual Metacognition","volume":"38","author":"M Shekhar","year":"2018","journal-title":"J Neurosci"},{"issue":"1","key":"pcbi.1014108.ref008","doi-asserted-by":"crossref","first-page":"4208","DOI":"10.1038\/s41467-022-31727-0","article-title":"Dynamic influences on static measures of metacognition","volume":"13","author":"K Desender","year":"2022","journal-title":"Nat Commun"},{"key":"pcbi.1014108.ref009","doi-asserted-by":"crossref","DOI":"10.1017\/S0140525X18000936","article-title":"Suboptimality in perceptual decision making","volume":"41","author":"D Rahnev","year":"2018","journal-title":"Behavioral and Brain Sciences"},{"key":"pcbi.1014108.ref010","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.75420","article-title":"Reverse engineering of metacognition","volume":"11","author":"M Guggenmos","year":"2022","journal-title":"Elife"},{"key":"pcbi.1014108.ref011","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1162\/opmi_a_00091","article-title":"Metacognitive Information Theory","volume":"7","author":"P Dayan","year":"2023","journal-title":"Open Mind (Camb)"},{"issue":"1","key":"pcbi.1014108.ref012","doi-asserted-by":"crossref","first-page":"422","DOI":"10.1016\/j.concog.2011.09.021","article-title":"A signal detection theoretic approach for estimating metacognitive sensitivity from confidence ratings","volume":"21","author":"B Maniscalco","year":"2012","journal-title":"Conscious Cogn"},{"issue":"1","key":"pcbi.1014108.ref013","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1037\/0033-2909.95.1.109","article-title":"A comparison of current measures of the accuracy of feeling-of-knowing predictions","volume":"95","author":"TO Nelson","year":"1984","journal-title":"Psychol Bull"},{"issue":"1","key":"pcbi.1014108.ref014","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1111\/j.1467-9280.2007.01850.x","article-title":"Transfer of metacognitive skills and hint seeking in monkeys","volume":"18","author":"N Kornell","year":"2007","journal-title":"Psychol Sci"},{"issue":"2","key":"pcbi.1014108.ref015","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1016\/j.neuroimage.2011.06.081","article-title":"Awareness-related activity in prefrontal and parietal cortices in blindsight reflects more than superior visual performance","volume":"58","author":"N Persaud","year":"2011","journal-title":"Neuroimage"},{"issue":"1","key":"pcbi.1014108.ref016","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1037\/rev0000249","article-title":"The nature of metacognitive inefficiency in perceptual decision making","volume":"128","author":"M Shekhar","year":"2021","journal-title":"Psychol Rev"},{"issue":"1","key":"pcbi.1014108.ref017","doi-asserted-by":"crossref","DOI":"10.1093\/nc\/nix007","article-title":"HMeta-d: hierarchical Bayesian estimation of metacognitive efficiency from confidence ratings","volume":"2017","author":"SM Fleming","year":"2017","journal-title":"Neurosci Conscious"},{"key":"pcbi.1014108.ref018","volume-title":"Signal detection theory and psychophysics","author":"DM Green","year":"1966"},{"issue":"3","key":"pcbi.1014108.ref019","doi-asserted-by":"crossref","first-page":"366","DOI":"10.1038\/nn.4240","article-title":"Confidence and certainty: distinct probabilistic quantities for different goals","volume":"19","author":"A Pouget","year":"2016","journal-title":"Nat Neurosci"},{"issue":"1","key":"pcbi.1014108.ref020","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1037\/rev0000045","article-title":"Self-evaluation of decision-making: A general Bayesian framework for metacognitive computation","volume":"124","author":"SM Fleming","year":"2017","journal-title":"Psychol Rev"},{"key":"pcbi.1014108.ref021","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/0001-6918(70)90013-2","article-title":"Measurement of subjective probability","volume":"34","author":"C-AS Sta\u00ebl von Holstein","year":"1970","journal-title":"Acta Psychologica"},{"key":"pcbi.1014108.ref022","doi-asserted-by":"crossref","first-page":"443","DOI":"10.3389\/fnhum.2014.00443","article-title":"How to measure metacognition","volume":"8","author":"SM Fleming","year":"2014","journal-title":"Front Hum Neurosci"},{"key":"pcbi.1014108.ref023","unstructured":"Hern\u00e1ndez-Orallo J, Flach PA, Ramirez CF. Brier curves: a new cost-based visualisation of classifier performance. In: Proceedings of the International Conference on Machine Learning (ICML), 2011. 585\u201392."},{"issue":"1","key":"pcbi.1014108.ref024","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1037\/xge0000505","article-title":"Domain-general enhancements of metacognitive ability through adaptive training","volume":"148","author":"J Carpenter","year":"2019","journal-title":"J Exp Psychol Gen"},{"issue":"1","key":"pcbi.1014108.ref025","doi-asserted-by":"crossref","DOI":"10.1093\/nc\/niz010","article-title":"How experimental procedures influence estimates of metacognitive ability","volume":"2019","author":"D Rahnev","year":"2019","journal-title":"Neurosci Conscious"},{"key":"pcbi.1014108.ref026","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1016\/j.cognition.2015.10.006","article-title":"Individual consistency in the accuracy and distribution of confidence judgments","volume":"146","author":"J Ais","year":"2016","journal-title":"Cognition"},{"key":"pcbi.1014108.ref027","volume-title":"Introduction to reinforcement learning","author":"RS Sutton","year":"2018"},{"issue":"11","key":"pcbi.1014108.ref028","doi-asserted-by":"crossref","first-page":"1664","DOI":"10.1177\/0956797615595037","article-title":"Confidence Leak in Perceptual Decision Making","volume":"26","author":"D Rahnev","year":"2015","journal-title":"Psychol Sci"},{"issue":"1","key":"pcbi.1014108.ref029","doi-asserted-by":"crossref","DOI":"10.1093\/nc\/niw018","article-title":"Metacognition about the past and future: quantifying common and distinct influences on prospective and retrospective judgments of self-performance","volume":"2016","author":"SM Fleming","year":"2016","journal-title":"Neurosci Conscious"},{"issue":"4","key":"pcbi.1014108.ref030","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1006973","article-title":"Contextual influence on confidence judgments in human reinforcement learning","volume":"15","author":"M Lebreton","year":"2019","journal-title":"PLoS Comput Biol"},{"issue":"12","key":"pcbi.1014108.ref031","doi-asserted-by":"crossref","first-page":"1704","DOI":"10.1038\/nn1560","article-title":"Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control","volume":"8","author":"ND Daw","year":"2005","journal-title":"Nat Neurosci"},{"issue":"4","key":"pcbi.1014108.ref032","doi-asserted-by":"crossref","DOI":"10.1073\/pnas.2016884118","article-title":"Human subjects exploit a cognitive map for credit assignment","volume":"118","author":"R Moran","year":"2021","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"1","key":"pcbi.1014108.ref033","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1038\/nn.3279","article-title":"Confidence in value-based choice","volume":"16","author":"B De Martino","year":"2013","journal-title":"Nat Neurosci"},{"key":"pcbi.1014108.ref034","article-title":"The computational origins of confidence biases in reinforcement learning","author":"N Salem-Garica","year":"2021"},{"issue":"1","key":"pcbi.1014108.ref035","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0304923","article-title":"Multifaceted confidence in exploratory choice","volume":"20","author":"O Solopchuk","year":"2025","journal-title":"PLoS One"},{"key":"pcbi.1014108.ref036","doi-asserted-by":"crossref","first-page":"1218","DOI":"10.1038\/81504","article-title":"Learning and selective attention","author":"P Dayan","year":"2000","journal-title":"Nat Neurosci"},{"issue":"9","key":"pcbi.1014108.ref037","doi-asserted-by":"crossref","first-page":"1214","DOI":"10.1038\/nn1954","article-title":"Learning the value of information in an uncertain world","volume":"10","author":"TEJ Behrens","year":"2007","journal-title":"Nat Neurosci"},{"key":"pcbi.1014108.ref038","doi-asserted-by":"crossref","first-page":"103008","DOI":"10.1016\/j.trc.2021.103008","article-title":"A survey on autonomous vehicle control in the era of mixed-autonomy: From physics-based to AI-guided driving policy learning","volume":"125","author":"X Di","year":"2021","journal-title":"Transportation Research Part C: Emerging Technologies"},{"issue":"4","key":"pcbi.1014108.ref039","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1016\/j.orbis.2020.08.003","article-title":"The Future of Military Applications of Artificial Intelligence: A Role for Confidence-Building Measures?","volume":"64","author":"MC Horowitz","year":"2020","journal-title":"Orbis"},{"issue":"1","key":"pcbi.1014108.ref040","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1097\/SLA.0000000000002693","article-title":"Artificial Intelligence in Surgery: Promises and Perils","volume":"268","author":"DA Hashimoto","year":"2018","journal-title":"Ann Surg"},{"issue":"7","key":"pcbi.1014108.ref041","doi-asserted-by":"crossref","first-page":"4991","DOI":"10.1007\/s00330-020-07561-7","article-title":"One step further into the blackbox: a pilot study of how to build more confidence around an AI-based decision system of breast nodule assessment in 2D ultrasound","volume":"31","author":"F Dong","year":"2021","journal-title":"Eur Radiol"},{"issue":"7","key":"pcbi.1014108.ref042","doi-asserted-by":"crossref","first-page":"7419","DOI":"10.1109\/TITS.2021.3069497","article-title":"Confidence-Aware Reinforcement Learning for Self-Driving Cars","volume":"23","author":"Z Cao","year":"2022","journal-title":"IEEE Trans Intell Transport Syst"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1014108","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T00:00:00Z","timestamp":1776816000000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1014108","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T17:48:27Z","timestamp":1776880107000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1014108"}},"subtitle":[],"editor":[{"given":"Megan A. K.","family":"Peters","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2026,3,31]]},"references-count":42,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,3,31]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1014108","relation":{},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,31]]}}}