{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T03:26:00Z","timestamp":1771989960983,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1010318","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2022,8,8]],"date-time":"2022-08-08T00:00:00Z","timestamp":1659916800000}}],"reference-count":78,"publisher":"Public Library of Science (PLoS)","issue":"7","license":[{"start":{"date-parts":[[2022,7,27]],"date-time":"2022-07-27T00:00:00Z","timestamp":1658880000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["EY08266"],"award-info":[{"award-number":["EY08266"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1420262"],"award-info":[{"award-number":["1420262"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100005156","name":"Alexander von Humboldt-Stiftung","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100005156","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003135","name":"Fondation Fyssen","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003135","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001665","name":"Agence Nationale de la Recherche","doi-asserted-by":"publisher","award":["ANR-18-CE28-0015-01 \"VICONTE\""],"award-info":[{"award-number":["ANR-18-CE28-0015-01 \"VICONTE\""]}],"id":[{"id":"10.13039\/501100001665","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001665","name":"Agence Nationale de la Recherche","doi-asserted-by":"publisher","award":["ANR-17-EURE-0017 \"FrontCog\""],"award-info":[{"award-number":["ANR-17-EURE-0017 \"FrontCog\""]}],"id":[{"id":"10.13039\/501100001665","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Perceptual confidence is an important internal signal about the certainty of our decisions and there is a substantial debate on how it is computed. We highlight three confidence metric types from the literature: observers either use 1) the full probability distribution to compute probability correct (Probability metrics), 2) point estimates from the perceptual decision process to estimate uncertainty (Evidence-Strength metrics), or 3) heuristic confidence from stimulus-based cues to uncertainty (Heuristic metrics). These metrics are rarely tested against one another, so we examined models of all three types on a suprathreshold spatial discrimination task. Observers were shown a cloud of dots sampled from a dot generating distribution and judged if the mean of the distribution was left or right of centre. In addition to varying the horizontal position of the mean, there were two sensory uncertainty manipulations: the number of dots sampled and the spread of the generating distribution. After every two perceptual decisions, observers made a confidence forced-choice judgement whether they were more confident in the first or second decision. Model results showed that the majority of observers were best-fit by either: 1) the Heuristic model, which used dot cloud position, spread, and number of dots as cues; or 2) an Evidence-Strength model, which computed the distance between the sensory measurement and discrimination criterion, scaled according to sensory uncertainty. An accidental repetition of some sessions also allowed for the measurement of confidence agreement for identical pairs of stimuli. This N-pass analysis revealed that human observers were more consistent than their best-fitting model would predict, indicating there are still aspects of confidence that are not captured by our modelling. As such, we propose confidence agreement as a useful technique for computational studies of confidence. Taken together, these findings highlight the idiosyncratic nature of confidence computations for complex decision contexts and the need to consider different potential metrics and transformations in the confidence computation.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1010318","type":"journal-article","created":{"date-parts":[[2022,7,27]],"date-time":"2022-07-27T17:50:43Z","timestamp":1658944243000},"page":"e1010318","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":24,"title":["Suprathreshold perceptual decisions constrain models of confidence"],"prefix":"10.1371","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1787-3345","authenticated-orcid":true,"given":"Shannon M.","family":"Locke","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2079-4552","authenticated-orcid":true,"given":"Michael S.","family":"Landy","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1605-4607","authenticated-orcid":true,"given":"Pascal","family":"Mamassian","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2022,7,27]]},"reference":[{"issue":"5","key":"pcbi.1010318.ref001","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1121\/1.1907764","article-title":"Two types of ROC curves and definitions of parameters","volume":"31","author":"FR Clarke","year":"1959","journal-title":"The Journal of the Acoustical Society of America"},{"key":"pcbi.1010318.ref002","doi-asserted-by":"crossref","first-page":"3157","DOI":"10.1016\/j.cub.2016.10.021","article-title":"Confidence is the bridge between multi-stage decisions","volume":"26","author":"R Van den Berg","year":"2016","journal-title":"Current Biology"},{"issue":"6","key":"pcbi.1010318.ref003","doi-asserted-by":"crossref","first-page":"e1004305","DOI":"10.1371\/journal.pcbi.1004305","article-title":"The sense of confidence during probabilistic learning: A normative account","volume":"11","author":"F Meyniel","year":"2015","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1010318.ref004","doi-asserted-by":"crossref","first-page":"e62825","DOI":"10.7554\/eLife.62825","article-title":"Response-based outcome predictions and confidence regulate feedback processing and learning","volume":"10","author":"R Fr\u00f6mer","year":"2021","journal-title":"Elife"},{"issue":"6","key":"pcbi.1010318.ref005","doi-asserted-by":"crossref","first-page":"1329","DOI":"10.1016\/j.neuron.2014.12.015","article-title":"Choice certainty is informed by both evidence and decision time","volume":"84","author":"R Kiani","year":"2014","journal-title":"Neuron"},{"key":"pcbi.1010318.ref006","doi-asserted-by":"crossref","first-page":"422","DOI":"10.1016\/j.concog.2011.09.021","article-title":"A signal detection theoretic approach for estimating metacognitive sensitivity from confidence ratings","volume":"21","author":"B Maniscalco","year":"2012","journal-title":"Consciousness and Cognition"},{"issue":"1","key":"pcbi.1010318.ref007","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1037\/rev0000045","article-title":"Self-evaluation of decision-making: A general Bayesian framework for metacognitive computation","volume":"124","author":"SM Fleming","year":"2017","journal-title":"Psychological Review"},{"issue":"3","key":"pcbi.1010318.ref008","doi-asserted-by":"crossref","first-page":"864","DOI":"10.1037\/a0019737","article-title":"Two-stage dynamic signal detection: A theory of choice, decision time, and confidence","volume":"117","author":"TJ Pleskac","year":"2010","journal-title":"Psychological Review"},{"issue":"3","key":"pcbi.1010318.ref009","doi-asserted-by":"crossref","first-page":"366","DOI":"10.1038\/nn.4240","article-title":"Confidence and certainty: Distinct probabilistic quantities for different goals","volume":"19","author":"A Pouget","year":"2016","journal-title":"Nature Neuroscience"},{"issue":"3","key":"pcbi.1010318.ref010","doi-asserted-by":"crossref","first-page":"499","DOI":"10.1016\/j.neuron.2016.03.025","article-title":"Signatures of a statistical computation in the human sense of confidence","volume":"90","author":"JI Sanders","year":"2016","journal-title":"Neuron"},{"issue":"11","key":"pcbi.1010318.ref011","doi-asserted-by":"crossref","first-page":"e1006572","DOI":"10.1371\/journal.pcbi.1006572","article-title":"Comparing Bayesian and non-Bayesian accounts of human confidence reports","volume":"14","author":"WT Adler","year":"2018","journal-title":"PLoS Computational Biology"},{"issue":"1","key":"pcbi.1010318.ref012","first-page":"1","article-title":"Confidence reports in decision-making with multiple alternatives violate the Bayesian confidence hypothesis","volume":"11","author":"HH Li","year":"2020","journal-title":"Nature Communications"},{"issue":"4","key":"pcbi.1010318.ref013","doi-asserted-by":"crossref","first-page":"843","DOI":"10.3758\/BF03196546","article-title":"Type 2 tasks in the theory of signal detectability: Discrimination between correct and incorrect decisions","volume":"10","author":"SJ Galvin","year":"2003","journal-title":"Psychonomic Bulletin & Review"},{"issue":"3","key":"pcbi.1010318.ref014","doi-asserted-by":"crossref","first-page":"e0120870","DOI":"10.1371\/journal.pone.0120870","article-title":"Weighting mean and variability during confidence judgments","volume":"10","author":"V De Gardelle","year":"2015","journal-title":"PLoS One"},{"issue":"1748","key":"pcbi.1010318.ref015","doi-asserted-by":"crossref","first-page":"4853","DOI":"10.1098\/rspb.2012.1847","article-title":"Inferring subjective states through the observation of actions","volume":"279","author":"D Patel","year":"2012","journal-title":"Proceedings of the Royal Society B: Biological Sciences"},{"key":"pcbi.1010318.ref016","volume-title":"Decision processes in visual perception","author":"D Vickers","year":"1979"},{"issue":"10","key":"pcbi.1010318.ref017","doi-asserted-by":"crossref","first-page":"2223","DOI":"10.1177\/1747021817737496","article-title":"Metacognitive judgements of perceptual-motor steering performance","volume":"71","author":"CD Mole","year":"2018","journal-title":"Quarterly Journal of Experimental Psychology"},{"key":"pcbi.1010318.ref018","doi-asserted-by":"crossref","first-page":"79","DOI":"10.3389\/fnint.2012.00079","article-title":"The construction of confidence in a perceptual decision","volume":"6","author":"A Zylberberg","year":"2012","journal-title":"Frontiers in Integrative Neuroscience"},{"issue":"3","key":"pcbi.1010318.ref019","doi-asserted-by":"crossref","first-page":"923","DOI":"10.3758\/s13414-016-1059-x","article-title":"Heuristic use of perceptual evidence leads to dissociation between performance and metacognitive sensitivity","volume":"78","author":"B Maniscalco","year":"2016","journal-title":"Attention, Perception, and Psychophysics"},{"key":"pcbi.1010318.ref020","doi-asserted-by":"crossref","first-page":"00443","DOI":"10.3389\/fnhum.2014.00443","article-title":"How to measure metacognition","volume":"8","author":"SM Fleming","year":"2014","journal-title":"Frontiers in Human Neuroscience"},{"issue":"6","key":"pcbi.1010318.ref021","doi-asserted-by":"crossref","first-page":"3158","DOI":"10.3758\/s13414-020-02018-x","article-title":"Priors and payoffs in confidence judgments","volume":"82","author":"SM Locke","year":"2020","journal-title":"Attention, Perception, & Psychophysics"},{"issue":"1","key":"pcbi.1010318.ref022","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1146\/annurev-vision-111815-114630","article-title":"Visual confidence","volume":"2","author":"P Mamassian","year":"2016","journal-title":"Annual Review of Vision Science"},{"issue":"4","key":"pcbi.1010318.ref023","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1037\/a0033268","article-title":"Measures of metacognition on signal-detection theoretic models","volume":"18","author":"AB Barrett","year":"2013","journal-title":"Psychological Methods"},{"issue":"1","key":"pcbi.1010318.ref024","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1093\/nc\/niw002","article-title":"The signal processing architecture underlying subjective reports of sensory awareness","volume":"2016","author":"B Maniscalco","year":"2016","journal-title":"Neuroscience of Consciousness"},{"issue":"3","key":"pcbi.1010318.ref025","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1037\/xge0000511","article-title":"Sensory noise increases meta-cognitive efficiency","volume":"148","author":"JW Bang","year":"2019","journal-title":"Journal of Experimental Psychology: General"},{"key":"pcbi.1010318.ref026","article-title":"Modeling perceptual confidence and the confidence forced-choice paradigm","author":"P Mamassian","year":"2021","journal-title":"Psychological Review"},{"key":"pcbi.1010318.ref027","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1016\/j.concog.2014.05.012","article-title":"Variance misperception explains illusions of confidence in simple perceptual decisions","volume":"27","author":"A Zylberberg","year":"2014","journal-title":"Consciousness and Cognition"},{"issue":"43","key":"pcbi.1010318.ref028","doi-asserted-by":"crossref","first-page":"11090","DOI":"10.1073\/pnas.1717720115","article-title":"Humans incorporate attention-dependent uncertainty into perceptual decisions and confidence","volume":"115","author":"RN Denison","year":"2018","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1010318.ref029","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1146\/annurev.neuro.29.051605.113038","article-title":"The neural basis of decision making","volume":"30","author":"JI Gold","year":"2007","journal-title":"Annual Review of Neuroscience"},{"key":"pcbi.1010318.ref030","doi-asserted-by":"crossref","first-page":"e17688","DOI":"10.7554\/eLife.17688","article-title":"The influence of evidence volatility on choice, reaction time and confidence in a perceptual decision","volume":"5","author":"A Zylberberg","year":"2016","journal-title":"Elife"},{"issue":"1","key":"pcbi.1010318.ref031","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-020-15561-w","article-title":"Confidence controls perceptual evidence accumulation","volume":"11","author":"T Balsdon","year":"2020","journal-title":"Nature Communications"},{"issue":"10","key":"pcbi.1010318.ref032","doi-asserted-by":"crossref","first-page":"e1004519","DOI":"10.1371\/journal.pcbi.1004519","article-title":"Doubly Bayesian analysis of confidence in perceptual decision-making","volume":"11","author":"L Aitchison","year":"2015","journal-title":"PLoS Computational Biology"},{"issue":"5","key":"pcbi.1010318.ref033","first-page":"671","article-title":"Computations underlying confidence in visual perception","volume":"42","author":"ML Spence","year":"2015","journal-title":"Journal of Experimental Psychology: Human Perception and Performance"},{"issue":"8","key":"pcbi.1010318.ref034","first-page":"1520","article-title":"The impact of evidence reliability on sensitivity and bias in decision confidence","volume":"43","author":"A Boldt","year":"2017","journal-title":"Journal of Experimental Psychology: Human Perception and Performance"},{"issue":"5","key":"pcbi.1010318.ref035","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1167\/jov.21.5.21","article-title":"Dual strategies in human confidence judgments","volume":"21","author":"A Bertana","year":"2021","journal-title":"Journal of Vision"},{"issue":"48","key":"pcbi.1010318.ref036","doi-asserted-by":"crossref","first-page":"20834","DOI":"10.1073\/pnas.1007704107","article-title":"Flexible mechanisms underlie the evaluation of visual confidence","volume":"107","author":"S Barthelm\u00e9","year":"2010","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1010318.ref037","doi-asserted-by":"crossref","first-page":"104396","DOI":"10.1016\/j.cognition.2020.104396","article-title":"Performance monitoring for sensorimotor confidence: A visuomotor tracking study","volume":"205","author":"SM Locke","year":"2020","journal-title":"Cognition"},{"key":"pcbi.1010318.ref038","first-page":"73","article-title":"On small differences in sensation","volume":"3","author":"CS Peirce","year":"1884","journal-title":"Memoirs of the National Academy of Science"},{"issue":"2","key":"pcbi.1010318.ref039","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1038\/s41562-020-00953-1","article-title":"Discrete confidence levels revealed by sequential decisions","volume":"5","author":"M Lisi","year":"2021","journal-title":"Nature Human Behaviour"},{"key":"pcbi.1010318.ref040","doi-asserted-by":"crossref","unstructured":"Rahnev D, Balsdon T, Charles L, de Gardelle V, Denison RN, Desender K, et al. Consensus goals for the field of visual metacognition. PsyArXiv [Preprint]. 2021 [cited 2022 June 23]. Available from: https:\/\/psyarxiv.com\/z8v5x.","DOI":"10.31234\/osf.io\/z8v5x"},{"issue":"6","key":"pcbi.1010318.ref041","doi-asserted-by":"crossref","first-page":"616","DOI":"10.1177\/0301006620928010","article-title":"Confidence forced-choice and other metaperceptual tasks","volume":"49","author":"P Mamassian","year":"2020","journal-title":"Perception"},{"issue":"3","key":"pcbi.1010318.ref042","doi-asserted-by":"crossref","first-page":"e4909","DOI":"10.1371\/journal.pone.0004909","article-title":"The spatial and temporal construction of confidence in the visual scene","volume":"4","author":"M Graziano","year":"2009","journal-title":"PLoS One"},{"key":"pcbi.1010318.ref043","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1016\/j.cognition.2015.10.006","article-title":"Individual consistency in the accuracy and distribution of confidence judgments","volume":"146","author":"J Ais","year":"2016","journal-title":"Cognition"},{"issue":"11","key":"pcbi.1010318.ref044","doi-asserted-by":"crossref","first-page":"810","DOI":"10.1038\/s41562-017-0215-1","article-title":"The idiosyncratic nature of confidence","volume":"1","author":"J Navajas","year":"2017","journal-title":"Nature Human Behaviour"},{"issue":"5998","key":"pcbi.1010318.ref045","doi-asserted-by":"crossref","first-page":"1541","DOI":"10.1126\/science.1191883","article-title":"Relating introspective accuracy to individual differences in brain structure","volume":"329","author":"SM Fleming","year":"2010","journal-title":"Science"},{"issue":"1","key":"pcbi.1010318.ref046","doi-asserted-by":"crossref","first-page":"niab039","DOI":"10.1093\/nc\/niab039","article-title":"A robust confidence\u2013accuracy dissociation via criterion attraction","volume":"2021","author":"D Rahnev","year":"2021","journal-title":"Neuroscience of Consciousness"},{"key":"pcbi.1010318.ref047","doi-asserted-by":"crossref","first-page":"e223","DOI":"10.1017\/S0140525X18000936","article-title":"Suboptimality in perceptual decision making","volume":"41","author":"D Rahnev","year":"2018","journal-title":"Behavioral and Brain Sciences"},{"issue":"22","key":"pcbi.1010318.ref048","doi-asserted-by":"crossref","first-page":"12380","DOI":"10.1073\/pnas.97.22.12380","article-title":"Failure to handle more than one internal representation in visual detection tasks","volume":"97","author":"A Gorea","year":"2000","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"12","key":"pcbi.1010318.ref049","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1038\/nn.2948","article-title":"Attention induces conservative subjective biases in visual perception","volume":"14","author":"D Rahnev","year":"2011","journal-title":"Nature Neuroscience"},{"key":"pcbi.1010318.ref050","volume-title":"Detection theory: A user\u2019s guide","author":"NA Macmillan","year":"2005","edition":"2"},{"key":"pcbi.1010318.ref051","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1093\/acprof:oso\/9780195387247.003.0001","volume-title":"Sensory cue integration","author":"MS Landy","year":"2011"},{"key":"pcbi.1010318.ref052","doi-asserted-by":"crossref","first-page":"263","DOI":"10.2307\/1914185","article-title":"Prospect theory: An analysis of decision under risk","volume":"4","author":"D Kahneman","year":"1979","journal-title":"Econometrica"},{"key":"pcbi.1010318.ref053","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/B978-0-12-374176-9.00011-7","volume-title":"Neuroeconomics: decision making and the brain","author":"CR Fox","year":"2009"},{"issue":"8","key":"pcbi.1010318.ref054","doi-asserted-by":"crossref","first-page":"1152","DOI":"10.1038\/nn.4055","article-title":"Human representation of visuo-motor uncertainty as mixtures of orthogonal basis distributions","volume":"18","author":"H Zhang","year":"2015","journal-title":"Nature Neuroscience"},{"key":"pcbi.1010318.ref055","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fnins.2012.00001","article-title":"Ubiquitous log odds: a common representation of probability and frequency distortion in perception, action, and cognition","volume":"6","author":"H Zhang","year":"2012","journal-title":"Frontiers in Neuroscience"},{"issue":"10","key":"pcbi.1010318.ref056","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1016\/j.tics.2012.08.010","article-title":"Organizing probabilistic models of perception","volume":"16","author":"WJ Ma","year":"2012","journal-title":"Trends in Cognitive Sciences"},{"issue":"4","key":"pcbi.1010318.ref057","doi-asserted-by":"crossref","first-page":"514","DOI":"10.1038\/s41593-019-0340-4","article-title":"Optimality and heuristics in perceptual neuroscience","volume":"22","author":"JL Gardner","year":"2019","journal-title":"Nature Neuroscience"},{"issue":"4","key":"pcbi.1010318.ref058","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1016\/j.neuroimage.2009.03.025","article-title":"Bayesian model selection for group studies","volume":"46","author":"KE Stephan","year":"2009","journal-title":"Neuroimage"},{"key":"pcbi.1010318.ref059","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1016\/j.neuroimage.2013.08.065","article-title":"Bayesian model selection for group studies\u2014Revisited","volume":"84","author":"L Rigoux","year":"2014","journal-title":"NeuroImage"},{"key":"pcbi.1010318.ref060","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1146\/annurev-psych-120709-145346","article-title":"Heuristic decision making","volume":"62","author":"G Gigerenzer","year":"2011","journal-title":"Annual Review of Psychology"},{"issue":"1","key":"pcbi.1010318.ref061","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1037\/rev0000249","article-title":"The nature of metacognitive inefficiency in perceptual decision making","volume":"128","author":"M Shekhar","year":"2021","journal-title":"Psychological Review"},{"key":"pcbi.1010318.ref062","doi-asserted-by":"crossref","unstructured":"Shekhar M, Rahnev D. How do humans give confidence? A comprehensive comparison of process models of metacognition. PsyArXiv [Preprint]. 2022 [cited 2022 June 23]. Available from: https:\/\/psyarxiv.com\/cwrnt.","DOI":"10.31234\/osf.io\/cwrnt"},{"issue":"11","key":"pcbi.1010318.ref063","doi-asserted-by":"crossref","first-page":"1664","DOI":"10.1177\/0956797615595037","article-title":"Confidence leak in perceptual decision making","volume":"26","author":"D Rahnev","year":"2015","journal-title":"Psychological science"},{"issue":"4","key":"pcbi.1010318.ref064","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1364\/JOSAA.5.000617","article-title":"Visual signal detection. IV. Observer inconsistency","volume":"5","author":"AE Burgess","year":"1988","journal-title":"Journal of the Optical Society of America A"},{"issue":"4","key":"pcbi.1010318.ref065","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1167\/6.4.2","article-title":"The receptive field and internal noise for position acuity change with feature separation","volume":"6","author":"RW Li","year":"2006","journal-title":"Journal of Vision"},{"key":"pcbi.1010318.ref066","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.visres.2012.06.014","article-title":"Estimation of internal noise using double passes: Does it matter how the second pass is delivered?","volume":"69","author":"BAS Hasan","year":"2012","journal-title":"Vision Research"},{"key":"pcbi.1010318.ref067","doi-asserted-by":"crossref","first-page":"104041","DOI":"10.1016\/j.cognition.2019.104041","article-title":"Evidence for metacognitive bias in perception of voluntary action","volume":"194","author":"L Charles","year":"2020","journal-title":"Cognition"},{"issue":"5","key":"pcbi.1010318.ref068","doi-asserted-by":"crossref","first-page":"738","DOI":"10.1038\/nn.3689","article-title":"Serial dependence in visual perception","volume":"17","author":"J Fischer","year":"2014","journal-title":"Nature Neuroscience"},{"issue":"6","key":"pcbi.1010318.ref069","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1167\/19.6.24","article-title":"Disambiguating serial effects of multiple timescales","volume":"19","author":"N Gekas","year":"2019","journal-title":"Journal of Vision"},{"issue":"4","key":"pcbi.1010318.ref070","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1163\/156856897X00357","article-title":"The Psychophysics Toolbox","volume":"10","author":"DH Brainard","year":"1997","journal-title":"Spatial Vision"},{"key":"pcbi.1010318.ref071","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1163\/156856897X00366","article-title":"The Video Toolbox software for visual psychophysics: Transforming numbers into movies","volume":"10","author":"DG Pelli","year":"1997","journal-title":"Spatial Vision"},{"issue":"14","key":"pcbi.1010318.ref072","first-page":"1","article-title":"What\u2019s new in psychtoolbox-3","volume":"36","author":"M Kleiner","year":"2007","journal-title":"Perception"},{"key":"pcbi.1010318.ref073","volume-title":"Pattern recognition and machine learning","author":"CM Bishop","year":"2006"},{"key":"pcbi.1010318.ref074","unstructured":"Murphy KP. Conjugate Bayesian analysis of the Gaussian distribution. KP Murphy\u2019s faculty webpage, The University of British Columbia [Technical report]. 2007 [cited 2022 June 23]. Available from https:\/\/www.cs.ubc.ca\/~murphyk\/Papers\/bayesGauss.pdf."},{"key":"pcbi.1010318.ref075","first-page":"1834","article-title":"Practical Bayesian optimization for model fitting with Bayesian Adaptive Direct Search","volume":"30","author":"L Acerbi","year":"2017","journal-title":"Advances in Neural Information Processing Systems"},{"issue":"6","key":"pcbi.1010318.ref076","doi-asserted-by":"crossref","first-page":"716","DOI":"10.1109\/TAC.1974.1100705","article-title":"A new look at the statistical model identification","volume":"19","author":"H Akaike","year":"1974","journal-title":"IEEE Transactions on Automatic Control"},{"issue":"2","key":"pcbi.1010318.ref077","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/S0167-7152(96)00128-9","article-title":"Unifying the derivations for the Akaike and corrected Akaike information criteria","volume":"33","author":"JE Cavanaugh","year":"1997","journal-title":"Statistics & Probability Letters"},{"issue":"6","key":"pcbi.1010318.ref078","doi-asserted-by":"crossref","first-page":"2083","DOI":"10.3758\/s13423-018-1451-8","article-title":"Small is beautiful: In defense of the small-N design","volume":"25","author":"PL Smith","year":"2018","journal-title":"Psychonomic Bulletin & Review"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1010318","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2022,8,8]],"date-time":"2022-08-08T00:00:00Z","timestamp":1659916800000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010318","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,8]],"date-time":"2022-08-08T17:41:40Z","timestamp":1659980500000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010318"}},"subtitle":[],"editor":[{"given":"Christoph","family":"Mathys","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2022,7,27]]},"references-count":78,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,7,27]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1010318","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1010318","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,27]]}}}