{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,15]],"date-time":"2025-03-15T04:18:57Z","timestamp":1742012337734,"version":"3.38.0"},"reference-count":27,"publisher":"Walter de Gruyter GmbH","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2010,12,1]]},"abstract":"<jats:title>Testing for Equivalence: A Methodology for Computational Cognitive Modelling<\/jats:title><jats:p>The equivalence test (Stewart and West, 2007; Stewart, 2007) is a statistical measure for evaluating the similarity between a model and the system being modelled. It is designed to avoid over-fitting and to generate an easily interpretable summary of the quality of a model. We apply the equivalence test to two tasks: Repeated Binary Choice (Erev et al., 2010) and Dynamic Stocks and Flows (Gonzalez and Dutt, 2007). In the first case, we find a broad range of statistically equivalent models (and win a prediction competition) while identifying particular aspects of the task that are not yet adequately captured. In the second case, we re-evaluate results from the Dynamic Stocks and Flows challenge, demonstrating how our method emphasizes the breadth of coverage of a model and how it can be used for comparing different models. We argue that the explanatory power of models hinges on numerical similarity to empirical data over a broad set of measures.<\/jats:p>","DOI":"10.2478\/v10229-011-0010-8","type":"journal-article","created":{"date-parts":[[2011,11,23]],"date-time":"2011-11-23T20:55:31Z","timestamp":1322081731000},"page":"69-87","source":"Crossref","is-referenced-by-count":3,"title":["Testing for Equivalence: A Methodology for Computational Cognitive Modelling"],"prefix":"10.2478","volume":"2","author":[{"given":"Terrence","family":"Stewart","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Robert","family":"West","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"374","reference":[{"volume-title":"The atomic components of thought","year":"1998","author":"J. Anderson","key":"1"},{"issue":"4","key":"2","doi-asserted-by":"crossref","first-page":"1036","DOI":"10.1037\/0033-295X.111.4.1036","article-title":"An integrated theory of the mind","volume":"111","author":"J. Anderson","year":"2004","journal-title":"Psychological Review"},{"issue":"2","key":"3","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/BF01299065","article-title":"Aligning simulation models: A case of study and results","volume":"1","author":"R. Axtell","year":"1996","journal-title":"Computational Mathematical Organization Theory"},{"issue":"11","key":"4","doi-asserted-by":"crossref","first-page":"1056","DOI":"10.1093\/aje\/kwf149","article-title":"Assessing equivalence: an alternative to the use of difference tests for measuring disparities in vaccination coverage","volume":"156","author":"L. Barker","year":"2002","journal-title":"American Journal of Epidemiology"},{"volume-title":"Discovering cell mechanisms: The creation of modern cell biology","year":"2006","author":"W. Bechtel","key":"5"},{"volume-title":"Mental mechanisms: Philosophical perspectives on cognitive neuroscience","year":"2008","author":"W. Bechtel","key":"6"},{"issue":"12","key":"7","doi-asserted-by":"crossref","first-page":"997","DOI":"10.1037\/0003-066X.49.12.997","article-title":"The earth is round (p < .05)","volume":"49","author":"J. Cohen","year":"1994","journal-title":"American Psychologist"},{"key":"8","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511802843","volume-title":"Bootstrap Methods and Their Application","author":"A. Davison","year":"1997"},{"key":"9","doi-asserted-by":"crossref","first-page":"27","DOI":"10.2307\/2027085","article-title":"Real patterns","volume":"88","author":"D. Dennett","year":"1991","journal-title":"Journal of Philosophy"},{"key":"10","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4899-4541-9","volume-title":"An introduction to the bootstrap","author":"B. Efron","year":"1993"},{"issue":"1","key":"11","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1002\/bdm.683","article-title":"A choice prediction competition for choices from experience and from description","volume":"23","author":"I. Erev","year":"2010","journal-title":"Journal of Behavioral Decision Making: Special edition on Decisions from Experience"},{"key":"12","first-page":"61","article-title":"Learning to control a dynamic task: A system dynamics cognitive model of the slope effect","author":"C. Gonzalez","year":"2007"},{"issue":"4","key":"13","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1207\/s15516709cog2704_2","article-title":"Instance-based learning in real-time dynamic decision making","volume":"27","author":"C. Gonzalez","year":"2003","journal-title":"Cognitive Science"},{"issue":"8","key":"14","first-page":"124","article-title":"Why most published research findings are false","volume":"2","author":"J. Ioannidis","year":"2005","journal-title":"Public Library of Science Medicine"},{"key":"15","first-page":"296","article-title":"A dynamic ACT-R model of simple games","author":"C. Lebiere","year":"1999"},{"key":"16","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/2004.001.0001","volume-title":"Computation and cognition","author":"Z. Pylyshyn","year":"1984"},{"volume-title":"Foundations of Cognitive Science","year":"1989","author":"Z. Pylyshyn","key":"17"},{"key":"18","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1037\/0033-295X.107.2.358","article-title":"How persuasive is a good fit? A comment on theory testing","volume":"107","author":"S. Roberts","year":"2000","journal-title":"Psychological Review"},{"key":"19","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/2335.001.0001","volume-title":"Dennett's Philosophy: A Comprehensive Assessment","author":"D. Ross","year":"2000"},{"key":"20","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1037\/1082-989X.1.2.115","article-title":"Statistical significance testing and cumulative knowledge in psychology: Implications for the training of researchers","volume":"1","author":"F. Schmidt","year":"1996","journal-title":"Psychological Methods"},{"issue":"1","key":"21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s001970050070","article-title":"Cognitive modeling in perspective","volume":"8","author":"H. Simon","year":"1999","journal-title":"Kognitionswissenschaft"},{"key":"22","unstructured":"Stewart, T.C. 2007. <i>A Methodology for Computational Cognitive Modelling<\/i>. Ph.D. Dissertation, Institute of Cognitive Science, Carleton University, Ottawa, Ontario."},{"article-title":"Equivalence: A novel basis for model comparison","year":"2007","author":"T. Stewart","key":"23"},{"article-title":"Applying cognitive architectures to decision-making: How cognitive theory and the equivalence measure triumphed in the Technion Prediction Tournament","year":"2009","author":"T. Stewart","key":"24"},{"volume-title":"Theory, evidence and explanation","year":"1995","author":"P. Thagard","key":"25"},{"issue":"4","key":"26","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1037\/1082-989X.6.4.371","article-title":"Evaluating statistical difference, equivalence, and indeterminacy using inferential confidence intervals: An integrated alternative method of conducting null hypothesis statistical tests","volume":"6","author":"W. Tryon","year":"2001","journal-title":"Psychological Methods"},{"key":"27","doi-asserted-by":"crossref","first-page":"594","DOI":"10.1037\/0003-066X.54.8.594","article-title":"Statistical methods in psychology journals: Guidelines and explanations","volume":"54","author":"L. Wilkinson","year":"1999","journal-title":"American Psychologist"}],"container-title":["Journal of Artificial General Intelligence"],"original-title":[],"link":[{"URL":"http:\/\/content.sciendo.com\/view\/journals\/jagi\/2\/2\/article-p69.xml","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyter.com\/view\/j\/jagi.2010.2.issue-2\/v10229-011-0010-8\/v10229-011-0010-8.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,14]],"date-time":"2025-03-14T10:51:57Z","timestamp":1741949517000},"score":1,"resource":{"primary":{"URL":"https:\/\/content.sciendo.com\/doi\/10.2478\/v10229-011-0010-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,12,1]]},"references-count":27,"journal-issue":{"issue":"2"},"URL":"https:\/\/doi.org\/10.2478\/v10229-011-0010-8","relation":{},"ISSN":["1946-0163"],"issn-type":[{"type":"electronic","value":"1946-0163"}],"subject":[],"published":{"date-parts":[[2010,12,1]]}}}