{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T10:12:56Z","timestamp":1781604776951,"version":"3.54.5"},"reference-count":66,"publisher":"Wiley","issue":"8","license":[{"start":{"date-parts":[[2008,12,1]],"date-time":"2008-12-01T00:00:00Z","timestamp":1228089600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Cognitive Science"],"published-print":{"date-parts":[[2008,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This article reviews current methods for evaluating models in the cognitive sciences, including theoretically based approaches, such as Bayes factors and minimum description length measures; simulation approaches, including model mimicry evaluations; and practical approaches, such as validation and generalization measures. This article argues that, although often useful in specific settings, most of these approaches are limited in their ability to give a general assessment of models. This article argues that hierarchical methods, generally, and hierarchical Bayesian methods, specifically, can provide a more thorough evaluation of models in the cognitive sciences. This article presents two worked examples of hierarchical Bayesian analyses to demonstrate how the approach addresses key questions of descriptive adequacy, parameter interference, prediction, and generalization in principled and coherent ways.<\/jats:p>","DOI":"10.1080\/03640210802414826","type":"journal-article","created":{"date-parts":[[2008,12,5]],"date-time":"2008-12-05T07:37:00Z","timestamp":1228462620000},"page":"1248-1284","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":247,"title":["A Survey of Model Evaluation Approaches With a Tutorial on Hierarchical Bayesian Methods"],"prefix":"10.1111","volume":"32","author":[{"given":"Richard M.","family":"Shiffrin","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael D.","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Woojae","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eric\u2010Jan","family":"Wagenmakers","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2008,12]]},"reference":[{"key":"e_1_2_8_2_1","doi-asserted-by":"publisher","DOI":"10.1080\/03640210802352992"},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0277(94)90018-3"},{"key":"e_1_2_8_4_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.114.3.539"},{"key":"e_1_2_8_5_1","doi-asserted-by":"publisher","DOI":"10.1006\/jmps.1999.1279"},{"key":"e_1_2_8_6_1","doi-asserted-by":"publisher","DOI":"10.1006\/jmps.1999.1282"},{"key":"e_1_2_8_7_1","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1111\/j.2517-6161.1995.tb02042.x","article-title":"Bayesian model choice via Markov chain Monte Carlo methods","volume":"57","author":"Carlin B. P.","year":"1995","journal-title":"Journal of the Royal Statistical Society, Series B"},{"key":"e_1_2_8_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-1276-8"},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1995.10476635"},{"key":"e_1_2_8_10_1","unstructured":"Chiu Y. C. Lin C. H. Huang J. T. Lin S. Lee P. L. Hsieh J. C.Immediate gain is long\u2010term loss: Are there foresighted decision makers in Iowa gambling taskSeptember 2005Paper presented at the 3rd annual meeting of the Society for Neuroeconomics. Kiawah Island South Carolina."},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.3758\/PBR.15.4.692"},{"key":"e_1_2_8_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2006.05.004"},{"key":"e_1_2_8_13_1","doi-asserted-by":"publisher","DOI":"10.2307\/2981683"},{"key":"e_1_2_8_14_1","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1111\/j.2517-6161.1991.tb01810.x","article-title":"Fisherian inference in likelihood and prequential frames of reference","volume":"53","author":"Dawid A. P.","year":"1991","journal-title":"Journal of the Royal Statistical Society B"},{"key":"e_1_2_8_15_1","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1093\/oso\/9780198522669.003.0007","volume-title":"Bayesian statistics 4","author":"Dawid A. P.","year":"1992"},{"key":"e_1_2_8_16_1","doi-asserted-by":"publisher","DOI":"10.2307\/3318616"},{"key":"e_1_2_8_17_1","doi-asserted-by":"publisher","DOI":"10.2307\/2685844"},{"key":"e_1_2_8_18_1","doi-asserted-by":"publisher","DOI":"10.2307\/2965703"},{"key":"e_1_2_8_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-4541-9"},{"key":"e_1_2_8_20_1","first-page":"148","volume-title":"Markov chain Monte Carlo in practice","author":"Gelfand A. E.","year":"1996"},{"key":"e_1_2_8_21_1","volume-title":"Bayesian data analysis","author":"Gelman A.","year":"2004"},{"key":"e_1_2_8_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4899-4485-6"},{"key":"e_1_2_8_23_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/82.4.711"},{"key":"e_1_2_8_24_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511816772.006"},{"key":"e_1_2_8_25_1","doi-asserted-by":"crossref","first-page":"5","DOI":"10.7551\/mitpress\/1114.001.0001","volume-title":"Advances in minimum description length: Theory and application","author":"Gr\u00fcnwald P. D.","year":"2005"},{"key":"e_1_2_8_26_1","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/4643.001.0001"},{"key":"e_1_2_8_27_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511790423"},{"key":"e_1_2_8_28_1","doi-asserted-by":"publisher","DOI":"10.1214\/088342304000000026"},{"key":"e_1_2_8_29_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1995.10476572"},{"key":"e_1_2_8_30_1","first-page":"233","volume-title":"Proceedings of the 8th international workshop on artificial intelligence and statistics","author":"Kontkanen P.","year":"2001"},{"key":"e_1_2_8_31_1","doi-asserted-by":"publisher","DOI":"10.3758\/PBR.15.1.1"},{"key":"e_1_2_8_32_1","doi-asserted-by":"publisher","DOI":"10.1080\/03640210802073697"},{"key":"e_1_2_8_33_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.112.3.662"},{"key":"e_1_2_8_34_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008929526011"},{"key":"e_1_2_8_35_1","volume-title":"Information theory, inference, and learning algorithms","author":"MacKay D. J. C.","year":"2003"},{"key":"e_1_2_8_36_1","doi-asserted-by":"crossref","first-page":"482","DOI":"10.1037\/h0045106","article-title":"The serial position effect in free recall","volume":"64","author":"Murdock B. B.","year":"1962","journal-title":"Journal of Experimental Psychology"},{"key":"e_1_2_8_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0022-2496(02)00028-7"},{"key":"e_1_2_8_38_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.170283897"},{"key":"e_1_2_8_39_1","doi-asserted-by":"publisher","DOI":"10.1006\/jmps.1999.1273"},{"key":"e_1_2_8_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmp.2005.06.008"},{"key":"e_1_2_8_41_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03210778"},{"key":"e_1_2_8_42_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03193089"},{"key":"e_1_2_8_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogpsych.2003.11.001"},{"key":"e_1_2_8_44_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.109.3.472"},{"key":"e_1_2_8_45_1","first-page":"1","volume-title":"Bayesian statistics 8","author":"Raftery A. E.","year":"2007"},{"key":"e_1_2_8_46_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.85.2.59"},{"key":"e_1_2_8_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/0005-1098(78)90005-5"},{"key":"e_1_2_8_48_1","doi-asserted-by":"publisher","DOI":"10.1093\/imamci\/3.2-3.211"},{"key":"e_1_2_8_49_1","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1176350051"},{"key":"e_1_2_8_50_1","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1111\/j.2517-6161.1987.tb01694.x","article-title":"Stochastic complexity","volume":"49","author":"Rissanen J.","year":"1987","journal-title":"Journal of the Royal Statistical Society, Series B"},{"key":"e_1_2_8_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/18.481776"},{"key":"e_1_2_8_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/18.930912"},{"key":"e_1_2_8_53_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03196750"},{"key":"e_1_2_8_54_1","doi-asserted-by":"publisher","DOI":"10.1037\/0096-3445.137.2.370"},{"key":"e_1_2_8_55_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03257252"},{"key":"e_1_2_8_56_1","doi-asserted-by":"publisher","DOI":"10.1037\/0278-7393.25.5.1161"},{"key":"e_1_2_8_57_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.103.4.734"},{"key":"e_1_2_8_58_1","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1176344136"},{"issue":"422","key":"e_1_2_8_59_1","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1080\/01621459.1993.10476299","article-title":"Linear model selection by cross\u2010validation","volume":"88","author":"Shao J.","year":"1993","journal-title":"Journal of the American Statistical Association"},{"key":"e_1_2_8_60_1","volume-title":"Data analysis: A Bayesian tutorial","author":"Sivia D. S.","year":"1996"},{"key":"e_1_2_8_61_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9868.00153"},{"key":"e_1_2_8_62_1","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1111\/j.2517-6161.1974.tb00994.x","article-title":"Cross\u2010validatory choice and assessment of statistical predictions (with discussion)","volume":"36","author":"Stone M.","year":"1974","journal-title":"Journal of the Royal Statistical Society B"},{"key":"e_1_2_8_63_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/64.1.29"},{"key":"e_1_2_8_64_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.108.3.550"},{"key":"e_1_2_8_65_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmp.2006.01.004"},{"key":"e_1_2_8_66_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmp.2003.11.004"},{"issue":"2","key":"e_1_2_8_67_1","article-title":"Model selection: Theoretical developments and applications [Special issue]","volume":"50","author":"Wagenmakers E.\u2010J.","year":"2006","journal-title":"Journal of Mathematical Psychology"}],"container-title":["Cognitive Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1080%2F03640210802414826","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1080%2F03640210802414826","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1080\/03640210802414826","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,26]],"date-time":"2024-10-26T16:46:18Z","timestamp":1729961178000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1080\/03640210802414826"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,12]]},"references-count":66,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2008,12]]}},"alternative-id":["10.1080\/03640210802414826"],"URL":"https:\/\/doi.org\/10.1080\/03640210802414826","archive":["Portico"],"relation":{},"ISSN":["0364-0213","1551-6709"],"issn-type":[{"value":"0364-0213","type":"print"},{"value":"1551-6709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2008,12]]},"assertion":[{"value":"2008-12-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}