{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:38:12Z","timestamp":1760240292207,"version":"build-2065373602"},"reference-count":28,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2019,4,29]],"date-time":"2019-04-29T00:00:00Z","timestamp":1556496000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["NWO-talent grant (406-15- 1444 062)","NWO-VIDI grant (452-14-006)"],"award-info":[{"award-number":["NWO-talent grant (406-15- 1444 062)","NWO-VIDI grant (452-14-006)"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The present paper contrasts two related criteria for the evaluation of prior-data conflict: the Data Agreement Criterion (DAC; Bousquet, 2008) and the criterion of Nott et al. (2016). One aspect that these criteria have in common is that they depend on a distance measure, of which dozens are available, but so far, only the Kullback-Leibler has been used. We describe and compare both criteria to determine whether a different choice of distance measure might impact the results. By means of a simulation study, we investigate how the choice of a specific distance measure influences the detection of prior-data conflict. The DAC seems more susceptible to the choice of distance measure, while the criterion of Nott et al. seems to lead to reasonably comparable conclusions of prior-data conflict, regardless of the distance measure choice. We conclude with some practical suggestions for the user of the DAC and the criterion of Nott et al.<\/jats:p>","DOI":"10.3390\/e21050446","type":"journal-article","created":{"date-parts":[[2019,4,29]],"date-time":"2019-04-29T07:01:22Z","timestamp":1556521282000},"page":"446","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["How the Choice of Distance Measure Influences the Detection of Prior-Data Conflict"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2996-5194","authenticated-orcid":false,"given":"Kimberley","family":"Lek","sequence":"first","affiliation":[{"name":"Department of Methods and Statistics, Utrecht University, 3584 CH 14 Utrecht, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rens","family":"Van De Schoot","sequence":"additional","affiliation":[{"name":"Department of Methods and Statistics, Utrecht University, 3584 CH 14 Utrecht, The Netherlands"},{"name":"Optentia Research Program, Faculty of Humanities, North-West University, Vanderbijlpark 1900, South Africa"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,4,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"O\u2019Hagan, A., Buck, C.E., Daneshkhah, A., Eiser, J.R., Garthwaite, P.H., Jenkinson, D.J., Oakley, J.E., and Rakow, T. (2006). Uncertain Judgements: Eliciting Experts\u2019 Probabilities, John Wiley & Sons. [3rd ed.].","DOI":"10.1002\/0470033312"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"900","DOI":"10.1111\/j.1461-0248.2010.01477.x","article-title":"A guide to eliciting and using expert knowledge in Bayesian ecological models","volume":"13","author":"Kuhnert","year":"2010","journal-title":"Ecol. Lett."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/env.935","article-title":"Comparison of three expert elicitation methods for logistic regression on predicting the presence of the threatened brush-tailed rock-wallaby Petrogale penicillata","volume":"20","author":"Murray","year":"2009","journal-title":"Environmetrics"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1111\/j.1523-1739.2011.01806.x","article-title":"Eliciting expert knowledge in conservation science","volume":"26","author":"Martin","year":"2011","journal-title":"Conserv. Biol."},{"key":"ref_5","first-page":"1","article-title":"Application and evaluation of an expert judgment elicitation procedure for correlations","volume":"8","author":"Lek","year":"2017","journal-title":"Front. Psychol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/feduc.2018.00082","article-title":"Development and evaluation of a digital expert elicitation method aimed at fostering elementary school teachers\u2019 diagnostic competence","volume":"3","author":"Lek","year":"2018","journal-title":"Front. Educ."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1011","DOI":"10.1080\/02664760802192981","article-title":"Diagnostics of prior-data agreement in applied Bayesian analysis","volume":"35","author":"Bousquet","year":"2008","journal-title":"J. Appl. Stat."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1214\/06-BA129","article-title":"Checking for prior-data conflict","volume":"1","author":"Evans","year":"2006","journal-title":"Bayesian Anal."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Veen, D., Stoel, D., Schalken, N., Mulder, K., and Van De Schoot, R. (2018). Using the data agreement criterion to rank experts\u2019 beliefs. Entropy, 20.","DOI":"10.3390\/e20080592"},{"key":"ref_10","unstructured":"Nott, D.J., Xueou, W., Evans, M., and Englert, B.-G. (2016). Checking for prior-data conflict using prior to posterior divergences. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1037\/met0000131","article-title":"Testing small variance priors using prior-posterior predictive p values","volume":"23","author":"Hoijtink","year":"2018","journal-title":"Psychol. Methods"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1214\/aoms\/1177729694","article-title":"On information and sufficiency","volume":"1","author":"Kullback","year":"1951","journal-title":"Ann. Math. Stat."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Deza, M.M., and Deza, E. (2009). Encyclopedia of Distances, Springer.","DOI":"10.1007\/978-3-642-00234-2"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1111\/j.2517-6161.1979.tb01066.x","article-title":"Reference posterior distributions for Bayesian inference","volume":"41","author":"Bernardo","year":"1979","journal-title":"J. Royal Stat. Soc. B Methodol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"905","DOI":"10.1214\/07-AOS587","article-title":"The formal definition of reference priors","volume":"37","author":"Berger","year":"2009","journal-title":"Ann. Stat."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"383","DOI":"10.2307\/2982063","article-title":"Sampling and Bayes\u2019 inference in scientific modelling and robustness","volume":"143","author":"Box","year":"1980","journal-title":"J. Royal Stat. Soc. A"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1034","DOI":"10.1016\/j.spl.2011.02.025","article-title":"A limit result for the prior predictive applied to checking for prior-data conflict","volume":"81","author":"Evans","year":"2011","journal-title":"Stat. Probab. Lett."},{"key":"ref_18","unstructured":"Upadhyay, A., Singh, U., and Dey, D. (2007). Checking for prior-data conflict with hierarchically specified priors. Bayesian Statistics and its Applications, Anamaya Publishers."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Cox, D.R., and Hinkley, D.V. (1974). Theoretical Statistics, Chapman and Hall.","DOI":"10.1007\/978-1-4899-2887-0"},{"key":"ref_20","unstructured":"Jang, G.-H. (2010). Invariant procedures for model checking, checking for prior-data conflict and Bayesian inference. [Ph.D. Thesis, University of Toronto]."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Evans, M. (2015). Measuring Statistical Evidence Using Relative Belief, Taylor & Francis.","DOI":"10.1201\/b18587"},{"key":"ref_22","unstructured":"Bernardo, J.M., and Smith, A.F.M. (2000). Bayesian Theory, John Wiley & Sons Ltd.. Paperback."},{"key":"ref_23","unstructured":"RStudio Team (2019, April 09). RStudio: Integrated Development for R. Available online: http:\/\/www.rstudio.com."},{"key":"ref_24","unstructured":"Drost, H.-G. (2019, April 09). Package \u2018Philentropy\u2019, Similarity and Distance Quantification between Probability Functions. Available online: https:\/\/github.com\/HajkD\/philentropy."},{"key":"ref_25","first-page":"2","article-title":"S4 Classes for Distributions","volume":"6","author":"Ruckdeschel","year":"2006","journal-title":"R News"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1111\/j.2517-6161.1966.tb00626.x","article-title":"A general class of coefficients of divergence of one distribution from another","volume":"28","author":"Ali","year":"1966","journal-title":"J. Royal Stat. Soc. Ser. B"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"4394","DOI":"10.1109\/TIT.2006.881731","article-title":"On divergences and informations in statistics and information theory","volume":"52","author":"Liese","year":"2006","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_28","first-page":"300","article-title":"Comprehensive survey on distance\/similarity measures between probability density functions","volume":"1","author":"Cha","year":"2007","journal-title":"Int. J. Math. Model. Methods Appl. Sci."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/5\/446\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:48:01Z","timestamp":1760186881000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/5\/446"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,29]]},"references-count":28,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2019,5]]}},"alternative-id":["e21050446"],"URL":"https:\/\/doi.org\/10.3390\/e21050446","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2019,4,29]]}}}