{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T11:04:49Z","timestamp":1777892689407,"version":"3.51.4"},"reference-count":25,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2016,7,13]],"date-time":"2016-07-13T00:00:00Z","timestamp":1468368000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001807","name":"FAPESP","doi-asserted-by":"publisher","award":["2014\/25302-2"],"award-info":[{"award-number":["2014\/25302-2"]}],"id":[{"id":"10.13039\/501100001807","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001807","name":"FAPESP","doi-asserted-by":"publisher","award":["2014\/50279-4"],"award-info":[{"award-number":["2014\/50279-4"]}],"id":[{"id":"10.13039\/501100001807","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003593","name":"CNPq","doi-asserted-by":"publisher","award":["301206\/2011-2"],"award-info":[{"award-number":["301206\/2011-2"]}],"id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Simultaneous hypothesis tests can fail to provide results that meet logical requirements. For example, if A and B are two statements such that A implies B, there exist tests that, based on the same data, reject B but not A. Such outcomes are generally inconvenient to statisticians (who want to communicate the results to practitioners in a simple fashion) and non-statisticians (confused by conflicting pieces of information). Based on this inconvenience, one might want to use tests that satisfy logical requirements. However, Izbicki and Esteves shows that the only tests that are in accordance with three logical requirements (monotonicity, invertibility and consonance) are trivial tests based on point estimation, which generally lack statistical optimality. As a possible solution to this dilemma, this paper adapts the above logical requirements to agnostic tests, in which one can accept, reject or remain agnostic with respect to a given hypothesis. Each of the logical requirements is characterized in terms of a Bayesian decision theoretic perspective. Contrary to the results obtained for regular hypothesis tests, there exist agnostic tests that satisfy all logical requirements and also perform well statistically. In particular, agnostic tests that fulfill all logical requirements are characterized as region estimator-based tests. Examples of such tests are provided.<\/jats:p>","DOI":"10.3390\/e18070256","type":"journal-article","created":{"date-parts":[[2016,7,13]],"date-time":"2016-07-13T09:48:45Z","timestamp":1468403325000},"page":"256","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["The Logical Consistency of Simultaneous Agnostic Hypothesis Tests"],"prefix":"10.3390","volume":"18","author":[{"given":"Lu\u00eds","family":"Esteves","sequence":"first","affiliation":[{"name":"Institute of Mathematics and Statistics, University of S\u00e3o Paulo, S\u00e3o Paulo 13565-905, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rafael","family":"Izbicki","sequence":"additional","affiliation":[{"name":"Department of Statistics, Federal University of S\u00e3o Carlos, S\u00e3o Carlos 05508-090, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2720-3871","authenticated-orcid":false,"given":"Julio","family":"Stern","sequence":"additional","affiliation":[{"name":"Institute of Mathematics and Statistics, University of S\u00e3o Paulo, S\u00e3o Paulo 13565-905, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rafael","family":"Stern","sequence":"additional","affiliation":[{"name":"Department of Statistics, Federal University of S\u00e3o Carlos, S\u00e3o Carlos 05508-090, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,7,13]]},"reference":[{"key":"ref_1","unstructured":"Wiener, Y., and El-Yaniv, R. (2011). Advances in Neural Information Processing Systems, MIT Press."},{"key":"ref_2","unstructured":"Balsubramani, A. (2016). Learning to abstain from binary prediction."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"732","DOI":"10.1093\/jigpal\/jzv027","article-title":"Logical consistency in simultaneous statistical test procedures","volume":"23","author":"Izbicki","year":"2015","journal-title":"Logic J. IGPL"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1194","DOI":"10.1214\/aos\/1031689023","article-title":"The partitioning principle: A powerful tool in multiple decision theory","volume":"30","author":"Finner","year":"2002","journal-title":"Ann. Stat."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1002\/bimj.200810462","article-title":"General solutions to multiple testing problems","volume":"50","author":"Sonnemann","year":"2008","journal-title":"Biom. J."},{"key":"ref_6","first-page":"14","article-title":"S-value: An alternative measure of evidence for testing general null hypotheses","volume":"36","author":"Patriota","year":"2014","journal-title":"Cienc. Nat."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"6534","DOI":"10.3390\/e17106534","article-title":"A bayesian decision-theoretic approach to logically-consistent hypothesis testing","volume":"17","author":"Esteves","year":"2015","journal-title":"Entropy"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"631","DOI":"10.1016\/j.socec.2004.09.036","article-title":"No-decision classification: An alternative to testing for statistical significance","volume":"33","author":"Berg","year":"2004","journal-title":"J. Socio-Econ."},{"key":"ref_9","unstructured":"Babb, J., Rogatko, A., and Zacks, S. (1998). Asymptotic Methods in Probability and Statistics, Elsevier."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ripley, B.D. (1996). Pattern Recognition and Neural Networks, Cambridge University Press.","DOI":"10.1017\/CBO9780511812651"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"99","DOI":"10.3390\/e1040099","article-title":"Evidence and credibility: Full bayesian significance test for precise hypotheses","volume":"1","author":"Stern","year":"1999","journal-title":"Entropy"},{"key":"ref_12","first-page":"317","article-title":"Testing precise hypotheses","volume":"2","author":"Berger","year":"1987","journal-title":"Stat. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: A practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J. R. Stat. Soc."},{"key":"ref_14","unstructured":"Jaynes, E.T. (1976). Foundations of Probability Theory, Statistical Inference, and Statistical Theories of Science, Springer."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1214\/aoms\/1177697819","article-title":"Simultaneous test procedures\u2014Some theory of multiple comparisons","volume":"41","author":"Gabriel","year":"1969","journal-title":"Ann. Math. Stat."},{"key":"ref_16","unstructured":"Fossaluza, V., Izbicki, R., da Silva, G.M., and Esteves, L.G. (2016). Coherent hypothesis testing. Am. Stat., submitted for publication."},{"key":"ref_17","unstructured":"Bauer, P., Hommel, G., and Sonnemann, E. (1988). Multiple Hypothesenpr\u00fcfung, Springer. (In German)."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1080\/00031305.1999.10474443","article-title":"Bayes factors: What they are and what they are not","volume":"53","author":"Lavine","year":"1999","journal-title":"Am. Stat."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Izbicki, R., Fossaluza, V., Hounie, A.G., Nakano, E.Y., and Pereira, C.A.B. (2012). Testing allele homogeneity: The problem of nested hypotheses. BMC Genet., 13.","DOI":"10.1186\/1471-2156-13-103"},{"key":"ref_20","first-page":"203","article-title":"p values: What they are and what they are not","volume":"50","author":"Schervish","year":"1996","journal-title":"Am. Stat."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Hochberg, Y., and Tamhane, A.C. (1987). Multiple Comparison Procedures, John Wiley & Sons.","DOI":"10.1002\/9780470316672"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1093\/jigpal\/jzm032","article-title":"The rules of logic composition for the bayesian epistemic e-values","volume":"15","author":"Borges","year":"2007","journal-title":"Logic J. IGPL"},{"key":"ref_23","unstructured":"Johnson, R.A., and Wichern, D.W. (2007). Applied Multivariate Statistical Analysis, Pearson. [6th ed.]."},{"key":"ref_24","unstructured":"Schervish, M.J. (1997). Theory of Statistics, Springer."},{"key":"ref_25","unstructured":"Robert, C. (2007). The Bayesian Choice: From Decision-Theoretic Foundations to Computational Implementation, Springer. [2nd ed.]."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/18\/7\/256\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:26:00Z","timestamp":1760210760000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/18\/7\/256"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,7,13]]},"references-count":25,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2016,7]]}},"alternative-id":["e18070256"],"URL":"https:\/\/doi.org\/10.3390\/e18070256","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,7,13]]}}}