{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,7]],"date-time":"2026-10-07T17:57:53Z","timestamp":1791395873596,"version":"4.3.3"},"reference-count":39,"publisher":"Institute of Mathematical Statistics","issue":"5","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Ann. Statist."],"published-print":{"date-parts":[[2024,10,1]]},"abstract":"Given a composite null P and composite alternative Q, when and how can we construct a p-value whose distribution is exactly uniform under the null, and stochastically smaller than uniform under the alternative? Similarly, when and how can we construct an e-value whose expectation exactly equals one under the null, but its expected logarithm under the alternative is positive? We answer these basic questions, and other related ones, when P and Q are convex polytopes (in the space of probability measures). We prove that such constructions are possible if and only if Q does not intersect the span of P. If the p-value is allowed to be stochastically larger than uniform under P\u2208P, and the e-value can have expectation at most one under P\u2208P, then it is achievable whenever P and Q are disjoint. More generally, even when P and Q are not polytopes, we characterize the existence of a bounded nontrivial e-variable whose expectation exactly equals one under any P\u2208P. The proofs utilize recently developed techniques in simultaneous optimal transport. A key role is played by coarsening the filtration: sometimes, no such p-value or e-value exists in the richest data filtration, but it does exist in some reduced filtration, and our work provides the first general characterization of this phenomenon. We also provide an iterative construction that explicitly constructs such processes, and under certain conditions it finds the one that grows fastest under a specific alternative Q. We discuss implications for the construction of composite nonnegative (super)martingales, and end with some conjectures and open problems.<\/jats:p>","DOI":"10.1214\/24-aos2434","type":"journal-article","created":{"date-parts":[[2024,11,21]],"date-time":"2024-11-21T01:28:23Z","timestamp":1732152503000},"page":"2241-2267","source":"Crossref","is-referenced-by-count":4,"title":["On the existence of powerful p-values and e-values for composite hypotheses"],"prefix":"10.1214","volume":"52","author":[{"given":"Zhenyuan","family":"Zhang","sequence":"first","affiliation":[{"name":"Department of Mathematics, Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aaditya","family":"Ramdas","sequence":"additional","affiliation":[{"name":"Department of Statistics & Data Science, Carnegie Mellon University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ruodu","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Statistics and Actuarial Science, University of Waterloo"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"108","reference":[{"key":"17","doi-asserted-by":"publisher","unstructured":"RAMDAS, A.<\/small>, RUF, J.<\/small>, LARSSON, M.<\/small> and KOOLEN, W. M.<\/small> (2022). Testing exchangeability: Fork-convexity, supermartingales and e-processes. Internat. J. Approx. Reason.<\/i> 141<\/b> 83\u2013109.","DOI":"10.1016\/j.ijar.2021.06.017"},{"key":"36","doi-asserted-by":"publisher","unstructured":"WASSERMAN, L.<\/small>, RAMDAS, A.<\/small> and BALAKRISHNAN, S.<\/small> (2020). Universal inference. Proc. Natl. Acad. Sci. USA<\/i> 117<\/b> 16880\u201316890.","DOI":"10.1073\/pnas.1922664117"},{"key":"10","doi-asserted-by":"publisher","unstructured":"Kelly, J. L. Jr.<\/small> (1956). A new interpretation of information rate. Bell Syst. Tech. J.<\/i> 35<\/b> 917\u2013926.","DOI":"10.1002\/j.1538-7305.1956.tb03809.x"},{"key":"20","doi-asserted-by":"publisher","unstructured":"SHAFER, G.<\/small> (2021). Testing by betting: A strategy for statistical and scientific communication. J. Roy. Statist. Soc. Ser. A<\/i> 184<\/b> 407\u2013478.","DOI":"10.1111\/rssa.12647"},{"key":"32","doi-asserted-by":"publisher","unstructured":"VOVK, V.<\/small> and WANG, R.<\/small> (2021). E-values: Calibration, combination and applications. Ann. Statist.<\/i> 49<\/b> 1736\u20131754.","DOI":"10.1214\/20-AOS2020"},{"key":"34","doi-asserted-by":"crossref","unstructured":"WANG, R.<\/small> and RAMDAS, A.<\/small> (2022). False discovery rate control with e-values. J. R. Stat. Soc. Ser. B. Stat. Methodol.<\/i> 84<\/b> 822\u2013852.","DOI":"10.1111\/rssb.12489"},{"key":"31","doi-asserted-by":"publisher","unstructured":"VOVK, V.<\/small> (2021). Testing randomness online. Statist. Sci.<\/i> 36<\/b> 595\u2013611.","DOI":"10.1214\/20-sts817"},{"key":"9","doi-asserted-by":"publisher","unstructured":"HOWARD, S. R.<\/small>, RAMDAS, A.<\/small>, MCAULIFFE, J.<\/small> and SEKHON, J.<\/small> (2021). Time-uniform, nonparametric, nonasymptotic confidence sequences. Ann. Statist.<\/i> 49<\/b> 1055\u20131080.","DOI":"10.1214\/20-aos1991"},{"key":"24","doi-asserted-by":"publisher","unstructured":"Shaked, M.<\/small> and Shanthikumar, J. G.<\/small> (2007). Stochastic Orders<\/i>. Springer Series in Statistics<\/i>. Springer, New York.","DOI":"10.1007\/978-0-387-34675-5"},{"key":"5","doi-asserted-by":"publisher","unstructured":"Darling, D. A.<\/small> and Robbins, H.<\/small> (1967). Confidence sequences for mean, variance, and median. Proc. Natl. Acad. Sci. USA<\/i> 58<\/b> 66\u201368.","DOI":"10.1073\/pnas.58.1.66"},{"key":"18","doi-asserted-by":"crossref","unstructured":"Robbins, H.<\/small> and Siegmund, D.<\/small> (1974). The expected sample size of some tests of power one. Ann. Statist.<\/i> 2<\/b> 415\u2013436.","DOI":"10.1214\/aos\/1176342704"},{"key":"21","doi-asserted-by":"publisher","unstructured":"Shafer, G.<\/small>, Shen, A.<\/small>, Vereshchagin, N.<\/small> and Vovk, V.<\/small> (2011). Test martingales, Bayes factors and p<\/i>-values. Statist. Sci.<\/i> 26<\/b> 84\u2013101.","DOI":"10.1214\/10-STS347"},{"key":"23","doi-asserted-by":"crossref","unstructured":"Shafer, G.<\/small> and Vovk, V.<\/small> (2019). Game-Theoretic Foundations for Probability and Finance<\/i>. Wiley, Hoboken, NJ.","DOI":"10.1002\/9781118548035"},{"key":"30","doi-asserted-by":"publisher","unstructured":"Villani, C.<\/small> (2009). Optimal Transport<\/i>: Old and New<\/i>. Grundlehren der Mathematischen Wissenschaften<\/i> [Fundamental Principles of Mathematical Sciences<\/i>] 338<\/b>. Springer, Berlin.","DOI":"10.1007\/978-3-540-71050-9"},{"key":"28","doi-asserted-by":"publisher","unstructured":"Strassen, V.<\/small> (1965). The existence of probability measures with given marginals. Ann. Math. Stat.<\/i> 36<\/b> 423\u2013439.","DOI":"10.1214\/aoms\/1177700153"},{"key":"19","doi-asserted-by":"publisher","unstructured":"SANTAMBROGIO, F.<\/small> (2015). Optimal Transport for Applied Mathematicians<\/i>: Calculus of Variations, PDEs, and Modeling<\/i>. Progress in Nonlinear Differential Equations and Their Applications<\/i> 87<\/b>. Birkh\u00e4user, Cham.","DOI":"10.1007\/978-3-319-20828-2"},{"key":"37","doi-asserted-by":"publisher","unstructured":"WAUDBY-SMITH, I.<\/small> and RAMDAS, A.<\/small> (2024). Estimating means of bounded random variables by betting. J. R. Stat. Soc. Ser. B. Stat. Methodol.<\/i> 86<\/b> 1\u201327.","DOI":"10.1093\/jrsssb\/qkad009"},{"key":"15","doi-asserted-by":"publisher","unstructured":"RAMDAS, A.<\/small>, GR\u00dcNWALD, P.<\/small>, VOVK, V.<\/small> and SHAFER, G.<\/small> (2023). Game-theoretic statistics and safe anytime-valid inference. Statist. Sci.<\/i> 38<\/b> 576\u2013601.","DOI":"10.1214\/23-sts894"},{"key":"38","doi-asserted-by":"crossref","unstructured":"WILKS, S. S.<\/small> (1938). The large-sample distribution of the likelihood ratio for testing composite hypotheses. Ann. Math. Stat.<\/i> 9<\/b> 60\u201362.","DOI":"10.1214\/aoms\/1177732360"},{"key":"26","doi-asserted-by":"publisher","unstructured":"SIMON, B.<\/small> (2011). Convexity<\/i>: An Analytic Viewpoint<\/i>. Cambridge Tracts in Mathematics<\/i> 187<\/b>. Cambridge Univ. Press, Cambridge.","DOI":"10.1017\/CBO9780511910135"},{"key":"1","doi-asserted-by":"publisher","unstructured":"BELL, R.<\/small> and COVER, T. M.<\/small> (1988). Game-theoretic optimal portfolios. Manage. Sci.<\/i> 34<\/b> 724\u2013733.","DOI":"10.1287\/mnsc.34.6.724"},{"key":"2","doi-asserted-by":"publisher","unstructured":"BERGER, A.<\/small> (1951). On uniformly consistent tests. Ann. Math. Stat.<\/i> 22<\/b> 289\u2013293.","DOI":"10.1214\/aoms\/1177729649"},{"key":"3","doi-asserted-by":"publisher","unstructured":"BERTANHA, M.<\/small> and MOREIRA, M. J.<\/small> (2020). Impossible inference in econometrics: Theory and applications. J. Econometrics<\/i> 218<\/b> 247\u2013270.","DOI":"10.1016\/j.jeconom.2020.04.016"},{"key":"4","unstructured":"BREIMAN, L.<\/small> (1960). Optimal gambling systems for favorable games. In Proc<\/i>. 4th Berkeley Sympos. Math. Statist. And Prob<\/i>., Vol. I<\/i> 65\u201378. Univ. California Press, Berkeley."},{"key":"6","unstructured":"GANGRADE, A.<\/small>, RINALDO, A.<\/small> and RAMDAS, A.<\/small> (2023). A sequential test for log-concavity. arXiv preprint. Available at arXiv:2301.03542<\/a>."},{"key":"7","unstructured":"GR\u00dcNWALD, P. D.<\/small>, DE HEIDE, R.<\/small> and KOOLEN, W.<\/small> (2024). Safe testing. J. Roy. Statist. Soc. Ser. B<\/i>."},{"key":"8","doi-asserted-by":"publisher","unstructured":"HOEFFDING, W.<\/small> and WOLFOWITZ, J.<\/small> (1958). Distinguishability of sets of distributions. (The case of independent and identically distributed chance variables). Ann. Math. Stat.<\/i> 29<\/b> 700\u2013718.","DOI":"10.1214\/aoms\/1177706531"},{"key":"11","unstructured":"KRAFT, C.<\/small> (1955). Some conditions for consistency and uniform consistency of statistical procedures. Univ. California Publ. Statist.<\/i> 2<\/b> 125\u2013141."},{"key":"12","doi-asserted-by":"publisher","unstructured":"K\u00dcHNEL, W.<\/small> (2015). Differential Geometry<\/i>: Curves\u2014Surfaces\u2014Manifolds<\/i>, 3rd ed. Student Mathematical Library<\/i> 77<\/b>. Am. Math. Soc., Providence, RI. Translated from the 2013 German edition by Bruce Hunt, with corrections and additions by the author.","DOI":"10.1090\/stml\/077"},{"key":"13","unstructured":"LARDY, T.<\/small>, GR\u00dcNWALD, P.<\/small> and HARREMO\u00cbS, P.<\/small>, (2023). Universal reverse information projections and optimal e-statistics. To appear in IEEE Transactions on Information Theory<\/i>. Available at arXiv:2306.16646<\/a>."},{"key":"14","unstructured":"LARSSON, M.<\/small>, RAMDAS, A.<\/small> and RUF, J.<\/small> (2024). The numeraire e-variable and reverse information projection. arXiv preprint. Available at arXiv:2402.18810<\/a>."},{"key":"16","unstructured":"RAMDAS, A.<\/small>, RUF, J.<\/small>, LARSSON, M.<\/small> and KOOLEN, W.<\/small> (2020). Admissible anytime-valid sequential inference must rely on nonnegative martingales. Available at arXiv:2009.03167<\/a>."},{"key":"22","doi-asserted-by":"publisher","unstructured":"SHAFER, G.<\/small> and VOVK, V.<\/small> (2001). Probability and Finance<\/i>: It\u2019s Only a Game!<\/i>. Wiley Series in Probability and Statistics. Financial Engineering Section<\/i>. Wiley-Interscience, New York.","DOI":"10.1002\/0471249696"},{"key":"25","doi-asserted-by":"publisher","unstructured":"SHEN, J.<\/small>, SHEN, Y.<\/small>, WANG, B.<\/small> and WANG, R.<\/small> (2019). Distributional compatibility for change of measures. Finance Stoch.<\/i> 23<\/b> 761\u2013794.","DOI":"10.1007\/s00780-019-00393-4"},{"key":"27","doi-asserted-by":"publisher","unstructured":"SIMONS, G.<\/small> (1970). A martingale decomposition theorem. Ann. Math. Stat.<\/i> 41<\/b> 1102\u20131104.","DOI":"10.1214\/aoms\/1177696991"},{"key":"29","doi-asserted-by":"publisher","unstructured":"TESCHL, G.<\/small> (2012). Ordinary Differential Equations and Dynamical Systems<\/i>. Graduate Studies in Mathematics<\/i> 140<\/b>. Am. Math. Soc., Providence, RI.","DOI":"10.1090\/gsm\/140"},{"key":"33","doi-asserted-by":"crossref","unstructured":"VOVK, V.<\/small> and WANG, R.<\/small> (2024). Nonparametric e-tests of symmetry. N. Engl. J. Statist. Data Sci.<\/i> 1\u201310.","DOI":"10.51387\/24-NEJSDS60"},{"key":"35","unstructured":"WANG, R.<\/small> and ZHANG, Z.<\/small> (2023). Simultaneous optimal transport. arXiv preprint. Available at arXiv:2201.03483v2<\/a>."},{"key":"39","doi-asserted-by":"crossref","unstructured":"ZHANG, Z.<\/small>, RAMDAS, A.<\/small> and WANG, R.<\/small> (2024). Supplement to \u201cOn the existence of powerful p-values and e-values for composite hypotheses.\u201d https:\/\/doi.org\/10.1214\/24-AOS2434SUPP<\/a>","DOI":"10.1214\/24-AOS2434SUPP"}],"container-title":["The Annals of Statistics"],"original-title":[],"deposited":{"date-parts":[[2026,10,7]],"date-time":"2026-10-07T17:27:45Z","timestamp":1791394065000},"score":1,"resource":{"primary":{"URL":"https:\/\/projecteuclid.org\/journals\/annals-of-statistics\/volume-52\/issue-5\/On-the-existence-of-powerful-p-values-and-e-values\/10.1214\/24-AOS2434.full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,1]]},"references-count":39,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,10,1]]}},"URL":"https:\/\/doi.org\/10.1214\/24-aos2434","relation":{},"ISSN":["0090-5364","2168-8966"],"issn-type":[{"value":"0090-5364","type":"print"},{"value":"2168-8966","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,1]]}}}