{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T06:12:23Z","timestamp":1782281543085,"version":"3.54.5"},"reference-count":28,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2024,2,28]],"date-time":"2024-02-28T00:00:00Z","timestamp":1709078400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/501100008982","name":"NSF","doi-asserted-by":"publisher","award":["grant DMS-2015259"],"award-info":[{"award-number":["grant DMS-2015259"]}],"id":[{"id":"10.13039\/501100008982","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","award":["grant R01-GM129781"],"award-info":[{"award-number":["grant R01-GM129781"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,9,13]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Motivated by applications in text mining and discrete distribution inference, we test for equality of probability mass functions of K groups of high-dimensional multinomial distributions. Special cases of this problem include global testing for topic models, two-sample testing in authorship attribution, and closeness testing for discrete distributions. A test statistic, which is shown to have an asymptotic standard normal distribution under the null hypothesis, is proposed. This parameter-free limiting null distribution holds true without requiring identical multinomial parameters within each group or equal group sizes. The optimal detection boundary for this testing problem is established, and the proposed test is shown to achieve this optimal detection boundary across the entire parameter space of interest. The proposed method is demonstrated in simulation studies and applied to analyse two real-world datasets to examine, respectively, variation among customer reviews of Amazon movies and the diversity of statistical paper abstracts.<\/jats:p>","DOI":"10.1093\/jrsssb\/qkae003","type":"journal-article","created":{"date-parts":[[2024,2,28]],"date-time":"2024-02-28T19:26:15Z","timestamp":1709148375000},"page":"922-942","source":"Crossref","is-referenced-by-count":2,"title":["Testing high-dimensional multinomials with applications to text analysis"],"prefix":"10.1093","volume":"86","author":[{"given":"T Tony","family":"Cai","sequence":"first","affiliation":[{"name":"Department of Statistics and Data Science, University of Pennsylvania , Philadelphia, PA , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4550-235X","authenticated-orcid":false,"given":"Zheng T","family":"Ke","sequence":"additional","affiliation":[{"name":"Department of Statistics, Harvard University , Cambridge, MA , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7818-0182","authenticated-orcid":false,"given":"Paxton","family":"Turner","sequence":"additional","affiliation":[{"name":"Department of Statistics, Harvard University , Cambridge, MA , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2024,2,28]]},"reference":[{"issue":"2","key":"2024091323312957800_qkae003-B1","doi-asserted-by":"publisher","first-page":"2170","DOI":"10.1214\/15-EJS1066","article-title":"The sparse Poisson means model","volume":"9","author":"Arias-Castro","year":"2015","journal-title":"Electronic Journal of Statistics"},{"issue":"2","key":"2024091323312957800_qkae003-B2","doi-asserted-by":"publisher","first-page":"99","DOI":"10.2753\/JEC1086-4415170204","article-title":"Helpfulness of online consumer reviews: Readers\u2019 objectives and review cues","volume":"17","author":"Baek","year":"2012","journal-title":"International Journal of Electronic Commerce"},{"issue":"2","key":"2024091323312957800_qkae003-B3","doi-asserted-by":"publisher","first-page":"727","DOI":"10.1214\/18-AOAS1155SF","article-title":"Hypothesis testing for high-dimensional multinomials: A selective review","volume":"12","author":"Balakrishnan","year":"2018","journal-title":"The Annals of Applied Statistics"},{"issue":"4","key":"2024091323312957800_qkae003-B4","doi-asserted-by":"publisher","first-page":"1893","DOI":"10.1214\/18-AOS1729","article-title":"Hypothesis testing for densities and high-dimensional multinomials: Sharp local minimax rates","volume":"47","author":"Balakrishnan","year":"2019","journal-title":"The Annals of Statistics"},{"issue":"3","key":"2024091323312957800_qkae003-B5","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1093\/biomet\/asz024","article-title":"Nonparametric independence testing via mutual information","volume":"106","author":"Berrett","year":"2019","journal-title":"Biometrika"},{"key":"2024091323312957800_qkae003-B6","first-page":"1","article-title":"Testing closeness with unequal sized samples","volume":"28","author":"Bhattacharya","year":"2015","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2024091323312957800_qkae003-B7","first-page":"993","article-title":"Latent dirichlet allocation","volume":"3","author":"Blei","year":"2003","journal-title":"Journal of Machine Learning Research"},{"key":"2024091323312957800_qkae003-B8","author":"Cai","year":"2023"},{"key":"2024091323312957800_qkae003-B9","author":"Chan","year":"2014"},{"issue":"3","key":"2024091323312957800_qkae003-B10","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1509\/jmkr.43.3.345","article-title":"The effect of word of mouth on sales: Online book reviews","volume":"43","author":"Chevalier","year":"2006","journal-title":"Journal of Marketing Research"},{"key":"2024091323312957800_qkae003-B11","author":"Diakonikolas","year":"2016"},{"issue":"3","key":"2024091323312957800_qkae003-B12","doi-asserted-by":"publisher","first-page":"962","DOI":"10.1214\/009053604000000265","article-title":"Higher criticism for detecting sparse heterogeneous mixtures","volume":"32","author":"Donoho","year":"2004","journal-title":"The Annals of Statistics"},{"issue":"3","key":"2024091323312957800_qkae003-B13","doi-asserted-by":"publisher","first-page":"1447","DOI":"10.1214\/21-AOS2158","article-title":"Higher criticism to compare two large frequency tables, with sensitivity to possible rare and weak differences","volume":"50","author":"Donoho","year":"2022","journal-title":"The Annals of Statistics"},{"issue":"13","key":"2024091323312957800_qkae003-B14","doi-asserted-by":"publisher","first-page":"13","DOI":"10.5120\/11638-7118","article-title":"A survey of text similarity approaches","volume":"68","author":"Gomaa","year":"2013","journal-title":"International Journal of Computer Applications"},{"key":"2024091323312957800_qkae003-B15","volume-title":"Martingale limit theory and its application","author":"Hall","year":"2014"},{"issue":"2","key":"2024091323312957800_qkae003-B16","doi-asserted-by":"publisher","first-page":"801","DOI":"10.1093\/qje\/qjx045","article-title":"Transparency and deliberation within the FOMC: A computational linguistics approach","volume":"133","author":"Hansen","year":"2018","journal-title":"The Quarterly Journal of Economics"},{"issue":"4","key":"2024091323312957800_qkae003-B17","doi-asserted-by":"publisher","first-page":"1779","DOI":"10.1214\/15-AOAS896","article-title":"Coauthorship and citation networks for statisticians","volume":"10","author":"Ji","year":"2016","journal-title":"The Annals of Applied Statistics"},{"key":"2024091323312957800_qkae003-B18","volume-title":"Speech and language processing","author":"Jurafsky","year":"2023","edition":"3rd ed."},{"key":"2024091323312957800_qkae003-B19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/01621459.2022.2123813","article-title":"Using SVD for topic modeling","author":"Ke","year":"2022","journal-title":"Journal of the American Statistical Association"},{"issue":"1","key":"2024091323312957800_qkae003-B20","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1214\/21-AOS2103","article-title":"Minimax optimality of permutation tests","volume":"50","author":"Kim","year":"2022","journal-title":"The Annals of Statistics"},{"issue":"2","key":"2024091323312957800_qkae003-B21","doi-asserted-by":"publisher","first-page":"1236","DOI":"10.1214\/21-AOAS1544","article-title":"Higher criticism for discriminating word-frequency tables and authorship attribution","volume":"16","author":"Kipnis","year":"2022","journal-title":"The Annals of Applied Statistics"},{"key":"2024091323312957800_qkae003-B22","author":"Kipnis","year":"2021"},{"issue":"4","key":"2024091323312957800_qkae003-B23","doi-asserted-by":"publisher","first-page":"610","DOI":"10.1016\/j.molcel.2015.04.005","article-title":"The technology and biology of single-cell RNA sequencing","volume":"58","author":"Kolodziejczyk","year":"2015","journal-title":"Molecular Cell"},{"key":"2024091323312957800_qkae003-B24","doi-asserted-by":"publisher","first-page":"102539","DOI":"10.1016\/j.ijhm.2020.102539","article-title":"Are all five points equal? Scaling heterogeneity in hotel online ratings","volume":"88","author":"Leung","year":"2020","journal-title":"International Journal of Hospitality Management"},{"key":"2024091323312957800_qkae003-B25","author":"Maurya","year":"2018"},{"issue":"302","key":"2024091323312957800_qkae003-B26","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1080\/01621459.1963.10500849","article-title":"Inference in an authorship problem: A comparative study of discrimination methods applied to the authorship of the disputed federalist papers","volume":"58","author":"Mosteller","year":"1963","journal-title":"Journal of the American Statistical Association"},{"key":"2024091323312957800_qkae003-B27","volume-title":"Applied Bayesian and classical inference: The case of the federalist papers","author":"Mosteller","year":"2012"},{"issue":"1","key":"2024091323312957800_qkae003-B28","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1137\/151002526","article-title":"An automatic inequality prover and instance optimal identity testing","volume":"46","author":"Valiant","year":"2017","journal-title":"SIAM Journal on Computing"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/86\/4\/922\/59112631\/qkae003.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/86\/4\/922\/59112631\/qkae003.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,14]],"date-time":"2024-09-14T08:16:18Z","timestamp":1726301778000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/86\/4\/922\/7615734"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,28]]},"references-count":28,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2024,2,28]]},"published-print":{"date-parts":[[2024,9,13]]}},"URL":"https:\/\/doi.org\/10.1093\/jrsssb\/qkae003","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,9]]},"published":{"date-parts":[[2024,2,28]]}}}