{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,15]],"date-time":"2026-10-15T07:01:36Z","timestamp":1792047696461,"version":"4.4.0"},"reference-count":65,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2021,9,14]],"date-time":"2021-09-14T00:00:00Z","timestamp":1631577600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100012338","name":"Alan Turing Institute","doi-asserted-by":"publisher","award":["EP\/N510129\/1"],"award-info":[{"award-number":["EP\/N510129\/1"]}],"id":[{"id":"10.13039\/100012338","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Markov networks are frequently used in sciences to represent conditional independence relationships underlying observed variables arising from a complex system. It is often of interest to understand how an underlying network differs between two conditions. In this paper, we develop methods for comparing a pair of high-dimensional Markov networks where we allow the number of observed variables to increase with the sample sizes. By taking the density ratio approach, we are able to learn the network difference directly and avoid estimating the individual graphs. Our methods are thus applicable even when the individual networks are dense as long as their difference is sparse. We prove finite-sample Gaussian approximation error bounds for the estimator we construct under significantly weaker assumptions than are typically required for model selection consistency. Furthermore, we propose bootstrap procedures for estimating quantiles of a max-type statistics based on our estimator, and show how they can be used to test the equality of two Markov networks or construct simultaneous confidence intervals. The performance of our methods is demonstrated through extensive simulations. The scientific usefulness is illustrated with an analysis of a new fMRI data set.<\/jats:p>","DOI":"10.1111\/rssb.12446","type":"journal-article","created":{"date-parts":[[2021,9,14]],"date-time":"2021-09-14T14:03:13Z","timestamp":1631628193000},"page":"939-962","source":"Crossref","is-referenced-by-count":10,"title":["Two-Sample Inference for High-Dimensional Markov Networks"],"prefix":"10.1093","volume":"83","author":[{"given":"Byol","family":"Kim","sequence":"first","affiliation":[{"name":"Department of Statistics , , Chicago, Illinois , USA"},{"name":"The University of Chicago , , Chicago, Illinois , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Song","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Mathematics , University of Bristol, Bristol , UK"},{"name":"The Alan Turing Institute , London , UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mladen","family":"Kolar","sequence":"additional","affiliation":[{"name":"Booth School of Business , , Chicago, Illinois , USA"},{"name":"The University of Chicago , , Chicago, Illinois , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2021,9,14]]},"reference":[{"issue":"3","key":"2023022408373940400_","first-page":"485","article-title":"Model selection through sparse maximum likelihood estimation","volume":"9","author":"Banerjee","year":"2008","journal-title":"The Journal of Machine Learning Research"},{"issue":"6B","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"3422","DOI":"10.1214\/17-AOS1663","article-title":"Rocket: Robust confidence intervals via kendall\u2019s tau for transelliptical graphical models","volume":"46","author":"Barber","year":"2018","journal-title":"The Annals of Statistics"},{"key":"2023022408373940400_","first-page":"595","volume-title":"Advances in neural information processing systems 29","author":"Belilovsky","year":"2016"},{"issue":"2","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"521","DOI":"10.3150\/11-BEJ410","article-title":"Least squares after model selection in high-dimensional sparse models","volume":"19","author":"Belloni","year":"2013","journal-title":"Bernoulli"},{"key":"2023022408373940400_","volume-title":"High-dimensional econometrics and regularized GMM","author":"Belloni","year":"2018"},{"issue":"2","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"608","DOI":"10.1093\/restud\/rdt044","article-title":"Inference on treatment effects after selection amongst high-dimensional controls","volume":"81","author":"Belloni","year":"2013","journal-title":"The Review of Economic Studies"},{"issue":"2","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"757","DOI":"10.1214\/14-AOS1204","article-title":"Pivotal estimation via square-root Lasso in nonparametric regression","volume":"42","author":"Belloni","year":"2014","journal-title":"The Annals of Statistics"},{"issue":"4","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1080\/07350015.2016.1166116","article-title":"Post-selection inference for generalized linear models with many controls","volume":"34","author":"Belloni","year":"2016","journal-title":"The Journal of Business and Economic Statistics"},{"issue":"2","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1093\/biomet\/asz012","article-title":"Differential Markov random field analysis with an application to detecting differential microbial community networks","volume":"106","author":"Cai","year":"2019","journal-title":"Biometrika"},{"issue":"494","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"594","DOI":"10.1198\/jasa.2011.tm10155","article-title":"A constrained \u21131 minimization approach to sparse precision matrix estimation","volume":"106","author":"Cai","year":"2011","journal-title":"Journal of the American Statistical Association"},{"issue":"2","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"642","DOI":"10.1214\/17-AOS1563","article-title":"Gaussian and bootstrap approximations for high-dimensional U-statistics and their applications","volume":"46","author":"Chen","year":"2018","journal-title":"The Annals of Statistics"},{"issue":"6","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"2786","DOI":"10.1214\/13-AOS1161","article-title":"Gaussian approximations and multiplier bootstrap for maxima of sums of high-dimensional random vectors","volume":"41","author":"Chernozhukov","year":"2013","journal-title":"The Annals of Statistics"},{"issue":"1\u20132","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1007\/s00440-014-0565-9","article-title":"Comparison and anti-concentration bounds for maxima of Gaussian random vectors","volume":"162","author":"Chernozhukov","year":"2015","journal-title":"Probability Theory and Related Fields"},{"issue":"4","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"2309","DOI":"10.1214\/16-AOP1113","article-title":"Central limit theorems and bootstrap in high dimensions","volume":"45","author":"Chernozhukov","year":"2017","journal-title":"Annals of Probability"},{"issue":"1","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1146\/annurev-economics-012315-015826","article-title":"Valid post-selection and post-regularization inference: An elementary, general approach","volume":"7","author":"Chernozhukov","year":"2015","journal-title":"Annual Review of Economics"},{"issue":"4","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1007\/s11222-010-9191-2","article-title":"Inferring multiple graphical structures","volume":"21","author":"Chiquet","year":"2011","journal-title":"Statistics and Computing"},{"issue":"2","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1111\/rssb.12033","article-title":"The joint graphical lasso for inverse covariance estimation across multiple classes","volume":"76","author":"Danaher","year":"2014","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"issue":"6","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"3643","DOI":"10.1214\/20-AOS1946","article-title":"Beyond Gaussian approximation: Bootstrap for maxima of sums of independent random vectors","volume":"48","author":"Deng","year":"2020","journal-title":"The Annals of Statistics"},{"issue":"4","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1007\/s11749-017-0554-2","article-title":"High-dimensional simultaneous inference with the bootstrap","volume":"26","author":"Dezeure","year":"2017","journal-title":"TEST"},{"issue":"1","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1016\/j.jmva.2004.02.009","article-title":"Sparse graphical models for exploring gene expression data","volume":"90","author":"Dobra","year":"2004","journal-title":"Journal of Multivariate Analysis"},{"issue":"1","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1146\/annurev-statistics-060116-053803","article-title":"Structure learning in graphical modeling","volume":"4","author":"Drton","year":"2017","journal-title":"Annual Review of Statistics and its Application"},{"key":"2023022408373940400_","first-page":"2281","volume-title":"Proceedings of the 33rd international conference on machine learning","author":"Fazayeli","year":"2016"},{"issue":"3","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1093\/biostatistics\/kxm045","article-title":"Sparse inverse covariance estimation with the graphical lasso","volume":"9","author":"Friedman","year":"2008","journal-title":"Biostatistics"},{"issue":"1","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1093\/biomet\/asq060","article-title":"Joint estimation of multiple graphical models","volume":"98","author":"Guo","year":"2011","journal-title":"Biometrika"},{"key":"2023022408373940400_","article-title":"Markov fields on finite graphs and lattices","volume":"46","author":"Hammersley","year":"1971","journal-title":"Unpublished manuscript"},{"key":"2023022408373940400_","first-page":"422","volume-title":"Proceedings of the 6th pacific symposium on biocomputing, PSB 2001, Hawaii, USA, January 3\u20137, 2001","author":"Hartemink","year":"2001"},{"issue":"1","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"1205","DOI":"10.1214\/15-EJS1031","article-title":"Confidence intervals for high-dimensional inverse covariance estimation","volume":"9","author":"Jankov\u00e1","year":"2015","journal-title":"Electronic Journal of Statistics"},{"issue":"1","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1007\/s11749-016-0503-5","article-title":"Honest confidence regions and optimality in high-dimensional precision matrix estimation","volume":"26","author":"Jankov\u00e1","year":"2017","journal-title":"TEST"},{"issue":"1","key":"2023022408373940400_","first-page":"2869","article-title":"Confidence intervals and hypothesis testing for high-dimensional regression","volume":"15","author":"Javanmard","year":"2014","journal-title":"The Journal of Machine Learning Research"},{"key":"2023022408373940400_","first-page":"1391","article-title":"A least-squares approach to direct importance estimation","volume":"10","author":"Kanamori","year":"2009","journal-title":"The Journal of Machine Learning Research"},{"key":"2023022408373940400_","volume-title":"Probabilistic graphical models: principles and techniques","author":"Koller","year":"2009"},{"key":"2023022408373940400_","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780198522195.001.0001","volume-title":"Graphical models","author":"Lauritzen","year":"1996"},{"issue":"6","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"2680","DOI":"10.1214\/17-AOS1539","article-title":"Structural similarity and difference testing on multiple sparse Gaussian graphical models","volume":"45","author":"Liu","year":"2017","journal-title":"The Annals of Statistics"},{"issue":"6","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"1169","DOI":"10.1162\/NECO_a_00589","article-title":"Direct learning of sparse changes in Markov networks by density ratio estimation","volume":"26","author":"Liu","year":"2014","journal-title":"Neural Computation"},{"issue":"3","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"959","DOI":"10.1214\/16-AOS1470","article-title":"Support consistency of direct sparse-change learning in Markov networks","volume":"45","author":"Liu","year":"2017","journal-title":"The Annals of Statistics"},{"issue":"203","key":"2023022408373940400_","first-page":"1","article-title":"Post-regularization inference for time-varying nonparanormal graphical models","volume":"18","author":"Lu","year":"2018","journal-title":"Journal of Machine Learning Research"},{"key":"2023022408373940400_","volume-title":"Information theory, inference and learning algorithms","author":"MacKay","year":"2003"},{"key":"2023022408373940400_","volume-title":"Joint estimation and inference for data integration problems based on multiple multi-layered gaussian graphical models","author":"Majumdar","year":"2018"},{"key":"2023022408373940400_","volume-title":"Inter-subject analysis: inferring sparse interactions with dense intra-graphs","author":"Ma","year":"2017"},{"issue":"166","key":"2023022408373940400_","first-page":"1","article-title":"Joint structural estimation of multiple graphical models","volume":"17","author":"Ma","year":"2016","journal-title":"Journal of Machine Learning Research"},{"issue":"5","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"923","DOI":"10.1111\/rssb.12094","article-title":"Group bound: confidence intervals for groups of variables in sparse high dimensional regression without assumptions on the design","volume":"77","author":"Meinshausen","year":"2015","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"key":"2023022408373940400_","first-page":"445","article-title":"Node-based learning of multiple gaussian graphical models","volume":"15","author":"Mohan","year":"2014","journal-title":"The Journal of Machine Learning Research"},{"issue":"11","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"5847","DOI":"10.1109\/TIT.2010.2068870","article-title":"Estimating divergence functionals and the likelihood ratio by convex risk minimization","volume":"56","author":"Nguyen","year":"2010","journal-title":"IEEE Transactions on Information Theory"},{"issue":"1","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1214\/16-AOS1448","article-title":"A general theory of hypothesis tests and confidence regions for sparse high dimensional models","volume":"45","author":"Ning","year":"2017","journal-title":"The Annals of Statistics"},{"key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"935","DOI":"10.1214\/11-EJS631","article-title":"High-dimensional covariance estimation by minimizing \u21131-penalized log-determinant divergence","volume":"5","author":"Ravikumar","year":"2011","journal-title":"Electronic Journal of Statistics"},{"issue":"3","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"991","DOI":"10.1214\/14-AOS1286","article-title":"Asymptotic normality and optimalities in estimation of large Gaussian graphical models","volume":"43","author":"Ren","year":"2015","journal-title":"The Annals of Statistics"},{"issue":"2","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"e1508","DOI":"10.1002\/wics.1508","article-title":"Differential network analysis: a statistical perspective","volume":"13","author":"Shojaie","year":"2021","journal-title":"Wiley Interdisciplinary Reviews: Computational Statistics"},{"key":"2023022408373940400_","first-page":"1433","volume-title":"Advances in neural information processing systems 20","author":"Sugiyama","year":"2008"},{"key":"2023022408373940400_","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9781139035613","volume-title":"Density ratio estimation in machine learning","author":"Sugiyama","year":"2012"},{"key":"2023022408373940400_","first-page":"3385","article-title":"Sparse matrix inversion with scaled lasso","volume":"14","author":"Sun","year":"2013","journal-title":"The Journal of Machine Learning Research"},{"issue":"6","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"e1000100","DOI":"10.1371\/journal.pcbi.1000100","article-title":"Network analysis of intrinsic functional brain connectivity in alzheimer\u2019s disease","volume":"4","author":"Supekar","year":"2008","journal-title":"PLoS Computational Biology"},{"issue":"3","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"1166","DOI":"10.1214\/14-AOS1221","article-title":"On asymptotically optimal confidence regions and tests for high-dimensional models","volume":"42","author":"van de Geer","year":"2014","journal-title":"The Annals of Statistics"},{"key":"2023022408373940400_","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511802256","volume-title":"Asymptotic statistics","author":"van der Vaart","year":"1998"},{"issue":"1\u20132","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/2200000001","article-title":"Graphical models, exponential families, and variational inference","volume":"1","author":"Wainwright","year":"2008","journal-title":"Foundations and Trends in Machine Learning"},{"key":"2023022408373940400_","first-page":"751","volume-title":"Proceedings of AISTATS","author":"Wang","year":"2016"},{"issue":"2","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1093\/biomet\/asu074","article-title":"Testing differential networks with applications to the detection of gene-gene interactions","volume":"102","author":"Xia","year":"2015","journal-title":"Biometrika"},{"issue":"3","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"1304","DOI":"10.1214\/19-AOS1848","article-title":"Distribution and correlation-free two-sample test of high-dimensional means","volume":"48","author":"Xue","year":"2020","journal-title":"The Annals of Statistics"},{"key":"2023022408373940400_","first-page":"1064","volume-title":"Advances in neural information processing systems 29","author":"Xu","year":"2016"},{"key":"2023022408373940400_","first-page":"3813","article-title":"On graphical models via univariate exponential family distributions","volume":"16","author":"Yang","year":"2015","journal-title":"Journal of Machine Learning Research"},{"key":"2023022408373940400_","first-page":"2261","article-title":"High dimensional inverse covariance matrix estimation via linear programming","volume":"11","author":"Yuan","year":"2010","journal-title":"Journal of Machine Learning Research"},{"issue":"1","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1093\/biomet\/asm018","article-title":"Model selection and estimation in the gaussian graphical model","volume":"94","author":"Yuan","year":"2007","journal-title":"Biometrika"},{"key":"2023022408373940400_","volume-title":"Advances in neural information processing systems 29","author":"Yu","year":"2016"},{"issue":"91","key":"2023022408373940400_","first-page":"1","article-title":"Simultaneous inference for pairwise graphical models with generalized score matching","volume":"21","author":"Yu","year":"2020","journal-title":"Journal of Machine Learning Research"},{"issue":"1","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1111\/rssb.12026","article-title":"Confidence intervals for low dimensional parameters in high dimensional linear models","volume":"76","author":"Zhang","year":"2013","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"},{"issue":"2","key":"2023022408373940400_","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1093\/biomet\/asu009","article-title":"Direct estimation of differential networks","volume":"101","author":"Zhao","year":"2014","journal-title":"Biometrika"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/rssb.12446","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/rssb.12446","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/83\/5\/939\/49321015\/jrsssb_83_5_939.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/83\/5\/939\/49321015\/jrsssb_83_5_939.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,8]],"date-time":"2023-11-08T19:54:19Z","timestamp":1699473259000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/83\/5\/939\/7056050"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,14]]},"references-count":65,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2021,9,14]]},"published-print":{"date-parts":[[2021,11,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12446","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,11]]},"published":{"date-parts":[[2021,9,14]]}}}