{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,28]],"date-time":"2026-09-28T03:43:53Z","timestamp":1790567033190,"version":"4.1.0"},"reference-count":46,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2023,2,24]],"date-time":"2023-02-24T00:00:00Z","timestamp":1677196800000},"content-version":"vor","delay-in-days":238,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,7,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>We propose a new method for changepoint estimation in partially observed, high-dimensional time series that undergo a simultaneous change in mean in a sparse subset of coordinates. Our first methodological contribution is to introduce a \u2018MissCUSUM\u2019 transformation (a generalisation of the popular cumulative sum statistics), that captures the interaction between the signal strength and the level of missingness in each coordinate. In order to borrow strength across the coordinates, we propose to project these MissCUSUM statistics along a direction found as the solution to a penalised optimisation problem tailored to the specific sparsity structure. The changepoint can then be estimated as the location of the peak of the absolute value of the projected univariate series. In a model that allows different missingness probabilities in different component series, we identify that the key interaction between the missingness and the signal is a weighted sum of squares of the signal change in each coordinate, with weights given by the observation probabilities. More specifically, we prove that the angle between the estimated and oracle projection directions, as well as the changepoint location error, are controlled with high probability by the sum of two terms, both involving this weighted sum of squares, and representing the error incurred due to noise and the error due to missingness respectively. A lower bound confirms that our changepoint estimator, which we call MissInspect, is optimal up to a logarithmic factor. The striking effectiveness of the MissInspect methodology is further demonstrated both on simulated data, and on an oceanographic data set covering the Neogene period.<\/jats:p>","DOI":"10.1111\/rssb.12540","type":"journal-article","created":{"date-parts":[[2022,7,11]],"date-time":"2022-07-11T14:15:33Z","timestamp":1657548933000},"page":"1023-1055","source":"Crossref","is-referenced-by-count":22,"title":["High-dimensional Changepoint Estimation with Heterogeneous Missingness"],"prefix":"10.1093","volume":"84","author":[{"given":"Bertille","family":"Follain","sequence":"first","affiliation":[{"name":"Statistical Laboratory, University of Cambridge , Cambridge, Cambridgeshire , UK"},{"name":"Ecole Normale Sup\u00e9rieure , , , Paris , France"},{"name":"PSL Research University , , , Paris , France"},{"name":"INRIA , , , Paris , France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tengyao","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Statistics , , London, London , UK"},{"name":"London School of Economics and Political Science , , London, London , UK"},{"name":"Department of Statistical Science , , London , UK"},{"name":"University College London , , London , UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard J.","family":"Samworth","sequence":"additional","affiliation":[{"name":"Statistical Laboratory, University of Cambridge , Cambridge ,, Cambridgeshire , UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2022,7,11]]},"reference":[{"key":"2023022408355452900_","first-page":"1906","article-title":"Evaluating stationarity via change-point alternatives with applications to fMRI data","volume":"6","author":"Aston","year":"2013","journal-title":"Annals of Applied Statistics"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1016\/j.jeconom.2009.10.020","article-title":"Common breaks in means and variances for panel data","volume":"157","author":"Bai","year":"2010","journal-title":"Journal of Economics"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13634-019-0635-3","article-title":"Sketching for sequential change-point detection","volume":"2019","author":"Cao","year":"2019","journal-title":"EURASIP Journal on Advances in Signal Processing"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"2736","DOI":"10.1214\/17-AOS1546","article-title":"Optimal sequential detection in multi-stream data","volume":"45","author":"Chan","year":"2017","journal-title":"The Annals of Statistics"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"1865","DOI":"10.1214\/15-AOS1328","article-title":"Optimal detection of multi-sample aligned sparse signals","volume":"43","author":"Chan","year":"2015","journal-title":"The Annals of Statistics"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"739","DOI":"10.1080\/01621459.1997.10474026","article-title":"Testing and locating variance changepoints with application to stock prices","volume":"92","author":"Chen","year":"1997","journal-title":"Journal of the American Statistical Association"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1111\/rssb.12447","article-title":"High-dimensional, multiscale online changepoint detection","volume":"84","author":"Chen","year":"2022","journal-title":"Journal of the Royal Statistical Society: Series B"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"2000","DOI":"10.1214\/16-EJS1155","article-title":"Change-point detection in panel data via double CUSUM statistic","volume":"10","author":"Cho","year":"2016","journal-title":"Electronic Journal of Statistics"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1111\/rssb.12079","article-title":"Multiple-change-point detection for high dimensional time series via sparsified binary segmentation","volume":"77","author":"Cho","year":"2014","journal-title":"Journal of the Royal Statistical Society: Series B"},{"key":"2023022408355452900_","volume-title":"Limit theorems in change-point analysis","author":"Cs\u00f6rg\u02dd","year":"1997"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1111\/j.1467-9868.2010.00753.x","article-title":"Maximum likelihood estimation of a multi-dimensional log-concave density","volume":"72","author":"Cule","year":"2010","journal-title":"Journal of the Royal Statistical Society: Series B (with discussion)"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"40","DOI":"10.3150\/08-BEJ141","article-title":"Maximum likelihood estimation of a log-concave density and its distribution function: basic properties and uniform consistency","volume":"15","author":"D\u00fcmbgen","year":"2009","journal-title":"Bernoulli"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"2051","DOI":"10.1214\/18-AOS1740","article-title":"High-dimensional change-point detection under sparse alternatives","volume":"47","author":"Enikeeva","year":"2019","journal-title":"The Annals of Statistics"},{"key":"2023022408355452900_","volume-title":"Change-point detection in dynamic networks with missing links","author":"Enikeeva","year":"2021"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"2243","DOI":"10.1214\/14-AOS1245","article-title":"Wild binary segmentation for multiple change-point detection","volume":"42","author":"Fryzlewicz","year":"2014","journal-title":"The Annals of Statistics"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1080\/01621459.1974.10482962","article-title":"The influence curve and its role in robust estimation","volume":"69","author":"Hampel","year":"1974","journal-title":"Journal of the American Statistical Association"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1007\/978-3-642-11690-2_3","article-title":"Fault detection and diagnosis for aeronautic and aerospace missions","volume":"399","author":"Henry","year":"2010","journal-title":"Fault Tolerant Flight Control"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"631","DOI":"10.1111\/j.1467-9892.2012.00796.x","article-title":"Change-point detection in panel data","volume":"33","author":"Horv\u00e1th","year":"2012","journal-title":"Journal of Time Series Analysis"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1007\/s11749-014-0368-4","article-title":"Extensions of some classical methods in change point analysis","volume":"23","author":"Horv\u00e1th","year":"2014","journal-title":"TEST"},{"key":"2023022408355452900_","volume-title":"Disease progression subtype discovery from longitudinal EMR data with a majority of missing values and unknown initial time points","author":"Huopaniemi","year":"2014"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"2451","DOI":"10.1214\/15-AOS1347","article-title":"Uniform change point tests in high dimension","volume":"43","author":"Jirak","year":"2015","journal-title":"The Annals of Statistics"},{"key":"2023022408355452900_","volume-title":"Optimistic search strategy: change point detection for large-scale data via adaptive logarithmic queries","author":"Kov\u00e1cs","year":"2020"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1214\/20-AOS1994","article-title":"Minimax rates in sparse, high-dimensional change point detection","volume":"49","author":"Liu","year":"2021","journal-title":"The Annals of Statistics"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"768","DOI":"10.1080\/10618600.2020.1853549","article-title":"Change-point detection for graphical models in the presence of missing values","volume":"30","author":"Londschien","year":"2021","journal-title":"Journal of Computational and Graphical Statistics"},{"key":"2023022408355452900_","first-page":"2287","article-title":"Spectral regularization algorithms for learning large incomplete matrices","volume":"11","author":"Mazumder","year":"2010","journal-title":"Journal of Machine Learning Research"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1093\/biomet\/asq010","article-title":"Efficient scalable schemes for monitoring a large number of data streams","volume":"97","author":"Mei","year":"2010","journal-title":"Biometrika"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1093\/biostatistics\/kxh008","article-title":"Circular binary segmentation for the analysis of array-based DNA copy number data","volume":"5","author":"Olshen","year":"2004","journal-title":"Biostatistics"},{"key":"2023022408355452900_","article-title":"Optimal nonparametric multivariate change point detection and localization","author":"Padilla","year":"2022","journal-title":"IEEE Transactions on Information Theory"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1093\/biomet\/42.3-4.523","article-title":"A test for a change in a parameter occurring at an unknown point","volume":"42","author":"Page","year":"1955","journal-title":"Biometrika"},{"key":"2023022408355452900_","first-page":"771","volume-title":"Proactively detecting distributed denial of service attacks using source IP address monitoring","author":"Peng","year":"2004"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"Q06010","DOI":"10.1029\/2005GC001085","article-title":"Neogene over flow of northern component water at the Greenland-Scotland Ridge","volume":"7","author":"Poore","year":"2006","journal-title":"Geochemistry, Geophysics, Geosystems"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1191\/1471082X05st102oa","article-title":"Understanding past ocean circulations: a nonparametric regression case study","volume":"5","author":"Samworth","year":"2005","journal-title":"Statistical model"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1016\/j.acha.2015.11.003","article-title":"High-dimensional change-point estimation: combining filtering with convex optimization","volume":"43","author":"Soh","year":"2017","journal-title":"Applied and Computational Harmonic Analysis"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"1911","DOI":"10.1080\/02664760903186056","article-title":"Early warning CUSUM plans for surveillance of negative binomial daily disease counts","volume":"37","author":"Sparks","year":"2010","journal-title":"Journal of Applied Statistics"},{"key":"2023022408355452900_","volume-title":"Matrix perturbation theory","author":"Stewart","year":"1990"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","DOI":"10.1017\/9781108627771","volume-title":"High-dimensional statistics: a non-asymptotic viewpoint","author":"Wainwright","year":"2019"},{"key":"2023022408355452900_","volume-title":"Spectral methods and computational trade-offs in high-dimensional statistical inference","author":"Wang","year":"2016"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1111\/rssb.12243","article-title":"High dimensional change point estimation via sparse projection","volume":"80","author":"Wang","year":"2018","journal-title":"Journal of the Royal Statistical Society: Series B"},{"key":"2023022408355452900_","volume-title":"InspectChangepoint: high-dimensional changepoint estimation via sparse projection","author":"Wang","year":"2022"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1029\/95PA03696","article-title":"Control of North Atlantic deep water circulation by the greenland-scotland ridge","volume":"11","author":"Wright","year":"1996","journal-title":"Paleoceanography"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"670","DOI":"10.1214\/13-AOS1094","article-title":"Sequential multi-sensor change-point detection","volume":"41","author":"Xie","year":"2013","journal-title":"The Annals of Statistics"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1109\/JSTSP.2012.2234082","article-title":"Change-point detection for high-dimensional time series with missing data","volume":"7","author":"Xie","year":"2013","journal-title":"IEEE Journal of Selected Topics in Signal Processing"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1007\/978-1-4612-1880-7_29","volume-title":"Festschrift for Lucien Le Cam: research papers in probability and statistics","author":"Yu","year":"1997"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1093\/biomet\/asv008","article-title":"A useful variant of the Davis\u2013Kahan theorem for statisticians","volume":"102","author":"Yu","year":"2015","journal-title":"Biometrika"},{"key":"2023022408355452900_","doi-asserted-by":"crossref","first-page":"631","DOI":"10.1093\/biomet\/asq025","article-title":"Detecting simultaneous changepoints in multiple sequences","volume":"97","author":"Zhang","year":"2010","journal-title":"Biometrika"},{"key":"2023022408355452900_","volume-title":"High-dimensional principal component analysis with heterogeneous missingness","author":"Zhu","year":"2019"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/rssb.12540","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/rssb.12540","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/84\/3\/1023\/49322561\/jrsssb_84_3_1023.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/84\/3\/1023\/49322561\/jrsssb_84_3_1023.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,24]],"date-time":"2023-11-24T07:44:27Z","timestamp":1700811867000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/84\/3\/1023\/7056166"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,1]]},"references-count":46,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,7,11]]},"published-print":{"date-parts":[[2022,7,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12540","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,7]]},"published":{"date-parts":[[2022,7,1]]}}}