{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T16:24:09Z","timestamp":1787329449680,"version":"build-2736575974"},"reference-count":77,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"4","funder":[{"DOI":"10.13039\/100000185","name":"Defense Advanced Research Projects Agency","doi-asserted-by":"publisher","award":["FA8750-17-2-0101"],"award-info":[{"award-number":["FA8750-17-2-0101"]}],"id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["N00014-11-1002"],"award-info":[{"award-number":["N00014-11-1002"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["N00014-17-1-214"],"award-info":[{"award-number":["N00014-17-1-214"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000006","name":"Office of Naval Research","doi-asserted-by":"publisher","award":["N00014-17-1-2146"],"award-info":[{"award-number":["N00014-17-1-2146"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["725594"],"award-info":[{"award-number":["725594"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000936","name":"Gordon and Betty Moore Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000936","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001711","name":"Schweizerischer Nationalfonds zur F\u00f6rderung der Wissenschaftlichen Forschung","doi-asserted-by":"publisher","award":["200021_178865"],"award-info":[{"award-number":["200021_178865"]}],"id":[{"id":"10.13039\/501100001711","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM J. Sci. Comput."],"published-print":{"date-parts":[[2019,1]]},"abstract":"<jats:p>This paper argues that randomized linear sketching is a natural tool for on-the-fly compression of data matrices that arise from large-scale scientific simulations and data collection. The technical contribution consists in a new algorithm for constructing an accurate low-rank approximation of a matrix from streaming data. This method is accompanied by an a priori analysis that allows the user to set algorithm parameters with confidence and an a posteriori error estimator that allows the user to validate the quality of the reconstructed matrix. In comparison to previous techniques, the new method achieves smaller relative approximation errors and is less sensitive to parameter choices. As concrete applications, the paper outlines how the algorithm can be used to compress a Navier--Stokes simulation and a sea surface temperature dataset.<\/jats:p>","DOI":"10.1137\/18m1201068","type":"journal-article","created":{"date-parts":[[2019,7,30]],"date-time":"2019-07-30T12:01:41Z","timestamp":1564488101000},"page":"A2430-A2463","source":"Crossref","is-referenced-by-count":70,"title":["Streaming Low-Rank Matrix Approximation with an Application to Scientific Simulation"],"prefix":"10.1137","volume":"41","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1024-1791","authenticated-orcid":true,"given":"Joel A.","family":"Tropp","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alp","family":"Yurtsever","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3985-915X","authenticated-orcid":true,"given":"Madeleine","family":"Udell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Volkan","family":"Cevher","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2019,7,30]]},"reference":[{"key":"atypb1","volume-title":"Feb.","author":"Physical Sciences Division","year":"2019"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1016\/S0022-0000(03)00025-4"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1137\/060673096"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1006\/jcss.2001.1813"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1145\/237814.237823"},{"key":"atypb6","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2016.67"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1145\/1944345.1944349"},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1145\/2600212.2600217"},{"key":"atypb9","doi-asserted-by":"publisher","DOI":"10.2514\/6.2004-267"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1002\/9781118671627"},{"key":"atypb11","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-0653-8"},{"key":"atypb12","doi-asserted-by":"publisher","DOI":"10.1007\/s00039-015-0332-9"},{"key":"atypb13","doi-asserted-by":"publisher","DOI":"10.1137\/120874540"},{"key":"atypb14","volume-title":"Optimal Principal Component Analysis in Distributed and Streaming Models, preprint, https:\/\/arxiv.org\/abs\/1504.06729","author":"Boutsidis C.","year":"2016"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1145\/2897518.2897646"},{"key":"atypb16","doi-asserted-by":"publisher","DOI":"10.1016\/j.laa.2005.07.021"},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.1177\/1094342018762036"},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1080\/00401706.2015.1027068"},{"key":"atypb19","volume-title":"Feb.","author":"Processing CERN","year":"2019"},{"key":"atypb20","doi-asserted-by":"publisher","DOI":"10.1145\/1536414.1536445"},{"key":"atypb21","doi-asserted-by":"publisher","DOI":"10.1145\/2488608.2488620"},{"key":"atypb22","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611974331.ch21"},{"key":"atypb23","doi-asserted-by":"publisher","DOI":"10.1145\/2746539.2746569"},{"key":"atypb24","doi-asserted-by":"publisher","DOI":"10.1137\/0720053"},{"key":"atypb25","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611973549"},{"key":"atypb26","first-page":"2774","volume-title":"Proceedings of the 30th International Conference on Neural Information Processing Systems (NIPS)","author":"Feldman D.","year":"2016"},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1145\/1039488.1039494"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.1007\/978-90-481-2819-8"},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1137\/15M1009718"},{"key":"atypb30","doi-asserted-by":"publisher","DOI":"10.1145\/227683.227684"},{"key":"atypb31","doi-asserted-by":"publisher","DOI":"10.1137\/17M1137541"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1145\/347837.347846"},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.2017.1395339"},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1137\/100804139"},{"key":"atypb35","doi-asserted-by":"publisher","DOI":"10.1137\/090771806"},{"key":"atypb36","first-page":"1","volume-title":"Applications of Matrix Theory (Bradford","author":"Higham N. J.","year":"1988"},{"key":"atypb37","doi-asserted-by":"publisher","DOI":"10.1002\/oca.771"},{"key":"atypb38","doi-asserted-by":"publisher","DOI":"10.1088\/1367-2630\/17\/5\/053044"},{"key":"atypb39","doi-asserted-by":"publisher","DOI":"10.1080\/03610918908812806"},{"key":"atypb40","doi-asserted-by":"publisher","DOI":"10.1145\/276698.276876"},{"key":"atypb41","doi-asserted-by":"publisher","DOI":"10.1090\/conm\/026\/737400"},{"key":"atypb42","series-title":"Springer Series in Statistics","volume-title":"Principal Component Analysis","author":"Jolliffe I. T.","year":"2002","edition":"2"},{"key":"atypb43","doi-asserted-by":"publisher","DOI":"10.1145\/2591796.2591812"},{"key":"atypb44","unstructured":"E. Liberty,\n                      Accelerated Dense Random Projections\n                      , Ph.D. thesis, Yale University, New Haven, CT, 2009."},{"key":"atypb45","first-page":"3223","volume-title":"Proceedings of the 35th International Conference on Machine Learning (ICML)","author":"Lopes M.","year":"2018"},{"key":"atypb46","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1561\/2200000035","volume":"3","author":"Mahoney M. W.","year":"2011","journal-title":"Found. Trends Mach. Learning"},{"key":"atypb47","doi-asserted-by":"publisher","DOI":"10.1016\/j.combustflame.2017.08.012"},{"key":"atypb48","volume-title":"Randomized Methods for Matrix Computations, preprint, https:\/\/arxiv.org\/abs\/1607.01649v3","author":"Martinsson P.-G.","year":"2019"},{"key":"atypb49","doi-asserted-by":"publisher","DOI":"10.1016\/j.acha.2010.02.003"},{"key":"atypb50","doi-asserted-by":"publisher","DOI":"10.1145\/2488608.2488621"},{"key":"atypb51","first-page":"625","volume":"4","author":"Menter F. R.","year":"2003","journal-title":"Turbulence Heat Mass Transfer"},{"key":"atypb52","doi-asserted-by":"publisher","DOI":"10.1017\/jfm.2013.457"},{"key":"atypb53","doi-asserted-by":"publisher","DOI":"10.1561\/0400000002"},{"key":"atypb54","doi-asserted-by":"publisher","DOI":"10.1109\/FOCS.2013.21"},{"key":"atypb55","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-43948-7_73"},{"key":"atypb56","doi-asserted-by":"publisher","DOI":"10.1006\/jcss.2000.1711"},{"key":"atypb57","volume-title":"Numerical Heat Transfer and Fluid Flow","author":"Patankar S.","year":"1980"},{"key":"atypb58","doi-asserted-by":"publisher","DOI":"10.1175\/1520-0442(2002)015<1609:AIISAS>2.0.CO;2"},{"key":"atypb59","doi-asserted-by":"publisher","DOI":"10.1175\/2007JCLI1824.1"},{"key":"atypb60","doi-asserted-by":"publisher","DOI":"10.1137\/080736417"},{"key":"atypb61","doi-asserted-by":"publisher","DOI":"10.1007\/s10208-014-9220-1"},{"key":"atypb62","volume-title":"Large Eddy Simulation for Incompressible Flows: An Introduction","author":"Sagaut P.","year":"2006"},{"key":"atypb63","doi-asserted-by":"publisher","DOI":"10.1109\/FOCS.2006.37"},{"key":"atypb64","first-page":"76","volume":"1","author":"Son S. W.","year":"2014","journal-title":"Supercomput. Frontiers Innovations"},{"key":"atypb65","volume-title":"Low-Rank Tucker Approximation of a Tensor from Streaming Data, manuscript","author":"Sun Y.","year":"2018"},{"key":"atypb66","volume-title":"NeurIPS Workshop on Relational Representation Learning, 2018","author":"Sun Y.","year":"2041"},{"key":"atypb67","doi-asserted-by":"publisher","DOI":"10.1142\/S1793536911000787"},{"key":"atypb68","volume-title":"Advances in Neural Information Processing Systems 30 (NIPS)","author":"Tropp J. A.","year":"2017"},{"key":"atypb69","doi-asserted-by":"publisher","DOI":"10.1137\/17M1111590"},{"key":"atypb70","unstructured":"J. A. Tropp, A. Yurtsever, M. Udell, and V. Cevher,\n                      Randomized Single-View Algorithms for Low-Rank Matrix Approximation\n                      , ACM Report 2017-01, Caltech, Pasadena, CA, 2017; preprint,https:\/\/arxiv.org\/abs\/1609.00048v1, 2016."},{"key":"atypb71","volume-title":"Fast and Space-Optimal Low-Rank Factorization in the Streaming Model with Application in Differential Privacy, preprint, https:\/\/arxiv.org\/abs\/1604.01429v1","author":"Upadhyay J.","year":"2016"},{"key":"atypb72","doi-asserted-by":"publisher","DOI":"10.1109\/LDAV.2011.6092314"},{"key":"atypb73","first-page":"10","author":"Woodruff D. P.","year":"2014","journal-title":"Found. Trends Theor. Comput. Sci."},{"key":"atypb74","doi-asserted-by":"publisher","DOI":"10.1016\/j.acha.2007.12.002"},{"key":"atypb75","volume-title":"Sketchy decisions: Convex low-rank matrix optimization with optimal storage, in the 20th International Conference on Artificial Intelligence and Statistics (AISTATS)","author":"Yurtsever A.","year":"2017"},{"key":"atypb76","volume-title":"Decomposition of Big Tensors with Low Multilinear Rank, preprint, https:\/\/arxiv.org\/abs\/1412.1885","author":"Zhou G.","year":"2014"},{"key":"atypb77","doi-asserted-by":"publisher","DOI":"10.1137\/17M1123286"}],"container-title":["SIAM Journal on Scientific Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/18M1201068","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T15:17:52Z","timestamp":1787325472000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/18M1201068"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1]]},"references-count":77,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2019,1]]}},"alternative-id":["10.1137\/18M1201068"],"URL":"https:\/\/doi.org\/10.1137\/18m1201068","relation":{},"ISSN":["1064-8275","1095-7197"],"issn-type":[{"value":"1064-8275","type":"print"},{"value":"1095-7197","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1]]}}}