{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T09:51:34Z","timestamp":1773481894899,"version":"3.50.1"},"reference-count":47,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2024,3,12]],"date-time":"2024-03-12T00:00:00Z","timestamp":1710201600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006374","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["2020R1A2C1010358"],"award-info":[{"award-number":["2020R1A2C1010358"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Manag. Data"],"published-print":{"date-parts":[[2024,3,12]]},"abstract":"<jats:p>Large-scale matrix computations have become indispensable in artificial intelligence and scientific applications. It is of paramount importance to efficiently perform out-of-core computations that often entail an excessive amount of disk I\/O. Unfortunately, however, most existing systems do not focus on disk I\/O aspects and are vulnerable to performance degradation when the scale of input matrices and intermediate data grows large. To address this problem, we present a new out-of-core matrix computation system called PreVision. The PreVision system can achieve optimal buffer replacement by leveraging the deterministic characteristics of data access patterns, and it can also avoid redundant I\/O operations by proactively evicting the pages that are no longer referenced. Through extensive evaluations, we demonstrate that PreVision outperforms the existing out-of-core matrix computation systems and significantly reduces disk I\/O operations.<\/jats:p>","DOI":"10.1145\/3639297","type":"journal-article","created":{"date-parts":[[2024,3,26]],"date-time":"2024-03-26T18:51:32Z","timestamp":1711479092000},"page":"1-25","source":"Crossref","is-referenced-by-count":3,"title":["PreVision: An Out-of-Core Matrix Computation System with Optimal Buffer Replacement"],"prefix":"10.1145","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2560-923X","authenticated-orcid":false,"given":"Kyoseung","family":"Koo","sequence":"first","affiliation":[{"name":"Seoul National University, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-9107-7683","authenticated-orcid":false,"given":"Sohyun","family":"Kim","sequence":"additional","affiliation":[{"name":"Seoul National University, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-6930-9425","authenticated-orcid":false,"given":"Wonhyeon","family":"Kim","sequence":"additional","affiliation":[{"name":"Seoul National University, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-1413-1401","authenticated-orcid":false,"given":"Yoojin","family":"Choi","sequence":"additional","affiliation":[{"name":"Seoul National University, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-6315-3075","authenticated-orcid":false,"given":"Juhee","family":"Han","sequence":"additional","affiliation":[{"name":"Seoul National Unviersity, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5559-4040","authenticated-orcid":false,"given":"Bogyeong","family":"Kim","sequence":"additional","affiliation":[{"name":"Seoul National University, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9382-8306","authenticated-orcid":false,"given":"Bongki","family":"Moon","sequence":"additional","affiliation":[{"name":"Seoul National University, Seoul, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,3,26]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"12th USENIX symposium on operating systems design and implementation (OSDI 16)","author":"Abadi Mart'in","year":"2016","unstructured":"Mart'in Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, Manjunath Kudlur, Josh Levenberg, Rajat Monga, Sherry Moore, Derek G. Murray, Benoit Steiner, Paul Tucker, Vijay Vasudevan, Pete Warden, Martin Wicke, Yuan Yu, Xiaoqiang Zheng, and Google Brain. 2016. TensorFlow: a system for Large-Scale machine learning. In 12th USENIX symposium on operating systems design and implementation (OSDI 16). Savannah, GA, USA."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/346000.346003"},{"key":"e_1_2_2_3_1","volume-title":"CAR: Clock with Adaptive Replacement. In 3rd USENIX Conference on File and Storage Technologies (FAST 04)","author":"Bansal Sorav","unstructured":"Sorav Bansal and Dharmendra S. Modha. 2004. CAR: Clock with Adaptive Replacement. In 3rd USENIX Conference on File and Storage Technologies (FAST 04). San Francisco, CA, USA."},{"key":"e_1_2_2_4_1","volume-title":"15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18)","author":"Beckmann Nathan","year":"2018","unstructured":"Nathan Beckmann, Haoxian Chen, and Asaf Cidon. 2018. LHD: Improving cache hit rate by maximizing hit density. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18). Renton, WA, USA."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1147\/sj.52.0078"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3224427"},{"key":"e_1_2_2_7_1","unstructured":"L. S. Blackford J. Choi A. Cleary E. D'Azevedo J. Demmel I. Dhillon J. Dongarra S. Hammarling G. Henry A. Petitet K. Stanley D. Walker and R. C. Whaley. 1987. ScaLAPACK Users' Guide. SIAM Philadelphia PA."},{"key":"e_1_2_2_8_1","volume-title":"2017 USENIX Annual Technical Conference (USENIX ATC 17)","author":"Blankstein Aaron","unstructured":"Aaron Blankstein, Siddhartha Sen, and Michael J. Freedman. 2017. Hyperbolic caching: Flexible caching for web applications. In 2017 USENIX Annual Technical Conference (USENIX ATC 17). Santa Clara, CA, USA, 499--511."},{"key":"e_1_2_2_9_1","volume-title":"SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle. In 10th Conference on Innovative Data Systems Research","author":"Boehm Matthias","year":"2020","unstructured":"Matthias Boehm, Iulian Antonov, Sebastian Baunsgaard, Mark Dokter, Robert Ginth\u00f6 r, Kevin Innerebner, Florijan Klezin, Stefanie Lindstaedt, Arnab Phani, Benjamin Rath, Berthold Reinwald, Shafaq Siddiqui, and Sebastian Benjamin Wrede. 2020. SystemDS: A Declarative Machine Learning System for the End-to-End Data Science Lifecycle. In 10th Conference on Innovative Data Systems Research. Amsterdam, The Netherlands."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.14778\/3007263.3007279"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.14778\/3229863.3229865"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00453-011-9502-9"},{"key":"e_1_2_2_13_1","unstructured":"Apache Software Foundation. 2023. RDD Programming Guide. https:\/\/spark.apache.org\/docs\/3.3.2\/rdd-programming-guide.html."},{"key":"e_1_2_2_14_1","first-page":"19","article-title":"PostgreSQL","volume":"12","author":"The PostgreSQL Global Development Group","year":"2023","unstructured":"The PostgreSQL Global Development Group. 2023. PostgreSQL: Documentation: 12: 19.4. Resource Consumption. https:\/\/www.postgresql.org\/docs\/12\/runtime-config-resource.html","journal-title":"Documentation"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514221.3517895"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-020-2649-2"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.14778\/2367502.2367510"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3373376.3378530"},{"key":"e_1_2_2_19_1","volume-title":"MATLAB version: 9.13.0 (R2022b)","author":"The MathWorks Inc. 2022.","unstructured":"The MathWorks Inc. 2022. MATLAB version: 9.13.0 (R2022b). Natick, Massachusetts, United States. https:\/\/www.mathworks.com"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3007787.3001146"},{"key":"e_1_2_2_21_1","volume-title":"Proceedings of the 20th International Conference on Very Large Data Bases (Sept.","author":"Johnson Theodore","year":"1994","unstructured":"Theodore Johnson and Dennis Shasha. 1994. 2Q: A Low Overhead High Performance Buffer Management Replacement Algorithm. Proceedings of the 20th International Conference on Very Large Data Bases (Sept. 1994), 439--450."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772751"},{"key":"e_1_2_2_23_1","volume-title":"Algorithms for non-negative matrix factorization. Advances in neural information processing systems","author":"Lee Daniel D.","year":"2000","unstructured":"Daniel D. Lee and H. Sebastian Seung. 2000. Algorithms for non-negative matrix factorization. Advances in neural information processing systems, Vol. 13 (2000)."},{"key":"e_1_2_2_24_1","unstructured":"Jure Leskovec and Andrej Krevl. 2014. SNAP Datasets: Stanford Large Network Dataset Collection. http:\/\/snap.stanford.edu\/data."},{"key":"e_1_2_2_25_1","volume-title":"2009 IEEE International Symposium on Parallel & Distributed Processing","author":"Marqu\u00e9s Mercedes","unstructured":"Mercedes Marqu\u00e9s, Gregorio Quintana-Orti, Enrique. S. Quintana-Orti, and Robert. A. van de Geijn. 2009. Solving ?large\" dense matrix problems on multi-core processors. In 2009 IEEE International Symposium on Parallel & Distributed Processing. Rome, Italy."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1147\/sj.92.0078"},{"key":"e_1_2_2_27_1","volume-title":"2nd USENIX Conference on File and Storage Technologies (FAST 03)","author":"Megiddo Nimrod","unstructured":"Nimrod Megiddo and Dharmendra S. Modha. 2003. ARC: A Self-Tuning, low overhead replacement cache. In 2nd USENIX Conference on File and Storage Technologies (FAST 03). San Francisco, CA, USA."},{"key":"e_1_2_2_28_1","volume-title":"Mllib: Machine learning in apache spark.","author":"Meng Xiangrui","year":"2016","unstructured":"Xiangrui Meng, Joseph Bradley, Burak Yavuz, Evan Sparks, Shivaram Venkataraman, Davies Liu, Jeremy Freeman, D. B. Tsai, Manish Amde, Sean Owen, Doris Xin, Reynold Xin, Michael J. Franklin, Reza Zadeh, Matei Zaharia, and Ameet Talwalkar. 2016. Mllib: Machine learning in apache spark., Vol. 17, 1 (Jan. 2016), 1235--1241."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/170036.170081"},{"key":"e_1_2_2_30_1","unstructured":"Lawrence Page S. Brin R. Motwani and T. Winograd. 1998. The pagerank citation ranking: Bring order to the web. Technical Report. Technical report Stanford University."},{"key":"e_1_2_2_31_1","volume-title":"Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala.","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas K\u00f6 pf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/78973.78977"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3458817.3476205"},{"key":"e_1_2_2_34_1","volume-title":"Database management systems","author":"Ramakrishnan Raghu","unstructured":"Raghu Ramakrishnan and Johannes Gehrke. 2002. Database management systems 3rd ed.). McGraw-Hill.","edition":"3"},{"key":"e_1_2_2_35_1","volume-title":"2016 49th Annual IEEE\/ACM International Symposium on Microarchitecture (MICRO)","author":"Rhu Minsoo","unstructured":"Minsoo Rhu, Natalia Gimelshein, Jason Clemons, Arslan Zulfiqar, and Stephen W. Keckler. 2016. vDNN: Virtualized deep neural networks for scalable, memory-efficient neural network design. In 2016 49th Annual IEEE\/ACM International Symposium on Microarchitecture (MICRO). Taipei, Taiwan, 1--13."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.25080\/Majora-7b98e3ed-013"},{"key":"e_1_2_2_37_1","doi-asserted-by":"crossref","unstructured":"Yousef Saad. 2003. Iterative methods for sparse linear systems. SIAM.","DOI":"10.1137\/1.9780898718003"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.1994.283048"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.5555\/2032397.2032399"},{"key":"e_1_2_2_40_1","volume-title":"Proceedings of the 1993 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems","author":"Rabin","unstructured":"Rabin A. Sugumar and Santosh G. Abraham. 1993. Efficient simulation of caches under optimal replacement with applications to miss characterization. In Proceedings of the 1993 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems. Santa Clara, CA, USA."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.14778\/3275366.3284963"},{"key":"e_1_2_2_42_1","volume-title":"A survey of out-of-core algorithms in numerical linear algebra. External memory algorithms","author":"Toledo Sivan","year":"1999","unstructured":"Sivan Toledo. 1999. A survey of out-of-core algorithms in numerical linear algebra. External memory algorithms, Vol. 50 (Dec. 1999), 161--179."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2011.37"},{"key":"e_1_2_2_44_1","first-page":"3","article-title":"SciPy 1.0: fundamental algorithms for scientific computing in Python","volume":"17","author":"Virtanen Pauli","year":"2020","unstructured":"Pauli Virtanen, Ralf Gommers, Travis E. Oliphant, Matt Haberland, Tyler Reddy, David Cournapeau, Evgeni Burovski, Pearu Peterson, Warren Weckesser, Jonathan Bright, St\u00e9 fan van der Walt, Matthew Brett, Joshua Wilson, K. Jarrod Millman, Nikolay Mayorov, Andrew R. J. Nelson, Eric Jones, Robert Kern, Eric Larson, CJ Carey, Ilhan Polat, Yu Feng, Eric W. Moore, Jake VanderPlas, Denis Laxalde, Josef Perktold, Robert Cimrman, Ian Henriksen, E. A. Quintero, Charles R. Harris, Anne M. Archibald, Ant\u00f4 nio H. Ribeiro, Fabian Pedregosa, Paul van Mulbregt, and SciPy 1.0 Contributors. 2020. SciPy 1.0: fundamental algorithms for scientific computing in Python. Nature Methods, Vol. 17, 3 (Feb. 2020), 261--272.","journal-title":"Nature Methods"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3178487.3178491"},{"key":"e_1_2_2_46_1","volume-title":"9th USENIX Symposium on Networked Systems Design and Implementation (NSDI 12)","author":"Zaharia Matei","year":"2012","unstructured":"Matei Zaharia, Mosharaf Chowdhury, Tathagata Das, Ankur Dave, Justin Ma, Murphy McCauly, Michael J. Franklin, Scott Shenker, and Ion Stoica. 2012. Resilient distributed datasets: A Fault-Tolerant abstraction for In-Memory cluster computing. In 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI 12). San Jose, CA, USA."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.14778\/2212351.2212358"}],"container-title":["Proceedings of the ACM on Management of Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3639297","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3639297","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T15:18:03Z","timestamp":1755789483000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3639297"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,12]]},"references-count":47,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,3,12]]}},"alternative-id":["10.1145\/3639297"],"URL":"https:\/\/doi.org\/10.1145\/3639297","relation":{},"ISSN":["2836-6573"],"issn-type":[{"value":"2836-6573","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,12]]}}}