{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,3]],"date-time":"2025-11-03T14:24:27Z","timestamp":1762179867950,"version":"build-2065373602"},"reference-count":71,"publisher":"Association for Computing Machinery (ACM)","issue":"4","funder":[{"name":"NRF","award":["NRF2022R1A2C2091680"],"award-info":[{"award-number":["NRF2022R1A2C2091680"]}]},{"name":"IITP","award":["No. 2021-0-01817, No. RS-2024-00459026, No. RS-2024-00461572, No. RS-2024-00460762"],"award-info":[{"award-number":["No. 2021-0-01817, No. RS-2024-00459026, No. RS-2024-00461572, No. RS-2024-00460762"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Storage"],"published-print":{"date-parts":[[2025,11,30]]},"abstract":"<jats:p>To explore the opportunity of expanding the page cache using disaggregated memory for file-backed pages, this study presents BalloonStasher, an RDMA-based disaggregated memory for data-intensive applications. Utilizing the ephemeral nature of the page cache, BalloonStasher dynamically adapts to the changing page cache demands of multiple clients. BalloonStasher supports one-sided RDMA-based memory pooling or two-sided RDMA-based memory sharing when using memory nodes. Additionally, it also supports peer memory mode, which utilizes the idle memory of peer nodes. Our extensive performance study compares the benefits and limitations of the three cache modes, and shows that BalloonStasher can mitigate the memory underutilization problem and improve the performance of data-intensive applications by a large margin.<\/jats:p>","DOI":"10.1145\/3736585","type":"journal-article","created":{"date-parts":[[2025,5,21]],"date-time":"2025-05-21T06:55:32Z","timestamp":1747810532000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Disaggregated Memory for File-backed Pages"],"prefix":"10.1145","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-0870-1284","authenticated-orcid":false,"given":"Daegyu","family":"Han","sequence":"first","affiliation":[{"name":"Sungkyunkwan University","place":["Suwon, Korea (the Republic of)"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-4268-5112","authenticated-orcid":false,"given":"Jaeyoon","family":"Nam","sequence":"additional","affiliation":[{"name":"Sungkyunkwan University - Suwon Campus","place":["Suwon, Korea (the Republic of)"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-4305-5721","authenticated-orcid":false,"given":"Hokeun","family":"Cha","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Madison","place":["Madison, United States"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9895-5125","authenticated-orcid":false,"given":"Changdae","family":"Kim","sequence":"additional","affiliation":[{"name":"ETRI","place":["Daejeon, Korea (the Republic of)"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3318-3109","authenticated-orcid":false,"given":"Kwangwon","family":"Koh","sequence":"additional","affiliation":[{"name":"ETRI","place":["Daejeon, Korea (the Republic of)"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1819-968X","authenticated-orcid":false,"given":"Taehoon","family":"Kim","sequence":"additional","affiliation":[{"name":"ETRI","place":["Daejeon, Korea (the Republic of)"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2105-1734","authenticated-orcid":false,"given":"Sang-Hoon","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Software and Computer Engineering, Ajou University","place":["Suwon, Korea (the Republic of)"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5481-6070","authenticated-orcid":false,"given":"Beomseok","family":"Nam","sequence":"additional","affiliation":[{"name":"Sungkyunkwan University - Suwon Campus","place":["Suwon, Korea (the Republic of)"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,11,3]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"Alibaba Inc. 2018. Alibaba Cluster Trace 2018. Retrieved from https:\/\/github.com\/alibaba\/clusterdata\/blob\/master\/cluster-trace-v2018\/trace_2018.md"},{"key":"e_1_3_2_3_2","unstructured":"DM-Cache. Retrieved from https:\/\/www.kernel.org\/doc\/Documentation\/device-mapper\/cache.txt (n.d.)."},{"key":"e_1_3_2_4_2","unstructured":"Google Cluster Trace 2011. (n.d.). Retrieved from https:\/\/github.com\/google\/cluster-data\/blob\/master\/ClusterData2011_2.md"},{"key":"e_1_3_2_5_2","unstructured":"HiBench benchmark suite. Retrieved from https:\/\/github.com\/Intel-bigdata\/HiBench. (n.d.)"},{"key":"e_1_3_2_6_2","unstructured":"Linkbench for PostgreSQL. Retrieved from https:\/\/github.com\/mdcallag\/linkbench. (n.d.)"},{"key":"e_1_3_2_7_2","unstructured":"NVIDIA Developer Data Loading Library (DALI). (n.d.). Retrieved from https:\/\/developer.nvidia.com\/dali"},{"key":"e_1_3_2_8_2","unstructured":"Percona Sysbench-TPCC. Retrieved from https:\/\/github.com\/Percona-Lab\/sysbench-tpcc. (n.d.)"},{"key":"e_1_3_2_9_2","unstructured":"Swarm64 DA Benchmark Toolkit. Retrieved from https:\/\/github.com\/swarm64\/s64da-benchmark-toolkit (n.d.)."},{"key":"e_1_3_2_10_2","unstructured":"2013. RAMster. (2013). Retrieved from https:\/\/github.com\/torvalds\/linux\/tree\/v3.11\/drivers\/staging\/zcache\/ramster"},{"key":"e_1_3_2_11_2","first-page":"775","volume-title":"Proceedings of the USENIX Annual Technical Conference (ATC)","year":"2018","unstructured":"Marcos K. Aguilera, Nadav Amit, Irina Calciu, Xavier Deguillard, Jayneel Gandhi, Stanko Novakovic, Arun Ramanathan, Pratap Subrahmanyam, Lalith Suresh, Kiran Tati, Rajesh Venkatasubramanian, and Michael Wei. 2018. Remote regions: A simple abstraction for remote memory. In Proceedings of the USENIX Annual Technical Conference (ATC). 775\u2013787."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/3533737.3535090"},{"key":"e_1_3_2_13_2","first-page":"843","volume-title":"Proceedings of the USENIX Annual Technical Conference (ATC)","author":"Maruf Hasan Al","year":"2020","unstructured":"Hasan Al Maruf and Mosharaf Chowdhury. 2020. Effectively prefetching remote memory with leap. In Proceedings of the USENIX Annual Technical Conference (ATC). 843\u2013857."},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/3342195.3387522"},{"key":"e_1_3_2_15_2","unstructured":"Storage Networking Industry Association. The SNIA\u2019s I\/O Traces Tools and Analysis (IOTTA) Repository. (n.d.). Retrieved from http:\/\/iotta.snia.org\/"},{"key":"e_1_3_2_16_2","unstructured":"Jens Axboe et\u00a0al. FIO (Flexible I\/O Tester). Retrieved from https:\/\/github.com\/axboe\/fio (n.d.)."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3447786.3456259"},{"key":"e_1_3_2_18_2","first-page":"195","volume-title":"Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI)","author":"Berger Daniel S","year":"2018","unstructured":"Daniel S Berger, Benjamin Berg, Timothy Zhu, Siddhartha Sen, and Mor Harchol-Balter. 2018. RobinHood: Tail latency aware caching\u2013dynamic reallocation from cache-rich to cache-poor. In Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI). 195\u2013212."},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/3445814.3446713"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.5555\/3386691.3386712"},{"key":"e_1_3_2_21_2","volume-title":"Proceedings of the 38th Intl. Conf. on Massive Storage Systems and Technology (MSST)","author":"Cao Zhang","year":"2024","unstructured":"Zhang Cao, Chang Guo, Ziyuan Lv, Anand Ananthabhotla, and Zhichao Cao. 2024. SAS-cache: A semantic-aware secondary cache for LSM-based key-value stores. In Proceedings of the 38th Intl. Conf. on Massive Storage Systems and Technology (MSST)."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/CCGrid54584.2022.00011"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/2541940.2541941"},{"key":"e_1_3_2_24_2","first-page":"401","volume-title":"Proceedings of the 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI)","author":"Dragojevi\u0107 Aleksandar","year":"2014","unstructured":"Aleksandar Dragojevi\u0107, Dushyanth Narayanan, Miguel Castro, and Orion Hodson. 2014. FaRM: Fast remote memory. In Proceedings of the 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI). 401\u2013414."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/224056.224072"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.5555\/645918.672473"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/3503222.3507725"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICPADS.2017.00092"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPSW.2019.00151"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpdc.2022.01.013"},{"key":"e_1_3_2_31_2","volume-title":"Proceedings of the USENIX Annual Technical Conference (USENIX ATC)","author":"Gouk Donghyun","year":"2022","unstructured":"Donghyun Gouk, Sangwon Lee, Miryeong Kwon, and Myoungsoo Jung. 2022. Direct access, high-performance memory disaggregation with DirectCXL. In Proceedings of the USENIX Annual Technical Conference (USENIX ATC)."},{"key":"e_1_3_2_32_2","first-page":"649","volume-title":"Proceedings of the 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI)","author":"Gu Juncheng","year":"2017","unstructured":"Juncheng Gu, Youngmoon Lee, Yiwen Zhang, Mosharaf Chowdhury, and Kang G. Shin. 2017. Efficient memory disaggregation with infiniswap. In Proceedings of the 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI). 649\u2013667."},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/CCGRID.2018.00017"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/511399.511340"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/2619239.2626299"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.5555\/3026959.3027000"},{"key":"e_1_3_2_37_2","first-page":"185","volume-title":"Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI)","author":"Kalia Anuj","year":"2016","unstructured":"Anuj Kalia, Michael Kaminsky, and David G. Andersen. 2016. FaSST: Fast, scalable and simple distributed transactions with two-sided RDMA datagram RPCs. In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI). 185\u2013201."},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/3492321.3527539"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/2818950.2818967"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/1555754.1555789"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/HPCA.2012.6168955"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/2757667.2757669"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/Cluster48925.2021.00096"},{"key":"e_1_3_2_44_2","first-page":"191","volume-title":"Proceedings of Linux Symposium","author":"Magenheimer D.","year":"2009","unstructured":"D. Magenheimer, C. Mason, D. McCracken, and K. Hackel. 2009. Transcendent memory and linux. In Proceedings of Linux Symposium. 191\u2013200."},{"key":"e_1_3_2_45_2","unstructured":"Hasan Al Maruf Yuhong Zhong Hongyi Wang Mosharaf Chowdhury Asaf Cidon and Carl Waldspurger. 2021. Memtrade: A disaggregated-memory marketplace for public clouds. arXiv:2108.06893. Retrieved from https:\/\/arxiv.org\/abs\/2108.06893"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3589985"},{"key":"e_1_3_2_47_2","volume-title":"Proceedings of the 9th USENIX Conference on File and Storage Technologies (FAST)","author":"Megiddo Nimrod","year":"2003","unstructured":"Nimrod Megiddo and Dharmendra S Modha. 2003. ARC: A self-tuning, low overhead replacement cache. In Proceedings of the 9th USENIX Conference on File and Storage Technologies (FAST)."},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3135974.3135992"},{"key":"e_1_3_2_49_2","first-page":"103","volume-title":"Proceedings of the USENIX Annual Technical Conference (USENIX ATC)","author":"Mitchell Christopher","year":"2013","unstructured":"Christopher Mitchell, Yifeng Geng, and Jinyang Li. 2013. Using one-sided RDMA reads to build a fast, CPU-efficient key-value store. In Proceedings of the USENIX Annual Technical Conference (USENIX ATC). 103\u2013114."},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.14778\/3446095.3446100"},{"key":"e_1_3_2_51_2","doi-asserted-by":"crossref","unstructured":"Yeonhong Park Sunhong Min and Jae W. Lee. 2022. Ginex: SSD-enabled billion-scale graph neural network training on a single machine via provably optimal in-memory caching. Proceedings of the VLDB Endowment 15 11 (2022) 2626\u20132639.","DOI":"10.14778\/3551793.3551819"},{"key":"e_1_3_2_52_2","first-page":"393","volume-title":"Proceedings of the 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI)","author":"Pu Qifan","year":"2016","unstructured":"Qifan Pu, Haoyuan Li, Matei Zaharia, Ali Ghodsi, and Ion Stoica. 2016. FairRide: Near-optimal, fair cache sharing. In Proceedings of the 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI). 393\u2013406."},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3331526"},{"key":"e_1_3_2_54_2","first-page":"341","volume-title":"Proceedings of the 19th USENIX Conference on File and Storage Technologies (FAST)","author":"Rodriguez Liana V.","year":"2021","unstructured":"Liana V. Rodriguez, Farzana Yusuf, Steven Lyons, Eysler Paz, Raju Rangaswami, Jason Liu, Ming Zhao, and Giri Narasimhan. 2021. Learning cache replacement with CACHEUS. In Proceedings of the 19th USENIX Conference on File and Storage Technologies (FAST). 341\u2013354."},{"key":"e_1_3_2_55_2","first-page":"69","volume-title":"Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI)","author":"Shan Yizhou","year":"2018","unstructured":"Yizhou Shan, Yutong Huang, Yilun Chen, and Yiying Zhang. 2018. LegoOS: A disseminated, distributed OS for hardware resource disaggregation. In Proceedings of the 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI). 69\u201387."},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1145\/2287076.2287081"},{"key":"e_1_3_2_57_2","first-page":"255","volume-title":"Proceedings of the 16th USENIX Conference on Networked Systems Design and Implementation (NSDI)","author":"Shrivastav Vishal","year":"2019","unstructured":"Vishal Shrivastav, Asaf Valadarsky, Hitesh Ballani, Paolo Costa, Ki Suh Lee, Han Wang, Rachit Agarwal, and Hakim Weatherspoon. 2019. Shoal: A network architecture for disaggregated racks. In Proceedings of the 16th USENIX Conference on Networked Systems Design and Implementation (NSDI). USENIX Association, 255\u2013270."},{"key":"e_1_3_2_58_2","unstructured":"Abraham Silberschatz Henry F. Korth and S. Sudershan. 1998. Database System Concepts (3rd ed.). McGraw-Hill Inc. USA."},{"issue":"1","key":"e_1_3_2_59_2","first-page":"6","article-title":"Filebench: A flexible framework for file system benchmarking","volume":"41","author":"Tarasov Vasily","year":"2016","unstructured":"Vasily Tarasov, Erez Zadok, and Spencer Shepler. 2016. Filebench: A flexible framework for file system benchmarking. ;login: USENIX Magazine 41, 1 (2016), 6\u201312.","journal-title":";login: USENIX Magazine"},{"key":"e_1_3_2_60_2","unstructured":"MELLANOX TECHNOLOGIES. RDMA aware networks programming user manual. Retrieved from https:\/\/docs.nvidia.com\/networking\/display\/rdmaawareprogrammingv17 (n.d.)."},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/HPCC.2014.160"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.5555\/3277332.3277335"},{"key":"e_1_3_2_63_2","first-page":"449","volume-title":"Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI)","author":"Vuppalapati Midhul","year":"2020","unstructured":"Midhul Vuppalapati, Justin Miron, Rachit Agarwal, Dan Truong, Ashish Motivala, and Thierry Cruanes. 2020. Building an elastic query engine on disaggregated storage. In Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI). 449\u2013462."},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/844128.844146"},{"key":"e_1_3_2_65_2","volume-title":"Proceedings of the 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI)","author":"Wang Chenxi","year":"2022","unstructured":"Chenxi Wang, Haoran Ma, Shi Liu, Yifan Qiao, Jonathan Eyolfson, Christian Navasca, Shan Lu, and Harry Xu. 2022. MemLiner: Lining up tracing and application for a far-memory-friendly runtime. In Proceedings of the 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI). Carlsbad, CA."},{"key":"e_1_3_2_66_2","first-page":"745","volume-title":"Proceedings of the USENIX Annual Technical Conference (ATC)","author":"Wang Jingjing","year":"2017","unstructured":"Jingjing Wang and Magdalena Balazinska. 2017. Elastic memory management for cloud data analytics. In Proceedings of the USENIX Annual Technical Conference (ATC). 745\u2013758."},{"key":"e_1_3_2_67_2","first-page":"639","volume-title":"Proceedings of the 2022 USENIX Annual Technical Conference (USENIX ATC)","author":"Wang Zhe","year":"2022","unstructured":"Zhe Wang, Teng Ma, Linghe Kong, Zhenzao Wen, Jingxuan Li, Zhuo Song, Yang Lu, Guihai Chen, and Wei Cao. 2022. Zero overhead monitoring for cloud-native infrastructure using RDMA. In Proceedings of the 2022 USENIX Annual Technical Conference (USENIX ATC). USENIX Association, Carlsbad, CA, 639\u2013654. Retrieved from https:\/\/www.usenix.org\/conference\/atc22\/presentation\/wang-zhe"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1145\/2815400.2815419"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1145\/3503222.3507731"},{"key":"e_1_3_2_70_2","first-page":"639","volume-title":"Proceedings of the 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI)","author":"Yang Lei","year":"2022","unstructured":"Lei Yang, Seo Jin Park, Mohammad Alizadeh, Sreeram Kannan, and David Tse. 2022. DispersedLedger: High-throughput byzantine consensus on variable bandwidth networks. In Proceedings of the 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI). Renton, WA, 639\u2013654."},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1145\/3190508.3190534"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/3655038.3665956"}],"container-title":["ACM Transactions on Storage"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3736585","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,3]],"date-time":"2025-11-03T13:35:51Z","timestamp":1762176951000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3736585"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,3]]},"references-count":71,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,11,30]]}},"alternative-id":["10.1145\/3736585"],"URL":"https:\/\/doi.org\/10.1145\/3736585","relation":{},"ISSN":["1553-3077","1553-3093"],"issn-type":[{"type":"print","value":"1553-3077"},{"type":"electronic","value":"1553-3093"}],"subject":[],"published":{"date-parts":[[2025,11,3]]},"assertion":[{"value":"2024-04-04","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-04-24","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-11-03","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}