{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T05:05:30Z","timestamp":1750309530066,"version":"3.41.0"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2025,2,8]],"date-time":"2025-02-08T00:00:00Z","timestamp":1738972800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Storage"],"published-print":{"date-parts":[[2025,5,31]]},"abstract":"<jats:p>\n            In this paper, we qualitatively and quantitatively discuss the design choices, production experience, and lessons in building the Elastic Block Storage (\n            <jats:monospace>EBS<\/jats:monospace>\n            ) at\n            <jats:sc>Alibaba Cloud<\/jats:sc>\n            over the past decade. To cope with hardware advancement and users\u2019 demands, we shift our focus from design simplicity in\n            <jats:monospace>EBS1<\/jats:monospace>\n            to high performance and space efficiency in\n            <jats:monospace>EBS2<\/jats:monospace>\n            , and finally reducing network traffic amplification in\n            <jats:monospace>EBS3<\/jats:monospace>\n            . In addition to the architectural evolutions, we also summarize development lessons and experiences as four topics, including: (i) achieving high elasticity in latency, throughput, IOPS, and capacity; (ii) improving availability by minimizing the blast radius of individual, regional, and global failure events; (iii) identifying the motivations and key tradeoffs in various hardware offloading solutions; and (iv) identifying the pros\/cons of alternative solutions and explaining why seemingly promising ideas would not work in practice.\n          <\/jats:p>","DOI":"10.1145\/3705925","type":"journal-article","created":{"date-parts":[[2024,12,4]],"date-time":"2024-12-04T10:59:38Z","timestamp":1733309978000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Evolving the Cloud Block Store with Performance, Elasticity, Availability, and Hardware Offloading"],"prefix":"10.1145","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6654-4364","authenticated-orcid":false,"given":"Erci","family":"Xu","sequence":"first","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0832-474X","authenticated-orcid":false,"given":"Weidong","family":"Zhang","sequence":"additional","affiliation":[{"name":"Alibaba Group, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5361-678X","authenticated-orcid":false,"given":"Qiuping","family":"Wang","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-6828-4238","authenticated-orcid":false,"given":"Xiaolu","family":"Zhang","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-1655-1221","authenticated-orcid":false,"given":"Yuesheng","family":"Gu","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-5419-3868","authenticated-orcid":false,"given":"Zhenwei","family":"Lu","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-6348-2429","authenticated-orcid":false,"given":"Tao","family":"Ouyang","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-1031-5045","authenticated-orcid":false,"given":"Guanqun","family":"Dong","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-4700-0225","authenticated-orcid":false,"given":"Wenwen","family":"Peng","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-8597-3414","authenticated-orcid":false,"given":"Zhe","family":"Xu","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2371-0502","authenticated-orcid":false,"given":"Shuo","family":"Zhang","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-2393-0057","authenticated-orcid":false,"given":"Dong","family":"Wu","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-9716-8869","authenticated-orcid":false,"given":"Yilei","family":"Peng","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-0028-914X","authenticated-orcid":false,"given":"Tianyun","family":"Wang","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-2230-0534","authenticated-orcid":false,"given":"Haoran","family":"Zhang","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-9763-3199","authenticated-orcid":false,"given":"Jiasheng","family":"Wang","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-1740-7797","authenticated-orcid":false,"given":"Wenyuan","family":"Yan","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2744-8652","authenticated-orcid":false,"given":"Yuanyuan","family":"Dong","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-2940-7674","authenticated-orcid":false,"given":"Wenhui","family":"Yao","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-6175-4783","authenticated-orcid":false,"given":"Zhongjie","family":"Wu","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-5145-6097","authenticated-orcid":false,"given":"Lingjun","family":"Zhu","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0057-6678","authenticated-orcid":false,"given":"Chao","family":"Shi","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-0767-6339","authenticated-orcid":false,"given":"Yinhu","family":"Wang","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-2761-3379","authenticated-orcid":false,"given":"Rong","family":"Liu","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-0857-2216","authenticated-orcid":false,"given":"Junping","family":"Wu","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-7913-2801","authenticated-orcid":false,"given":"Jiaji","family":"Zhu","sequence":"additional","affiliation":[{"name":"Alibaba Cloud, Alibaba Group, Hangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7417-5469","authenticated-orcid":false,"given":"Jiesheng","family":"Wu","sequence":"additional","affiliation":[{"name":"Alibaba Group, Hangzhou, China"}]}],"member":"320","published-online":{"date-parts":[[2025,2,8]]},"reference":[{"key":"e_1_3_1_2_2","unstructured":"Apache Hadoop 3.3.6 - HDFS Federation. https:\/\/hadoop.apache.org\/docs\/stable\/hadoop-project-dist\/hadoop-hdfs\/Federation.html (n.d.)."},{"key":"e_1_3_1_3_2","unstructured":"Apache Hbase. https:\/\/hbase.apache.org\/ (n.d.)."},{"key":"e_1_3_1_4_2","unstructured":"Erasure code \u2013 Ceph documentation. https:\/\/docs.ceph.com\/en\/latest\/rados\/operations\/erasure-code (n.d.)."},{"key":"e_1_3_1_5_2","unstructured":"HBASE-14598. https:\/\/issues.apache.org\/jira\/browse\/HBASE-14598 (n.d.)."},{"key":"e_1_3_1_6_2","unstructured":"HBASE-22072. https:\/\/issues.apache.org\/jira\/browse\/HBASE-22072 (n.d.)."},{"key":"e_1_3_1_7_2","unstructured":"HBASE-22862. https:\/\/issues.apache.org\/jira\/browse\/HBASE-22862 (n.d.)."},{"key":"e_1_3_1_8_2","unstructured":"HDFS Architecture Guide. https:\/\/hadoop.apache.org\/docs\/r1.2.1\/hdfs_design.html (n.d.)."},{"volume-title":"Proc. of IEEE HCS","year":"2020","key":"e_1_3_1_9_2","unstructured":"2020. The fungible DPU\u2122: A new category of microprocessor for the data-centric era: Hot chips 2020. In Proc. of IEEE HCS."},{"key":"e_1_3_1_10_2","unstructured":"2021. Alibaba Cloud Unveils New Server Chips to Optimize Cloud Computing Services. https:\/\/www.alibabacloud.com\/blog\/598159?spm=a3c0i.23458820.2359477120.113.66117d3fm03t9b (2021)."},{"key":"e_1_3_1_11_2","unstructured":"2021. AWS Nitro System. https:\/\/aws.amazon.com\/ec2\/nitro\/ (2021)."},{"key":"e_1_3_1_12_2","unstructured":"2021. A Detailed Explanation about Alibaba Cloud CIPU. https:\/\/www.alibabacloud.com\/blog\/599183?spm=a3c0i.23458820.2359477120.3.76806e9bESi3SD (2021)."},{"key":"e_1_3_1_13_2","unstructured":"2021. Intel Infrastructure Processing Unit. https:\/\/www.intel.com\/content\/www\/us\/en\/products\/details\/network-io\/ipu\/e2000-asic.html (2021)."},{"key":"e_1_3_1_14_2","unstructured":"2021. NVIDIA BlueField Data Processing Units. https:\/\/www.nvidia.com\/en-us\/networking\/products\/data-processing-unit\/ (2021)."},{"key":"e_1_3_1_15_2","unstructured":"2023. About Google Persistent Disk. https:\/\/cloud.google.com\/compute\/docs\/disks (2023)."},{"key":"e_1_3_1_16_2","unstructured":"2023. Alibaba Cloud Apsara File Storage NAS. https:\/\/www.alibabacloud.com\/help\/en\/nas (2023)."},{"key":"e_1_3_1_17_2","unstructured":"2023. Alibaba Cloud Elastic Block Storage Devices. https:\/\/www.alibabacloud.com\/help\/en\/elastic-compute-service\/latest\/block-storage-overview-elastic-block-storage-devices (2023)."},{"key":"e_1_3_1_18_2","unstructured":"2023. Alibaba Cloud Object Storage Service. https:\/\/www.alibabacloud.com\/help\/en\/object-storage-service (2023)."},{"key":"e_1_3_1_19_2","unstructured":"2023. Amazon Elastic Block Store. https:\/\/docs.aws.amazon.com\/AWSEC2\/latest\/UserGuide\/AmazonEBS.html (2023)."},{"key":"e_1_3_1_20_2","unstructured":"2023. Introduction to Azure Managed Disks. https:\/\/learn.microsoft.com\/en-us\/azure\/virtual-machines\/managed-disks-overview (2023)."},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3352460.3358303"},{"key":"e_1_3_1_22_2","volume-title":"Proc. of USENIX OSDI","author":"Beaver Doug","year":"2010","unstructured":"Doug Beaver, Sanjeev Kumar, Harry C. Li, Jason Sobel, and Peter Vajgel. 2010. Finding a needle in haystack: Facebook\u2019s photo storage. In Proc. of USENIX OSDI."},{"key":"e_1_3_1_23_2","volume-title":"Proc. of USENIX ATC","author":"Bj\u00f8rling Matias","year":"2021","unstructured":"Matias Bj\u00f8rling, Abutalib Aghayev, Hans Holmberg, Aravind Ramesh, Damien Le Moal, Gregory R. Ganger, and George Amvrosiadis. 2021. ZNS: Avoiding the block interface tax for flash-based SSDs. In Proc. of USENIX ATC."},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3477132.3483540"},{"key":"e_1_3_1_25_2","volume-title":"Proc. of USENIX NSDI","author":"Brooker Marc","year":"2020","unstructured":"Marc Brooker, Tao Chen, and Fan Ping. 2020. Millions of tiny databases. In Proc. of USENIX NSDI."},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/2043556.2043571"},{"key":"e_1_3_1_27_2","article-title":"Silesia Compression Corpus","author":"Deorowicz Sebastian","year":"2014","unstructured":"Sebastian Deorowicz. 2014. Silesia Compression Corpus. https:\/\/sun.aei.polsl.pl\/ sdeor\/index.php?page=silesia (2014).","journal-title":"https:\/\/sun.aei.polsl.pl\/ sdeor\/index.php?page=silesia"},{"key":"e_1_3_1_28_2","article-title":"Peter DeSantis Keynote Recap - AWS re:Invent 2022","author":"DeSantis Peter","year":"2022","unstructured":"Peter DeSantis. 2022. Peter DeSantis Keynote Recap - AWS re:Invent 2022. https:\/\/caylent.com\/blog\/peter-de-santis-keynote-recap-aws-re-invent-2022 (2022).","journal-title":"https:\/\/caylent.com\/blog\/peter-de-santis-keynote-recap-aws-re-invent-2022"},{"key":"e_1_3_1_29_2","volume-title":"Proc. of USENIX NSDI","author":"Gao Yixiao","year":"2021","unstructured":"Yixiao Gao, Qiang Li, Lingbo Tang, Yongqing Xi, Pengcheng Zhang, Wenwen Peng, Bo Li, Yaohui Wu, Shaozong Liu, Lei Yan, et\u00a0al. 2021. When cloud storage meets RDMA. In Proc. of USENIX NSDI."},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/945445.945450"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3492321.3524271"},{"key":"e_1_3_1_32_2","volume-title":"Proc. of USENIX OSDI","author":"Huang Lexiang","year":"2022","unstructured":"Lexiang Huang, Matthew Magnusson, Abishek Bangalore Muralikrishna, Salman Estyak, Rebecca Isaacs, Abutalib Aghayev, Timothy Zhu, and Aleksey Charapko. 2022. Metastable failures in the wild. In Proc. of USENIX OSDI."},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3302424.3303967"},{"key":"e_1_3_1_34_2","volume-title":"Proc. of USENIX FAST","author":"Li Qiang","year":"2023","unstructured":"Qiang Li, Qiao Xiang, Yuxin Wang, Haohao Song, Ridi Wen, Wenhui Yao, Yuanyuan Dong, Shuqi Zhao, Shuo Huang, Zhaosheng Zhu, et\u00a0al. 2023. More than capacity: Performance-oriented evolution of Pangu in Alibaba. In Proc. of USENIX FAST."},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544216.3544238"},{"key":"e_1_3_1_36_2","volume-title":"Proc. of USENIX NSDI","author":"Mickens James","year":"2014","unstructured":"James Mickens, Edmund B. Nightingale, Jeremy Elson, Darren Gehring, Bin Fan, Asim Kadav, Vijay Chidambaram, Osama Khan, and Krishna Nareddy. 2014. Blizzard: Fast, cloud-scale block storage for cloud-oblivious applications. In Proc. of USENIX NSDI."},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/121132.121137"},{"key":"e_1_3_1_38_2","volume-title":"Proc. of USENIX FAST","author":"Wang Qiuping","year":"2022","unstructured":"Qiuping Wang, Jinhong Li, Patrick P. C. Lee, Tao Ouyang, Chao Shi, and Lilong Huang. 2022. Separating data via block invalidation time inference for write amplification reduction in log-structured storage. In Proc. of USENIX FAST."},{"key":"e_1_3_1_39_2","volume-title":"Proc. of USENIX NSDI","author":"Wang Yang","year":"2013","unstructured":"Yang Wang, Manos Kapritsos, Zuocheng Ren, Prince Mahajan, Jeevitha Kirubanandam, Lorenzo Alvisi, and Mike Dahlin. 2013. Robustness in the Salus scalable block store. In Proc. of USENIX NSDI."},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/MM.2021.3085578"},{"key":"e_1_3_1_41_2","volume-title":"Proc. of USENIX OSDI","author":"Zhang Jie","year":"2018","unstructured":"Jie Zhang, Miryeong Kwon, Donghyun Gouk, Sungjoon Koh, Changlim Lee, Mohammad Alian, Myoungjun Chun, Mahmut Taylan Kandemir, Nam Sung Kim, Jihong Kim, et\u00a0al. 2018. FlashShare: Punching through server storage stack from kernel to firmware for Ultra-Low latency SSDs. In Proc. of USENIX OSDI."},{"key":"e_1_3_1_42_2","volume-title":"Proc. of USENIX FAST","author":"Zhang Teng","year":"2020","unstructured":"Teng Zhang, Jianying Wang, Xuntao Cheng, Hao Xu, Nanlong Yu, Gui Huang, Tieying Zhang, Dengcheng He, Feifei Li, Wei Cao, et\u00a0al. 2020. FPGA-accelerated compactions for LSM-based key-value store. In Proc. of USENIX FAST."},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3373376.3378507"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3448418"},{"key":"e_1_3_1_45_2","volume-title":"Proc. of USENIX ATC","author":"Zhu Lingjun","year":"2023","unstructured":"Lingjun Zhu, Yifan Shen, Erci Xu, Bo Shi, Ting Fu, Shu Ma, Shuguang Chen, Zhongyu Wang, Haonan Wu, Xingyu Liao, et\u00a0al. 2023. Deploying user-space TCP at cloud scale with LUNA. In Proc. of USENIX ATC."}],"container-title":["ACM Transactions on Storage"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3705925","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3705925","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:18:13Z","timestamp":1750295893000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3705925"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,8]]},"references-count":44,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,5,31]]}},"alternative-id":["10.1145\/3705925"],"URL":"https:\/\/doi.org\/10.1145\/3705925","relation":{},"ISSN":["1553-3077","1553-3093"],"issn-type":[{"type":"print","value":"1553-3077"},{"type":"electronic","value":"1553-3093"}],"subject":[],"published":{"date-parts":[[2025,2,8]]},"assertion":[{"value":"2024-05-13","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-09-11","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-02-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}