{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:12:57Z","timestamp":1750219977896,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":33,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,1,6]],"date-time":"2023-01-06T00:00:00Z","timestamp":1672963200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,1,6]]},"DOI":"10.1145\/3589845.3589846","type":"proceedings-article","created":{"date-parts":[[2023,6,23]],"date-time":"2023-06-23T04:20:33Z","timestamp":1687494033000},"page":"1-9","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["An On-Demand Cloud-Native Containerized Storage Design and its Practice of HDFS-on-Kubernetes"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3379-9173","authenticated-orcid":false,"given":"Jian","family":"Lin","sequence":"first","affiliation":[{"name":"Oriental Mind (Wuhan) Computing Technology Co., Ltd., China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9513-0451","authenticated-orcid":false,"given":"Lin","family":"Huang","sequence":"additional","affiliation":[{"name":"Oriental Mind (Wuhan) Computing Technology Co., Ltd., China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0506-4842","authenticated-orcid":false,"given":"Tao","family":"Zhou","sequence":"additional","affiliation":[{"name":"Oriental Mind (Wuhan) Computing Technology Co., Ltd., China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6744-4373","authenticated-orcid":false,"given":"Dongming","family":"Xie","sequence":"additional","affiliation":[{"name":"Oriental Mind (Wuhan) Computing Technology Co., Ltd., China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6222-6919","authenticated-orcid":false,"given":"Bo","family":"Yu","sequence":"additional","affiliation":[{"name":"Oriental Mind (Wuhan) Computing Technology Co., Ltd., China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,6,22]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Alibaba. 2020. Lindorm. https:\/\/www.aliyun.com\/product\/apsaradb\/lindorm.  Alibaba. 2020. Lindorm. https:\/\/www.aliyun.com\/product\/apsaradb\/lindorm."},{"key":"e_1_3_2_1_2_1","volume-title":"Proceedings of the 13th Workshop on Hot Topics in Operating Systems (HotOS). 1\u20135.","author":"Ananthanarayanan Ganesh","year":"2011","unstructured":"Ganesh Ananthanarayanan , Ali Ghodsi , Scott Shenker , and Ion Stoica . 2011 . Disk-Locality in Datacenter Computing Considered Irrelevant . In Proceedings of the 13th Workshop on Hot Topics in Operating Systems (HotOS). 1\u20135. Ganesh Ananthanarayanan, Ali Ghodsi, Scott Shenker, and Ion Stoica. 2011. Disk-Locality in Datacenter Computing Considered Irrelevant. In Proceedings of the 13th Workshop on Hot Topics in Operating Systems (HotOS). 1\u20135."},{"key":"e_1_3_2_1_3_1","volume-title":"Apache Spark Usage and Deployment Models for Scientific Computing. EPJ Web of Conferences 214","author":"Castro Diogo","year":"2019","unstructured":"Diogo Castro , Prasanth Kothuri , Piotr Mrowczynski , Danilo Piparo , and Enric Tejedor . 2019 . Apache Spark Usage and Deployment Models for Scientific Computing. EPJ Web of Conferences 214 (2019), 1\u201310. Diogo Castro, Prasanth Kothuri, Piotr Mrowczynski, Danilo Piparo, and Enric Tejedor. 2019. Apache Spark Usage and Deployment Models for Scientific Computing. EPJ Web of Conferences 214 (2019), 1\u201310."},{"key":"e_1_3_2_1_4_1","unstructured":"Cloud Native Computing Foundation. 2016. Rook. https:\/\/rook.io.  Cloud Native Computing Foundation. 2016. Rook. https:\/\/rook.io."},{"key":"e_1_3_2_1_5_1","volume-title":"Kubernetes Documentation: Pod Lifecycle. https:\/\/kubernetes.io\/docs\/concepts\/workloads\/pods\/pod-lifecycle.","author":"Computing Foundation Cloud Native","year":"2022","unstructured":"Cloud Native Computing Foundation . 2022 . Kubernetes Documentation: Pod Lifecycle. https:\/\/kubernetes.io\/docs\/concepts\/workloads\/pods\/pod-lifecycle. Cloud Native Computing Foundation. 2022. Kubernetes Documentation: Pod Lifecycle. https:\/\/kubernetes.io\/docs\/concepts\/workloads\/pods\/pod-lifecycle."},{"key":"e_1_3_2_1_6_1","unstructured":"Cybozu. 2019. TopoLVM. https:\/\/github.com\/topolvm\/topolvm.  Cybozu. 2019. TopoLVM. https:\/\/github.com\/topolvm\/topolvm."},{"key":"e_1_3_2_1_7_1","unstructured":"Dawning Information Industry Co. Ltd.2018. Container-based HDFS High Availability Implementation Method. China Patent 201810980102.2.  Dawning Information Industry Co. Ltd.2018. Container-based HDFS High Availability Implementation Method. China Patent 201810980102.2."},{"key":"e_1_3_2_1_8_1","first-page":"1157","article-title":"LVM in the Linux Environment: Performance Examination","volume":"22","author":"Djordjevic Borislav","year":"2015","unstructured":"Borislav Djordjevic and Valentina Timcenko . 2015 . LVM in the Linux Environment: Performance Examination . Tehni\u010dki Vjesnik 22 , 5 (2015), 1157 \u2013 1164 . Borislav Djordjevic and Valentina Timcenko. 2015. LVM in the Linux Environment: Performance Examination. Tehni\u010dki Vjesnik 22, 5 (2015), 1157\u20131164.","journal-title":"Tehni\u010dki Vjesnik"},{"key":"e_1_3_2_1_9_1","volume-title":"Kubernetes Operators: Automating the Container Orchestration Platform. O\u2019Reilly Media.","author":"Dobies Jason","year":"2020","unstructured":"Jason Dobies and Joshua Wood . 2020 . Kubernetes Operators: Automating the Container Orchestration Platform. O\u2019Reilly Media. Jason Dobies and Joshua Wood. 2020. Kubernetes Operators: Automating the Container Orchestration Platform. O\u2019Reilly Media."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CloudCom.2019.00038"},{"volume-title":"Cloud Native Architecture and Design: A Handbook for Modern Day Architecture and Design with Enterprise-Grade Examples","author":"Goniwada R.","key":"e_1_3_2_1_11_1","unstructured":"Shivakumar\u00a0 R. Goniwada . 2022. Cloud Native Architecture and Design: A Handbook for Modern Day Architecture and Design with Enterprise-Grade Examples . Apress . Shivakumar\u00a0R. Goniwada. 2022. Cloud Native Architecture and Design: A Handbook for Modern Day Architecture and Design with Enterprise-Grade Examples. Apress."},{"key":"e_1_3_2_1_12_1","unstructured":"Google. 2017. Kubernetes Operator for Apache Spark. https:\/\/github.com\/GoogleCloudPlatform\/spark-on-k8s-operator.  Google. 2017. Kubernetes Operator for Apache Spark. https:\/\/github.com\/GoogleCloudPlatform\/spark-on-k8s-operator."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDEW.2010.5452747"},{"key":"e_1_3_2_1_14_1","first-page":"1","article-title":"On-the-Fly Fusion of Remotely-Sensed Big Data using an Elastic Computing Paradigm with a Containerized Spark Engine on Kubernetes","volume":"21","author":"Huang Wei","year":"2021","unstructured":"Wei Huang , Jianzhong Zhou , and Dongying Zhang . 2021 . On-the-Fly Fusion of Remotely-Sensed Big Data using an Elastic Computing Paradigm with a Containerized Spark Engine on Kubernetes . Sensors 21 , 9 (2021), 1 \u2013 18 . Wei Huang, Jianzhong Zhou, and Dongying Zhang. 2021. On-the-Fly Fusion of Remotely-Sensed Big Data using an Elastic Computing Paradigm with a Containerized Spark Engine on Kubernetes. Sensors 21, 9 (2021), 1\u201318.","journal-title":"Sensors"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.5220\/0005861701920201"},{"key":"e_1_3_2_1_16_1","unstructured":"Juicedata. 2021. JuiceFS for Hadoop Workloads (Replacing HDFS). https:\/\/juicefs.com\/docs\/cloud\/use_juicefs_in_hadoop_and_spark\/.  Juicedata. 2021. JuiceFS for Hadoop Workloads (Replacing HDFS). https:\/\/juicefs.com\/docs\/cloud\/use_juicefs_in_hadoop_and_spark\/."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2017.09.050"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/EDOCW.2016.7584353"},{"key":"e_1_3_2_1_19_1","volume-title":"Alluxio: A Virtual Distributed File System","author":"Li Haoyuan","year":"2018","unstructured":"Haoyuan Li . 2018 . Alluxio: A Virtual Distributed File System . University of California , Berkeley. Haoyuan Li. 2018. Alluxio: A Virtual Distributed File System. University of California, Berkeley."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/BESC48373.2019.8962995"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compeleceng.2018.03.041"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISPDC51135.2020.00025"},{"key":"e_1_3_2_1_23_1","unstructured":"Piotr Mrowczynski. 2018. Scaling Cloud-Native Apache Spark on Kubernetes for Workloads in External Storages. KTH Stockholm & TU Berlin.  Piotr Mrowczynski. 2018. Scaling Cloud-Native Apache Spark on Kubernetes for Workloads in External Storages. KTH Stockholm & TU Berlin."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/NCA.2016.7778624"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/3485849.3485868"},{"volume-title":"Advances in Data Sciences, Security and Applications","author":"Sharma Ashish","key":"e_1_3_2_1_26_1","unstructured":"Ashish Sharma , Sarita Yadav , Neha Gupta , Shafali Dhall , and Shikha Rastogi . 2020. Proposed Model for Distributed Storage Automation System using Kubernetes Operators . In Advances in Data Sciences, Security and Applications . Springer , 341\u2013351. Ashish Sharma, Sarita Yadav, Neha Gupta, Shafali Dhall, and Shikha Rastogi. 2020. Proposed Model for Distributed Storage Automation System using Kubernetes Operators. In Advances in Data Sciences, Security and Applications. Springer, 341\u2013351."},{"key":"e_1_3_2_1_27_1","unstructured":"Stackable. 2021. Stackable Operator for Apache HDFS. https:\/\/docs.stackable.tech\/hdfs.  Stackable. 2021. Stackable Operator for Apache HDFS. https:\/\/docs.stackable.tech\/hdfs."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.12720\/jait.7.4.302-307"},{"key":"e_1_3_2_1_29_1","unstructured":"Tencent. 2019. CHDFS. https:\/\/cloud.tencent.com\/product\/chdfs.  Tencent. 2019. CHDFS. https:\/\/cloud.tencent.com\/product\/chdfs."},{"key":"e_1_3_2_1_30_1","unstructured":"The CNI Authors. 2014. CNI Documentation: macvlan plugin. https:\/\/www.cni.dev\/plugins\/current\/main\/macvlan.  The CNI Authors. 2014. CNI Documentation: macvlan plugin. https:\/\/www.cni.dev\/plugins\/current\/main\/macvlan."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/PDP.2014.78"},{"key":"e_1_3_2_1_32_1","volume-title":"Proceedings of the 33rd International Conference on Massive Storage Systems and Technology (MSST). 1\u201312","author":"Xu Qiumin","year":"2017","unstructured":"Qiumin Xu , Manu Awasthi , Krishna\u00a0 T Malladi , Janki Bhimani , Jingpei Yang , and Murali Annavaram . 2017 . Performance Analysis of Containerized Applications on Local and Remote Storage . In Proceedings of the 33rd International Conference on Massive Storage Systems and Technology (MSST). 1\u201312 . Qiumin Xu, Manu Awasthi, Krishna\u00a0T Malladi, Janki Bhimani, Jingpei Yang, and Murali Annavaram. 2017. Performance Analysis of Containerized Applications on Local and Remote Storage. In Proceedings of the 33rd International Conference on Massive Storage Systems and Technology (MSST). 1\u201312."},{"key":"e_1_3_2_1_33_1","unstructured":"Xiang Zeng. 2019. Kubernetes Operator for Apache HDFS. https:\/\/github.com\/tommenx\/hdfs-operator.  Xiang Zeng. 2019. Kubernetes Operator for Apache HDFS. https:\/\/github.com\/tommenx\/hdfs-operator."}],"event":{"name":"ICCDE 2023: 2023 9th International Conference on Computing and Data Engineering","acronym":"ICCDE 2023","location":"Haikou China"},"container-title":["Proceedings of the 2023 9th International Conference on Computing and Data Engineering"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3589845.3589846","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3589845.3589846","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:22Z","timestamp":1750182562000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3589845.3589846"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,6]]},"references-count":33,"alternative-id":["10.1145\/3589845.3589846","10.1145\/3589845"],"URL":"https:\/\/doi.org\/10.1145\/3589845.3589846","relation":{},"subject":[],"published":{"date-parts":[[2023,1,6]]},"assertion":[{"value":"2023-06-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}