{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,30]],"date-time":"2025-08-30T00:06:07Z","timestamp":1756512367074,"version":"3.44.0"},"reference-count":50,"publisher":"Association for Computing Machinery (ACM)","issue":"6","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2025,2]]},"abstract":"<jats:p>In distributed time series databases (TSDBs), time series data are typically partitioned by both series and time. These partitions are then allocated to shards, whose replicas determine the storage location, with the leader managing the write load. In Internet of Things (IoT) scenarios, clusters expand as the number of sensors continues to grow. A common approach to re-balancing storage is migrating existing partitions, yet it incurs additional overhead. Fortunately, Time to Live (TTL) is often implemented in time series databases to automatically unload expired data. As a result, dynamically expanding shards rather than migrating existing partitions can also restore storage balance. In addition, the cluster's fault tolerance depends on replica placement schemes, and an expanding cluster complicates this issue. Finally, the intensive write load in IoT scenarios requires balanced leader selection, which becomes difficult due to fault-tolerant placement schemes. To address these IoT challenges, this paper presents the migration-free data partitioning and allocation strategies, a storage-balanced replica placement algorithm with proven fault tolerance, and a write-balanced leader selection algorithm. Our proposals have been deployed in Apache IoTDB since version 1.3. Extensive evaluation of the system demonstrates its superiority in availability and performance.<\/jats:p>","DOI":"10.14778\/3725688.3725706","type":"journal-article","created":{"date-parts":[[2025,8,29]],"date-time":"2025-08-29T14:19:21Z","timestamp":1756477161000},"page":"1784-1797","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Migration-Free Elastic Storage of Time Series in Apache IoTDB"],"prefix":"10.14778","volume":"18","author":[{"given":"Rongzhao","family":"Chen","sequence":"first","affiliation":[{"name":"Tsinghua University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiangpeng","family":"Hu","sequence":"additional","affiliation":[{"name":"Tsinghua University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiangdong","family":"Huang","sequence":"additional","affiliation":[{"name":"Tsinghua University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chen","family":"Wang","sequence":"additional","affiliation":[{"name":"Tsinghua University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shaoxu","family":"Song","sequence":"additional","affiliation":[{"name":"Tsinghua University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianmin","family":"Wang","sequence":"additional","affiliation":[{"name":"Tsinghua University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,8,29]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2025. Appendix. (2025 April). [Online]. Available: https:\/\/crzbulabula.github.io\/migration-free_appendix.pdf."},{"key":"e_1_2_1_2_1","volume-title":"Evaluation codes","year":"2025","unstructured":"2025. Evaluation codes. (2025, April). [Online]. Available: https:\/\/github.com\/CRZbulabula\/iotdb\/tree\/migration-free-elastic-storage."},{"key":"e_1_2_1_3_1","volume-title":"IoTDB implementations","year":"2025","unstructured":"2025. IoTDB implementations. (2025, April). [Online]. Available: https:\/\/iotdb.apache.org\/UserGuide\/V1.3.x\/Technical-Insider\/Cluster-data-partitioning.html."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/S00778-014-0357-Y"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3448016.3457565"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1002\/CPE.4334"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.14778\/3648160.3648186"},{"key":"e_1_2_1_8_1","volume-title":"2015 USENIX Annual Technical Conference, USENIX ATC '15","author":"Cidon Asaf","year":"2015","unstructured":"Asaf Cidon, Robert Escriva, Sachin Katti, Mendel Rosenblum, and Emin G\u00fcn Sirer. 2015. Tiered Replication: A Cost-effective Alternative to Full Cluster Geo-replication. In 2015 USENIX Annual Technical Conference, USENIX ATC '15, July 8\u201310, Santa Clara, CA, USA, Shan Lu and Erik Riedel (Eds.). USENIX Association, 31\u201343. https:\/\/www.usenix.org\/conference\/atc15\/technical-session\/presentation\/cidon"},{"key":"e_1_2_1_9_1","volume-title":"Copysets: Reducing the Frequency of Data Loss in Cloud Storage. In 2013 USENIX Annual Technical Conference","author":"Cidon Asaf","year":"2013","unstructured":"Asaf Cidon, Stephen M. Rumble, Ryan Stutsman, Sachin Katti, John K. Ousterhout, and Mendel Rosenblum. 2013. Copysets: Reducing the Frequency of Data Loss in Cloud Storage. In 2013 USENIX Annual Technical Conference, San Jose, CA, USA, June 26\u201328, 2013, Andrew Birrell and Emin G\u00fcn Sirer (Eds.). USENIX Association, 37\u201348. www.usenix.org\/conference\/atc13\/technical-sessions\/presentation\/cidon"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491245"},{"key":"e_1_2_1_11_1","volume-title":"17th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2020","author":"Ding Cong","year":"2020","unstructured":"Cong Ding, David Chu, Evan Zhao, Xiang Li, Lorenzo Alvisi, and Robbert van Renesse. 2020. Scalog: Seamless Reconfiguration and Total Order in a Scalable Shared Log. In 17th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2020, Santa Clara, CA, USA, February 25\u201327, 2020, Ranjita Bhagwan and George Porter (Eds.). USENIX Association, 325\u2013338. https:\/\/www.usenix.org\/conference\/nsdi20\/presentation\/ding"},{"key":"e_1_2_1_12_1","first-page":"1277","article-title":"Algorithm for solution of a problem of maximum flow in networks with power estimation","volume":"11","author":"Dinic Efim A","year":"1970","unstructured":"Efim A Dinic. 1970. Algorithm for solution of a problem of maximum flow in networks with power estimation. In Soviet Math. Doklady, Vol. 11. 1277\u20131280.","journal-title":"Soviet Math. Doklady"},{"key":"e_1_2_1_13_1","unstructured":"Ronald Aylmer Fisher et al. 1940. 174: An Examination of the Different Possible Solutions of a Problem in IncompleteBlocks. (1940)."},{"key":"e_1_2_1_14_1","volume-title":"9th USENIX Symposium on Operating Systems Design and Implementation, OSDI","author":"Ford Daniel","year":"2010","unstructured":"Daniel Ford, Fran\u00e7ois Labelle, Florentina I. Popovici, Murray Stokely, Van-Anh Truong, Luiz Barroso, Carrie Grimes, and Sean Quinlan. 2010. Availability in Globally Distributed Storage Systems. In 9th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2010, October 4\u20136, 2010, Vancouver, BC, Canada, Proceedings, Remzi H. Arpaci-Dusseau and Brad Chen (Eds.). USENIX Association, 61\u201374. http:\/\/www.usenix.org\/events\/osdi10\/tech\/full_papers\/Ford.pdf"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.4153\/CJM-1957-024-0"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCEA50009.2020.00136"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/48014.61051"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.14778\/3685800.3685803"},{"key":"e_1_2_1_19_1","volume-title":"https:\/\/hbase.apache.org\/","year":"2025","unstructured":"HBase. 2025. HBase. https:\/\/hbase.apache.org\/ (2025, April). [Online]. Available: https:\/\/hbase.apache.org\/."},{"key":"e_1_2_1_20_1","volume-title":"Data Availability and Durability with the Hadoop Distributed File System. login Usenix Mag. 37, 1","author":"Chansler Robert J.","year":"2012","unstructured":"Robert J. Chansler Jr. 2012. Data Availability and Durability with the Hadoop Distributed File System. login Usenix Mag. 37, 1 (2012). https:\/\/www.usenix.org\/publications\/login\/february-2012\/data-availability-and-durability-hadoop-distributed-file-system."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE53745.2022.00315"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/258533.258660"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1773912.1773922"},{"key":"e_1_2_1_24_1","volume-title":"20th USENIX Conference on File and Storage Technologies, FAST 2022","author":"Lee Youngmoon","year":"2022","unstructured":"Youngmoon Lee, Hasan Al Maruf, Mosharaf Chowdhury, Asaf Cidon, and Kang G. Shin. 2022. Hydra : Resilient and Highly Available Remote Memory. In 20th USENIX Conference on File and Storage Technologies, FAST 2022, Santa Clara, CA, USA, February 22\u201324, 2022, Dean Hildebrand and Donald E. Porter (Eds.). USENIX Association, 181\u2013198. https:\/\/www.usenix.org\/conference\/fast22\/presentation\/lee"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2013.110"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the 2021 USENIX Annual Technical Conference, USENIX ATC 2021, July 14\u201316","author":"Liu Pinchao","year":"2021","unstructured":"Pinchao Liu, Dilma Da Silva, and Liting Hu. 2021. DART: A Scalable and Adaptive Edge Stream Processing Engine. In Proceedings of the 2021 USENIX Annual Technical Conference, USENIX ATC 2021, July 14\u201316, 2021, Irina Calciu and Geoff Kuenning (Eds.). USENIX Association, 239\u2013252. https:\/\/www.usenix.org\/conference\/atc21\/presentation\/liu"},{"key":"e_1_2_1_27_1","volume-title":"Proc. of the International Symposium on the Theory of Switching","author":"Moore Edward F","year":"1959","unstructured":"Edward F Moore. 1959. The shortest path through a maze. In Proc. of the International Symposium on the Theory of Switching. Harvard University Press, 285\u2013292."},{"key":"e_1_2_1_28_1","volume-title":"https:\/\/mqtt.org\/","author":"MQTT.","year":"2025","unstructured":"MQTT. 2025. MQTT. https:\/\/mqtt.org\/ (2025, April). [Online]. Available: https:\/\/mqtt.org\/."},{"key":"e_1_2_1_29_1","first-page":"1","article-title":"Time series databases and influxdb","volume":"12","author":"Zehra Naqvi Syeda Noor","year":"2017","unstructured":"Syeda Noor Zehra Naqvi, Sofia Yfantidou, and Esteban Zim\u00e1nyi. 2017. Time series databases and influxdb. Studienarbeit, Universit\u00e9 Libre de Bruxelles 12 (2017), 1\u201344.","journal-title":"Studienarbeit, Universit\u00e9 Libre de Bruxelles"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2019.2896115"},{"key":"e_1_2_1_31_1","volume-title":"2014 USENIX Annual Technical Conference, USENIX ATC '14","author":"Ongaro Diego","year":"2014","unstructured":"Diego Ongaro and John K. Ousterhout. 2014. In Search of an Understandable Consensus Algorithm. In 2014 USENIX Annual Technical Conference, USENIX ATC '14, Philadelphia, PA, USA, June 19\u201320, 2014, Garth Gibson and Nickolai Zeldovich (Eds.). USENIX Association, 305\u2013319. www.usenix.org\/conference\/atc14\/technical-sessions\/presentation\/ongaro"},{"key":"e_1_2_1_32_1","unstructured":"OpenTSDB. 2025. Hbase in OpenTSDB. http:\/\/opentsdb.net\/ (2025 April). [Online]. Available: http:\/\/opentsdb.net\/docs\/build\/html\/user_guide\/backends\/hbase.html."},{"key":"e_1_2_1_33_1","volume-title":"http:\/\/opentsdb.net\/","author":"TSDB.","year":"2025","unstructured":"OpenTSDB. 2025. OpenTSDB. http:\/\/opentsdb.net\/ (2025, April). [Online]. Available: http:\/\/opentsdb.net\/."},{"key":"e_1_2_1_34_1","volume-title":"Exploiting Commutativity For Practical Fast Replication. In 16th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2019","author":"Park Seo Jin","year":"2019","unstructured":"Seo Jin Park and John K. Ousterhout. 2019. Exploiting Commutativity For Practical Fast Replication. In 16th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2019, Boston, MA, February 26\u201328, 2019, Jay R. Lorch and Minlan Yu (Eds.). USENIX Association, 47\u201364. https:\/\/www.usenix.org\/conference\/nsdi19\/presentation\/park"},{"key":"e_1_2_1_35_1","volume-title":"https:\/\/github.com\/zalando\/patroni","year":"2025","unstructured":"Patroni. 2025. Patroni. https:\/\/github.com\/zalando\/patroni (2025, April). [Online]. Available: https:\/\/github.com\/zalando\/patroni."},{"key":"e_1_2_1_36_1","volume-title":"https:\/\/github.com\/apache\/ratis","author":"Ratis Apache","year":"2025","unstructured":"Apache Ratis. 2025. Ratis. https:\/\/github.com\/apache\/ratis (2025, April). [Online]. Available: https:\/\/github.com\/apache\/ratis."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/383059.383072"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45518-3_18"},{"key":"e_1_2_1_39_1","doi-asserted-by":"crossref","first-page":"329","DOI":"10.4153\/CMB-1973-053-1","article-title":"On the Construction of Bibd With \u03bb= 1","volume":"16","author":"Scott Kenneth FN","year":"1973","unstructured":"Kenneth FN Scott. 1973. On the Construction of Bibd With \u03bb= 1. Canad. Math. Bull. 16, 3 (1973), 329\u2013335.","journal-title":"Canad. Math. Bull."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/S41019-024-00251-0"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2002.808407"},{"key":"e_1_2_1_42_1","volume-title":"https:\/\/www.timescale.com\/","author":"DB.","year":"2025","unstructured":"TimescaleDB. 2025. TimescaleDB. https:\/\/www.timescale.com\/ (2025, April). [Online]. Available: https:\/\/www.timescale.com\/."},{"key":"e_1_2_1_43_1","volume-title":"Chain Replication for Supporting High Throughput and Availability. In 6th Symposium on Operating System Design and Implementation (OSDI 2004","author":"van Renesse Robbert","year":"2004","unstructured":"Robbert van Renesse and Fred B. Schneider. 2004. Chain Replication for Supporting High Throughput and Availability. In 6th Symposium on Operating System Design and Implementation (OSDI 2004), San Francisco, California, USA, December 6\u20138, 2004, Eric A. Brewer and Peter Chen (Eds.). USENIX Association, 91\u2013104. http:\/\/www.usenix.org\/events\/osdi04\/tech\/renesse.html"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3589775"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3600006.3613145"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.14778\/3547305.3547319"},{"key":"e_1_2_1_47_1","volume-title":"Proceedings of the 9th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2012","author":"Zaharia Matei","year":"2012","unstructured":"Matei Zaharia, Mosharaf Chowdhury, Tathagata Das, Ankur Dave, Justin Ma, Murphy McCauly, Michael J. Franklin, Scott Shenker, and Ion Stoica. 2012. Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing. In Proceedings of the 9th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2012, San Jose, CA, USA, April 25\u201327, 2012, Steven D. Gribble and Dina Katabi (Eds.). USENIX Association, 15\u201328. https:\/\/www.usenix.org\/conference\/nsdi12\/technical-sessions\/presentation\/zaharia."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514221.3526051"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/S11390-021-1629-9"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2003.818784"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3725688.3725706","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,29]],"date-time":"2025-08-29T14:21:18Z","timestamp":1756477278000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3725688.3725706"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2]]},"references-count":50,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2025,2]]}},"alternative-id":["10.14778\/3725688.3725706"],"URL":"https:\/\/doi.org\/10.14778\/3725688.3725706","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2025,2]]},"assertion":[{"value":"2025-08-29","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}