{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,6]],"date-time":"2025-12-06T05:05:58Z","timestamp":1764997558481,"version":"3.44.0"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2023,8]]},"abstract":"<jats:p>Internet services supported by large-scale distributed systems have become essential for our daily life. To ensure the stability and high quality of services, diverse metric data are constantly collected and managed in a time-series database to monitor the service status. However, when the number of metrics becomes massive, existing time-series databases are inefficient in handling high-rate data ingestion and queries hitting multiple metrics. Besides, they all lack the support of machine learning functions, which are crucial for sophisticated analysis of large-scale time series. In this paper, we present Lindorm TSDB, a distributed time-series database designed for handling monitoring metrics at scale. It sustains high write throughput and low query latency with massive active metrics. It also allows users to analyze data with anomaly detection and time series forecasting algorithms directly through SQL. Furthermore, Lindorm TSDB retains stable performance even during node scaling. We evaluate Lindorm TSDB under different data scales, and the results show that it outperforms two popular open-source time-series databases on both writing and query, while executing time-series machine learning tasks efficiently.<\/jats:p>","DOI":"10.14778\/3611540.3611559","type":"journal-article","created":{"date-parts":[[2023,9,15]],"date-time":"2023-09-15T11:32:37Z","timestamp":1694777557000},"page":"3715-3727","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Lindorm TSDB: A Cloud-Native Time-Series Database for Large-Scale Monitoring Systems"],"prefix":"10.14778","volume":"16","author":[{"given":"Chunhui","family":"Shen","sequence":"first","affiliation":[{"name":"Alibaba Group"}]},{"given":"Qianyu","family":"Ouyang","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Feibo","family":"Li","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Zhipeng","family":"Liu","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Longcheng","family":"Zhu","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Yujie","family":"Zou","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Qing","family":"Su","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Tianhuan","family":"Yu","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Yi","family":"Yi","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Jianhong","family":"Hu","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Cen","family":"Zheng","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Bo","family":"Wen","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Hanbang","family":"Zheng","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Lunfan","family":"Xu","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Sicheng","family":"Pan","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Bin","family":"Wu","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Xiao","family":"He","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Ye","family":"Li","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Jian","family":"Tan","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Sheng","family":"Wang","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Dan","family":"Pei","sequence":"additional","affiliation":[{"name":"Tsinghua University"}]},{"given":"Wei","family":"Zhang","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]},{"given":"Feifei","family":"Li","sequence":"additional","affiliation":[{"name":"Alibaba Group"}]}],"member":"320","published-online":{"date-parts":[[2023,8]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2023. Apache HBase. https:\/\/hbase.apache.org\/. Last accessed: 2023-07-07."},{"key":"e_1_2_1_2_1","unstructured":"2023. Apache ZooKeeper. https:\/\/zookeeper.apache.org\/. Last accessed: 2023-07-07."},{"key":"e_1_2_1_3_1","unstructured":"2023. Time Series Benchmark Suite. https:\/\/github.com\/timescale\/tsbs. Last accessed: 2023-07-07."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.14778\/3181-3194"},{"key":"e_1_2_1_5_1","volume-title":"Btrdb: Optimizing storage system design for timeseries processing. In 14th {USENIX} Conference on File and Storage Technologies ({FAST} 16). 39--52.","author":"Andersen Michael P","year":"2016","unstructured":"Michael P Andersen and David E Culler. 2016. Btrdb: Optimizing storage system design for timeseries processing. In 14th {USENIX} Conference on File and Storage Technologies ({FAST} 16). 39--52."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/UKSim.2014.67"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514221.3526045"},{"key":"e_1_2_1_8_1","unstructured":"The OpenTSDB Authors. 2021. OpenTSDB. http:\/\/opentsdb.net\/. Last accessed: 2023-07-07."},{"key":"e_1_2_1_9_1","unstructured":"The OpenTelemetry Authors. 2023. OpenTelemetry. https:\/\/opentelemetry.io\/. Last accessed: 2023-07-07."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3190662"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3386136"},{"key":"e_1_2_1_12_1","unstructured":"Alibaba Cloud. 2023. Alibaba Cloud ESSDs. https:\/\/www.alibabacloud.com\/help\/en\/elastic-compute-service\/latest\/essds. Last accessed: 2023-07-07."},{"key":"e_1_2_1_13_1","unstructured":"Alibaba Cloud. 2023. Alibaba Cloud OSS. https:\/\/www.alibabacloud.com\/product\/object-storage-service. Last accessed: 2023-07-07."},{"key":"e_1_2_1_14_1","unstructured":"Alibaba Cloud. 2023. Alibaba ECS. https:\/\/www.alibabacloud.com\/product\/ecs. Last accessed: 2023-07-07."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.14778\/3415478.3415552"},{"key":"e_1_2_1_16_1","unstructured":"Google. 2023. Bigquery ML. https:\/\/cloud.google.com\/bigquery\/docs\/bqml-introduction. Last accessed: 2023-07-07."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.14778\/3583140.3583155"},{"key":"e_1_2_1_18_1","unstructured":"InfluxData Inc. 2023. InfluxDB. https:\/\/docs.influxdata.com\/influxdb\/v2.6\/. Last accessed: 2023-07-07."},{"key":"e_1_2_1_19_1","unstructured":"InfluxData Inc. 2023. InfluxDB TSM. https:\/\/docs.influxdata.com\/influxdb\/v1.3\/concepts\/storage_engine\/. Last accessed: 2023-07-07."},{"key":"e_1_2_1_20_1","unstructured":"InfluxData Inc. 2023. InfluxQL. https:\/\/docs.influxdata.com\/influxdb\/v1.8\/query_language\/. Last accessed: 2023-07-07."},{"key":"e_1_2_1_21_1","unstructured":"InfluxData Inc. 2023. InfluxQL Continuous Queries. https:\/\/docs.influxdata.com\/influxdb\/v1.8\/query_language\/continuous_queries\/. Last accessed: 2023-07-07."},{"key":"e_1_2_1_22_1","unstructured":"TimeScale Inc. 2020. TimescaleDB vs InfluxDB. https:\/\/www.timescale.com\/blog\/timescaledb-vs-influxdb-for-time-series-data-timescale-influx-sql-nosql-36489299877\/. Last accessed: 2023-07-07."},{"key":"e_1_2_1_23_1","unstructured":"TimeScale Inc. 2023. TimeScaleDB. https:\/\/www.timescale.com. Last accessed: 2023-07-07."},{"key":"e_1_2_1_24_1","unstructured":"TimeScale Inc. 2023. TimeScaleDB does not use index in the last(). https:\/\/docs.timescale.com\/api\/latest\/hyperfunctions\/last\/. Last accessed: 2023-07-07."},{"key":"e_1_2_1_25_1","unstructured":"Konstantinos Karanasos Matteo Interlandi Doris Xin Fotis Psallidas Rathijit Sen Kwanghyun Park Ivan Popivanov Supun Nakandal Subru Krishnan Markus Weimer et al. 2019. Extending relational query processing with ML inference. arXiv preprint arXiv:1911.00231 (2019)."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1002\/spe.2402"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijforecast.2021.03.012"},{"key":"e_1_2_1_28_1","unstructured":"Microsoft. 2023. Azure Data Explorer. https:\/\/azure.microsoft.com\/en-us\/products\/data-explorer. Last accessed: 2023-07-07."},{"key":"e_1_2_1_29_1","unstructured":"Microsoft. 2023. ONXX Runtime. https:\/\/onnxruntime.ai\/. Last accessed: 2023-07-07."},{"key":"e_1_2_1_30_1","unstructured":"Oracle. 2023. Oracle Machine Learning for SQL. https:\/\/docs.oracle.com\/en\/database\/oracle\/machine-learning\/oml4sql\/21\/dmcon\/time-series.html. Last accessed: 2023-07-07."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.14778\/2824032.2824078"},{"key":"e_1_2_1_32_1","unstructured":"QuestDB. 2023. QuestDB. https:\/\/questdb.io\/. Last accessed: 2023-07-07."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijforecast.2019.07.001"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1515\/9783110611236"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3419111.3421289"},{"key":"e_1_2_1_36_1","unstructured":"solid IT. 2023. DB-Engines Ranking of Time Series DBMS. https:\/\/db-engines.com\/en\/ranking\/time+series+dbms. Last accessed: 2023-07-07."},{"key":"e_1_2_1_37_1","unstructured":"TDengine. 2023. TDengine. https:\/\/tdengine.com\/. Last accessed: 2023-07-07."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.5555\/3489146.3489186"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.14778\/3415478.3415504"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514221.3526175"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3611540.3611559","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,10]],"date-time":"2025-09-10T22:32:46Z","timestamp":1757543566000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3611540.3611559"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8]]},"references-count":40,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2023,8]]}},"alternative-id":["10.14778\/3611540.3611559"],"URL":"https:\/\/doi.org\/10.14778\/3611540.3611559","relation":{},"ISSN":["2150-8097"],"issn-type":[{"type":"print","value":"2150-8097"}],"subject":[],"published":{"date-parts":[[2023,8]]},"assertion":[{"value":"2023-08-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}