{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T09:02:59Z","timestamp":1775638979414,"version":"3.50.1"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2023,6,13]],"date-time":"2023-06-13T00:00:00Z","timestamp":1686614400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key Research and Development Plan","award":["2021YFB3300500"],"award-info":[{"award-number":["2021YFB3300500"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. ACM Manag. Data"],"published-print":{"date-parts":[[2023,6,13]]},"abstract":"<jats:p>A typical industrial scenario encounters thousands of devices with millions of sensors, consistently generating billions of data points. It poses new requirements of time series data management, not well addressed in existing solutions, including (1) device-defined ever-evolving schema, (2) mostly periodical data collection, (3) strongly correlated series, (4) variously delayed data arrival, and (5) highly concurrent data ingestion. In this paper, we present a time series database management system, Apache IoTDB. It consists of (i) a time series native file format, TsFile, with specially designed data encoding, and (ii) an IoTDB engine for efficiently handling delayed data arrivals and processing queries. The system achieves a throughput of 10 million inserted values per second. Queries such as 1-day data selection of 0.1 million points and 3-year data aggregation over 10 million points can be processed in 100 ms. Comparisons with InfluxDB, TimescaleDB, KairosDB, Parquet and ORC over real world data loads demonstrate the superiority of IoTDB and TsFile.<\/jats:p>","DOI":"10.1145\/3589775","type":"journal-article","created":{"date-parts":[[2023,6,20]],"date-time":"2023-06-20T20:26:45Z","timestamp":1687292805000},"page":"1-27","source":"Crossref","is-referenced-by-count":51,"title":["Apache IoTDB: A Time Series Database for IoT Applications"],"prefix":"10.1145","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1698-8992","authenticated-orcid":false,"given":"Chen","family":"Wang","sequence":"first","affiliation":[{"name":"Tsinghua University, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-7644-1734","authenticated-orcid":false,"given":"Jialin","family":"Qiao","sequence":"additional","affiliation":[{"name":"Timecho Ltd., Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6868-4045","authenticated-orcid":false,"given":"Xiangdong","family":"Huang","sequence":"additional","affiliation":[{"name":"Timecho Ltd., Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9503-2755","authenticated-orcid":false,"given":"Shaoxu","family":"Song","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-6618-0457","authenticated-orcid":false,"given":"Haonan","family":"Hou","sequence":"additional","affiliation":[{"name":"Timecho Ltd., Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-5311-9254","authenticated-orcid":false,"given":"Tian","family":"Jiang","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-0112-8329","authenticated-orcid":false,"given":"Lei","family":"Rui","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6841-7943","authenticated-orcid":false,"given":"Jianmin","family":"Wang","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5884-7939","authenticated-orcid":false,"given":"Jiaguang","family":"Sun","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}]}],"member":"320","published-online":{"date-parts":[[2023,6,20]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Beringei: A high-performance time series storage engine | engineering blog | facebook code."},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.14778\/3181-3194"},{"key":"e_1_2_2_3_1","first-page":"39","volume-title":"14th USENIX Conference on File and Storage Technologies, FAST 2016","author":"Andersen M. P.","year":"2016","unstructured":"M. P. Andersen and D. E. Culler. Btrdb: Optimizing storage system design for timeseries processing. In A. D. Brown and F. I. Popovici, editors, 14th USENIX Conference on File and Storage Technologies, FAST 2016, Santa Clara, CA, USA, February 22--25, 2016, pages 39--52. USENIX Association, 2016."},{"key":"e_1_2_2_4_1","unstructured":"Apache Hadoop. https:\/\/hadoop.apache.org\/."},{"key":"e_1_2_2_5_1","unstructured":"Apache HBase. Apache hbase home page. http:\/\/hbase.apache.org\/."},{"key":"e_1_2_2_6_1","unstructured":"Apache IoTDB. https:\/\/iotdb.apache.org\/."},{"key":"e_1_2_2_7_1","unstructured":"Apache IoTDB. https:\/\/iotdb.apache.org\/UserGuide\/Master\/Process-Data\/UDF-User-Defined-Function.html."},{"key":"e_1_2_2_8_1","unstructured":"Apache IoTDB. https:\/\/iotdb.apache.org\/UserGuide\/Master\/UDF-Library\/Quick-Start.html."},{"key":"e_1_2_2_9_1","unstructured":"Apache Kafka. https:\/\/kafka.apache.org\/."},{"key":"e_1_2_2_10_1","unstructured":"Apache Storm. http:\/\/storm.apache.org\/."},{"key":"e_1_2_2_11_1","unstructured":"Apache Zeppelin. https:\/\/zeppelin.apache.org\/."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2742797"},{"key":"e_1_2_2_13_1","unstructured":"AVRO. https:\/\/avro.apache.org\/docs\/current\/."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.23919\/DATE.2017.7927143"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.14778\/3476249.3476266"},{"key":"e_1_2_2_16_1","volume-title":"Lz4: Extremely fast compression algorithm. code. google. com","author":"Collet Y.","year":"2013","unstructured":"Y. Collet et al. Lz4: Extremely fast compression algorithm. code. google. com, 2013."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1364\/AO.23.003260"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1327452.1327492"},{"key":"e_1_2_2_19_1","first-page":"1","article-title":"GZIP file format specification version 4.3","volume":"1952","author":"Deutsch P.","year":"1996","unstructured":"P. Deutsch. GZIP file format specification version 4.3. RFC, 1952:1--12, 1996.","journal-title":"RFC"},{"key":"e_1_2_2_20_1","series-title":"Proceedings of Machine Learning Research","first-page":"1406","volume-title":"Proceedings of the 35th International Conference on Machine Learning, ICML","author":"Espeholt L.","year":"2018","unstructured":"L. Espeholt, H. Soyer, R. Munos, K. Simonyan, V. Mnih, T. Ward, Y. Doron, V. Firoiu, T. Harley, I. Dunning, S. Legg, and K. Kavukcuoglu. IMPALA: scalable distributed deep-rl with importance weighted actor-learner architectures. In J. G. Dy and A. Krause, editors, Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan, Stockholm, Sweden, July 10--15, 2018, volume 80 of Proceedings of Machine Learning Research, pages 1406--1415. PMLR, 2018."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3588703"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.14778\/3538598.3538607"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3534678.3539373"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1966.1053907"},{"key":"e_1_2_2_25_1","unstructured":"S. H. Gunderson. Snappy: A fast compressor\/decompressor. code. google. com\/p\/snappy."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2011.5767933"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2595630"},{"key":"e_1_2_2_28_1","unstructured":"InfluxData. https:\/\/docs.influxdata.com\/influxdb\/v1.7\/concepts\/glossary\/#retention-policy-rp\/."},{"key":"e_1_2_2_29_1","unstructured":"InfluxData. https:\/\/github.com\/influxdata\/influxdb-java\/."},{"key":"e_1_2_2_30_1","unstructured":"InfluxData. Influxdb home page. https:\/\/www.influxdata.com\/time-series-platform\/influxdb\/."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2017.2740932"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.14778\/3236187.3236215"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE55515.2023.00092"},{"key":"e_1_2_2_34_1","unstructured":"KAIROSDB. https:\/\/kairosdb.github.io\/."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE53745.2022.00315"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/1773912.1773922"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11390-022-1087-z"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.14778\/3384345.3384357"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/s002360050048"},{"key":"e_1_2_2_40_1","first-page":"305","volume-title":"2014 USENIX Annual Technical Conference (Usenix ATC 14)","author":"Ongaro D.","year":"2014","unstructured":"D. Ongaro and J. Ousterhout. In search of an understandable consensus algorithm. In 2014 USENIX Annual Technical Conference (Usenix ATC 14), pages 305--319, 2014."},{"key":"e_1_2_2_41_1","unstructured":"ORCFile. https:\/\/orc.apache.org\/."},{"key":"e_1_2_2_42_1","unstructured":"PARQUET. http:\/\/parquet.apache.org\/documentation\/latest\/."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.14778\/2824032.2824078"},{"key":"e_1_2_2_44_1","unstructured":"PI. https:\/\/docs.osisoft.com\/bundle\/pi-server\/page\/the-structure-of-pi-af-asset-models_2.html."},{"key":"e_1_2_2_45_1","unstructured":"PostgreSQL. https:\/\/www.postgresql.org\/."},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/s41019-022-00185-5"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/320473.320484"},{"key":"e_1_2_2_48_1","volume-title":"Proc. OSCON, 11","author":"Sigoure B.","year":"2010","unstructured":"B. Sigoure. Opentsdb: The distributed, scalable time series database. Proc. OSCON, 11, 2010."},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3448016.3452818"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2723730"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3588939"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE48307.2020.00068"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3514221.3517852"},{"key":"e_1_2_2_54_1","unstructured":"TimescaleDB. https:\/\/www.timescale.com\/."},{"key":"e_1_2_2_55_1","unstructured":"TimescaleDB. https:\/\/github.com\/timescale\/tsbs."},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.14778\/3415478.3415504"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.14778\/3565816.3565829"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2019.00082"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.14778\/3547305.3547319"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2595631"},{"key":"e_1_2_2_61_1","volume-title":"2nd USENIX Workshop on Hot Topics in Cloud Computing, HotCloud'10","author":"Zaharia M.","year":"2010","unstructured":"M. Zaharia, M. Chowdhury, M. J. Franklin, S. Shenker, and I. Stoica. Spark: Cluster computing with working sets. In E. M. Nahum and D. Xu, editors, 2nd USENIX Workshop on Hot Topics in Cloud Computing, HotCloud'10, Boston, MA, USA, June 22, 2010. USENIX Association, 2010."},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2915233"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.14778\/3115404.3115410"}],"container-title":["Proceedings of the ACM on Management of Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3589775","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3589775","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:22Z","timestamp":1750182562000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3589775"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,13]]},"references-count":63,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,6,13]]}},"alternative-id":["10.1145\/3589775"],"URL":"https:\/\/doi.org\/10.1145\/3589775","relation":{},"ISSN":["2836-6573"],"issn-type":[{"value":"2836-6573","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,13]]}}}