{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T22:40:36Z","timestamp":1780440036376,"version":"3.54.1"},"publisher-location":"Berlin, Heidelberg","reference-count":28,"publisher":"Springer Berlin Heidelberg","isbn-type":[{"value":"9783662668627","type":"print"},{"value":"9783662668634","type":"electronic"}],"license":[{"start":{"date-parts":[[2023,1,1]],"date-time":"2023-01-01T00:00:00Z","timestamp":1672531200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,2,9]],"date-time":"2023-02-09T00:00:00Z","timestamp":1675900800000},"content-version":"vor","delay-in-days":39,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>To ensure critical infrastructure is operating as expected, high-quality sensors are increasingly installed. However, due to the enormous amounts of high-frequency time series they produce, it is impossible or infeasible to transfer or even store these time series in the cloud when using state-of-the-practice compression methods. Thus, simple aggregates, e.g., 1\u201310-minutes averages, are stored instead of the raw time series. However, by only storing these simple aggregates, informative outliers and fluctuations are lost. Many Time Series Management System (TSMS) have been proposed to efficiently manage time series, but they are generally designed for either the edge or the cloud. In this paper, we describe a new version of the open-source model-based TSMS ModelarDB. The system is designed to be modular and the same binary can be efficiently deployed on the edge and in the cloud. It also supports continuously transferring high-frequency time series compressed using models from the edge to the cloud. We first provide an overview of ModelarDB, analyze the requirements and limitations of the edge, and evaluate existing query engines and data stores for use on the edge. Then, we describe how ModelarDB has been extended to efficiently manage time series on the edge, a novel file-based data store, how ModelarDB\u2019s compression has been improved by not storing time series that can be derived from base time series, and how ModelarDB transfers high-frequency time series from the edge to the cloud. As the work that led to ModelarDB began in 2015, we also reflect on the lessons learned while developing it.<\/jats:p>","DOI":"10.1007\/978-3-662-66863-4_1","type":"book-chapter","created":{"date-parts":[[2023,2,8]],"date-time":"2023-02-08T23:32:31Z","timestamp":1675899151000},"page":"1-33","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["ModelarDB: Integrated Model-Based Management of\u00a0Time Series from\u00a0Edge to\u00a0Cloud"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1184-1000","authenticated-orcid":false,"given":"S\u00f8ren Kejser","family":"Jensen","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0862-0509","authenticated-orcid":false,"given":"Christian","family":"Thomsen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1615-777X","authenticated-orcid":false,"given":"Torben Bach","family":"Pedersen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,2,9]]},"reference":[{"issue":"4","key":"1_CR1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3276463","volume":"43","author":"F Abuzaid","year":"2018","unstructured":"Abuzaid, F., et al.: MacroBase: prioritizing attention in fast data. ACM Trans. Database Syst. 43(4), 1\u201345 (2018). https:\/\/doi.org\/10.1145\/3276463","journal-title":"ACM Trans. Database Syst."},{"key":"1_CR2","doi-asserted-by":"publisher","unstructured":"Adams, C., et al.: Monarch: Google\u2019s planet-scale in-memory time series database. Proc. VLDB Endow. 13(12), 3181\u20133194 (2020). https:\/\/doi.org\/10.14778\/3181-3194","DOI":"10.14778\/3181-3194"},{"key":"1_CR3","doi-asserted-by":"publisher","unstructured":"Agrawal, N., Vulimiri, A.: Low-latency analytics on colossal data streams with SummaryStore. In: Proceedings 26th ACM Symposium on Operating System Principles, pp. 647\u2013664. ACM (2017). https:\/\/doi.org\/10.1145\/3132747.3132758","DOI":"10.1145\/3132747.3132758"},{"key":"1_CR4","unstructured":"Bader, A., Kopp, O., Michael, F.: Survey and comparison of open source time series databases. In: Datenbanksysteme f\u00fcr Business, Technologie und Web - Workshopband, pp. 249\u2013268. GI (2017)"},{"key":"1_CR5","doi-asserted-by":"publisher","unstructured":"Buevich, M., Wright, A., Sargent, R., Rowe, A.: Respawn: a distributed multi-resolution time-series datastore. In: Proceedings of IEEE 34th Real-Time Systems Symposium, pp. 288\u2013297. IEEE (2013). https:\/\/doi.org\/10.1109\/RTSS.2013.36","DOI":"10.1109\/RTSS.2013.36"},{"key":"1_CR6","doi-asserted-by":"publisher","unstructured":"Cejka, S., Mosshammer, R., Einfalt, A.: Java embedded storage for time series and meta data in smart grids. In: 2015 IEEE International Conference on Smart Grid Communications, pp. 434\u2013439. IEEE (2015). https:\/\/doi.org\/10.1109\/SmartGridComm.2015.7436339","DOI":"10.1109\/SmartGridComm.2015.7436339"},{"key":"1_CR7","doi-asserted-by":"publisher","unstructured":"Elmeleegy, H., Elmagarmid, A.K., Cecchet, E., Aref, W.G., Zwaenepoel, W.: Online piece-wise linear approximation of numerical streams with precision guarantees. Proc. VLDB Endow. 2(1), 145\u2013156 (2009). https:\/\/doi.org\/10.14778\/1687627.1687645","DOI":"10.14778\/1687627.1687645"},{"key":"1_CR8","doi-asserted-by":"publisher","unstructured":"Garcia-Arellano, C., et al.: DB2 event store: a purpose-built IoT database engine. Proc. VLDB Endow. 13(12), 3299\u20133312 (2020). https:\/\/doi.org\/10.14778\/3415478.3415552","DOI":"10.14778\/3415478.3415552"},{"issue":"11","key":"1_CR9","doi-asserted-by":"publisher","first-page":"2434","DOI":"10.1109\/TKDE.2012.237","volume":"25","author":"NQV Hung","year":"2013","unstructured":"Hung, N.Q.V., Jeung, H., Aberer, K.: An evaluation of model-based approaches to sensor data compression. IEEE Trans. Knowl. Data Eng. 25(11), 2434\u20132447 (2013). https:\/\/doi.org\/10.1109\/TKDE.2012.237","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"1_CR10","unstructured":"Jensen, S.K., Pedersen, T.B., Thomsen, C.: Time series management systems: a 2022 survey. In: Palpanas, T., Zoumpatianos, K. (eds.) Data Series Management and Analytics. ACM (forthcoming)"},{"issue":"11","key":"1_CR11","doi-asserted-by":"publisher","first-page":"2581","DOI":"10.1109\/TKDE.2017.2740932","volume":"29","author":"SK Jensen","year":"2017","unstructured":"Jensen, S.K., Pedersen, T.B., Thomsen, C.: Time series management systems: a survey. IEEE Trans. Knowl. Data Eng. 29(11), 2581\u20132600 (2017). https:\/\/doi.org\/10.1109\/TKDE.2017.2740932","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"1_CR12","doi-asserted-by":"publisher","unstructured":"Jensen, S.K., Pedersen, T.B., Thomsen, C.: ModelarDB: modular model-based time series management with spark and cassandra. Proc. VLDB Endow. 11(11), 1688\u20131701 (2018). https:\/\/doi.org\/10.14778\/3236187.3236215","DOI":"10.14778\/3236187.3236215"},{"key":"1_CR13","doi-asserted-by":"publisher","unstructured":"Jensen, S.K., Pedersen, T.B., Thomsen, C.: Demonstration of ModelarDB: model-based management of dimensional time series. In: Proceedings of ACM SIGMOD International Conference on Management of Data, pp. 1933\u20131936. ACM (2019). https:\/\/doi.org\/10.1145\/3299869.3320216","DOI":"10.1145\/3299869.3320216"},{"key":"1_CR14","doi-asserted-by":"publisher","unstructured":"Jensen, S.K., Pedersen, T.B., Thomsen, C.: Scalable model-based management of correlated dimensional time series in ModelarDB$$_+$$. In: Proceedings of 37th International Conference on Data Engineering, pp. 1380\u20131391. IEEE (2021). https:\/\/doi.org\/10.1109\/ICDE51399.2021.00123","DOI":"10.1109\/ICDE51399.2021.00123"},{"key":"1_CR15","unstructured":"Katsis, Y., Freund, Y., Papakonstantinou, Y.: Combining databases and signal processing in Plato. In: Proceedings of 7th Biennial Conference on Innovative Data Systems Research, pp. 1\u20139 (2015)"},{"key":"1_CR16","doi-asserted-by":"publisher","unstructured":"Khelifati, A., Khayati, M., Cudr\u00e9-Mauroux, P.: CORAD: correlation-aware compression of massive time series using sparse dictionary coding. In: Proceedings of 2019 IEEE International Conference on Big Data, pp. 2289\u20132298. IEEE (2019). https:\/\/doi.org\/10.1109\/BigData47090.2019.9005580","DOI":"10.1109\/BigData47090.2019.9005580"},{"key":"1_CR17","doi-asserted-by":"publisher","unstructured":"Lazaridis, I., Mehrotra, S.: Capturing sensor-generated time series with quality guarantees. In: Proceedings of 19th International Conference on Data Engineering, pp. 429\u2013440. IEEE (2003). https:\/\/doi.org\/10.1109\/ICDE.2003.1260811","DOI":"10.1109\/ICDE.2003.1260811"},{"key":"1_CR18","unstructured":"Limitations of the Java Virtual Machine. https:\/\/docs.oracle.com\/javase\/specs\/jvms\/se11\/html\/jvms-4.html#jvms-4.11"},{"key":"1_CR19","doi-asserted-by":"publisher","unstructured":"Lin, C., Boursier, E., Papakonstantinou, Y.: Plato: approximate analytics system over compressed time series with tight deterministic error guarantees. Proc. VLDB Endow. 13(7), 1105\u20131118 (2020). https:\/\/doi.org\/10.14778\/3384345.3384357","DOI":"10.14778\/3384345.3384357"},{"key":"1_CR20","doi-asserted-by":"publisher","unstructured":"Marascu, A., et al.: MiSTRAL: an architecture for low-latency analytics on massive time series. In: Proceedings of 2013 IEEE International Conference on Big Data, pp. 15\u201321. IEEE (2013). https:\/\/doi.org\/10.1109\/BigData.2013.6691772","DOI":"10.1109\/BigData.2013.6691772"},{"key":"1_CR21","doi-asserted-by":"publisher","unstructured":"Marascu, A., et al.: TRISTAN: real-time analytics on massive time series using sparse dictionary compression. In: Proceedings of 2014 IEEE International Conference on Big Data, pp. 291\u2013300. IEEE (2014). https:\/\/doi.org\/10.1109\/BigData.2014.7004244","DOI":"10.1109\/BigData.2014.7004244"},{"key":"1_CR22","doi-asserted-by":"publisher","unstructured":"Neumann, T.: Evolution of a compiling query engine. Proc. VLDB Endow. 14(12), 3207\u20133210 (2021). https:\/\/doi.org\/10.14778\/3476311.3476410","DOI":"10.14778\/3476311.3476410"},{"key":"1_CR23","unstructured":"Package java.lang.ref. https:\/\/docs.oracle.com\/en\/java\/javase\/11\/docs\/api\/java.base\/java\/lang\/ref\/package-summary.html"},{"key":"1_CR24","doi-asserted-by":"publisher","unstructured":"Pelkonen, T., et al.: Gorilla: a fast, scalable, in-memory time series database. Proc. VLDB Endow. 8(12), 1816\u20131827 (2015). https:\/\/doi.org\/10.14778\/2824032.2824078","DOI":"10.14778\/2824032.2824078"},{"key":"1_CR25","doi-asserted-by":"publisher","unstructured":"Raman, V., et al.: DB2 with BLU acceleration: so much more than just a column store. Proc. VLDB Endow. 6(11), 1080\u20131091 (2013). https:\/\/doi.org\/10.14778\/2536222.2536233","DOI":"10.14778\/2536222.2536233"},{"key":"1_CR26","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1007\/978-1-4614-6309-2_2","volume-title":"Managing and Mining Sensor Data","author":"S Sathe","year":"2013","unstructured":"Sathe, S., Papaioannou, T.G., Jeung, H., Aberer, K.: A survey of model-based sensor data acquisition and management. In: Aggarwal, C.C. (ed.) Managing and Mining Sensor Data, pp. 9\u201350. Springer, Boston (2013). https:\/\/doi.org\/10.1007\/978-1-4614-6309-2_2"},{"key":"1_CR27","doi-asserted-by":"publisher","unstructured":"Thiagarajan, A., Madden, S.: Querying continuous functions in a database system. In: Proceedings of ACM SIGMOD International Conference on Management of Data, pp. 791\u2013804 (2008). https:\/\/doi.org\/10.1145\/1376616.1376696","DOI":"10.1145\/1376616.1376696"},{"key":"1_CR28","doi-asserted-by":"publisher","unstructured":"Wang, C., et al.: Apache IoTDB: time-series database for internet of things. Proc. VLDB Endow. 13(12), 2901\u20132904 (2020). https:\/\/doi.org\/10.14778\/3415478.3415504","DOI":"10.14778\/3415478.3415504"}],"container-title":["Lecture Notes in Computer Science","Transactions on Large-Scale Data- and Knowledge-Centered Systems LIII"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-662-66863-4_1","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,8]],"date-time":"2023-03-08T17:06:36Z","timestamp":1678295196000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-662-66863-4_1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023]]},"ISBN":["9783662668627","9783662668634"],"references-count":28,"URL":"https:\/\/doi.org\/10.1007\/978-3-662-66863-4_1","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"value":"0302-9743","type":"print"},{"value":"1611-3349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023]]},"assertion":[{"value":"9 February 2023","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}}]}}