{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T19:03:28Z","timestamp":1778267008572,"version":"3.51.4"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2025,1,15]],"date-time":"2025-01-15T00:00:00Z","timestamp":1736899200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,1,15]],"date-time":"2025-01-15T00:00:00Z","timestamp":1736899200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2023YFB4502905"],"award-info":[{"award-number":["2023YFB4502905"]}]},{"name":"Natural Science Foundation of Shanghai","award":["23ZR1418300"],"award-info":[{"award-number":["23ZR1418300"]}]},{"name":"NSFC Project","award":["No. 92270202"],"award-info":[{"award-number":["No. 92270202"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Data Sci. Eng."],"published-print":{"date-parts":[[2025,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Distributed in-memory databases are widely adopted to achieve low latency and high bandwidth for data-intensive applications. They support scale-out by sharding and distributing data across multiple nodes. To efficiently adapt to various workloads, distributed in-memory databases must be capable of migrating shards across nodes. In this paper, we demonstrate that state-of-the-art approaches experience significant performance degradation during migration due to service downtime and redundant data transfer. Furthermore, our findings indicate that the presence of service downtime constrains the scalability of migration strategies, while the transfer of redundant data during the snapshot transfer phase limits their adaptability to dynamic workloads. To this end, this paper proposes Aion, a live migration strategy designed for distributed in-memory databases. Aion eliminates any potential service downtime by immediately switching transaction routing to the destination node. To ensure data consistency between the source and destination nodes, as well as serializable execution during migration, Aion proposes the mutual validation phase. Moreover, Aion introduces an analysis phase before the snapshot transfer phase to identify dynamically changing hotspots in workloads. The analysis phase identifies and transfers tuples and versions accessed less frequently to the destination node, reducing the amount of data transferred. Aion is implemented on a distributed in-memory database and evaluated using various OLTP workloads. The results demonstrate that Aion can fundamentally eliminate service downtime, adapt effectively to various workloads and exhibit robust scalability. Compared to state-of-the-art approaches, Aion achieves up to 2.25x\u20136.57x higher throughput during migration and shortens the migration duration by 53.7\u201368.2%.<\/jats:p>","DOI":"10.1007\/s41019-024-00276-5","type":"journal-article","created":{"date-parts":[[2025,1,15]],"date-time":"2025-01-15T08:36:52Z","timestamp":1736930212000},"page":"212-229","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Aion: Live Migration for In-Memory Databases with Zero Downtime and Reduced Redundant Data Transfer"],"prefix":"10.1007","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-9777-2513","authenticated-orcid":false,"given":"Huijie","family":"Cao","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chenfeng","family":"Huang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shengchi","family":"Liu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5220-3166","authenticated-orcid":false,"given":"Huiqi","family":"Hu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Minghao","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuan","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yaofeng","family":"Tu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weining","family":"Qian","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,1,15]]},"reference":[{"key":"276_CR1","unstructured":"Redis (2024) https:\/\/redis.io\/. Accessed 26 Mar 2024"},{"key":"276_CR2","unstructured":"VoltDB (2023) https:\/\/www.voltactivedata.com\/. Accessed 26 Mar 2024"},{"key":"276_CR3","doi-asserted-by":"crossref","unstructured":"Kemper A, Neumann T (2011) Hyper: a hybrid oltp &olap main memory database system based on virtual memory snapshots. In 2011 IEEE 27th International conference on data engineering, pp 195\u2013206. IEEE","DOI":"10.1109\/ICDE.2011.5767867"},{"issue":"4","key":"276_CR4","doi-asserted-by":"publisher","first-page":"445","DOI":"10.14778\/3025111.3025125","volume":"10","author":"M Serafini","year":"2016","unstructured":"Serafini M, Taft R, Elmore AJ, Pavlo A, Aboulnaga A, Stonebraker M (2016) Clay: fine-grained adaptive partitioning for general database schemas. Proceed VLDB Endow 10(4):445\u2013456","journal-title":"Proceed VLDB Endow"},{"issue":"3","key":"276_CR5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2806887","volume":"33","author":"J Ousterhout","year":"2015","unstructured":"Ousterhout J, Gopalan A, Gupta A, Kejriwal A, Lee C, Montazeri B, Ongaro D, Park SJ, Qin H, Rosenblum M et al (2015) The ramcloud storage system. ACM Trans Comput Syst (TOCS) 33(3):1\u201355","journal-title":"ACM Trans Comput Syst (TOCS)"},{"key":"276_CR6","doi-asserted-by":"crossref","unstructured":"Taft R, El-Sayed N, Serafini M, Lu Y, Aboulnaga A, Stonebraker M, Mayerhofer R, Andrade F (2018) P-store: an elastic database system with predictive provisioning. In Proceedings of the 2018 international conference on management of data, pp 205\u2013219. Association for computing machinery, New York, NY, USA","DOI":"10.1145\/3183713.3190650"},{"issue":"4","key":"276_CR7","doi-asserted-by":"publisher","first-page":"779","DOI":"10.1109\/TPDS.2019.2945315","volume":"31","author":"H Jin","year":"2019","unstructured":"Jin H, Li Z, Liu H, Liao X, Zhang Y (2019) Hotspot-aware hybrid memory management for in-memory key-value stores. IEEE Trans Parallel Distrib Syst 31(4):779\u2013792","journal-title":"IEEE Trans Parallel Distrib Syst"},{"key":"276_CR8","unstructured":"Wei X, Shen S, Chen R, Chen H (2017) Replication-driven live reconfiguration for fast distributed transaction processing. In 2017 USENIX annual technical conference (USENIX ATC 17), pp 335\u2013347. USENIX association, Santa Clara, CA"},{"key":"276_CR9","doi-asserted-by":"crossref","unstructured":"Lyu Z, Zhang HH, Xiong G, Guo G, Wang H, Chen J, Praveen A, Yang Y, Gao X, Wang A, Lin W, Agrawal A, Yang J, Wu H, Li X, Guo F, Wu J, Zhang J, Raghavan V (2021) Greenplum: a hybrid database for transactional and analytical workloads. In Proceedings of the 2021 international conference on management of data, pp 2530\u20132542. Association for computing machinery, New York, NY, USA","DOI":"10.1145\/3448016.3457562"},{"issue":"4","key":"276_CR10","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1145\/1721654.1721672","volume":"53","author":"M Armbrust","year":"2010","unstructured":"Armbrust M, Fox A, Griffith R, Joseph AD, Katz R, Konwinski A, Lee G, Patterson D, Rabkin A, Stoica I et al (2010) A view of cloud computing. Commun ACM 53(4):50\u201358","journal-title":"Commun ACM"},{"issue":"8","key":"276_CR11","doi-asserted-by":"publisher","first-page":"494","DOI":"10.14778\/2002974.2002977","volume":"4","author":"S Das","year":"2011","unstructured":"Das S, Nishimura S, Agrawal D, El Abbadi A (2011) Albatross: lightweight elasticity in shared storage databases for the cloud using live data migration. Proceed VLDB Endow 4(8):494\u2013505","journal-title":"Proceed VLDB Endow"},{"key":"276_CR12","doi-asserted-by":"crossref","unstructured":"Abebe M, Glasbergen B, Daudjee K (2020) Dynamast: adaptive dynamic mastering for replicated systems. In 2020 IEEE 36th international conference on data engineering (ICDE), pp 1381\u20131392. IEEE","DOI":"10.1109\/ICDE48307.2020.00123"},{"issue":"12","key":"276_CR13","doi-asserted-by":"publisher","first-page":"1822","DOI":"10.14778\/3229863.3229870","volume":"11","author":"L Cai","year":"2018","unstructured":"Cai L, Chen J, Chen J, Chen Y, Chiang K, Dimitrijevic M, Ding Y, Dong Y, Ghazal A, Hebert J, Jagtiani K, Lin S, Liu Y, Ni D, Pei C, Sun J, Wang Y, Zhang L, Zhang M, Zhu C (2018) Fusion insight libra: huawei\u2019s enterprise cloud data analytics platform. Proc VLDB Endow 11(12):1822\u20131834","journal-title":"Proc VLDB Endow"},{"key":"276_CR14","doi-asserted-by":"crossref","unstructured":"Elmore AJ, Das S, Agrawal D, El\u00a0Abbadi A (2011) Zephyr: live migration in shared nothing databases for elastic cloud platforms. In Proceedings of the 2011 ACM sigmod international conference on management of data, pp 301\u2013312. Association for computing machinery, New York, NY, USA","DOI":"10.1145\/1989323.1989356"},{"key":"276_CR15","doi-asserted-by":"crossref","unstructured":"Schiller O, Cipriani N, Mitschang B (2013) Prorea: live database migration for multi-tenant rdbms with snapshot isolation. In Proceedings of the 16th international conference on extending database technology, pp 53\u201364. Association for computing machinery, New York, NY, USA","DOI":"10.1145\/2452376.2452384"},{"key":"276_CR16","doi-asserted-by":"crossref","unstructured":"Elmore AJ, Arora V, Taft R, Pavlo A, Agrawal D, El\u00a0Abbadi A (2015) Squall: fine-grained live reconfiguration for partitioned main memory databases. In Proceedings of the 2015 ACM sigmod international conference on management of data, pp 299\u2013313. Association for computing machinery, New York, NY, USA","DOI":"10.1145\/2723372.2723726"},{"key":"276_CR17","doi-asserted-by":"crossref","unstructured":"Kang J, Cai L, Li F, Zhou X, Cao W, Cai S, Shao D (2022) Remus: efficient live migration for distributed databases with snapshot isolation. In Proceedings of the 2022 international conference on management of data, pp 2232\u20132245. Association for computing machinery, New York, NY, USA","DOI":"10.1145\/3514221.3526047"},{"key":"276_CR18","doi-asserted-by":"crossref","unstructured":"Kulkarni C, Kesavan A, Zhang T, Ricci R, Stutsman R (2017) Rocksteady: fast migration for low-latency in-memory storage. In Proceedings of the 26th symposium on operating systems principles, pp 390\u2013405. Association for computing machinery, New York, NY, USA","DOI":"10.1145\/3132747.3132784"},{"key":"276_CR19","doi-asserted-by":"crossref","unstructured":"Cubukcu U, Erdogan O, Pathak S, Sannakkayala S Slot M (2021) Citus: distributed postgresql for data-intensive applications. In Proceedings of the 2021 international conference on management of data, pp 2490\u20132502. Association for computing machinery, New York, NY, USA","DOI":"10.1145\/3448016.3457551"},{"issue":"1","key":"276_CR20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2445583.2445588","volume":"38","author":"S Das","year":"2013","unstructured":"Das S, Agrawal D, El Abbadi A (2013) Elastras: an elastic, scalable, and self-managing transactional database for the cloud. ACM Trans Database Syst (TODS) 38(1):1\u201345","journal-title":"ACM Trans Database Syst (TODS)"},{"issue":"2","key":"276_CR21","doi-asserted-by":"publisher","first-page":"189","DOI":"10.14778\/3425879.3425889","volume":"14","author":"Y Xia","year":"2020","unstructured":"Xia Y, Yu X, Pavlo A, Devadas S (2020) Taurus: lightweight parallel logging for in-memory database management systems. Proc VLDB Endow 14(2):189\u2013201","journal-title":"Proc VLDB Endow"},{"key":"276_CR22","doi-asserted-by":"crossref","unstructured":"Wu Y, Guo W, Chan C-Y, Tan K-L (2017) Fast failure recovery for main-memory dbmss on multicores. In Proceedings of the 2017 ACM international conference on management of data, pp 267\u2013281. Association for computing machinery, New York, NY, USA","DOI":"10.1145\/3035918.3064011"},{"key":"276_CR23","unstructured":"TPC-C Benchmark V5.11 (1988-2024). https:\/\/www.tpc.org\/tpcc\/ . Accessed 26 Mar 2024"},{"issue":"3","key":"276_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2491245","volume":"31","author":"JC Corbett","year":"2013","unstructured":"Corbett JC, Dean J, Epstein M, Fikes A, Frost C, Furman JJ, Ghemawat S, Gubarev AH et al (2013) Spanner: google\u2019s globally distributed database. ACM Trans Comput Syst (TOCS) 31(3):1\u201322","journal-title":"ACM Trans Comput Syst (TOCS)"},{"key":"276_CR25","doi-asserted-by":"crossref","unstructured":"Larson P-\u00c5, Blanas S, Diaconu C, Freedman C, Patel JM, Zwilling M (2011) High-performance concurrency control mechanisms for main-memory databases. arXiv preprint arXiv:1201.0228","DOI":"10.14778\/2095686.2095689"},{"issue":"1","key":"276_CR26","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1007\/s00778-022-00737-1","volume":"32","author":"G Liu","year":"2023","unstructured":"Liu G, Chen L, Chen S (2023) Zen+: a robust numa-aware oltp engine optimized for non-volatile main memory. VLDB J 32(1):123\u2013148","journal-title":"VLDB J"},{"key":"276_CR27","doi-asserted-by":"crossref","unstructured":"Neumann T, M\u00fchlbauer T, Kemper A (2015) Fast serializable multi-version concurrency control for main-memory database systems. In Proceedings of the 2015 ACM SIGMOD international conference on management of data, pp 677\u2013689. Association for computing machinery, New York, NY, USA","DOI":"10.1145\/2723372.2749436"},{"key":"276_CR28","unstructured":"Daudjee K, Salem K (2006) Lazy database replication with snapshot isolation. In Proceedings of the 32nd international conference on very large data bases, pp 715\u2013726. VLDB Endowment, Portsmouth, NH, USA"},{"key":"276_CR29","unstructured":"Das S, Nishimura S, Agrawal D, El\u00a0Abbadi A (2010) Live database migration for elasticity in a multitenant database for cloud platforms. CS, UCSB, Santa Barbara, CA, USA, Tech. Rep 9, 2010"},{"key":"276_CR30","unstructured":"Clark C, Fraser K, Hand S, Hansen JG, Jul E, Limpach C, Pratt I, Warfield A (2005) Live migration of virtual machines. In Proceedings of the 2nd conference on symposium on networked systems design & implementation, Vol 2, pp 273\u2013286. USENIX Association, Santa Clara, CA"},{"key":"276_CR31","doi-asserted-by":"crossref","unstructured":"Barker S, Chi Y, Moon HJ, Hacig\u00fcm\u00fc\u015f H, Shenoy P (2012) \"cut me some slack\": latency-aware live migration for databases. In Proceedings of the 15th international conference on extending database technology, pp. 432\u2013443. Association for computing machinery, New York, NY, USA","DOI":"10.1145\/2247596.2247647"},{"issue":"2","key":"276_CR32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3442197","volume":"54","author":"A Magalhaes","year":"2021","unstructured":"Magalhaes A, Monteiro JM, Brayner A (2021) Main memory database recovery: a survey. ACM Comput Surv 54(2):1\u201336","journal-title":"ACM Comput Surv"},{"key":"276_CR33","doi-asserted-by":"crossref","unstructured":"Lim H, Kaminsky M, Andersen DG (2017) Cicada: dependably fast multi-core in-memory transactions. In Proceedings of the 2017 ACM international conference on management of data, pp 21\u201335. Association for computing machinery, New York, NY, USA","DOI":"10.1145\/3035918.3064015"},{"key":"276_CR34","volume-title":"Transactional information systems: theory, algorithms, and the practice of concurrency control and recovery","author":"G Weikum","year":"2001","unstructured":"Weikum G, Vossen G (2001) Transactional information systems: theory, algorithms, and the practice of concurrency control and recovery. Elsevier, San Francisco"},{"key":"276_CR35","volume-title":"Transaction processing: concepts and techniques","author":"J Gray","year":"1992","unstructured":"Gray J, Reuter A (1992) Transaction processing: concepts and techniques. Elsevier, San Mateo"},{"key":"276_CR36","doi-asserted-by":"crossref","unstructured":"Yu X, Pavlo A, Sanchez D, Devadas S (2016) Tictoc: time traveling optimistic concurrency control. In Proceedings of the 2016 international conference on management of data, pp 1629\u20131642. Association for computing machinery, New York, NY, USA","DOI":"10.1145\/2882903.2882935"},{"key":"276_CR37","doi-asserted-by":"crossref","unstructured":"Cooper BF, Silberstein A, Tam E, Ramakrishnan R, Sears R (2010) Benchmarking cloud serving systems with ycsb. In Proceedings of the 1st ACM symposium on cloud computing, pp 143\u2013154. Association for computing machinery, New York, NY, USA","DOI":"10.1145\/1807128.1807152"},{"key":"276_CR38","doi-asserted-by":"crossref","unstructured":"Alomari M, Cahill M, Fekete A, Rohm U (2008) The cost of serializability on platforms that use snapshot isolation. In 2008 IEEE 24th international conference on data engineering, pp 576\u2013585. IEEE","DOI":"10.1109\/ICDE.2008.4497466"},{"key":"276_CR39","doi-asserted-by":"crossref","unstructured":"Kim J, Cho H, Kim K, Yu J, Kang S, Jung H (2020) Long-lived transactions made less harmful. In Proceedings of the 2020 ACM SIGMOD international conference on management of data, pp 495\u2013510. Association for computing machinery, New York, NY, USA","DOI":"10.1145\/3318464.3389714"},{"key":"276_CR40","doi-asserted-by":"crossref","unstructured":"Lee J, Shin H, Park CG, Ko S, Noh J, Chuh Y, Stephan W, Han W-S (2016) Hybrid garbage collection for multi-version concurrency control in sap hana. In: Proceedings of the 2016 international conference on management of data, pp 1307\u20131318. Association for computing machinery, New York, NY, USA","DOI":"10.1145\/2882903.2903734"}],"container-title":["Data Science and Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41019-024-00276-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s41019-024-00276-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41019-024-00276-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,6]],"date-time":"2025-06-06T08:57:50Z","timestamp":1749200270000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s41019-024-00276-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,15]]},"references-count":40,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,6]]}},"alternative-id":["276"],"URL":"https:\/\/doi.org\/10.1007\/s41019-024-00276-5","relation":{},"ISSN":["2364-1185","2364-1541"],"issn-type":[{"value":"2364-1185","type":"print"},{"value":"2364-1541","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,15]]},"assertion":[{"value":"3 May 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 November 2024","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 December 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 January 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no known competing Financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}