{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,26]],"date-time":"2026-03-26T13:10:02Z","timestamp":1774530602364,"version":"3.50.1"},"reference-count":69,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2023,8]]},"abstract":"<jats:p>This paper presents ScalarDB, a universal transaction manager that achieves distributed transactions across multiple disparate databases. ScalarDB provides a database-agnostic transaction manager on top of its database abstraction; thus, it achieves transactions spanning various databases without depending on the transactional capability of underlying databases. ScalarDB is based on several research works and extended to provide a strong correctness guarantee (i.e., strict serializability), further performance optimizations, and several critical mechanisms for productization. In this paper, we describe the design and implementation of ScalarDB. We also present evaluation results showing that ScalarDB achieves database-spanning transactions with reasonable performance and near-linear scalability without sacrificing correctness. Finally, we share some case studies and lessons learned while building and running ScalarDB.<\/jats:p>","DOI":"10.14778\/3611540.3611563","type":"journal-article","created":{"date-parts":[[2023,9,15]],"date-time":"2023-09-15T11:32:37Z","timestamp":1694777557000},"page":"3768-3780","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["ScalarDB: Universal Transaction Manager for Polystores"],"prefix":"10.14778","volume":"16","author":[{"given":"Hiroyuki","family":"Yamada","sequence":"first","affiliation":[{"name":"Scalar, Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Toshihiro","family":"Suzuki","sequence":"additional","affiliation":[{"name":"Scalar, Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuji","family":"Ito","sequence":"additional","affiliation":[{"name":"Scalar, Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Nemoto","sequence":"additional","affiliation":[{"name":"Scalar, Inc."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,8]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"A. Adya B. Liskov and P. O'Neil. 2000. Generalized Isolation Level Definitions. In ICDE. 67--78."},{"key":"e_1_2_1_2_1","unstructured":"Atomikos. 2023. Atomikos. https:\/\/www.atomikos.com\/Main\/WebHome."},{"key":"e_1_2_1_3_1","doi-asserted-by":"crossref","unstructured":"H. Berenson P. Bernstein J. Gray J. Melton E. O'Neil and P. O'Neil. 1995. A Critique of ANSI SQL Isolation Levels. In SIGMOD. 1--10.","DOI":"10.1145\/568271.223785"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01231700"},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","unstructured":"M. Cafarella D. DeWitt V. Gadepally J. Kepner C. Kozyrakis T. Kraska M. Stonebraker and M. Zaharia. 2021. A Polystore Based Database Operating System (DBOS). In Heterogeneous Data Management Polystores and Analytics for Healthcare. 3--24.","DOI":"10.1007\/978-3-030-71055-2_1"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"M. Cahill U. R\u00f6hm and A. Fekete. 2008. Serializable Isolation for Snapshot Databases. In SIGMOD. 729--738.","DOI":"10.1145\/1376616.1376690"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183628.3183631"},{"key":"e_1_2_1_8_1","volume-title":"Bigtable: A Distributed Storage System for Structured Data. In OSDI. 205--218.","author":"Chang F.","year":"2006","unstructured":"F. Chang, J. Dean, S. Ghemawat, W. Hsieh, D. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. Gruber. 2006. Bigtable: A Distributed Storage System for Structured Data. In OSDI. 205--218."},{"key":"e_1_2_1_9_1","doi-asserted-by":"crossref","unstructured":"B. Cooper A. Silberstein E. Tam R. Ramakrishnan and R. Sears. 2010. Benchmarking Cloud Serving Systems with YCSB. In SoCC. 143--154.","DOI":"10.1145\/1807128.1807152"},{"key":"e_1_2_1_10_1","volume-title":"Spanner: Google's Globally-Distributed Database. In OSDI. 251--264.","author":"Corbett J.","year":"2012","unstructured":"J. Corbett, J. Dean, M. Epstein, A. Fikes, C. Frost, J. Furman, S. Ghemawat, A. Gubarev, C. Heiser, P. Hochschild, W. Hsieh, S. Kanthak, E. Kogan, H. Li, A. Lloyd, S. Melnik, D. Mwaura, D. Nagle, S. Quinlan, R. Rao, L. Rolig, Y. Saito, M. Szymaniak, C. Taylor, R. Wang, and D. Woodford. 2012. Spanner: Google's Globally-Distributed Database. In OSDI. 251--264."},{"key":"e_1_2_1_11_1","unstructured":"A. Dey. 2015. Cherry Garcia: Transactions across Heterogeneous Data Stores. Ph.D. Dissertation. http:\/\/hdl.handle.net\/2123\/14212"},{"key":"e_1_2_1_12_1","doi-asserted-by":"crossref","unstructured":"A. Dey A. Fekete and U. R\u00f6hm. 2015. Scalable Distributed Transactions across Heterogeneous Stores. In ICDE. 125--136.","DOI":"10.1109\/ICDE.2015.7113278"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2463710"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2814710.2814713"},{"key":"e_1_2_1_15_1","unstructured":"M. Elhemali N. Gallagher N. Gordon J. Idziorek R. Krog C. Lazier E. Mo A. Mritunjai S. Perianayagam T. Rath S. Sivasubramanian J. C. Sorenson III S. Sosothikul D. Terry and A. Vig. 2022. Amazon DynamoDB: A Scalable Predictably Performant and Fully Managed NoSQL Database Service. In ATC. 1037--1048."},{"key":"e_1_2_1_16_1","doi-asserted-by":"crossref","unstructured":"N. Faria J. Pereira A. Alonso and R. Vila\u00e7a. 2021. Towards Generic Fine-Grained Transaction Isolation in Polystores. In Heterogeneous Data Management Polystores and Analytics for Healthcare. 29--42.","DOI":"10.1007\/978-3-030-93663-1_3"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1071610.1071615"},{"key":"e_1_2_1_18_1","unstructured":"The Apache Software Foundation. 2023. Apache Cassandra. https:\/\/cassandra.apache.org\/."},{"key":"e_1_2_1_19_1","unstructured":"The Apache Software Foundation. 2023. Apache HBase. https:\/\/hbase.apache.org\/."},{"key":"e_1_2_1_20_1","doi-asserted-by":"crossref","unstructured":"H. Garcia-Molina and K. Salem. 1987. Sagas. In SIGMOD. 249--259.","DOI":"10.1145\/38714.38742"},{"key":"e_1_2_1_21_1","unstructured":"Google. 2023. Cloud Spanner. https:\/\/cloud.google.com\/spanner."},{"key":"e_1_2_1_22_1","doi-asserted-by":"crossref","unstructured":"J. Gray. 1978. Notes on Data Base Operating Systems. In Operating Systems An Advanced Course. 393--481.","DOI":"10.1007\/3-540-08755-9_9"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1132863.1132867"},{"key":"e_1_2_1_24_1","unstructured":"The Open Group. 1991. Distributed Transaction Processing: The XA Specification. https:\/\/pubs.opengroup.org\/onlinepubs\/009680699\/toc.pdf."},{"key":"e_1_2_1_25_1","unstructured":"The PostgreSQL Global Development Group. 2023. PostgreSQL. https:\/\/www.postgresql.org\/."},{"key":"e_1_2_1_26_1","unstructured":"gRPC Authors. 2023. gRPC. https:\/\/grpc.io\/."},{"key":"e_1_2_1_27_1","unstructured":"B. Hagler. 2020. Overcoming Data Silos In Your Organization. https:\/\/www.forbes.com\/sites\/forbestechcouncil\/2020\/05\/12\/overcoming-data-silos-in-your-organization."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/4229.4233"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3012426.3025012"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/78969.78972"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.14778\/3415478.3415535"},{"key":"e_1_2_1_32_1","unstructured":"M. Fowler J. Lewis. 2014. Microservices. https:\/\/martinfowler.com\/articles\/microservices.html."},{"key":"e_1_2_1_33_1","unstructured":"Jepsen. 2023. Jepsen. https:\/\/github.com\/jepsen-io\/jepsen."},{"key":"e_1_2_1_34_1","doi-asserted-by":"crossref","unstructured":"D. Karger E. Lehman T. Leighton R. Panigrahy M. Levine and D. Lewin. 1997. Consistent Hashing and Random Trees: Distributed Caching Protocols for Relieving Hot Spots on the World Wide Web. In STOC. 654--663.","DOI":"10.1145\/258533.258660"},{"key":"e_1_2_1_35_1","first-page":"268","article-title":"Elle: Inferring Isolation Anomalies from Experimental Observations","volume":"14","author":"Kingsbury K.","year":"2021","unstructured":"K. Kingsbury and P. Alvaro. 2021. Elle: Inferring Isolation Anomalies from Experimental Observations. PVLDB 14, 3 (2021), 268--280.","journal-title":"PVLDB"},{"key":"e_1_2_1_36_1","unstructured":"K. Kingsbury and P. Alvaro. 2023. Elle. https:\/\/github.com\/jepsen-io\/elle."},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","unstructured":"S. Kulkarni M. Demirbas D. Madappa B. Avva and M. Leone. 2014. Logical Physical Clocks. In Principles of Distributed Systems. 17--32.","DOI":"10.1007\/978-3-319-14472-6_2"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.14778\/3484224.3484232"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/359545.359563"},{"key":"e_1_2_1_40_1","volume-title":"Deuteronomy: Transaction Support for Cloud Data. In CIDR.","author":"Levandoski J.","year":"2011","unstructured":"J. Levandoski, D. Lomet, M. Mokbel, and K Zhao. 2011. Deuteronomy: Transaction Support for Cloud Data. In CIDR."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.14778\/2831360.2831368"},{"key":"e_1_2_1_42_1","doi-asserted-by":"crossref","unstructured":"R. Li L. Zhang J. Pan J. Liu P. Wang N. Sun S. Wang C. Chen F. Gu and S. Guo. 2022. Apache ShardingSphere: A Holistic and Pluggable Platform for Data Sharding. In ICDE. 2468--2480.","DOI":"10.1109\/ICDE53745.2022.00230"},{"key":"e_1_2_1_43_1","doi-asserted-by":"crossref","unstructured":"S. Mehrotra R. Rastogi A. Silberschatz and H. Korth. 1992. A Transaction Model for Multidatabase Systems. In ICDCS. 56--63.","DOI":"10.1109\/ICDCS.1992.235055"},{"key":"e_1_2_1_44_1","unstructured":"Microsoft. 2023. Azure Cosmos DB. https:\/\/azure.microsoft.com\/en-us\/services\/cosmos-db\/."},{"key":"e_1_2_1_45_1","unstructured":"Microsoft. 2023. SQL Server. https:\/\/www.microsoft.com\/en-us\/sql-server\/."},{"key":"e_1_2_1_46_1","unstructured":"Oracle. 2023. MySQL. https:\/\/www.mysql.com\/."},{"key":"e_1_2_1_47_1","unstructured":"Oracle. 2023. Oracle Database. https:\/\/www.oracle.com\/database\/."},{"key":"e_1_2_1_48_1","unstructured":"Oracle. 2023. Oracle Tuxedo. https:\/\/www.oracle.com\/middleware\/technologies\/tuxedo.html."},{"key":"e_1_2_1_49_1","volume-title":"Processes & Products to Reduce System Complexity. In CloudComputingExpo","author":"Rodgers P.","year":"2005","unstructured":"P. Rodgers. 2005. Service-Oriented Development on NetKernel- Patterns, Processes & Products to Reduce System Complexity. In CloudComputingExpo 2005."},{"key":"e_1_2_1_50_1","unstructured":"Scalar. 2023. Jepsen tests for ScalarDB. https:\/\/github.com\/scalar-labs\/scalar-jepsen\/tree\/master\/scalardb."},{"key":"e_1_2_1_51_1","unstructured":"Scalar. 2023. ScalarDB. https:\/\/github.com\/scalar-labs\/scalardb."},{"key":"e_1_2_1_52_1","unstructured":"Scalar. 2023. ScalarDL. https:\/\/github.com\/scalar-labs\/scalardl."},{"key":"e_1_2_1_53_1","unstructured":"Scalar. 2023. Sensor test. https:\/\/github.com\/scalar-labs\/kelpie-test\/tree\/master\/scalardb-test\/src\/main\/java\/kelpie\/scalardb\/sensor."},{"key":"e_1_2_1_54_1","unstructured":"Seata. 2023. Seata. https:\/\/seata.io\/en-us\/."},{"key":"e_1_2_1_55_1","unstructured":"Amazon Web Services. 2023. Amazon DynamoDB. https:\/\/aws.amazon.com\/dynamodb\/."},{"key":"e_1_2_1_56_1","unstructured":"Amazon Web Services. 2023. Amazon Neptune. https:\/\/aws.amazon.com\/neptune\/."},{"key":"e_1_2_1_57_1","unstructured":"Amazon Web Services. 2023. Amazon Quantum Ledger Database (QLDB). https:\/\/aws.amazon.com\/qldb\/."},{"key":"e_1_2_1_58_1","unstructured":"Amazon Web Services. 2023. AWS Cloud Databases. https:\/\/aws.amazon.com\/products\/databases\/."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/96602.96604"},{"key":"e_1_2_1_60_1","unstructured":"M. Stonebraker. 2015. The Case For Polystores. https:\/\/wp.sigmod.org\/?p=1629."},{"key":"e_1_2_1_61_1","doi-asserted-by":"crossref","unstructured":"M. Stonebraker and U. Cetintemel. 2005. \"One Size Fits All\": An Idea Whose Time Has Come and Gone. In ICDE. 2--11.","DOI":"10.1109\/ICDE.2005.1"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/1080862.1080877"},{"key":"e_1_2_1_63_1","doi-asserted-by":"crossref","unstructured":"R. Taft I. Sharif A. Matei N. VanBenschoten J. Lewis T. Grieger K. Niemi A. Woods A. Birzin R. Poss P. Bardea A. Ranade B. Darnell B. Gruneir J. Jaffray L. Zhang and P. Mattis. 2020. CockroachDB: The Resilient Geo-Distributed SQL Database. In SIGMOD. 1493--1509.","DOI":"10.1145\/3318464.3386134"},{"key":"e_1_2_1_64_1","unstructured":"Transaction Processing Performance Council (TPC). 2010. TPC Benchmark C (Revision 5.11). http:\/\/www.tpc.org\/tpcc\/."},{"key":"e_1_2_1_65_1","doi-asserted-by":"crossref","unstructured":"S. Tu W. Zheng E. Kohler B. Liskov and S. Madden. 2013. Speedy Transactions in Multicore In-Memory Databases. In SOSP. 18--32.","DOI":"10.1145\/2517349.2522713"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3035918.3056101"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-017-0463-8"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.14778\/3523210.3523212"},{"key":"e_1_2_1_69_1","unstructured":"Yugabyte. 2023. YugabyteDB. https:\/\/www.yugabyte.com\/."}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3611540.3611563","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,10]],"date-time":"2025-09-10T22:34:39Z","timestamp":1757543679000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3611540.3611563"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8]]},"references-count":69,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2023,8]]}},"alternative-id":["10.14778\/3611540.3611563"],"URL":"https:\/\/doi.org\/10.14778\/3611540.3611563","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2023,8]]},"assertion":[{"value":"2023-08-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}