{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,17]],"date-time":"2025-09-17T03:18:43Z","timestamp":1758079123396,"version":"3.44.0"},"reference-count":37,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2025,8]]},"abstract":"<jats:p>Organizations across industries increasingly rely on sharing data to drive collaboration, innovation, and business performance. However, securely and efficiently sharing live data across diverse platforms and adhering to varying governance requirements remains a significant challenge. Traditional approaches, such as FTP and proprietary in-data-warehouse solutions, often fail to meet the demands of interoperability, cost, scalability, and low overhead. This paper introduces Delta Sharing, an open protocol we developed in collaboration with industry partners, to overcome these limitations. Delta Sharing leverages open formats like Delta Lake and Apache Parquet alongside simple HTTP APIs to enable seamless, secure, and live data sharing across heterogeneous systems. Since its launch in 2021, Delta Sharing has been adopted by over 4000 enterprises and supported by hundreds of major software and data vendors. We discuss the key challenges in developing Delta Sharing and how our design addresses them. We also present, to our knowledge, the first large-scale study of production data sharing workloads offering insights into this emerging data platform capability.<\/jats:p>","DOI":"10.14778\/3750601.3750637","type":"journal-article","created":{"date-parts":[[2025,9,16]],"date-time":"2025-09-16T13:38:05Z","timestamp":1758029885000},"page":"5197-5209","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Delta Sharing: An Open Protocol for Cross-Platform Data Sharing"],"prefix":"10.14778","volume":"18","author":[{"given":"Krishna","family":"Puttaswamy","sequence":"first","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"Abhijit","family":"Chakankar","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"Tao","family":"Tao","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"Zaheera","family":"Valani","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"Ramesh","family":"Chandra","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"William","family":"Chau","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"Mengxi","family":"Chen","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"Akram","family":"Chetibi","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"Tianyi","family":"Huang","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"Jonathan","family":"Keller","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"Celia","family":"Kung","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"Andy","family":"Liu","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"Charlene","family":"Lyu","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"Samarth","family":"Shetty","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"Xiaotong","family":"Sun","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"Steve","family":"Weis","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"Lin","family":"Zhou","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"Ryan","family":"Zhu","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"Reynold","family":"Xin","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]},{"given":"Matei","family":"Zaharia","sequence":"additional","affiliation":[{"name":"Databricks, San Francisco, CA, USA"}]}],"member":"320","published-online":{"date-parts":[[2025,9,16]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Amazon S3. https:\/\/aws.amazon.com\/s3\/."},{"key":"e_1_2_1_2_1","unstructured":"Amperity builds an innovative consumer data platform with Delta Sharing. https:\/\/www.databricks.com\/blog\/delta-sharing-and-emergence-lakehouse-customer-data-platform-cdp."},{"key":"e_1_2_1_3_1","unstructured":"Amperity Bridge. https:\/\/docs.amperity.com\/datagrid\/bridge_databricks.html."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.14778\/3415478.3415560"},{"key":"e_1_2_1_5_1","unstructured":"AVEVA and Databricks Forge Strategic Collaboration to Accelerate Industrial AI Outcomes and Enable a Connected Industrial Ecosystem. https:\/\/www.aveva.com\/en\/about\/news\/press-releases\/2024\/aveva-and-databricks-forge-strategic-collaboration-to-accelerate-industrial-ai-outcomes-and-enable-a-connected-industrial-ecosystem\/."},{"key":"e_1_2_1_6_1","unstructured":"Azure Blob Storage. https:\/\/azure.microsoft.com\/en-us\/products\/storage\/blobs."},{"key":"e_1_2_1_7_1","unstructured":"Azure Shared Access Signatures. https:\/\/learn.microsoft.com\/en-us\/azure\/storage\/common\/storage-sas-overview."},{"key":"e_1_2_1_8_1","unstructured":"Azure Data Share. https:\/\/azure.microsoft.com\/en-us\/products\/data-share."},{"key":"e_1_2_1_9_1","unstructured":"BigQuery Analytics Hub. https:\/\/cloud.google.com\/analytics-hub\/?hl=en."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3722212.3724459"},{"key":"e_1_2_1_11_1","unstructured":"Databricks Clean Rooms. https:\/\/www.databricks.com\/product\/clean-room."},{"key":"e_1_2_1_12_1","unstructured":"current_recipient function. https:\/\/docs.databricks.com\/en\/sql\/language-manual\/functions\/current_recipient.html."},{"key":"e_1_2_1_13_1","unstructured":"Announcing Public Preview of Delta Sharing with Cloudflare R2 Integration. https:\/\/www.databricks.com\/blog\/announcing-public-preview-delta-sharing-cloudflare-r2-integration."},{"key":"e_1_2_1_14_1","unstructured":"Delta Kernel. https:\/\/delta.io\/blog\/delta-kernel\/."},{"key":"e_1_2_1_15_1","unstructured":"Delta Lake. https:\/\/delta.io\/."},{"key":"e_1_2_1_16_1","unstructured":"Delta Sharing Protocol. https:\/\/github.com\/delta-io\/delta-sharing\/blob\/main\/PROTOCOL.md."},{"key":"e_1_2_1_17_1","unstructured":"Delta Sharing. https:\/\/github.com\/delta-io\/delta-sharing."},{"key":"e_1_2_1_18_1","unstructured":"Delta Sharing Server. https:\/\/github.com\/delta-io\/delta-sharing\/tree\/main\/server."},{"key":"e_1_2_1_19_1","unstructured":"Top Three Data Sharing Use Cases With Delta Sharing. https:\/\/www.databricks.com\/blog\/2022\/01\/14\/top-three-data-sharing-use-cases-with-delta-sharing.html?t."},{"key":"e_1_2_1_20_1","unstructured":"GCP Signed URLs. https:\/\/cloud.google.com\/storage\/docs\/access-control\/signed-urls."},{"key":"e_1_2_1_21_1","unstructured":"Google Cloud Storage. https:\/\/cloud.google.com\/storage."},{"key":"e_1_2_1_22_1","unstructured":"Apache Hudi. https:\/\/hudi.apache.org\/."},{"key":"e_1_2_1_23_1","unstructured":"Apache Iceberg. https:\/\/iceberg.apache.org\/."},{"key":"e_1_2_1_24_1","unstructured":"How Delta Sharing Enables Secure End-to-End Collaboration. https:\/\/www.databricks.com\/blog\/how-delta-sharing-enables-secure-end-end-collaboration?t."},{"key":"e_1_2_1_25_1","unstructured":"ActionIQ Adds Databricks Delta Sharing: Flexibility and Control in Data Integration. https:\/\/www.actioniq.com\/blog\/databricks-delta-sharing-integration\/?t."},{"key":"e_1_2_1_26_1","unstructured":"Exploring Premium Data Sharing Solutions: Databricks Delta Sharing vs. Snowflake Data Sharing. https:\/\/www.linkedin.com\/pulse\/exploring-premium-data-sharing-solutions-databricks-delta-ben-poole\/."},{"key":"e_1_2_1_27_1","unstructured":"Streamline data collaboration with Databricks Delta Sharing and Microsoft Power BI. https:\/\/techcommunity.microsoft.com\/blog\/analyticsonazure\/streamline-data-collaboration-with-databricks-delta-sharing-and-microsoft-power-\/3707837?t."},{"key":"e_1_2_1_28_1","unstructured":"Databricks Marketplace. https:\/\/www.databricks.com\/product\/marketplace."},{"key":"e_1_2_1_29_1","unstructured":"Unlimited data-driven collaboration with Data Sharing of Oracle Autonomous Database. https:\/\/blogs.oracle.com\/datawarehousing\/post\/share-data-with-oracle-autonomous-database-data-sharing."},{"key":"e_1_2_1_30_1","unstructured":"Apache Parquet. https:\/\/parquet.apache.org\/."},{"key":"e_1_2_1_31_1","unstructured":"Pre-Signed URLs. https:\/\/docs.aws.amazon.com\/AmazonS3\/latest\/userguide\/ShareObjectPreSignedURL.html."},{"key":"e_1_2_1_32_1","unstructured":"Amazon Redshift Data Sharing. https:\/\/aws.amazon.com\/redshift\/features\/data-sharing\/."},{"key":"e_1_2_1_33_1","unstructured":"SAP and Databricks Open a Bold New Era of Data and AI. https:\/\/news.sap.com\/2025\/02\/sap-databricks-open-bold-new-era-data-ai\/."},{"key":"e_1_2_1_34_1","unstructured":"Snowflake for Collaboration. https:\/\/www.snowflake.com\/en\/data-cloud\/workloads\/collaboration\/."},{"key":"e_1_2_1_35_1","unstructured":"Data Sources. https:\/\/spark.apache.org\/docs\/latest\/sql-data-sources.html."},{"key":"e_1_2_1_36_1","unstructured":"Monitor account activity with system tables. https:\/\/docs.databricks.com\/en\/admin\/system-tables\/index.html."},{"key":"e_1_2_1_37_1","unstructured":"Universal Format (UniForm). https:\/\/docs.delta.io\/latest\/delta-uniform.html\/."}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3750601.3750637","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,16]],"date-time":"2025-09-16T13:38:47Z","timestamp":1758029927000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3750601.3750637"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8]]},"references-count":37,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2025,8]]}},"alternative-id":["10.14778\/3750601.3750637"],"URL":"https:\/\/doi.org\/10.14778\/3750601.3750637","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2025,8]]},"assertion":[{"value":"2025-09-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}