{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,17]],"date-time":"2025-09-17T03:18:57Z","timestamp":1758079137027,"version":"3.44.0"},"reference-count":13,"publisher":"Association for Computing Machinery (ACM)","issue":"12","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2025,8]]},"abstract":"<jats:p>Fast and scalable data transfer is crucial in today's decentralized data ecosystems and data-driven applications, including extraction-transformation-loading (ETL) pipelines, and data science workflows. Transfers often occur across heterogeneous environments\u2014ranging from cloud-hosted systems to local consumer devices\u2014with varying compute and network constraints. However, existing solutions struggle to balance performance with generality across such diverse setups. We recently proposed XDBC, a holistic data transfer framework that decomposes the pipeline into logical components with multiple physical implementations per component. Its modular architecture enables seamless system integration and automatic tuning based on workload and environment characteristics. In this demonstration, we present Enter the Warp, an interactive game built around XDBC that visualizes data transfer as a space mission. Players configure transfer parameters, monitor live throughput metrics, and optimize performance to shield Earth from meteor strikes, gaining an understanding and hands-on experience of data transfer challenges in an engaging and intuitive way.<\/jats:p>","DOI":"10.14778\/3750601.3750660","type":"journal-article","created":{"date-parts":[[2025,9,16]],"date-time":"2025-09-16T13:38:05Z","timestamp":1758029885000},"page":"5315-5318","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Enter the Warp: Fast and Adaptive Data Transfer with XDBC"],"prefix":"10.14778","volume":"18","author":[{"given":"Haralampos","family":"Gavriilidis","sequence":"first","affiliation":[{"name":"TU Berlin, BIFOLD, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joel","family":"Ziegler","sequence":"additional","affiliation":[{"name":"TU Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Midhun Kaippillil","family":"Venugopalan","sequence":"additional","affiliation":[{"name":"TU Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Benedikt","family":"Didrich","sequence":"additional","affiliation":[{"name":"TU Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthias","family":"Boehm","sequence":"additional","affiliation":[{"name":"TU Berlin, BIFOLD, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Volker","family":"Markl","sequence":"additional","affiliation":[{"name":"TU Berlin, BIFOLD, DFKI, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,9,16]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Accessed","author":"SQL","year":"2025","unstructured":"2025. PostgreSQL wiki | Foreign data wrappers. https:\/\/wiki.postgresql.org\/wiki\/Foreign_data_wrappers#Specific_SQL_Database_Wrappers. Accessed: July 15, 2025."},{"key":"e_1_2_1_2_1","volume-title":"Accessed","author":"Turbodbc","year":"2025","unstructured":"2025. Turbodbc - Turbocharged database access for data scientists. https:\/\/turbodbc.readthedocs.io\/en\/latest\/. Accessed: July 15, 2025."},{"key":"e_1_2_1_3_1","unstructured":"Matthias Boehm. 2011. Cost-based optimization of integration flows. (2011). https:\/\/nbn-resolving.org\/urn:nbn:de:bsz:14-qucosa-67936"},{"key":"e_1_2_1_4_1","volume-title":"Accelerate: Tuning Data Transfer Parameters. In AIDB@VLDB","author":"Benedikt Didrich","year":"2025","unstructured":"Benedikt Didrich et al. 2025. Learning to Accelerate: Tuning Data Transfer Parameters. In AIDB@VLDB 2025."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","unstructured":"Haralampos Gavriilidis et al. 2023. In-Situ Cross-Database Query Processing. In ICDE. 10.1109\/ICDE55515.2023.00214","DOI":"10.1109\/ICDE55515.2023.00214"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3725294"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","unstructured":"Brandon Haynes Alvin Cheung and Magdalena Balazinska. 2016. PipeGen: Data pipe generator for hybrid analytics. In SoCC. 10.1145\/2987550.2987567","DOI":"10.1145\/2987550.2987567"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.14778\/3115404.3115408"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2019.00196"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2005.103"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","unstructured":"Alkis Simitsis Kevin Wilkinson and Petar Jovanovic. 2013. xPAD: a platform for analytic data flows. In SIGMOD. 10.1145\/2463676.2465247","DOI":"10.1145\/2463676.2465247"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2972950"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","unstructured":"Xiaoying Wang et al. 2022. ConnectorX: accelerating data loading from databases to dataframes. PVLDB 15 11 (2022). 10.14778\/3551793.3551847","DOI":"10.14778\/3551793.3551847"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3750601.3750660","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,16]],"date-time":"2025-09-16T13:44:18Z","timestamp":1758030258000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3750601.3750660"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8]]},"references-count":13,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2025,8]]}},"alternative-id":["10.14778\/3750601.3750660"],"URL":"https:\/\/doi.org\/10.14778\/3750601.3750660","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2025,8]]},"assertion":[{"value":"2025-09-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}