{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,11]],"date-time":"2026-01-11T04:43:30Z","timestamp":1768106610290,"version":"3.49.0"},"reference-count":26,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,3,8]],"date-time":"2021-03-08T00:00:00Z","timestamp":1615161600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGMOD Rec."],"published-print":{"date-parts":[[2021,3,8]]},"abstract":"<jats:p>Data science and artificial intelligence are driven by a plethora of diverse data-related assets, including datasets, data streams, algorithms, processing software, compute resources, and domain knowledge. As providing all these assets requires a huge investment, data science and artificial intelligence technologies are currently dominated by a small number of providers who can afford these investments. This leads to lock-in effects and hinders features that require a flexible exchange of assets among users. In this paper, we introduce Agora, our vision towards a unified ecosystem that brings together data, algorithms, models, and computational resources and provides them to a broad audience. Agora (i) treats assets as first-class citizens and leverages a fine-grained exchange of assets, (ii) allows for combining assets to novel applications, and (iii) flexibly executes such applications on available resources. As a result, it enables easy creation and composition of data science pipelines as well as their scalable execution. In contrast to existing data management systems, Agora operates in a heavily decentralized and dynamic environment: Data, algorithms, and even compute resources are dynamically created, modified, and removed by different stakeholders. Agora presents novel research directions for the data management community as a whole: It requires to combine our traditional expertise in scalable data processing and management with infrastructure provisioning as well as economic and application aspects of data, algorithms, and infrastructure.<\/jats:p>","DOI":"10.1145\/3456859.3456861","type":"journal-article","created":{"date-parts":[[2021,3,11]],"date-time":"2021-03-11T07:04:51Z","timestamp":1615446291000},"page":"6-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["Agora"],"prefix":"10.1145","volume":"49","author":[{"given":"Jonas","family":"Traub","sequence":"first","affiliation":[{"name":"Technische Universit\u00e4t Berlin, Berlin, Germany"}]},{"given":"Zoi","family":"Kaoudi","sequence":"additional","affiliation":[{"name":"Technische Universit\u00e4t Berlin, Berlin, Germany"}]},{"given":"Jorge-Arnulfo","family":"Quian\u00e9-Ruiz","sequence":"additional","affiliation":[{"name":"Technische Universit\u00e4t Berlin, Berlin, Germany"}]},{"given":"Volker","family":"Markl","sequence":"additional","affiliation":[{"name":"Technische Universit\u00e4t Berlin, Berlin, Germany"}]}],"member":"320","published-online":{"date-parts":[[2021,3,10]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"D. Abadi etal The Seattle Report on Database Research. https:\/\/db.cs.washington.edu\/events\/other\/2018\/Seattle DBResearch Report-Full.pdf.  D. Abadi et al. The Seattle Report on Database Research. https:\/\/db.cs.washington.edu\/events\/other\/2018\/Seattle DBResearch Report-Full.pdf."},{"key":"e_1_2_1_2_1","unstructured":"Acumos. https:\/\/www.acumos.org.  Acumos. https:\/\/www.acumos.org."},{"key":"e_1_2_1_3_1","volume-title":"Rheem: enabling cross-platform data processing -- may the big data be with you! In PVLDB","author":"Agrawal D.","year":"2018","unstructured":"D. Agrawal , S. Chawla , B. Contreras-Rojas , Rheem: enabling cross-platform data processing -- may the big data be with you! In PVLDB , 2018 . D. Agrawal, S. Chawla, B. Contreras-Rojas, et al. Rheem: enabling cross-platform data processing -- may the big data be with you! In PVLDB, 2018."},{"key":"e_1_2_1_4_1","unstructured":"AWS Marketplace. https:\/\/aws.amazon.com\/ marketplace.  AWS Marketplace. https:\/\/aws.amazon.com\/ marketplace."},{"key":"e_1_2_1_5_1","volume-title":"May 18","author":"Blumenau S.","year":"2006","unstructured":"S. Blumenau and M. Barnes . Systems and methods for expiring digital assets using encryption key , May 18 2006 . US Patent App . 11\/282,463. S. Blumenau and M. Barnes. Systems and methods for expiring digital assets using encryption key, May 18 2006. US Patent App. 11\/282,463."},{"key":"e_1_2_1_6_1","unstructured":"Bonseyes. https:\/\/bonseyes.com\/.  Bonseyes. https:\/\/bonseyes.com\/."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-018-0512-y"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2018.00094"},{"key":"e_1_2_1_9_1","volume-title":"Intel SGX explained. IACR Cryptology ePrint Archive, (086):1--118","author":"Costan V.","year":"2016","unstructured":"V. Costan and S. Devadas . Intel SGX explained. IACR Cryptology ePrint Archive, (086):1--118 , 2016 . V. Costan and S. Devadas. Intel SGX explained. IACR Cryptology ePrint Archive, (086):1--118, 2016."},{"key":"e_1_2_1_10_1","unstructured":"Data Space. https:\/\/www.datapace.io.  Data Space. https:\/\/www.datapace.io."},{"key":"e_1_2_1_11_1","unstructured":"Datahub. https:\/\/datahub.io.  Datahub. https:\/\/datahub.io."},{"key":"e_1_2_1_12_1","unstructured":"Datawex. https:\/\/www.dawex.com.  Datawex. https:\/\/www.dawex.com."},{"key":"e_1_2_1_13_1","unstructured":"Enigma. https:\/\/enigma.co.  Enigma. https:\/\/enigma.co."},{"key":"e_1_2_1_14_1","unstructured":"G Suite Marketplace. https:\/\/gsuite.google.com\/marketplace.  G Suite Marketplace. https:\/\/gsuite.google.com\/marketplace."},{"key":"e_1_2_1_15_1","volume-title":"Datum network - the decentralized data marketplace - white paper v15","author":"Haenni R.","year":"2017","unstructured":"R. Haenni . Datum network - the decentralized data marketplace - white paper v15 . 2017 . https:\/\/datum.org\/assets\/Datum-WhitePaper.pdf. R. Haenni. Datum network - the decentralized data marketplace - white paper v15. 2017. https:\/\/datum.org\/assets\/Datum-WhitePaper.pdf."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2903730"},{"key":"e_1_2_1_17_1","volume-title":"CIDR","author":"Jindal A.","year":"2013","unstructured":"A. Jindal , J. Quian\u00b4e-Ruiz , and J. Dittrich . WWHow! Freeing Data Storage from Cages . In CIDR , 2013 . A. Jindal, J. Quian\u00b4e-Ruiz, and J. Dittrich. WWHow! Freeing Data Storage from Cages. In CIDR, 2013."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2017.2717883"},{"key":"e_1_2_1_19_1","unstructured":"Microsoft Azure. https:\/\/azure.microsoft.com.  Microsoft Azure. https:\/\/azure.microsoft.com."},{"key":"e_1_2_1_20_1","unstructured":"Ocean Protocol. https:\/\/oceanprotocol.com.  Ocean Protocol. https:\/\/oceanprotocol.com."},{"key":"e_1_2_1_21_1","unstructured":"OpenAI. https:\/\/openai.com.  OpenAI. https:\/\/openai.com."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2019.00243"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3329785.3329922"},{"key":"e_1_2_1_24_1","volume-title":"ADMS","author":"Rosenfeld V.","year":"2015","unstructured":"V. Rosenfeld , M. Heimel , C. Viebig , and V. Markl . The operator variant selection problem on heterogeneous hardware . In ADMS , 2015 . V. Rosenfeld, M. Heimel, C. Viebig, and V. Markl. The operator variant selection problem on heterogeneous hardware. In ADMS, 2015."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3386146"},{"key":"e_1_2_1_26_1","volume-title":"et al. Agora: A unified asset ecosystem going beyond marketplaces and cloud services. https:\/\/arxiv.org\/abs\/1909.03026","author":"Traub J.","year":"2020","unstructured":"J. Traub , Z. Kaoudi , K. Beedkar , et al. Agora: A unified asset ecosystem going beyond marketplaces and cloud services. https:\/\/arxiv.org\/abs\/1909.03026 , 2020 . J. Traub, Z. Kaoudi, K. Beedkar, et al. Agora: A unified asset ecosystem going beyond marketplaces and cloud services. https:\/\/arxiv.org\/abs\/1909.03026, 2020."}],"container-title":["ACM SIGMOD Record"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3456859.3456861","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3456859.3456861","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:26Z","timestamp":1750195886000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3456859.3456861"}},"subtitle":["Bringing Together Datasets, Algorithms, Models and More in a Unified Ecosystem [Vision]"],"short-title":[],"issued":{"date-parts":[[2021,3,8]]},"references-count":26,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,3,8]]}},"alternative-id":["10.1145\/3456859.3456861"],"URL":"https:\/\/doi.org\/10.1145\/3456859.3456861","relation":{},"ISSN":["0163-5808"],"issn-type":[{"value":"0163-5808","type":"print"}],"subject":[],"published":{"date-parts":[[2021,3,8]]},"assertion":[{"value":"2021-03-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}