{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:25:54Z","timestamp":1750307154467,"version":"3.41.0"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2011,12,1]],"date-time":"2011-12-01T00:00:00Z","timestamp":1322697600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Database Syst."],"published-print":{"date-parts":[[2011,12]]},"abstract":"<jats:p>A grand challenge of distributed query processing is to devise a self-organizing architecture which exploits all hardware resources optimally to manage the database hot set, minimize query response time, and maximize throughput without single point global coordination. The Data Cyclotron architecture [Goncalves and Kersten 2010] addresses this challenge using turbulent data movement through a storage ring built from distributed main memory and capitalizing on the functionality offered by modern remote-DMA network facilities. Queries assigned to individual nodes interact with the storage ring by picking up data fragments, which are continuously flowing around, that is, the hot set.<\/jats:p>\n          <jats:p>\n            The storage ring is steered by the\n            <jats:italic>Level Of Interest<\/jats:italic>\n            (\n            <jats:italic>LOI<\/jats:italic>\n            ) attached to each data fragment, which represents the cumulative query interest as it passes around the ring multiple times. A fragment with\n            <jats:italic>LOI<\/jats:italic>\n            below a given threshold, inversely proportional to the ring load, is pulled out to free up resources. This threshold is dynamically adjusted in a fully distributed manner based on ring characteristics and locally observed query behavior. It optimizes resource utilization by keeping the average data access latency low. The approach is illustrated using an extensive and validated simulation study. The results underpin the fragment hot set management robustness in turbulent workload scenarios.\n          <\/jats:p>\n          <jats:p>A fully functional prototype of the proposed architecture has been implemented using modest extensions to MonetDB and runs within a multirack cluster equipped with Infiniband. Extensive experimentation using both microbenchmarks and high-volume workloads based on TPC-H demonstrates its feasibility.<\/jats:p>\n          <jats:p>The Data Cyclotron architecture and experiments open a new vista for modern distributed database architectures with a plethora of new research challenges.<\/jats:p>","DOI":"10.1145\/2043652.2043660","type":"journal-article","created":{"date-parts":[[2011,12,20]],"date-time":"2011-12-20T17:49:14Z","timestamp":1324403354000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["The data cyclotron query processing scheme"],"prefix":"10.1145","volume":"36","author":[{"given":"Romulo","family":"Goncalves","sequence":"first","affiliation":[{"name":"CWI Amsterdam, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martin","family":"Kersten","sequence":"additional","affiliation":[{"name":"CWI Amsterdam, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2011,12,19]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/223784.223816"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/253260.253293"},{"volume-title":"Proceedings of the International Conference on Very Large Database (VLDB'01)","author":"Aksoy D.","key":"e_1_2_1_3_1"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807167.1807224"},{"volume-title":"Proceedings of the RAIT Workshop.","year":"2004","author":"Balaji P.","key":"e_1_2_1_5_1"},{"key":"e_1_2_1_6_1","article-title":"Evaluating the distributed datacycle scheme for a high performance distributed system","author":"Banerjee S.","year":"1994","journal-title":"J. Comput. Inf. 1."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409360.1409380"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2002.1019210"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/GCC.2007.40"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/138859.138868"},{"volume-title":"Proceedings of the International Conference on Very Large Databases (VLDB'07)","author":"Chaudhuri S.","key":"e_1_2_1_11_1"},{"key":"e_1_2_1_12_1","unstructured":"Chun T. 2001. Performance studies of high-speed communication on commodity cluster. Masters\/citeseer\/ist.psu.edu\/viewdoc\/download.jsessinoid\/0=1.1.1.137.3696.pdf. Thesis.  Chun T. 2001. Performance studies of high-speed communication on commodity cluster. Masters\/citeseer\/ist.psu.edu\/viewdoc\/download.jsessinoid\/0=1.1.1.137.3696.pdf. Thesis."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/129888.129894"},{"key":"e_1_2_1_14_1","unstructured":"Flouris M. D. and Markatos E. P. 1998. The network ramdisk: Using remote memory on heterogenous nows. http:\/\/dcs.ics.forth.gr\/Activities\/papers\/nrd.pdf.  Flouris M. D. and Markatos E. P. 1998. The network ramdisk: Using remote memory on heterogenous nows. http:\/\/dcs.ics.forth.gr\/Activities\/papers\/nrd.pdf."},{"volume-title":"Proceedings of the IEEE International Symposium on Performance Analysis of Systems and Software. 70--79","author":"Foong A.","key":"e_1_2_1_15_1"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1565694.1565701"},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","unstructured":"Frey P. Goncalves R. Kersten M. and Teubner J. 2010. A spinning join that does not get dizzy.  Frey P. Goncalves R. Kersten M. and Teubner J. 2010. A spinning join that does not get dizzy.","DOI":"10.1109\/ICDCS.2010.23"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCS.2009.32"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1739041.1739054"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1142473.1142511"},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","unstructured":"Gray J. Szalay A. S. Slutz D. Thakar A. R. vanden Berg J. et al. 2002. Data Mining the SDSS SkyServer Database. Tech. rep. MSR-TR-2002-01.  Gray J. Szalay A. S. Slutz D. Thakar A. R. vanden Berg J. et al. 2002. Data Mining the SDSS SkyServer Database. Tech. rep. MSR-TR-2002-01.","DOI":"10.1145\/564691.564758"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11227-006-0001-8"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/38714.38729"},{"key":"e_1_2_1_24_1","unstructured":"Ioannidis S. Markatos E. P. and Sevaslidou J. 1998. On using network memory to improve the performance of transaction-based systems. http:\/\/citeseerx.ist.psu.edu\/viewdoc\/summary&quest;doi=10.1.1.46.3025.  Ioannidis S. Markatos E. P. and Sevaslidou J. 1998. On using network memory to improve the performance of transaction-based systems. http:\/\/citeseerx.ist.psu.edu\/viewdoc\/summary&quest;doi=10.1.1.46.3025."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1862919.1862921"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559845.1559879"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/SSDBM.2007.19"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2008.4497404"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1002\/scj.v38:2"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/371578.371598"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/335191.335416"},{"volume-title":"Proceedings of the International Conference on Very Large Data Bases (VLDB). 54--65","author":"Manegold S.","key":"e_1_2_1_32_1"},{"key":"e_1_2_1_33_1","first-page":"11","article-title":"Dynamic query scheduling in parallel data warehouses","volume":"15","author":"M\u00e4rtens H.","year":"2003","journal-title":"Concurr. Comput. Practice Exper."},{"key":"e_1_2_1_34_1","doi-asserted-by":"crossref","unstructured":"Ousterhout J. Agrawal P. Erickson D. Kozyrakis C. Leverich J. Mazires D. Mitra S. Narayanan A. etal 2010. The Case for RAMClouds: Scalable High-Performance Storage Entirely in DRAM. Stanford University.  Ousterhout J. Agrawal P. Erickson D. Kozyrakis C. Leverich J. Mazires D. Mitra S. Narayanan A. et al. 2010. The Case for RAMClouds: Scalable High-Performance Storage Entirely in DRAM. Stanford University.","DOI":"10.1145\/1713254.1713276"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/383059.383072"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/383059.383071"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/564691.564758"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3872.3874"},{"volume-title":"Proceedings of the International Conference on Very Large Databases (VLDB). 1087--1097","author":"Zilio D. C.","key":"e_1_2_1_39_1"},{"volume-title":"Proceedings of the International Conference on Very Large Databases (VLDB). 723--734","author":"Zukowski M.","key":"e_1_2_1_40_1"}],"container-title":["ACM Transactions on Database Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2043652.2043660","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2043652.2043660","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T09:54:19Z","timestamp":1750240459000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2043652.2043660"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,12]]},"references-count":40,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2011,12]]}},"alternative-id":["10.1145\/2043652.2043660"],"URL":"https:\/\/doi.org\/10.1145\/2043652.2043660","relation":{},"ISSN":["0362-5915","1557-4644"],"issn-type":[{"type":"print","value":"0362-5915"},{"type":"electronic","value":"1557-4644"}],"subject":[],"published":{"date-parts":[[2011,12]]},"assertion":[{"value":"2010-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2011-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2011-12-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}