{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,29]],"date-time":"2025-09-29T08:05:52Z","timestamp":1759133152798},"reference-count":18,"publisher":"Association for Computing Machinery (ACM)","issue":"13","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2016,9]]},"abstract":"<jats:p>Supported by increasingly efficient HPC infra-structure, numerical simulations are rapidly expanding to fields such as oil and gas, medicine and meteorology. As simulations become more precise and cover longer periods of time, they may produce files with terabytes of data that need to be efficiently analyzed. In this paper, we investigate techniques for managing such data using an array DBMS. We take advantage of multidimensional arrays that nicely models the dimensions and variables used in numerical simulations. However, a naive approach to map simulation data files may lead to sparse arrays, impacting query response time, in particular, when the simulation uses irregular meshes to model its physical domain. We propose efficient techniques to map coordinate values in numerical simulations to evenly distributed cells in array chunks with the use of equi-depth histograms and space-filling curves. We implemented our techniques in SciDB and, through experiments over real-world data, compared them with two other approaches: row-store and column-store DBMS. The results indicate that multidimensional arrays and column-stores are much faster than a traditional row-store system for queries over a larger amount of simulation data. They also help identifying the scenarios where array DBMSs are most efficient, and those where they are outperformed by column-stores.<\/jats:p>","DOI":"10.14778\/3007263.3007271","type":"journal-article","created":{"date-parts":[[2016,11,1]],"date-time":"2016-11-01T13:47:47Z","timestamp":1478008067000},"page":"1329-1340","source":"Crossref","is-referenced-by-count":7,"title":["Database system support of simulation data"],"prefix":"10.14778","volume":"9","author":[{"given":"Hermano","family":"Lustosa","sequence":"first","affiliation":[{"name":"National Laboratory for Scientific Computing, DEXL Lab, Petropolis, RJ, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fabio","family":"Porto","sequence":"additional","affiliation":[{"name":"National Laboratory for Scientific Computing, DEXL Lab, Petropolis, RJ, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Patrick","family":"Valduriez","sequence":"additional","affiliation":[{"name":"Inria and LIRMM Montpellier, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pablo","family":"Blanco","sequence":"additional","affiliation":[{"name":"National Laboratory for Scientific Computing, DEXL Lab, Petropolis, RJ, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2016,9]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbiomech.2009.01.034"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807167.1807271"},{"key":"e_1_2_1_3_1","first-page":"457","volume-title":": Efficient pipeline for image-based patient-specific analysis of cerebral aneurysm hemodynamics: technique and sensitivity","author":"Cebral J. R.","year":"2005","unstructured":"J. R. Cebral , M. A. Castro , C. M. Putman , D. Millan , and R. F. Frangi . A. : Efficient pipeline for image-based patient-specific analysis of cerebral aneurysm hemodynamics: technique and sensitivity . IEEE transactions on medical imaging, pages 457 -- 467 , 2005 . J. R. Cebral, M. A. Castro, C. M. Putman, D. Millan, and R. F. Frangi. A.: Efficient pipeline for image-based patient-specific analysis of cerebral aneurysm hemodynamics: technique and sensitivity. IEEE transactions on medical imaging, pages 457--467, 2005."},{"key":"e_1_2_1_4_1","volume-title":"Technologie und Web (BTW, 2015) - Workshopband, 2.-3. M\u00e4rz 2015","author":"Cijvat R.","year":"2015","unstructured":"R. Cijvat , S. Manegold , M. L. Kersten , G. W. Klau , A. Sch\u00f6nhuth , T. Marschall , and Y. Zhang . Genome sequence analysis with monetdb: a case study on ebola virus diversity. In Datenbanksysteme f\u00fcr Business , Technologie und Web (BTW, 2015) - Workshopband, 2.-3. M\u00e4rz 2015 , Hamburg, Germany, pages 143--150 , 2015 . R. Cijvat, S. Manegold, M. L. Kersten, G. W. Klau, A. Sch\u00f6nhuth, T. Marschall, and Y. Zhang. Genome sequence analysis with monetdb: a case study on ebola virus diversity. In Datenbanksysteme f\u00fcr Business, Technologie und Web (BTW, 2015) - Workshopband, 2.-3. M\u00e4rz 2015, Hamburg, Germany, pages 143--150, 2015."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/3225623.3225688"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/CISIS.2007.16"},{"key":"e_1_2_1_7_1","volume-title":"December","year":"2014","unstructured":"HeMoLab. Hemodynamics modeling laboratory , December 2014 . http:\/\/hemolab.lncc.br. HeMoLab. Hemodynamics modeling laboratory, December 2014. http:\/\/hemolab.lncc.br."},{"key":"e_1_2_1_9_1","first-page":"2012","volume-title":"Monetdb: Two decades of research in column-oriented database architectures","author":"Idreos S.","unstructured":"S. Idreos , F. Groffen , N. Nes , S. Manegold , S. Mullender , and M. Kersten . Monetdb: Two decades of research in column-oriented database architectures . IEEE Data Eng. Bull , page 2012 . S. Idreos, F. Groffen, N. Nes, S. Manegold, S. Mullender, and M. Kersten. Monetdb: Two decades of research in column-oriented database architectures. IEEE Data Eng. Bull, page 2012."},{"key":"e_1_2_1_10_1","unstructured":"M. Ivanova N. Nes R. Goncalves and M. Kersten. Monetdb\/sql meets skyserver: the challenges of a scientific database. Technical report.  M. Ivanova N. Nes R. Goncalves and M. Kersten. Monetdb\/sql meets skyserver: the challenges of a scientific database. Technical report."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/373626.373678"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2744700.2744702"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/69.908985"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/645926.671872"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2505515.2505733"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2390021.2390032"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2463676.2465306"},{"key":"e_1_2_1_18_1","volume-title":"Conference on Innovative Data Systems Research (CIDR)","author":"Stonebraker M.","year":"2009","unstructured":"M. Stonebraker , J. Becla , D. Dewitt , K.-T. Lim , D. Maier , O. Ratzesberger , and S. Zdonik . Requirements for science data bases and scidb . In Conference on Innovative Data Systems Research (CIDR) , January 2009 . M. Stonebraker, J. Becla, D. Dewitt, K.-T. Lim, D. Maier, O. Ratzesberger, and S. Zdonik. Requirements for science data bases and scidb. In Conference on Innovative Data Systems Research (CIDR), January 2009."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2005.1"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/3007263.3007271","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T09:34:42Z","timestamp":1672220082000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/3007263.3007271"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,9]]},"references-count":18,"journal-issue":{"issue":"13","published-print":{"date-parts":[[2016,9]]}},"alternative-id":["10.14778\/3007263.3007271"],"URL":"https:\/\/doi.org\/10.14778\/3007263.3007271","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2016,9]]}}}