{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,25]],"date-time":"2026-10-25T20:43:46Z","timestamp":1792961026891,"version":"4.5.0"},"reference-count":13,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2005,12,1]],"date-time":"2005-12-01T00:00:00Z","timestamp":1133395200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGMOD Rec."],"published-print":{"date-parts":[[2005,12]]},"abstract":"<jats:p>Scientific instruments and computer simulations are creating vast data stores that require new scientific methods to analyze and organize the data. Data volumes are approximately doubling each year. Since these new instruments have extraordinary precision, the data quality is also rapidly improving. Analyzing this data to find the subtle effects missed by previous studies requires algorithms that can simultaneously deal with huge datasets and that can find very subtle effects --- finding both needles in the haystack and finding very small haystacks that were undetected in previous measurements.<\/jats:p>","DOI":"10.1145\/1107499.1107503","type":"journal-article","created":{"date-parts":[[2006,2,6]],"date-time":"2006-02-06T13:14:10Z","timestamp":1139231650000},"page":"34-41","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":329,"title":["Scientific data management in the coming decade"],"prefix":"10.1145","volume":"34","author":[{"given":"Jim","family":"Gray","sequence":"first","affiliation":[{"name":"Microsoft"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David T.","family":"Liu","sequence":"additional","affiliation":[{"name":"Berkeley"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maria","family":"Nieto-Santisteban","sequence":"additional","affiliation":[{"name":"Johns Hopkins University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alex","family":"Szalay","sequence":"additional","affiliation":[{"name":"Johns Hopkins University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David J.","family":"DeWitt","sequence":"additional","affiliation":[{"name":"Wisconsin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gerd","family":"Heber","sequence":"additional","affiliation":[{"name":"Cornell"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2005,12]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"{fr1} Committee on Data Management Archiving and Computing (CODMAC) Data Level Definitions http:\/\/science.hq.nasa.gov\/research\/earth_science_formats.html  {fr1} Committee on Data Management Archiving and Computing (CODMAC) Data Level Definitions http:\/\/science.hq.nasa.gov\/research\/earth_science_formats.html"},{"key":"e_1_2_1_2_1","unstructured":"{fr2} http:\/\/hdf.ncsa.uiuc.edu\/HDF5\/  {fr2} http:\/\/hdf.ncsa.uiuc.edu\/HDF5\/"},{"key":"e_1_2_1_3_1","unstructured":"{fr3} http:\/\/my.unidata.ucar.edu\/content\/software\/netcdf\/  {fr3} http:\/\/my.unidata.ucar.edu\/content\/software\/netcdf\/"},{"key":"e_1_2_1_4_1","unstructured":"{fr4} http:\/\/fits.gsfc.nasa.gov\/  {fr4} http:\/\/fits.gsfc.nasa.gov\/"},{"key":"e_1_2_1_5_1","unstructured":"{fr5} http:\/\/vizier.u-strasbg.fr\/doc\/UCD.htx  {fr5} http:\/\/vizier.u-strasbg.fr\/doc\/UCD.htx"},{"key":"e_1_2_1_6_1","volume-title":"ACM OSDI","year":"2004","unstructured":"{fr6} \"MapReduce : Simplified Data Processing on Large Clusters,\" J. Dean, S. Ghemawat , ACM OSDI , Dec. 2004 . {fr6} \"MapReduce: Simplified Data Processing on Large Clusters,\" J. Dean, S. Ghemawat, ACM OSDI, Dec. 2004."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/129888.129894"},{"key":"e_1_2_1_8_1","volume-title":"Database Systems Meet the Grid,\" M. Nieto Santisteban et. al., CIDR","year":"2005","unstructured":"{fr8} \"When Database Systems Meet the Grid,\" M. Nieto Santisteban et. al., CIDR , 2005 , http:\/\/www-db.cs.wisc.edu\/cidr\/papers\/P13.pdf {fr8} \"When Database Systems Meet the Grid,\" M. Nieto Santisteban et. al., CIDR, 2005, http:\/\/www-db.cs.wisc.edu\/cidr\/papers\/P13.pdf"},{"key":"e_1_2_1_9_1","unstructured":"{fr9} \"Batch is back: CasJobs serving multi-TB data on the Web \" W. O'Mullane et. al in preparation.  {fr9} \"Batch is back: CasJobs serving multi-TB data on the Web \" W. O'Mullane et. al in preparation."},{"key":"e_1_2_1_10_1","volume-title":"CIDR","author":"Becla J.","year":"2005","unstructured":"{fr10} \"Lessons Learned from Managing a Petabyte,\" J. Becla and D. L. Wang , CIDR , 2005 , http:\/\/www-db.cs.wisc.edu\/cidr\/papers\/P06.pdf {fr10} \"Lessons Learned from Managing a Petabyte,\" J. Becla and D. L. Wang, CIDR, 2005, http:\/\/www-db.cs.wisc.edu\/cidr\/papers\/P06.pdf"},{"key":"e_1_2_1_11_1","volume-title":"VLDB","author":"Liu D. T.","year":"2004","unstructured":"{fr11} D. T. Liu and M. J. Franklin , VLDB , 2004 , www.cs.berkeley.edu\/~dtliu\/pubs\/griddb_vldb04. pdf {fr11} D. T. Liu and M. J. Franklin, VLDB, 2004, www.cs.berkeley.edu\/~dtliu\/pubs\/griddb_vldb04. pdf"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/DCS.1988.12507"},{"key":"e_1_2_1_13_1","author":"Foster I.","year":"1997","unstructured":"{fr13} I. Foster and C. Kesselman , Globus: A Metacomputing Infrastructure Toolkit, Journal of Supercomputer Applications and High Performance Computing , 1997 . {fr13} I. Foster and C. Kesselman, Globus: A Metacomputing Infrastructure Toolkit, Journal of Supercomputer Applications and High Performance Computing, 1997.","journal-title":"Globus: A Metacomputing Infrastructure Toolkit, Journal of Supercomputer Applications and High Performance Computing"}],"container-title":["ACM SIGMOD Record"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1107499.1107503","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1107499.1107503","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T12:08:26Z","timestamp":1750248506000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1107499.1107503"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2005,12]]},"references-count":13,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2005,12]]}},"alternative-id":["10.1145\/1107499.1107503"],"URL":"https:\/\/doi.org\/10.1145\/1107499.1107503","relation":{},"ISSN":["0163-5808"],"issn-type":[{"value":"0163-5808","type":"print"}],"subject":[],"published":{"date-parts":[[2005,12]]},"assertion":[{"value":"2005-12-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}