{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,1,28]],"date-time":"2025-01-28T07:10:25Z","timestamp":1738048225011,"version":"3.33.0"},"reference-count":21,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2007,11,1]],"date-time":"2007-11-01T00:00:00Z","timestamp":1193875200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["The International Journal of High Performance Computing Applications"],"published-print":{"date-parts":[[2007,11]]},"abstract":"<jats:p> An accurate cost model that accounts for dataset size and structure can help optimize geoscience data analysis. We develop and apply a computational model to estimate data analysis costs for arithmetic operations on gridded datasets typical of satellite- or climate model-origin. For these dataset geometries our model predicts data reduction scalings that agree with measurements of widely used geoscience data processing software, the netCDF Operators (NCO). I\/O performance and library design dominate throughput for simple analysis (e.g. dataset differencing). Dataset structure can reduce analysis throughput ten-fold relative to same-sized unstructured datasets. We demonstrate algorithmic optimizations which substantially increase throughput for more complex, arithmetic-dominated analysis such as weighted-averaging of multi-dimensional data. These scaling properties can help to estimate costs of distribution strategies for data reduction in cluster and grid environments. <\/jats:p>","DOI":"10.1177\/1094342007083802","type":"journal-article","created":{"date-parts":[[2007,10,29]],"date-time":"2007-10-29T14:19:04Z","timestamp":1193667544000},"page":"485-498","source":"Crossref","is-referenced-by-count":6,"title":["Scaling Properties of Common Statistical Operators for Gridded Datasets"],"prefix":"10.1177","volume":"21","author":[{"given":"Charles S.","family":"Zender","sequence":"first","affiliation":[{"name":"DEPARTMENT OF EARTH SYSTEM SCIENCE, UNIVERSITY OF CALIFORNIA, IRVINE,"}]},{"given":"Harry","family":"Mangalam","sequence":"additional","affiliation":[{"name":"DEPARTMENT OF EARTH SYSTEM SCIENCE, UNIVERSITY OF CALIFORNIA, IRVINE"}]}],"member":"179","published-online":{"date-parts":[[2007,11,1]]},"reference":[{"doi-asserted-by":"publisher","key":"atypb1","DOI":"10.1177\/109434200001400303"},{"volume-title":"Proceedings of the 2nd Workshop on Middleware for Grid Computing","author":"Chen, L.","key":"atypb2"},{"doi-asserted-by":"publisher","key":"atypb3","DOI":"10.1175\/JCLI3760.1"},{"key":"atypb4","first-page":"164","volume":"2","author":"Cornillon, P.","year":"2003","journal-title":"Science Journal"},{"doi-asserted-by":"publisher","key":"atypb5","DOI":"10.1177\/1094342005056117"},{"unstructured":"Cubasch, U.\n                 and \n                    Meehl, G.\n                 (2001). Projections of future climate change, in Climate\n                    Change 2001: The Scientific Basis. Contribution of Working Group I to the Third\n                    Assessment Report of the Intergovernmental Panel on Climate Change, \n                    J. T. Houghton\n                , \n                    Y. Ding\n                , \n                    D. J. Griggs\n                , \n                    M. Noguer\n                , \n                    P. J. van der Linden\n                , \n                    X. Dai\n                , \n                    K. Maskell\n                , and \n                    C. A. Johnson\n                , editors, chapter 9, pp. 527\u2014578, \n                    Cambridge\n                , UK, and \n                    New York, NY: Cambridge Univ. Press\n                .","key":"atypb6"},{"doi-asserted-by":"publisher","key":"atypb7","DOI":"10.1177\/1094342005056094"},{"volume-title":"Proceedings of the 18th International Conference on Interactive Information and Processing Systems for Meteorology, page J3.22, January 11\u201415","author":"Fiorino, M.","key":"atypb8"},{"volume-title":"Proceedings of the 18th International Conference on Interactive Information and Processing Systems for Meteorology","author":"Foster, I.","key":"atypb9"},{"issue":"4","key":"atypb10","first-page":"4","volume":"8","author":"Gregory, J.","year":"2003","journal-title":"CLIVAR Exchanges"},{"doi-asserted-by":"publisher","key":"atypb11","DOI":"10.7551\/mitpress\/4789.001.0001"},{"doi-asserted-by":"publisher","key":"atypb12","DOI":"10.1177\/1094342005056116"},{"volume-title":"Proceedings of the 2003 ACM\/ IEEE Conference on Supercomputing","author":"Li, J.","key":"atypb13"},{"doi-asserted-by":"publisher","key":"atypb14","DOI":"10.1023\/A:1015789220266"},{"volume-title":"Grand Challenges in Environmental Sciences, National Research Council","year":"2001","author":"Nrc","key":"atypb15"},{"volume-title":"Revolutionizing Science and Engineering Through Cyber-Infrastructure","year":"2003","author":"Nsf","key":"atypb16"},{"doi-asserted-by":"publisher","key":"atypb17","DOI":"10.1109\/38.56302"},{"volume-title":"Proceedings of the 22nd AMS Conference on Interactive Information and Processing Systems for Meteorology","author":"Rew, R.","key":"atypb18"},{"volume-title":"Establishing a Petascale Collaboratory for the Geosciences: Scientific Frontiers. A Report to the Geosciences Community, University Corporation for Atmospheric Research\/JOSS","year":"2005","author":"Ucar","key":"atypb19"},{"doi-asserted-by":"publisher","key":"atypb20","DOI":"10.1177\/1094342003173002"},{"author":"Zender, C.S.","journal-title":"Analysis of self-describing gridded geoscience data with netcdf operators (NCO)","key":"atypb21"}],"container-title":["The International Journal of High Performance Computing Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1094342007083802","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1094342007083802","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,28]],"date-time":"2025-01-28T06:11:18Z","timestamp":1738044678000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1094342007083802"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2007,11]]},"references-count":21,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2007,11]]}},"alternative-id":["10.1177\/1094342007083802"],"URL":"https:\/\/doi.org\/10.1177\/1094342007083802","relation":{},"ISSN":["1094-3420","1741-2846"],"issn-type":[{"type":"print","value":"1094-3420"},{"type":"electronic","value":"1741-2846"}],"subject":[],"published":{"date-parts":[[2007,11]]}}}