{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T23:00:53Z","timestamp":1777676453554,"version":"3.51.4"},"reference-count":13,"publisher":"SAGE Publications","issue":"3","license":[{"start":{"date-parts":[[2011,8,1]],"date-time":"2011-08-01T00:00:00Z","timestamp":1312156800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of High Performance Computing Applications"],"published-print":{"date-parts":[[2011,8]]},"abstract":"<jats:p>We live in an era in which scientific discovery is increasingly driven by data exploration of massive datasets. Scientists today are envisioning diverse data analyses and computations that scale from the desktop to supercomputers, yet often have difficulty designing and constructing software architectures to accommodate the heterogeneous and often inconsistent data at scale. Moreover, scientific data and computational resource needs can vary widely over time. The needs grow as the science collaboration broadens or as additional data is accumulated; the computational demand can have large transients in response to seasonal field campaigns or new instrumentation breakthroughs. Cloud computing can offer a scalable, economic, on-demand model that is well matched to some of these evolving science needs. This paper presents two of our experiences over the last year \u2014 the Terapixel Project, using workflow, high-performance computing and non-structured query language data processing to render the largest astronomical image for the WorldWide Telescope, and MODISAzure, a science pipeline for image processing, deployed using the Azure Cloud infrastructure.<\/jats:p>","DOI":"10.1177\/1094342011414746","type":"journal-article","created":{"date-parts":[[2011,8,5]],"date-time":"2011-08-05T06:09:32Z","timestamp":1312524572000},"page":"304-316","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":15,"title":["Data-intensive science: The Terapixel and MODISAzure projects"],"prefix":"10.1177","volume":"25","author":[{"given":"Deb","family":"Agarwal","sequence":"first","affiliation":[{"name":"Lawrence Berkeley National Lab, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"You-Wei","family":"Cheah","sequence":"additional","affiliation":[{"name":"School of Informatics and Computing, Indiana University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dan","family":"Fay","sequence":"additional","affiliation":[{"name":"Microsoft Research, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jonathan","family":"Fay","sequence":"additional","affiliation":[{"name":"Microsoft Research, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dean","family":"Guo","sequence":"additional","affiliation":[{"name":"Microsoft Research, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tony","family":"Hey","sequence":"additional","affiliation":[{"name":"Microsoft Research, USA,"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marty","family":"Humphrey","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Virginia, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Keith","family":"Jackson","sequence":"additional","affiliation":[{"name":"Lawrence Berkeley National Lab, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"family":"Jie Li","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Virginia, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christophe","family":"Poulain","sequence":"additional","affiliation":[{"name":"Microsoft Research, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Youngryel","family":"Ryu","sequence":"additional","affiliation":[{"name":"Department of Organismic and Evolutionary Biology, Harvard University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Catharine","family":"van Ingen","sequence":"additional","affiliation":[{"name":"Microsoft Research, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2011,8,5]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1071\/BT07151"},{"issue":"5919","key":"atypb2","doi-asserted-by":"crossref","first-page":"1297","DOI":"10.1126\/science.1170411","volume":"323","author":"Bell G.","journal-title":"Science"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1109\/36.701076"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1086\/344941"},{"key":"atypb5","author":"Hey T.","year":"2009","journal-title":"Microsoft Research"},{"key":"atypb6","doi-asserted-by":"publisher","DOI":"10.1016\/S0034-4257(02)00096-2"},{"key":"atypb7","volume-title":"Proceedings of the European Conference on Computer Systems (EuroSys)","author":"Isard M."},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1109\/36.701075"},{"key":"atypb9","first-page":"14","volume":"29","author":"Kazhdan M.","journal-title":"ACM Trans Graphics"},{"key":"atypb10","volume-title":"Proceedings of the International Parallel & Distributed Processing Symposium","author":"Li J."},{"key":"atypb11","first-page":"9","volume":"3","author":"Ryu Y.","year":"2010","journal-title":"Fluxletter"},{"key":"atypb12","volume-title":"Proceedings of the 3rd International Conference on Cloud Computing","author":"SimmhanY."},{"key":"atypb13","volume-title":"Proceedings of the Symposium on Operating System Design and Implementation (OSDI)","author":"Yu Y."}],"container-title":["The International Journal of High Performance Computing Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1094342011414746","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1094342011414746","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T08:18:59Z","timestamp":1777450739000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1094342011414746"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,8]]},"references-count":13,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2011,8]]}},"alternative-id":["10.1177\/1094342011414746"],"URL":"https:\/\/doi.org\/10.1177\/1094342011414746","relation":{},"ISSN":["1094-3420","1741-2846"],"issn-type":[{"value":"1094-3420","type":"print"},{"value":"1741-2846","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,8]]}}}