{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:38:31Z","timestamp":1750307911001,"version":"3.41.0"},"reference-count":17,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2007,1,1]],"date-time":"2007-01-01T00:00:00Z","timestamp":1167609600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGOPS Oper. Syst. Rev."],"published-print":{"date-parts":[[2007,1]]},"abstract":"<jats:p>\n            It has become a national priority to build and use PetaFlop supercomputers. The dependability of such large systems has been recognized as a key issue that can impact their usability. Even with smaller, existing machines, failures are the norm rather than an exception. Research has shown that storage systems are the primary source of faults leading to supercomputer unavailability. In this paper, we envision two mechanisms, namely\n            <jats:italic>on-demand data reconstruction<\/jats:italic>\n            and\n            <jats:italic>eager data offloading<\/jats:italic>\n            , to address the availability of job input\/output data. These two techniques aim to allow parallel jobs and post-job processing tools to continue execution despite storage system failures in supercomputers. Fundamental to both approaches is the definition and acquisition of recovery-related parallel file system metadata, which is then coupled with transparent remote data accesses. Our approach attempts to maximize the utilization of precious supercomputer resources by improving the accessibility of\n            <jats:italic>transient<\/jats:italic>\n            job data. Further, the proposed methods are best-effort in nature and complement existing file system recovery schemes, which are designed for persistent data. Several of our previous studies help in demonstrating the feasibility of the proposed approaches.\n          <\/jats:p>","DOI":"10.1145\/1228291.1228297","type":"journal-article","created":{"date-parts":[[2007,4,5]],"date-time":"2007-04-05T19:52:18Z","timestamp":1175802738000},"page":"14-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Recovering transient data"],"prefix":"10.1145","volume":"41","author":[{"given":"Sudharshan","family":"Vazhkudai","sequence":"first","affiliation":[{"name":"Oak Ridge National Laboratory"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaosong","family":"Ma","sequence":"additional","affiliation":[{"name":"North Carolina State University and Oak Ridge National Laboratory"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2007,1]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"http:\/\/pr.caltech.edu\/media\/Press_Releases\/PR12465.html","author":"SLAC","year":"2003","unstructured":"Caltech SLAC and LANL set new network performance marks. http:\/\/pr.caltech.edu\/media\/Press_Releases\/PR12465.html , 2003 . Caltech SLAC and LANL set new network performance marks. http:\/\/pr.caltech.edu\/media\/Press_Releases\/PR12465.html, 2003."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2005.72"},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the 4th Annual Linux Showcase and Conference","author":"Carns P.","year":"2000","unstructured":"P. Carns , W. Ligon III, R. Ross , and R. Thakur . PVFS: A Parallel File System For Linux Clusters . In Proceedings of the 4th Annual Linux Showcase and Conference , 2000 . P. Carns, W. Ligon III, R. Ross, and R. Thakur. PVFS: A Parallel File System For Linux Clusters. In Proceedings of the 4th Annual Linux Showcase and Conference, 2000."},{"key":"e_1_2_1_4_1","unstructured":"Cluster File Systems Inc. Lustre: A scalable high-performance file system. http:\/\/www.lustre.org\/docs\/whitepaper.pdf 2002.  Cluster File Systems Inc. Lustre: A scalable high-performance file system. http:\/\/www.lustre.org\/docs\/whitepaper.pdf 2002."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/378993.379239"},{"issue":"2","key":"e_1_2_1_6_1","volume":"11","author":"Foster I.","year":"1997","unstructured":"I. Foster and C. Kesselman . Globus: A metacomputing infrastructure toolkit. The International Journal of Supercomputer Applications and High Performance Computing , 11 ( 2 ), 1997 . I. Foster and C. Kesselman. Globus: A metacomputing infrastructure toolkit. The International Journal of Supercomputer Applications and High Performance Computing, 11(2), 1997.","journal-title":"Globus: A metacomputing infrastructure toolkit. The International Journal of Supercomputer Applications and High Performance Computing"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/874077.876491"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/945445.945450"},{"key":"e_1_2_1_9_1","unstructured":"J. Gray. Greetings from a file system user. http:\/\/research.microsoft.com\/~Gray\/talks\/Fast_2005.ppt 2005.  J. Gray. Greetings from a file system user. http:\/\/research.microsoft.com\/~Gray\/talks\/Fast_2005.ppt 2005."},{"key":"e_1_2_1_10_1","volume-title":"The Grid 2: Blueprint for a New Computing Infrastructure","author":"Gray J.","year":"2003","unstructured":"J. Gray and A. Szalay . Scientific data federation . In I. Foster and C. Kesselman, editors, The Grid 2: Blueprint for a New Computing Infrastructure , 2003 . J. Gray and A. Szalay. Scientific data federation. In I. Foster and C. Kesselman, editors, The Grid 2: Blueprint for a New Computing Infrastructure, 2003."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2005.3"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/514191.514215"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1183401.1183435"},{"key":"e_1_2_1_14_1","volume-title":"Algorithms for high performance, wide-area distributed file downloads. Parallel Processing Letters, 13(2)","author":"Plank J.","year":"2003","unstructured":"J. Plank , S. Atchley , Y. Ding , and M. Beck . Algorithms for high performance, wide-area distributed file downloads. Parallel Processing Letters, 13(2) , 2003 . J. Plank, S. Atchley, Y. Ding, and M. Beck. Algorithms for high performance, wide-area distributed file downloads. Parallel Processing Letters, 13(2), 2003."},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the Network Storage Symposium","author":"Plank J.","year":"1999","unstructured":"J. Plank , M. Beck , W. Elwasif , T. Moore , M. Swany , and R. Wolski . The Internet Backplane Protocol: Storage in the network . In Proceedings of the Network Storage Symposium , 1999 . J. Plank, M. Beck, W. Elwasif, T. Moore, M. Swany, and R. Wolski. The Internet Backplane Protocol: Storage in the network. In Proceedings of the Network Storage Symposium, 1999."},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the First Conference on File and Storage Technologies","author":"Schmuck F.","year":"2002","unstructured":"F. Schmuck and R. Haskin . GPFS: a shared-disk file system for large computing clusters . In Proceedings of the First Conference on File and Storage Technologies , 2002 . F. Schmuck and R. Haskin. GPFS: a shared-disk file system for large computing clusters. In Proceedings of the First Conference on File and Storage Technologies, 2002."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2005.27"}],"container-title":["ACM SIGOPS Operating Systems Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1228291.1228297","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1228291.1228297","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T14:47:51Z","timestamp":1750258071000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1228291.1228297"}},"subtitle":["automated on-demand data reconstruction and offloading for supercomputers"],"short-title":[],"issued":{"date-parts":[[2007,1]]},"references-count":17,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2007,1]]}},"alternative-id":["10.1145\/1228291.1228297"],"URL":"https:\/\/doi.org\/10.1145\/1228291.1228297","relation":{},"ISSN":["0163-5980"],"issn-type":[{"type":"print","value":"0163-5980"}],"subject":[],"published":{"date-parts":[[2007,1]]},"assertion":[{"value":"2007-01-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}