{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T13:00:45Z","timestamp":1781614845656,"version":"3.54.5"},"reference-count":34,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,10,25]],"date-time":"2021-10-25T00:00:00Z","timestamp":1635120000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-sa\/4.0\/"}],"funder":[{"DOI":"10.13039\/100017223","name":"NERSC","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100017223","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000015","name":"U.S. Department of Energy","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100006132","name":"Office of Science","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100006132","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Office of Advanced Scientific Computing Research","award":["DE-AC02-05CH11231"],"award-info":[{"award-number":["DE-AC02-05CH11231"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Storage"],"published-print":{"date-parts":[[2021,11,30]]},"abstract":"<jats:p>\n            Scientific workflows in\n            <jats:bold>High Performance Computing<\/jats:bold>\n            (\n            <jats:bold>HPC<\/jats:bold>\n            ) environments are processing large amounts of data. The storage hierarchy on HPC systems is getting deeper, driven by new technologies (NVRAMs, SSDs, etc.) There is a need for new programming abstractions that allow users to seamlessly manage data at the workflow level on multi-tiered storage systems, and provide optimal workflow performance and use of storage resources. In previous work, we introduced a software architecture\n            <jats:bold>Managing Data on Tiered Storage for Scientific Workflows<\/jats:bold>\n            <jats:bold>(MaDaTS<\/jats:bold>\n            ) that used a\n            <jats:bold>Virtual Data Space<\/jats:bold>\n            (\n            <jats:bold>VDS<\/jats:bold>\n            ) abstraction to hide the complexities of the underlying storage system while allowing users to control data management strategies. In this article, we detail the data-centric programming abstractions that allow users to manage a workflow around its data on the storage layer. The programming abstractions simplify data management for scientific workflows on multi-tiered storage systems, without affecting workflow performance or storage capacity. We measure the overheads and effectiveness introduced by the programming abstractions of MaDaTS. Our results show that these abstractions can optimally use the storage capacity in lesser capacity storage tiers, and simplify data management without adding any performance overheads.\n          <\/jats:p>","DOI":"10.1145\/3457119","type":"journal-article","created":{"date-parts":[[2021,10,25]],"date-time":"2021-10-25T21:19:08Z","timestamp":1635196748000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Programming Abstractions for Managing Workflows on Tiered Storage Systems"],"prefix":"10.1145","volume":"17","author":[{"given":"Devarshi","family":"Ghoshal","sequence":"first","affiliation":[{"name":"Lawrence Berkeley National Laboratory, Berkeley, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lavanya","family":"Ramakrishnan","sequence":"additional","affiliation":[{"name":"Lawrence Berkeley National Laboratory, Berkeley, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,10,25]]},"reference":[{"key":"e_1_3_1_2_2","unstructured":"2013. Titan. Retrieved on October 7 2021 from https:\/\/www.olcf.ornl.gov\/olcf-resources\/compute-systems\/titan\/."},{"key":"e_1_3_1_3_2","unstructured":"2015. Alluxio. Retrieved on October 7 2021 from http:\/\/www.alluxio.org\/."},{"key":"e_1_3_1_4_2","unstructured":"2015. North Carolina Floodplain Mapping Program. Retrieved on October 7 2021 from http:\/\/www.ncfloodmaps.com\/."},{"key":"e_1_3_1_5_2","unstructured":"2016. Cori. Retrieved on October 7 2021 from http:\/\/www.nersc.gov\/users\/computational-systems\/cori\/."},{"key":"e_1_3_1_6_2","unstructured":"2018. Count Lines of Code. Retrieved on October 7 2021 from https:\/\/github.com\/AlDanial\/cloc."},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/EDOCW.2006.7"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/NAS.2016.7549390"},{"key":"e_1_3_1_9_2","volume-title":"11th Workshop on Workflows in Support of Large-Scale Science","author":"Daley Christopher","year":"2016","unstructured":"Christopher Daley, Devarshi Ghoshal, Glenn Lockwood, Sudip Dosanjh, Lavanya Ramakrishnan, and Nicholas Wright. 2016. Performance characterization of scientific workflows for the optimal use of burst buffers. In 11th Workshop on Workflows in Support of Large-Scale Science (WORKS\u201916)."},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1155\/2005\/128026"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10586-011-0162-y"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2009.04.002"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/SSDM.2002.1029704"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/1107499.1107502"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3078597.3078611"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/CCGrid.2016.54"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/2907294.2907316"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.5555\/2865652.2865927"},{"key":"e_1_3_1_19_2","article-title":"Adaptive IO system (adios)","author":"Jin Chen","year":"2008","unstructured":"Chen Jin, Scott Klasky, Stephen Hodson, Weikuan Yu, Jay Lofstead, Hasan Abbasi, Karsten Schwan, Matthew Wolf, W Liao, Alok Choudhary, et\u00a0al. 2008. Adaptive IO system (adios). Cray User\u2019s Group.","journal-title":"Cray User\u2019s Group"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.5555\/1316689.1316742"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSST.2012.6232369"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/PADSW.2014.7097831"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2012.279"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCS.2011.33"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/2912152.2912157"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2019.00061"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/2807591.2807622"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.5555\/2655383"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/CCGrid.2012.109"},{"key":"e_1_3_1_30_2","article-title":"Development of a burst buffer system for data-intensive applications","author":"Wang Teng","year":"2015","unstructured":"Teng Wang, Sarp Oral, Michael Pritchard, Kevin Vasko, and Weikuan Yu. 2015. Development of a burst buffer system for data-intensive applications. CoRR.","journal-title":"CoRR"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.parco.2011.05.005"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.5555\/2228298.2228301"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSST.2010.5496999"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/1362622.1362696"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2013.46"}],"container-title":["ACM Transactions on Storage"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3457119","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3457119","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3457119","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:18Z","timestamp":1750191438000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3457119"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,25]]},"references-count":34,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,11,30]]}},"alternative-id":["10.1145\/3457119"],"URL":"https:\/\/doi.org\/10.1145\/3457119","relation":{},"ISSN":["1553-3077","1553-3093"],"issn-type":[{"value":"1553-3077","type":"print"},{"value":"1553-3093","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,25]]},"assertion":[{"value":"2020-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-10-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}