{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T22:54:48Z","timestamp":1777676088864,"version":"3.51.4"},"reference-count":49,"publisher":"SAGE Publications","issue":"6","license":[{"start":{"date-parts":[[2025,9,9]],"date-time":"2025-09-09T00:00:00Z","timestamp":1757376000000},"content-version":"vor","delay-in-days":365,"URL":"http:\/\/www.sagepub.com\/licence-information-for-chorus"}],"funder":[{"name":"Exascale Computing Project","award":["17-SC-20-S"],"award-info":[{"award-number":["17-SC-20-S"]}]},{"DOI":"10.13039\/100006132","name":"U.S. Department of Energy Office of Science","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100006132","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100006168","name":"National Nuclear Security Administration","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100006168","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of High Performance Computing Applications"],"published-print":{"date-parts":[[2024,11]]},"abstract":"<jats:p>Many extreme-scale applications require the movement of large quantities of data to, from, and among leadership computing facilities, as well as other scientific facilities and the home institutions of facility users. These applications, particularly when leadership computing facilities are involved, can touch upon edge cases (e.g., terabyte files) that had not been a focus of previous Globus optimization work, which had emphasized rather the movement of many smaller (megabyte to gigabyte) files. We report here on how automated client-driven chunking can be used to accelerate both the movement of large files and the integrity checking operations that have proven to be essential for large data transfers. We present detailed performance studies that provide insights into the benefits of these modifications in a range of file transfer scenarios.<\/jats:p>","DOI":"10.1177\/10943420241281744","type":"journal-article","created":{"date-parts":[[2024,9,10]],"date-time":"2024-09-10T09:26:00Z","timestamp":1725960360000},"page":"658-670","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":3,"title":["Globus service enhancements for exascale applications and facilities"],"prefix":"10.1177","volume":"38","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2791-0031","authenticated-orcid":false,"given":"Weijian","family":"Zheng","sequence":"first","affiliation":[{"name":"Data Science and Learning Division, Argonne National Laboratory, Lemont, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jack","family":"Kordas","sequence":"additional","affiliation":[{"name":"Globus, University of Chicago, Chicago, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tyler J","family":"Skluzacek","sequence":"additional","affiliation":[{"name":"National Center for Computational Sciences, Oak Ridge National Laboratory, Oak Ridge, TN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Raj","family":"Kettimuthu","sequence":"additional","affiliation":[{"name":"Data Science and Learning Division, Argonne National Laboratory, Lemont, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2129-5269","authenticated-orcid":false,"given":"Ian","family":"Foster","sequence":"additional","affiliation":[{"name":"Data Science and Learning Division, Argonne National Laboratory, Lemont, IL, USA"},{"name":"Department of Computer Science, University of Chicago, Chicago, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2024,9,9]]},"reference":[{"key":"bibr1-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1145\/2807591.2807628"},{"key":"bibr2-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1098\/rsta.2019.0056"},{"key":"bibr3-10943420241281744","volume-title":"Global Grid Forum","author":"Allcock W","year":"2003"},{"key":"bibr4-10943420241281744","first-page":"54","volume":"12","author":"Allcock W","year":"2005","journal-title":"ACM\/IEEE conference on supercomputing"},{"key":"bibr53-10943420241281744","series-title":"Protocols and services for distributed data- intensive science","first-page":"161","volume":"583","author":"Allcock W","year":"2001"},{"key":"bibr54-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1145\/3458817.3476208"},{"key":"bibr5-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2018.8622116"},{"key":"bibr6-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2018.2790948"},{"key":"bibr7-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpdc.2018.05.003"},{"key":"bibr8-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1145\/1416944.1416947"},{"key":"bibr9-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1023\/B:GRID.0000037555.53402.4f"},{"key":"bibr10-10943420241281744","doi-asserted-by":"crossref","unstructured":"Chard K, Tuecke S, Globus IF (2016) Recent enhancements and future plans. In: XSEDE16 conference on diversity, big data, and science at scale, Miami, USA, 17 July 2016, 1\u20138.","DOI":"10.1145\/2949550.2949554"},{"key":"bibr11-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2020.2966616"},{"key":"bibr12-10943420241281744","doi-asserted-by":"crossref","unstructured":"Dart E, Rotman L, Tierney B, et al. (2013) The Science DMZ: a network design pattern for data-intensive science. In: International conference on high performance computing, networking, storage and analysis, Denver, CO, USA, 17 Nov 2013, 1\u201310.","DOI":"10.1145\/2503210.2503245"},{"key":"bibr13-10943420241281744","unstructured":"Dart E, Allcock W, Bhimji W, et al. (2021a) The Petascale DTN project: high performance data transfer for HPC facilities. arXiv preprint arXiv:2105.12880."},{"key":"bibr14-10943420241281744","unstructured":"Dart E, Allcock W, Bhimji W, et al. (2021b) Petascale DTN project host network configurations and test data set. https:\/\/zenodo.org\/records\/3880669."},{"key":"bibr15-10943420241281744","doi-asserted-by":"publisher","DOI":"10.17487\/rfc3649"},{"key":"bibr16-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1109\/MIC.2011.64"},{"key":"bibr55-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1109\/HiPC.2017.00042"},{"key":"bibr17-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2006.11.009"},{"key":"bibr18-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2002.1015527"},{"key":"bibr19-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1109\/CLUSTR.2002.1137760"},{"key":"bibr20-10943420241281744","doi-asserted-by":"publisher","DOI":"10.3847\/1538-4365\/ab3724"},{"key":"bibr21-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1109\/ICBN.2005.1589763"},{"key":"bibr22-10943420241281744","doi-asserted-by":"crossref","unstructured":"Kettimuthu R, Sim A, Gunter D, et al. (2010) Lessons learned from moving Earth System Grid data sets over a 20 Gbps wide-area network. In: 19th ACM international symposium on high performance distributed computing, Chicago, Il, 21-25 June 2010, 316\u2013319.","DOI":"10.1145\/1851476.1851519"},{"key":"bibr23-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1109\/CCGrid.2014.114"},{"key":"bibr24-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1145\/2807591.2807660"},{"key":"bibr25-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2018.05.051"},{"key":"bibr26-10943420241281744","author":"Lacinski L","year":"2024","journal-title":"A case study"},{"key":"bibr27-10943420241281744","unstructured":"Leith D, Shorten R (2004) H-TCP: TCP for high-speed and long-distance networks. In: 2nd international workshop on protocols for fast long-distance networks, Argonne, Illinois, USA, 26-30 January 2004."},{"key":"bibr28-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1109\/BigData.2016.7840953"},{"key":"bibr29-10943420241281744","doi-asserted-by":"crossref","unstructured":"Liu Z, Balaprakash P, Kettimuthu R, et al. (2017) Explaining wide area data transfer performance. In: 26th international symposium on high-performance parallel and distributed computing, Washington D.C, 26 June 2017, 167\u2013178.","DOI":"10.1145\/3078597.3078605"},{"key":"bibr30-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1145\/3208040.3208053"},{"key":"bibr31-10943420241281744","doi-asserted-by":"crossref","unstructured":"Liu Z, Kettimuthu R, Foster IT, et al. (2018b) A comprehensive study of wide area data movement at a scientific computing facility. In: 38th international conference on distributed computing systems, Vienna, Austria, 2 July 2018, 1604\u20131611.","DOI":"10.1109\/ICDCS.2018.00180"},{"key":"bibr32-10943420241281744","first-page":"122","volume-title":"19th IEEE\/ACM international symposium on cluster, cloud and grid computing","author":"Liu Y","year":"2019"},{"key":"bibr33-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1109\/XLOOP54565.2021.00008"},{"key":"bibr34-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1145\/3452007"},{"key":"bibr35-10943420241281744","first-page":"10","volume-title":"19th IEEE international parallel and distributed processing symposium","author":"Lu D","year":"2005"},{"key":"bibr36-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1023\/B:GRID.0000037554.67413.52"},{"key":"bibr37-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-019-0912-1"},{"key":"bibr38-10943420241281744","first-page":"380","author":"Schwan P","year":"2003","journal-title":"Linux Symposium"},{"key":"bibr39-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2000.10040"},{"key":"bibr40-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1145\/347057.347561"},{"key":"bibr41-10943420241281744","doi-asserted-by":"crossref","unstructured":"Tierney B, Lee J, Chen LT, et al. (1994) Distributed parallel data storage systems: a scalable approach to high speed image servers. In: 2nd ACM international conference on multimedia, San Francisco California, 15 - 20 October 1994, 399\u2013405.","DOI":"10.1145\/192593.192709"},{"key":"bibr42-10943420241281744","doi-asserted-by":"publisher","DOI":"10.2172\/764335"},{"key":"bibr43-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2006.886335"},{"key":"bibr44-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1109\/SC.Companion.2012.73"},{"key":"bibr45-10943420241281744","doi-asserted-by":"publisher","DOI":"10.1109\/TCC.2015.2415804"},{"key":"bibr46-10943420241281744","first-page":"99","volume-title":"USENIX annual technical conference","author":"Zhang M","year":"2004"}],"container-title":["The International Journal of High Performance Computing Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420241281744","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/10943420241281744","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420241281744","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420241281744","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T08:17:38Z","timestamp":1777450658000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/10943420241281744"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,9]]},"references-count":49,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2024,11]]}},"alternative-id":["10.1177\/10943420241281744"],"URL":"https:\/\/doi.org\/10.1177\/10943420241281744","relation":{},"ISSN":["1094-3420","1741-2846"],"issn-type":[{"value":"1094-3420","type":"print"},{"value":"1741-2846","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,9]]}}}