{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T03:42:27Z","timestamp":1783568547503,"version":"3.55.0"},"reference-count":43,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2019,6,30]],"date-time":"2019-06-30T00:00:00Z","timestamp":1561852800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Parallel Comput."],"published-print":{"date-parts":[[2019,6,30]]},"abstract":"<jats:p>With the ever-growing need of data in HPC applications, the congestion at the I\/O level becomes critical in supercomputers. Architectural enhancement such as burst buffers and pre-fetching are added to machines but are not sufficient to prevent congestion. Recent online I\/O scheduling strategies have been put in place, but they add an additional congestion point and overheads in the computation of applications.<\/jats:p>\n          <jats:p>In this work, we show how to take advantage of the periodic nature of HPC applications to develop efficient periodic scheduling strategies for their I\/O transfers. Our strategy computes once during the job scheduling phase a pattern that defines the I\/O behavior for each application, after which the applications run independently, performing their I\/O at the specified times. Our strategy limits the amount of congestion at the I\/O node level and can be easily integrated into current job schedulers. We validate this model through extensive simulations and experiments on an HPC cluster by comparing it to state-of-the-art online solutions, showing that not only does our scheduler have the advantage of being de-centralized and thus overcoming the overhead of online schedulers, but also that it performs better than the other solutions, improving the application dilation up to 16% and the maximum system efficiency up to 18%.<\/jats:p>","DOI":"10.1145\/3338510","type":"journal-article","created":{"date-parts":[[2019,7,24]],"date-time":"2019-07-24T12:05:56Z","timestamp":1563969956000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["I\/O Scheduling Strategy for Periodic Applications"],"prefix":"10.1145","volume":"6","author":[{"given":"Guilllaume","family":"Aupy","sequence":"first","affiliation":[{"name":"Inria 8 University of Bordeaux, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ana","family":"Gainaru","sequence":"additional","affiliation":[{"name":"Vanderbilt University, Nashville, TN, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Valentin Le","family":"F\u00e8vre","sequence":"additional","affiliation":[{"name":"\u00c9cole Normale Sup\u00e9rieure de Lyon, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,7,23]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"{n.d.}. The Trinity project. Retrieved from http:\/\/www.lanl.gov\/projects\/trinity\/.  {n.d.}. The Trinity project. Retrieved from http:\/\/www.lanl.gov\/projects\/trinity\/."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2018.00075"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2019.00072"},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the International Workshop on Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems (PMBS\u201917)","author":"Aupy Guillaume","year":"2017","unstructured":"Guillaume Aupy , Ana Gainaru , and Valentin Le F\u00e8vre . 2017 . Periodic I\/O scheduling for supercomputers . In Proceedings of the International Workshop on Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems (PMBS\u201917) . Guillaume Aupy, Ana Gainaru, and Valentin Le F\u00e8vre. 2017. Periodic I\/O scheduling for supercomputers. In Proceedings of the International Workshop on Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems (PMBS\u201917)."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2503210.2503278"},{"key":"e_1_2_1_6_1","volume-title":"Petascale computing: Impact on future NASA missions","author":"Biswas Rupak","year":"2007","unstructured":"Rupak Biswas , M. J. Aftosmis , Cetin Kiris , and Bo-Wen Shen . 2007. Petascale computing: Impact on future NASA missions . Petascale Computing : Architectures and Algorithms ( 2007 ), 29--46. Rupak Biswas, M. J. Aftosmis, Cetin Kiris, and Bo-Wen Shen. 2007. Petascale computing: Impact on future NASA missions. Petascale Computing: Architectures and Algorithms (2007), 29--46."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1175\/1520-0493(2002)130<2917:ABSFMN>2.0.CO;2"},{"key":"e_1_2_1_8_1","volume-title":"Bryan et al","author":"Greg","year":"2013","unstructured":"Greg L. Bryan et al . 2013 . Enzo : An adaptive mesh refinement code for astrophysics. The Astrophysical Journal Supplement Series 211. Greg L. Bryan et al. 2013. Enzo: An adaptive mesh refinement code for astrophysics. The Astrophysical Journal Supplement Series 211."},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the 2008 ACM\/IEEE Conference on Supercomputing (SC\u201908)","author":"Byna S.","unstructured":"S. Byna , Y. Chen , X. Sun , R. Thakur , and W. Gropp . 2008. Parallel I\/O prefetching using MPI file caching and I\/O signatures . In Proceedings of the 2008 ACM\/IEEE Conference on Supercomputing (SC\u201908) . 1--12. S. Byna, Y. Chen, X. Sun, R. Thakur, and W. Gropp. 2008. Parallel I\/O prefetching using MPI file caching and I\/O signatures. In Proceedings of the 2008 ACM\/IEEE Conference on Supercomputing (SC\u201908). 1--12."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CLUSTR.2009.5289150"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30474-6_23"},{"key":"e_1_2_1_12_1","unstructured":"P. Colella et al. 2005. Chombo infrastructure for adaptive mesh refinement. Retrieved from https:\/\/seesar.lbl.gov\/ANAG\/chombo\/.  P. Colella et al. 2005. Chombo infrastructure for adaptive mesh refinement. Retrieved from https:\/\/seesar.lbl.gov\/ANAG\/chombo\/."},{"key":"e_1_2_1_13_1","volume-title":"A higher order estimate of the optimum checkpoint interval for restart dumps. Fut. Gen. Comput. Sci. 22, 3","author":"Daly J. T.","year":"2004","unstructured":"J. T. Daly . 2004. A higher order estimate of the optimum checkpoint interval for restart dumps. Fut. Gen. Comput. Sci. 22, 3 ( 2004 ). J. T. Daly. 2004. A higher order estimate of the optimum checkpoint interval for restart dumps. Fut. Gen. Comput. Sci. 22, 3 (2004)."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2014.27"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2014.56"},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of the International Meeting on High Performance Computing for Computational Science (VECPAR\u201912)","author":"Ethier Stephane","year":"2012","unstructured":"Stephane Ethier , Mark Adams , Jonathan Carter , and Leonid Oliker . 2012 . Petascale parallelization of the gyrokinetic toroidal code . In Proceedings of the International Meeting on High Performance Computing for Computational Science (VECPAR\u201912) . Stephane Ethier, Mark Adams, Jonathan Carter, and Leonid Oliker. 2012. Petascale parallelization of the gyrokinetic toroidal code. In Proceedings of the International Meeting on High Performance Computing for Computational Science (VECPAR\u201912)."},{"key":"e_1_2_1_17_1","unstructured":"Valentin Le F\u00e8vre. 2017. Source code. Retrieved from https:\/\/github.com\/vlefevre\/IO-scheduling-simu.  Valentin Le F\u00e8vre. 2017. Source code. Retrieved from https:\/\/github.com\/vlefevre\/IO-scheduling-simu."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2015.116"},{"key":"e_1_2_1_19_1","volume-title":"Information Theory and Reliable Communication","author":"Gallager Robert G.","unstructured":"Robert G. Gallager . 1968. Information Theory and Reliable Communication . Vol. 2 . Springer , Berlin . Robert G. Gallager. 1968. Information Theory and Reliable Communication. Vol. 2. Springer, Berlin."},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the ACM\/IEEE Conference on Supercomputing (SC\u201912)","author":"Salman","unstructured":"Salman Habib et al. 2012. The universe at extreme scale: Multi-petaflop sky simulation on the BG\/Q . In Proceedings of the ACM\/IEEE Conference on Supercomputing (SC\u201912) . IEEE Computer Society, Los Alamitos, CA, 4. Salman Habib et al. 2012. The universe at extreme scale: Multi-petaflop sky simulation on the BG\/Q. In Proceedings of the ACM\/IEEE Conference on Supercomputing (SC\u201912). IEEE Computer Society, Los Alamitos, CA, 4."},{"key":"e_1_2_1_21_1","unstructured":"Claire Hanen and Alix Munier. 1993. Cyclic Scheduling on Parallel Processors: An Overview. Citeseer.  Claire Hanen and Alix Munier. 1993. Cyclic Scheduling on Parallel Processors: An Overview. Citeseer."},{"key":"e_1_2_1_22_1","unstructured":"Bill Harrod. 2014. Big data and scientific discovery. https:\/\/www.exascale.org\/bdec\/sites\/www.exascale.org.bdec\/files\/talk4-Harrod.pdf.  Bill Harrod. 2014. Big data and scientific discovery. https:\/\/www.exascale.org\/bdec\/sites\/www.exascale.org.bdec\/files\/talk4-Harrod.pdf."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493123.2462909"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPSW.2018.00127"},{"key":"e_1_2_1_25_1","volume-title":"Storage wall for exascale supercomputing. Frontiers of Information Technology 8 Electronic Engineering 17","author":"Hu Wei","year":"2016","unstructured":"Wei Hu , Guang-ming Liu, Qiong Li , Yan-huang Jiang, and Gui-lin Cai. 2016. Storage wall for exascale supercomputing. Frontiers of Information Technology 8 Electronic Engineering 17 ( 2016 ), 1154--1175. Wei Hu, Guang-ming Liu, Qiong Li, Yan-huang Jiang, and Gui-lin Cai. 2016. Storage wall for exascale supercomputing. Frontiers of Information Technology 8 Electronic Engineering 17 (2016), 1154--1175."},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the Workshop on Exascale MPI at Supercomputing Conference.","author":"Isaila Florin","year":"2015","unstructured":"Florin Isaila and Jesus Carretero . 2015 . Making the case for data staging coordination and control for parallel applications . In Proceedings of the Workshop on Exascale MPI at Supercomputing Conference. Florin Isaila and Jesus Carretero. 2015. Making the case for data staging coordination and control for parallel applications. In Proceedings of the Workshop on Exascale MPI at Supercomputing Conference."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CCGrid.2016.24"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/eScience.2016.7870922"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2503210.2503252"},{"key":"e_1_2_1_30_1","unstructured":"Albert Lazzarini. 2003. Advanced LIGO Data 8 Computing. https:\/\/labcit.ligo.caltech.edu\/&sim;dhs\/Adv-LIGO\/review-june03\/breakouts\/Astrophysics %20Data%20Analysis%20Hardware %20Data%20Acquisition\/lazz-ldas-newer.pdf.  Albert Lazzarini. 2003. Advanced LIGO Data 8 Computing. https:\/\/labcit.ligo.caltech.edu\/&sim;dhs\/Adv-LIGO\/review-june03\/breakouts\/Astrophysics %20Data%20Analysis%20Hardware %20Data%20Acquisition\/lazz-ldas-newer.pdf."},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the MSST\/SNAPI.","author":"N. Liu","year":"2012","unstructured":"N. Liu et al. 2012 . On the role of burst buffers in leadership-class storage systems . In Proceedings of the MSST\/SNAPI. N. Liu et al. 2012. On the role of burst buffers in leadership-class storage systems. In Proceedings of the MSST\/SNAPI."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2018.00077"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2010.32"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2503210.2503238"},{"key":"e_1_2_1_35_1","series-title":"Journal of Physics: Conference Series","volume-title":"Petascale atmospheric general circulation models","author":"Nair RD","unstructured":"RD Nair and HM Tufo . 2007. Petascale atmospheric general circulation models . In Journal of Physics: Conference Series , Vol. 78 . IOP Publishing . RD Nair and HM Tufo. 2007. Petascale atmospheric general circulation models. In Journal of Physics: Conference Series, Vol. 78. IOP Publishing."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/46\/1\/004"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1254810.1254826"},{"key":"e_1_2_1_38_1","unstructured":"H. Shan and J. Shalf. 2007. Using IOR to analyze the I\/O performance for HPC platforms. Cray User Group (2007).  H. Shan and J. Shalf. 2007. Using IOR to analyze the I\/O performance for HPC platforms. Cray User Group (2007)."},{"key":"e_1_2_1_39_1","volume-title":"Proceedings of the IEEE Workload Characterization Symposium","author":"Skinner D.","year":"2005","unstructured":"D. Skinner and W. Kramer . 2005. Understanding the causes of performance variability in HPC workloads . Proceedings of the IEEE Workload Characterization Symposium ( 2005 ), 137--149. D. Skinner and W. Kramer. 2005. Understanding the causes of performance variability in HPC workloads. Proceedings of the IEEE Workload Characterization Symposium (2005), 137--149."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/MASCOTS.2017.35"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.5555\/3018058.3018066"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2012.39"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/CLUSTER.2015.45"}],"container-title":["ACM Transactions on Parallel Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3338510","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3338510","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:46Z","timestamp":1750203886000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3338510"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,30]]},"references-count":43,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,6,30]]}},"alternative-id":["10.1145\/3338510"],"URL":"https:\/\/doi.org\/10.1145\/3338510","relation":{},"ISSN":["2329-4949","2329-4957"],"issn-type":[{"value":"2329-4949","type":"print"},{"value":"2329-4957","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,6,30]]},"assertion":[{"value":"2018-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-05-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-07-23","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}