{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T22:52:54Z","timestamp":1777675974684,"version":"3.51.4"},"reference-count":57,"publisher":"SAGE Publications","issue":"3","license":[{"start":{"date-parts":[[2022,3,26]],"date-time":"2022-03-26T00:00:00Z","timestamp":1648252800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of High Performance Computing Applications"],"published-print":{"date-parts":[[2022,5]]},"abstract":"<jats:p>\n                    High performance computing (HPC) workflows are undergoing tumultuous changes, including an explosion in size and complexity. Despite these changes, most batch job systems still use slow, centralized schedulers. Generalized hierarchical scheduling (GHS) solves many of the challenges that face modern workflows, but GHS has not been widely adopted in HPC. A major difficulty that hinders adoption is the lack of a performance model to aid in configuring GHS for optimal performance on a given application. We propose an analytical performance model of GHS, and we validate our proposed model with four different applications on a moderately-sized system. Our validation shows that our model is extremely accurate at predicting the performance of GHS, explaining 98.7% of the variance (i.e., an R\n                    <jats:sup>2<\/jats:sup>\n                    statistic of 0.987). Our results also support the claim that GHS overcomes scheduling throughput problems; we measured throughput improvements of up to 270\u00d7 on our moderately-sized system. We then apply our performance model to a pre-exascale system, where our model predicts throughput improvements of four orders of magnitude and provides insight into optimally configuring GHS on next generation systems.\n                  <\/jats:p>","DOI":"10.1177\/10943420211051039","type":"journal-article","created":{"date-parts":[[2022,3,26]],"date-time":"2022-03-26T03:28:52Z","timestamp":1648265332000},"page":"289-306","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":3,"title":["An analytical performance model of generalized hierarchical scheduling"],"prefix":"10.1177","volume":"36","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0141-0653","authenticated-orcid":false,"given":"Stephen","family":"Herbein","sequence":"first","affiliation":[{"name":"Lawrence Livermore National Laboratory, Livermore, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tapasya","family":"Patki","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratory, Livermore, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dong H","family":"Ahn","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratory, Livermore, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sebastian","family":"Mobo","sequence":"additional","affiliation":[{"name":"University of Tennessee, Knoxville, TN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Clark","family":"Hathaway","sequence":"additional","affiliation":[{"name":"University of Tennessee, Knoxville, TN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Silvina","family":"Ca\u00edno-Lores","sequence":"additional","affiliation":[{"name":"University of Tennessee, Knoxville, TN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James","family":"Corbett","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratory, Livermore, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Domyancic","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratory, Livermore, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7234-5743","authenticated-orcid":false,"given":"Thomas RW","family":"Scogland","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratory, Livermore, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bronis R","family":"de Supinski","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratory, Livermore, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michela","family":"Taufer","sequence":"additional","affiliation":[{"name":"University of Tennessee, Knoxville, TN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2022,3,26]]},"reference":[{"key":"bibr1-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2020.04.006"},{"key":"bibr2-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1145\/3307681.3325400"},{"key":"bibr3-10943420211051039","volume-title":"SLURM and Moab","author":"Barney B","year":"2017"},{"key":"bibr4-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-47954-6_9"},{"key":"bibr5-10943420211051039","unstructured":"Computational data analysis workflow systems (2020). https:\/\/github.com\/common-workflow-language\/common-workflow-language\/wiki\/Existing-Workflow-systems (Retrieved April 19, 2020)."},{"key":"bibr6-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpdc.2004.05.001"},{"key":"bibr7-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1145\/173284.155333"},{"key":"bibr8-10943420211051039","unstructured":"Dahlgren TL, Domyancic D, Brandon S, et al. (2015) Poster: scaling uncertainty quantification studies to millions of jobs. In: Proceedings of the 27th ACM\/IEEE International Conference for High Performance Computing and Communications Conference (SC), Austin, TX, 15\u201320 November 2015"},{"key":"bibr9-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2014.10.008"},{"key":"bibr10-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1145\/3295500.3356197"},{"key":"bibr11-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1137\/120864672"},{"key":"bibr12-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-61756-5_10"},{"key":"bibr13-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2012.11"},{"key":"bibr14-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1016\/0743-7315(90)90042-N"},{"key":"bibr15-10943420211051039","unstructured":"Eleliemy A, Ciorba FM (2021) A resourceful coordination approach for multilevel scheduling. CoRR abs\/2103.05809. Available at: https:\/\/arxiv.org\/abs\/2103.05809."},{"key":"bibr16-10943420211051039","first-page":"364","volume":"2011","author":"Eriksson H","year":"2011","journal-title":"AMIA Annual Symposium Proceedings"},{"key":"bibr17-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1177\/109434209701100205"},{"key":"bibr18-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1145\/2464996.2465020"},{"key":"bibr19-10943420211051039","volume-title":"Thermodynamic Modeling of Uncertainties in NIF ICF Implosions Due to Underlying Microphysics Models","author":"Gaffney J","year":"2014"},{"key":"bibr20-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1016\/j.parco.2012.09.003"},{"key":"bibr21-10943420211051039","volume-title":"Efficiently Bootstrapping Extreme Scale Software Systems","author":"Goehner JD","year":"2011"},{"key":"bibr22-10943420211051039","unstructured":"Gyllenhaal J, Gamblin T, Bertsch A, et al. (2014) Enabling high job throughput for uncertainty quantification on BG\/Q. In: IBM HPC Systems Scientific Computing User Group (ScicomP), Chicago, IL, 27\u201330 May 2014"},{"key":"bibr23-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1109\/IGCC.2013.6604507"},{"key":"bibr24-10943420211051039","unstructured":"Hindman B, Konwinski A, Zaharia M, et al. (2011) Mesos: a platform for fine-grained resource sharing in the data center. In: Proceedings of the 8th USENIX Conference on Networked Systems Design and Implementation (NSDI), Boston, MA, 1 April 2011."},{"key":"bibr25-10943420211051039","volume-title":"Moab Scheduling Tweak Tightens Titan\u2019s Workload","author":"Hines J","year":"2015"},{"key":"bibr26-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1145\/7531.7535"},{"key":"bibr27-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1109\/TPS.2019.2955098"},{"key":"bibr28-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1016\/j.parco.2013.09.009"},{"key":"bibr29-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1109\/PMBS.2018.8641556"},{"key":"bibr30-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-43222-5_19"},{"key":"bibr31-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1145\/344588.344618"},{"key":"bibr32-10943420211051039","volume-title":"High-Order Lagrangian Hydrodynamics Miniapp","author":"Laghos","year":"2021"},{"key":"bibr33-10943420211051039","first-page":"358","volume-title":"Proceedings. 1998 International Conference on Parallel Architectures and Compilation Techniques","author":"Liou J-C","year":"1998"},{"key":"bibr34-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1109\/71.674322"},{"key":"bibr35-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2018.2793886"},{"key":"bibr36-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23400-2_10"},{"key":"bibr37-10943420211051039","volume-title":"Stream: Sustainable Memory Bandwidth in High-Performance Computers","author":"McCalpin JD","year":"1995"},{"key":"bibr38-10943420211051039","doi-asserted-by":"crossref","unstructured":"Merzky A, Turilli M, Maldonado M, et al. (2018) Using pilot systems to execute many task workloads on supercomputers. arXiv e-prints : arXiv:1512.08194.","DOI":"10.1007\/978-3-030-10632-4_4"},{"key":"bibr39-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1109\/71.932715"},{"key":"bibr40-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1038\/nature02771"},{"key":"bibr41-10943420211051039","unstructured":"OLCF policy guide (2019). https:\/\/www.olcf.ornl.gov\/for-users\/olcf-policy-guide\/(Retrieved29 January 2019)."},{"key":"bibr42-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1109\/ICPP.1996.537159"},{"key":"bibr43-10943420211051039","unstructured":"Peterson JL, Anirudh R, Athey K, et al. (2019) Merlin: enabling machine learning-ready HPC ensembles. arXiv e-prints : arXiv:1912.02892."},{"key":"bibr44-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1002\/jcc.20289"},{"key":"bibr45-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1109\/CCGRID.2018.00031"},{"key":"bibr46-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-77398-8_9"},{"key":"bibr47-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1145\/321921.321934"},{"key":"bibr48-10943420211051039","unstructured":"Schwarzkopf M, Konwinski A, Abd-El-Malek M, et al. (2013) Omega: flexible, scalable schedulers for large compute clusters. In: SIGOPS European Conference on Computer Systems (EuroSys), Prague, Czech Republic, 15\u201317 April 2013. pp, 351\u2013364. Available at: http:\/\/eurosys2013.tudos.org\/wp-content\/uploads\/2013\/paper\/Schwarzkopf.pdf."},{"key":"bibr49-10943420211051039","unstructured":"Sierra (2018). https:\/\/hpc.llnl.gov\/hardware\/platforms\/sierra (Retrieved July 30, 2018)."},{"key":"bibr50-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-72971-8_10"},{"key":"bibr51-10943420211051039","unstructured":"Summit (2018). https:\/\/www.olcf.ornl.gov\/summit\/(Retrieved July 30, 2018)."},{"key":"bibr52-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1109\/71.308533"},{"key":"bibr53-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1145\/2523616.2523633"},{"key":"bibr54-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1145\/2749246.2749249"},{"key":"bibr55-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1137\/0221021"},{"key":"bibr56-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2019.05.020"},{"key":"bibr57-10943420211051039","doi-asserted-by":"publisher","DOI":"10.1109\/ICPADS.2016.0040"}],"container-title":["The International Journal of High Performance Computing Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420211051039","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/10943420211051039","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420211051039","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T08:17:17Z","timestamp":1777450637000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/10943420211051039"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,26]]},"references-count":57,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2022,5]]}},"alternative-id":["10.1177\/10943420211051039"],"URL":"https:\/\/doi.org\/10.1177\/10943420211051039","relation":{},"ISSN":["1094-3420","1741-2846"],"issn-type":[{"value":"1094-3420","type":"print"},{"value":"1741-2846","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,26]]}}}