{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,2]],"date-time":"2026-07-02T23:48:11Z","timestamp":1783036091868,"version":"3.54.6"},"publisher-location":"New York, NY, USA","reference-count":62,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,11,13]],"date-time":"2021-11-13T00:00:00Z","timestamp":1636761600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,11,14]]},"DOI":"10.1145\/3458817.3476186","type":"proceedings-article","created":{"date-parts":[[2021,10,21]],"date-time":"2021-10-21T05:10:34Z","timestamp":1634793034000},"page":"1-15","source":"Crossref","is-referenced-by-count":24,"title":["Systematically inferring I\/O performance variability by examining repetitive job behavior"],"prefix":"10.1145","author":[{"given":"Emily","family":"Costa","sequence":"first","affiliation":[{"name":"Northeastern University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tirthak","family":"Patel","sequence":"additional","affiliation":[{"name":"Northeastern University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benjamin","family":"Schwaller","sequence":"additional","affiliation":[{"name":"Sandia National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jim M.","family":"Brandt","sequence":"additional","affiliation":[{"name":"Sandia National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Devesh","family":"Tiwari","sequence":"additional","affiliation":[{"name":"Northeastern University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,11,13]]},"reference":[{"key":"e_1_3_2_2_1_1","unstructured":"2018. Monitoring GPFS I\/O performance with the mmpmon command. https:\/\/www.ibm.com\/docs\/en\/spectrum-scale\/5.0.0?topic=monitoring-gpfs-io-performance-mmpmon-command  2018. Monitoring GPFS I\/O performance with the mmpmon command. https:\/\/www.ibm.com\/docs\/en\/spectrum-scale\/5.0.0?topic=monitoring-gpfs-io-performance-mmpmon-command"},{"key":"e_1_3_2_2_2_1","volume-title":"Reservation Strategies for Stochastic Jobs. In 2019 IEEE International Parallel and Distributed Processing Symposium (IPDPS). 166--175","author":"Aupy G.","year":"2019"},{"key":"e_1_3_2_2_3_1","volume-title":"HPC","author":"Bateman Keith","year":"2020"},{"key":"e_1_3_2_2_4_1","volume-title":"Proceedings of the 10th Parallel Data Storage Workshop","author":"Behzad Babak","year":"2015"},{"key":"e_1_3_2_2_5_1","volume-title":"Grafana and FUSE. In International Conference on High Performance Computing. Springer, 174--186","author":"Betke Eugen","year":"2017"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1016\/j.parco.2009.02.002","article-title":"HPC global file system performance analysis using a scientific-application derived benchmark","volume":"35","author":"Borrill Julian","year":"2009","journal-title":"Parallel Comput."},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1109\/TPDS.2009.84","article-title":"Evaluation and optimization of the robustness of dag schedules in heterogeneous environments","volume":"21","author":"Canon Louis-Claude","year":"2009","journal-title":"IEEE Transactions on Parallel and Distributed Systems"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2027066.2027068","article-title":"Understanding and improving computational science storage access through continuous characterization","volume":"7","author":"Carns Philip","year":"2011","journal-title":"ACM Transactions on Storage (TOS)"},{"key":"e_1_3_2_2_9_1","volume-title":"2009 IEEE International Conference on Cluster Computing and Workshops. IEEE, 1--10","author":"Carns Philip","year":"2009"},{"key":"e_1_3_2_2_10_1","volume-title":"2009 IEEE International Conference on Cluster Computing and Workshops. 1--10","author":"Carns P.","year":"2009"},{"key":"e_1_3_2_2_11_1","volume-title":"2020 IEEE International Conference on Cluster Computing (CLUSTER). 359--370","author":"Chien S. W. D.","year":"2020"},{"key":"e_1_3_2_2_12_1","unstructured":"Emily Costa. 2021. GoodwillComputingLab\/SC21-IO-Variability. 10.5281\/zenodo.5236852  Emily Costa. 2021. GoodwillComputingLab\/SC21-IO-Variability. 10.5281\/zenodo.5236852"},{"key":"e_1_3_2_2_13_1","volume-title":"2018 48th Annual IEEE\/IFIP International Conference on Dependable Systems and Networks (DSN). IEEE, 83--94","author":"Garg Rohan","year":"2018"},{"key":"e_1_3_2_2_14_1","volume-title":"Deborah Bard, Christopher Daley, Glenn Lockwood, Nicholas J Wright, and Lavanya Ramakrishnan.","author":"Ghoshal Devarshi","year":"2020"},{"key":"e_1_3_2_2_15_1","volume-title":"PIOM-PX: A Framework for Modeling the I\/O Behavior of Parallel Scientific Applications","author":"Gomez-Sanchez Pilar"},{"key":"e_1_3_2_2_16_1","volume-title":"Proceedings of the 22nd international symposium on High-Performance Parallel and Distributed Computing. 25--36","author":"He Jun","year":"2013"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"crossref","first-page":"631","DOI":"10.1109\/TC.2018.2881709","article-title":"Can i\/o variability be reduced on qos-less hpc storage systems","volume":"68","author":"Huang Dan","year":"2018","journal-title":"IEEE Trans. Comput."},{"key":"e_1_3_2_2_18_1","volume-title":"2020 SC20: International Conference for High Performance Computing, Networking, Storage and Analysis (SC). IEEE Computer Society","author":"Isakov M.","year":"2020"},{"key":"e_1_3_2_2_19_1","volume-title":"Proceedings of the 29th International Symposium on High-Performance Parallel and Distributed Computing","author":"Kim Sunggon","year":"2020"},{"key":"e_1_3_2_2_20_1","volume-title":"Proceedings of the 29th International Symposium on High-Performance Parallel and Distributed Computing. 77--88","author":"Kim Sunggon","year":"2020"},{"key":"e_1_3_2_2_21_1","volume-title":"2010 5th Petascale Data Storage Workshop (PDSW '10)","author":"Kim Y.","year":"2010"},{"key":"e_1_3_2_2_22_1","volume-title":"Scott Biersdorff, Kai Diethelm, Dominic Eschweiler, Markus Geimer, Michael Gerndt, Daniel Lorenz, Allen Malony, et al.","author":"Kn\u00fcpfer Andreas","year":"2012"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.jpdc.2020.10.007","article-title":"An empirical study of I\/O separation for burst buffers in HPC systems","volume":"148","author":"Koo Donghun","year":"2021","journal-title":"J. Parallel and Distrib. Comput."},{"key":"e_1_3_2_2_24_1","volume-title":"International Supercomputing Conference. Springer, 245--260","author":"Kunkel Julian M","year":"2014"},{"key":"e_1_3_2_2_25_1","volume-title":"2017 International Conference on Networking, Architecture, and Storage (NAS). IEEE, 1--10","author":"Liu Wei","year":"2017"},{"key":"e_1_3_2_2_26_1","volume-title":"SC18: International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, 931--943","author":"Lockwood Glenn K","year":"2018"},{"key":"e_1_3_2_2_27_1","volume-title":"TOKIO on ClusterStor: connecting standard tools to enable holistic I\/O performance analysis","author":"Lockwood Glenn K"},{"key":"e_1_3_2_2_28_1","volume-title":"Proceedings of the 2nd Joint International Workshop on Parallel Data Storage & Data Intensive Scalable Computing Systems. 55--60","author":"Lockwood Glenn K","year":"2017"},{"key":"e_1_3_2_2_29_1","volume-title":"18th {USENIX} Conference on File and Storage Technologies ({FAST} 20). 151--167.","author":"Lu Sidi"},{"key":"e_1_3_2_2_30_1","volume-title":"2018 IEEE\/ACM 3rd International Workshop on Parallel Data Storage & Data Intensive Scalable Computing Systems (PDSW-DISCS). IEEE, 64--75","author":"L\u00fcttgau Jakob","year":"2018"},{"key":"e_1_3_2_2_31_1","volume-title":"2018 IEEE\/ACM 3rd International Workshop on Parallel Data Storage Data Intensive Scalable Computing Systems (PDSW-DISCS). 64--75","author":"L\u00fcttgau J.","year":"2018"},{"key":"e_1_3_2_2_32_1","volume-title":"2017 International Conference on Networking, Architecture, and Storage (NAS). IEEE, 1--10","author":"Madireddy Sandeep","year":"2017"},{"key":"e_1_3_2_2_33_1","volume-title":"Dolores Rexachs del Rosario, and Emilio Luque Fad\u00f3n","author":"M\u00e9ndez HuangSandra","year":"2012"},{"key":"e_1_3_2_2_34_1","volume-title":"2012 IEEE International Conference on Cluster Computing Workshops. IEEE, 7--15","author":"M\u00e9ndez Sandra","year":"2012"},{"key":"e_1_3_2_2_35_1","volume-title":"A study of the comparability of external criteria for hierarchical cluster analysis. Multivariate behavioral research 21, 4","author":"Milligan Glenn W","year":"1986"},{"key":"e_1_3_2_2_36_1","volume-title":"2019 27th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP). IEEE, 291--298","author":"Oden Lena","year":"2019"},{"key":"e_1_3_2_2_37_1","volume-title":"Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. 1--13","author":"Patel Tirthak","year":"2019"},{"key":"e_1_3_2_2_38_1","volume-title":"18th {USENIX} Conference on File and Storage Technologies ({FAST} 20). 91--101.","author":"Patel Tirthak"},{"key":"e_1_3_2_2_39_1","volume-title":"18th {USENIX} Conference on File and Storage Technologies ({FAST} 20). 103--119.","author":"Patel Tirthak"},{"key":"e_1_3_2_2_40_1","volume-title":"SC20: International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, 1--17","author":"Patel Tirthak","year":"2020"},{"key":"e_1_3_2_2_41_1","volume-title":"2019 31st International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD). 33--40","author":"Pavan P. J.","year":"2019"},{"key":"e_1_3_2_2_42_1","unstructured":"SC PDSW-DISC. [n.d.]. Toward Understanding I\/O Behavior in HPC Workflows. ([n.d.]).  SC PDSW-DISC. [n.d.]. Toward Understanding I\/O Behavior in HPC Workflows. ([n.d.])."},{"key":"e_1_3_2_2_43_1","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa F.","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_2_44_1","volume-title":"Towards scalable deep learning via I\/O analysis and optimization. In 2017 IEEE 19th International Conference on High Performance Computing and Communications","author":"Pumma Sarunya"},{"key":"e_1_3_2_2_45_1","volume-title":"IEEE International. 2005 Proceedings of the IEEE Workload Characterization Symposium","author":"Skinner David","year":"2005"},{"key":"e_1_3_2_2_46_1","unstructured":"Michael Steinbach George Karypis and Vipin Kumar. 2000. A comparison of document clustering techniques. (2000).  Michael Steinbach George Karypis and Vipin Kumar. 2000. A comparison of document clustering techniques. (2000)."},{"key":"e_1_3_2_2_47_1","volume-title":"Usage Pattern-Driven Dynamic Data Layout Reorganization. In 2016 16th IEEE\/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid). 356--365","author":"Tang H.","year":"2016"},{"key":"e_1_3_2_2_48_1","volume-title":"2017 IEEE 25th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS). IEEE, 87--98","author":"Tang Kun","year":"2017"},{"key":"e_1_3_2_2_49_1","volume-title":"Coskun","author":"Tuncer Ozan","year":"2017"},{"key":"e_1_3_2_2_50_1","volume-title":"Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. 1--12","author":"Vazhkudai Sudharshan S","year":"2017"},{"key":"e_1_3_2_2_51_1","volume-title":"Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. 1--12","author":"Wan Lipeng","year":"2015"},{"key":"e_1_3_2_2_52_1","volume-title":"Proceedings of the 21st IEEE\/12th NASA Goddard Conference on Mass Storage Systems and Technologies. 139--152","author":"Wang Feng","year":"2004"},{"key":"e_1_3_2_2_53_1","volume-title":"2019 19th IEEE\/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID). 102--111","author":"Wang T.","year":"2019"},{"key":"e_1_3_2_2_54_1","unstructured":"Blue Waters. 2019. Publicly-available Blue Waters Darshan Data. Available from https:\/\/bluewaters.ncsa.illinois.edu\/data-setsDarshan.  Blue Waters. 2019. Publicly-available Blue Waters Darshan Data. Available from https:\/\/bluewaters.ncsa.illinois.edu\/data-setsDarshan."},{"key":"e_1_3_2_2_55_1","unstructured":"Blue Waters. 2019. Publicly-available Blue Waters Data. Available from https:\/\/bluewaters.ncsa.illinois.edu\/data-sets.  Blue Waters. 2019. Publicly-available Blue Waters Data. Available from https:\/\/bluewaters.ncsa.illinois.edu\/data-sets."},{"key":"e_1_3_2_2_56_1","volume-title":"Proceedings of the 47th International Conference on Parallel Processing. 1--12","author":"Wyatt Michael R","year":"2018"},{"key":"e_1_3_2_2_57_1","volume-title":"SC'12: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis. IEEE, 1--11","author":"Xie Bing","year":"2012"},{"key":"e_1_3_2_2_58_1","volume-title":"Proceedings of the 26th International Symposium on High-Performance Parallel and Distributed Computing. 181--192","author":"Xie Bing","year":"2017"},{"key":"e_1_3_2_2_59_1","unstructured":"Bin Yang Xu Ji Xiaosong Ma Xiyang Wang Tianyu Zhang Xiupeng Zhu Nosayba El-Sayed Haidong Lan Yibo Yang Jidong Zhai etal 2019. End-to-end I\/O monitoring on a leading supercomputer. In 16th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 19). 379--394.  Bin Yang Xu Ji Xiaosong Ma Xiyang Wang Tianyu Zhang Xiupeng Zhu Nosayba El-Sayed Haidong Lan Yibo Yang Jidong Zhai et al. 2019. End-to-end I\/O monitoring on a leading supercomputer. In 16th { USENIX } Symposium on Networked Systems Design and Implementation ( { NSDI } 19). 379--394."},{"key":"e_1_3_2_2_60_1","volume-title":"2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS). 750--759","author":"Yildiz O.","year":"2016"},{"key":"e_1_3_2_2_61_1","volume-title":"2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS). IEEE, 750--759","author":"Yildiz Orcun","year":"2016"},{"key":"e_1_3_2_2_62_1","volume-title":"Conquering Big Data with High Performance Computing","author":"Yoo Wucherl"}],"event":{"name":"SC '21: The International Conference for High Performance Computing, Networking, Storage and Analysis","location":"St. Louis Missouri","acronym":"SC '21","sponsor":["SIGHPC ACM Special Interest Group on High Performance Computing, Special Interest Group on High Performance Computing","IEEE CS"]},"container-title":["Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3458817.3476186","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3458817.3476186","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:12:21Z","timestamp":1750191141000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3458817.3476186"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,13]]},"references-count":62,"alternative-id":["10.1145\/3458817.3476186","10.1145\/3458817"],"URL":"https:\/\/doi.org\/10.1145\/3458817.3476186","relation":{},"subject":[],"published":{"date-parts":[[2021,11,13]]}}}