{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,26]],"date-time":"2026-06-26T09:41:04Z","timestamp":1782466864406,"version":"3.54.5"},"reference-count":96,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2023,1,11]],"date-time":"2023-01-11T00:00:00Z","timestamp":1673395200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2017YFA0604500"],"award-info":[{"award-number":["2017YFA0604500"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["41776010"],"award-info":[{"award-number":["41776010"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Storage"],"published-print":{"date-parts":[[2023,2,28]]},"abstract":"<jats:p>\n            This paper offers a solution to overcome the complexities of production system I\/O performance monitoring. We present Beacon, an end-to-end I\/O resource monitoring and diagnosis system for the 40960-node Sunway TaihuLight supercomputer, currently the fourth-ranked supercomputer in the world. Beacon simultaneously collects and correlates I\/O tracing\/profiling data from all the compute nodes, forwarding nodes, storage nodes, and metadata servers. With mechanisms such as aggressive online and offline trace compression and distributed caching\/storage, it delivers scalable, low-overhead, and sustainable I\/O diagnosis under production use. With Beacon\u2019s deployment on TaihuLight for more than three years, we demonstrate Beacon\u2019s effectiveness with real-world use cases for I\/O performance issue identification and diagnosis. It has already successfully helped center administrators identify obscure design or configuration flaws, system anomaly occurrences, I\/O performance interference, and resource under- or over-provisioning problems. Several of the exposed problems have already been fixed, with others being currently addressed. Encouraged by Beacon\u2019s success in I\/O monitoring, we extend it to monitor interconnection networks, which is another contention point on supercomputers. In addition, we demonstrate Beacon\u2019s generality by extending it to other supercomputers. Both Beacon codes and part of collected monitoring data are released.\n            <jats:xref ref-type=\"fn\">\n              <jats:sup>1<\/jats:sup>\n            <\/jats:xref>\n          <\/jats:p>","DOI":"10.1145\/3568425","type":"journal-article","created":{"date-parts":[[2022,11,19]],"date-time":"2022-11-19T10:27:26Z","timestamp":1668853646000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["End-to-end I\/O Monitoring on Leading Supercomputers"],"prefix":"10.1145","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3783-2228","authenticated-orcid":false,"given":"Bin","family":"Yang","sequence":"first","affiliation":[{"name":"Shandong University, National Supercomputing Center in Wuxi, Jinan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9740-6581","authenticated-orcid":false,"given":"Wei","family":"Xue","sequence":"additional","affiliation":[{"name":"Tsinghua, Beijing, University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3491-5909","authenticated-orcid":false,"given":"Tianyu","family":"Zhang","sequence":"additional","affiliation":[{"name":"Shandong University, Jinan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4714-3749","authenticated-orcid":false,"given":"Shichao","family":"Liu","sequence":"additional","affiliation":[{"name":"Shandong University, Jinan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1261-2496","authenticated-orcid":false,"given":"Xiaosong","family":"Ma","sequence":"additional","affiliation":[{"name":"Qatar Computing Research Institute, HBKU, Doha, Qatar"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7567-5211","authenticated-orcid":false,"given":"Xiyang","family":"Wang","sequence":"additional","affiliation":[{"name":"National Supercomputing Center in Wuxi, Wuxi, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8834-0453","authenticated-orcid":false,"given":"Weiguo","family":"Liu","sequence":"additional","affiliation":[{"name":"Shandong University, Jinan, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,1,11]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1109\/SC.2014.18","volume-title":"International Conference for High Performance Computing, Networking, Storage and Analysis","author":"Agelastos Anthony","year":"2014","unstructured":"Anthony Agelastos, Benjamin Allan, Jim Brandt, Paul Cassella, Jeremy Enos, Joshi Fullop, Ann Gentile, Steve Monk, Nichamon Naksinehaboon, Jeff Ogden, Mahesh Rajan, Michael Showerman, Joel Stevenson, Narate Taerat, and Tom Tucker. 2014. The lightweight distributed metric service: A scalable infrastructure for continuous monitoring of large scale computing systems and applications. In International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, New Orleans, 154\u2013165."},{"key":"e_1_3_2_3_2","first-page":"1","volume-title":"International Conference for High Performance Computing, Networking, Storage and Analysis","author":"Bent John","year":"2009","unstructured":"John Bent, Garth Gibson, Gary Grider, Ben McClelland, Paul Nowoczynski, James Nunez, Milo Polte, and Meghan Wingate. 2009. PLFS: A checkpoint filesystem for parallel applications. In International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, Portland, 1\u201312."},{"key":"e_1_3_2_4_2","unstructured":"Lawrence Berkeley and ANL. 2017. TOKIO: Total knowledge of I\/O. http:\/\/www.nersc.gov\/research-and-development\/tokio."},{"issue":"11","key":"e_1_3_2_5_2","first-page":"3429","article-title":"Lustre: A scalable, high performance file system","volume":"8","author":"Braam Peter J.","year":"2002","unstructured":"Peter J. Braam and Rumi Zahir. 2002. Lustre: A scalable, high performance file system. Cluster File Systems, Inc 8, 11 (2002), 3429\u20133441.","journal-title":"Cluster File Systems, Inc"},{"key":"e_1_3_2_6_2","first-page":"1","volume-title":"International Symposium on Parallel and Distributed Processing","author":"Brandt Jim","year":"2009","unstructured":"Jim Brandt, Ann Gentile, Jackson Mayo, Philippe Pebay, Diana Roe, David Thompson, and Matthew Wong. 2009. Resource monitoring and management with OVIS to enable HPC in cloud computing environments. In International Symposium on Parallel and Distributed Processing. IEEE, Rome, 1\u20138."},{"key":"e_1_3_2_7_2","first-page":"1","volume-title":"Workshop on Many-Task Computing on Grids and Supercomputers","author":"Budnik Tom","year":"2010","unstructured":"Tom Budnik, Brant Knudson, Mark Megerian, Sam Miller, Mike Mundy, and Will Stockdell. 2010. Blue gene\/q resource management architecture. In Workshop on Many-Task Computing on Grids and Supercomputers. IEEE, New Orleans, 1\u20135."},{"key":"e_1_3_2_8_2","first-page":"1","volume-title":"Cray User Group Conference","author":"Carlyle Adam G.","year":"2012","unstructured":"Adam G. Carlyle, Ross G. Miller, Dustin B. Leverman, William A. Renaud, and Don E. Maxwell. 2012. Practical support solutions for a workflow-oriented Cray environment. In Cray User Group Conference. Cray, Stuttgart, 1\u20137."},{"key":"e_1_3_2_9_2","doi-asserted-by":"crossref","DOI":"10.2172\/1055420","volume-title":"Performance Analysis of Darshan 2.2. 3 on the Cray XE6 Platform.","author":"Carns P.","year":"2012","unstructured":"P. Carns, K. Harms, R. Latham, and R. Ross. 2012. Performance Analysis of Darshan 2.2. 3 on the Cray XE6 Platform.Technical Report. Argonne National Lab.(ANL), Argonne, IL (United States)."},{"key":"e_1_3_2_10_2","first-page":"1","volume-title":"International Conference on Cluster Computing and Workshops","author":"Carns Philip","year":"2009","unstructured":"Philip Carns, Robert Latham, Robert Ross, Kamil Iskra, Samuel Lang, and Katherine Riley. 2009. 24\/7 characterization of Petascale I\/O workloads. In International Conference on Cluster Computing and Workshops. IEEE, New Orleans, 1\u201310."},{"key":"e_1_3_2_11_2","unstructured":"Cray. 2017. Cray burst buffer in Cori. https:\/\/docs.nersc.gov\/filesystems\/cori-burst-buffer\/."},{"key":"e_1_3_2_12_2","first-page":"166","volume-title":"European Conference on Parallel Processing","author":"Dandapanthula N.","year":"2011","unstructured":"N. Dandapanthula, Hari Subramoni, J\u00e9r\u00f4me Vienne, K. Kandalla, Sayantan Sur, Dhabaleswar K. Panda, and Ron Brightwell. 2011. INAM-a scalable infiniband network analysis and monitoring tool. In European Conference on Parallel Processing. Springer, Bordeaux, 166\u2013177."},{"key":"e_1_3_2_13_2","first-page":"442","volume-title":"International Symposium on Cluster, Cloud and Grid Computing","author":"Di Sheng","year":"2017","unstructured":"Sheng Di, Rinku Gupta, Marc Snir, Eric Pershey, and Franck Cappello. 2017. LogAider: A tool for mining potential correlations of HPC log events. In International Symposium on Cluster, Cloud and Grid Computing. IEEE, Madrid, 442\u2013451."},{"key":"e_1_3_2_14_2","first-page":"042014","volume-title":"Journal of Physics: Conference Series","author":"Donvito Giacinto","year":"2014","unstructured":"Giacinto Donvito, Giovanni Marzulli, and Domenico Diacono. 2014. Testing of several distributed file-systems (HDFS, Ceph and GlusterFS) for supporting the HEP experiments analysis. In Journal of Physics: Conference Series. IOP Publishing, Yokohama, 042014."},{"key":"e_1_3_2_15_2","first-page":"155","volume-title":"International Parallel and Distributed Processing Symposium","author":"Dorier Matthieu","year":"2014","unstructured":"Matthieu Dorier, Gabriel Antoniu, Robert Ross, Dries Kimpe, and Shadi Ibrahim. 2014. CALCioM: Mitigating I\/O interference in HPC systems through cross-application coordination. In International Parallel and Distributed Processing Symposium. IEEE, Phoenix, 155\u2013164."},{"key":"e_1_3_2_16_2","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1109\/SC.2018.00015","volume-title":"International Conference for High Performance Computing, Networking, Storage and Analysis","author":"Duan Xiaohui","year":"2018","unstructured":"Xiaohui Duan, Dexun Chen, Xiangxu Meng, Guangwen Yang, Ping Gao, Tingjian Zhang, Meng Zhang, Weiguo Liu, Wusheng Zhang, and Wei Xue. 2018. Redesigning LAMMPS for Petascale and hundred-billion-atom simulation on Sunway TaihuLight. In International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, Dallas, 148\u2013159."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.5555\/2484635"},{"key":"e_1_3_2_18_2","first-page":"229","volume-title":"USENIX Winter","author":"Eggert Paul R.","year":"1993","unstructured":"Paul R. Eggert and Douglas Stott Parker Jr. 1993. File systems in user space.. In USENIX Winter. 229\u2013240."},{"key":"e_1_3_2_19_2","first-page":"226","volume-title":"KDD","author":"Ester Martin","year":"1996","unstructured":"Martin Ester, Hans-Peter Kriegel, J\u00f6rg Sander, Xiaowei Xu, et\u00a0al. 1996. A density-based algorithm for discovering clusters in large spatial databases with noise. In KDD. AAAI, Portland, 226\u2013231."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.5555\/1468059"},{"key":"e_1_3_2_21_2","first-page":"1","volume-title":"International Conference for High Performance Computing, Networking, Storage and Analysis","author":"Fu Haohuan","year":"2017","unstructured":"Haohuan Fu, Conghui He, Bingwei Chen, Zekun Yin, Zhenguo Zhang, Wenqiang Zhang, Tingjian Zhang, Wei Xue, Weiguo Liu, Wanwang Yin, et\u00a0al. 2017. 9-pflops nonlinear earthquake simulation on Sunway TaihuLight: Enabling depiction of 18-Hz and 8-meter scenarios. In International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, Denver, 1\u201312."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3126908.3126909"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11432-016-5588-7"},{"key":"e_1_3_2_24_2","first-page":"1013","volume-title":"International Parallel and Distributed Processing Symposium","author":"Gainaru Ana","year":"2015","unstructured":"Ana Gainaru, Guillaume Aupy, Anne Benoit, Franck Cappello, Yves Robert, and Marc Snir. 2015. Scheduling the I\/O of HPC applications under congestion. In International Parallel and Distributed Processing Symposium. IEEE, Hyderabad, 1013\u20131022."},{"key":"e_1_3_2_25_2","unstructured":"Jim Garlick. 2010. Lustre monitoring tool. https:\/\/github.com\/LLNL\/lmt."},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.agee.2009.06.014"},{"key":"e_1_3_2_27_2","unstructured":"Gary Grider James Nunez and John Bent. 2008. LANL MPI-IO test. http:\/\/freshmeat.sourceforge.net\/projects\/mpiiotest."},{"key":"e_1_3_2_28_2","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1145\/2834976.2834985","volume-title":"Proceedings of the Parallel Data Storage Workshop","author":"Gunasekaran Raghul","year":"2015","unstructured":"Raghul Gunasekaran, Sarp Oral, Jason Hill, Ross Miller, Feiyi Wang, and Dustin Leverman. 2015. Comparative I\/O workload characterization of two leadership class storage clusters. In Proceedings of the Parallel Data Storage Workshop. IEEE, Austin, 31\u201336."},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3242086"},{"key":"e_1_3_2_30_2","unstructured":"Jack Dongarra and Hans Meuer. 2020. Top 500 list. https:\/\/www.top500.org\/resources\/top-systems\/."},{"key":"e_1_3_2_31_2","unstructured":"IBM. 2008. Intrepid. https:\/\/www.alcf.anl.gov\/intrepid."},{"key":"e_1_3_2_32_2","first-page":"265","volume-title":"Conference on File and Storage Technologies","author":"Ji Xu","year":"2019","unstructured":"Xu Ji, Bin Yang, Tianyu Zhang, Xiaosong Ma, Xiupeng Zhu, Xiyang Wang, Nosayba El-Sayed, Jidong Zhai, Weiguo Liu, and Wei Xue. 2019. Automatic, application-aware I\/O forwarding resource allocation. In Conference on File and Storage Technologies. USENIX, Boston, 265\u2013279."},{"key":"e_1_3_2_33_2","first-page":"449","volume-title":"International Parallel and Distributed Processing Symposium","author":"Jokanovic Ana","year":"2015","unstructured":"Ana Jokanovic, Jose Carlos Sancho, German Rodriguez, Alejandro Lucero, Cyriel Minkenberg, and Jesus Labarta. 2015. Quiet neighborhoods: Key to protect job performance predictability. In International Parallel and Distributed Processing Symposium. IEEE, Hyderabad, 449\u2013459."},{"key":"e_1_3_2_34_2","first-page":"42","volume-title":"International Solid-State Circuits Conference","author":"Kahle James A.","year":"2019","unstructured":"James A. Kahle, Jaime Moreno, and Dan Dreps. 2019. 2.1 Summit and Sierra: Designing AI\/HPC supercomputers. In International Solid-State Circuits Conference. IEEE, San Francisco, 42\u201343."},{"key":"e_1_3_2_35_2","first-page":"18","volume-title":"Companion: High Performance Computing, Networking Storage and Analysis","author":"Kim Seong Jo","year":"2012","unstructured":"Seong Jo Kim, Seung Woo Son, Wei-keng Liao, Mahmut Kandemir, Rajeev Thakur, and Alok Choudhary. 2012. IOPin: Runtime profiling of parallel I\/O in HPC systems. In Companion: High Performance Computing, Networking Storage and Analysis. IEEE, Salt Lake City, 18\u201323."},{"key":"e_1_3_2_36_2","first-page":"72","volume-title":"European MPI Users\u2019 Group Meeting","author":"Kim Seong Jo","year":"2010","unstructured":"Seong Jo Kim, Yuanrui Zhang, Seung Woo Son, Ramya Prabhakar, Mahmut Kandemir, Christina Patrick, Wei-keng Liao, and Alok Choudhary. 2010. Automated tracing of I\/O stack. In European MPI Users\u2019 Group Meeting. Springer, Stuttgart, 72\u201381."},{"key":"e_1_3_2_37_2","volume-title":"Elasticsearch Server","author":"Kuc Rafal","year":"2013","unstructured":"Rafal Kuc and Marek Rogozinski. 2013. Elasticsearch Server. Packt Publishing Ltd, Birmingham."},{"key":"e_1_3_2_38_2","first-page":"185","volume-title":"International Conference on Cluster Computing","author":"Kuo Chih-Song","year":"2014","unstructured":"Chih-Song Kuo, Aamer Shah, Akihiro Nomura, Satoshi Matsuoka, and Felix Wolf. 2014. How file access patterns influence interference among cluster applications. In International Conference on Cluster Computing. IEEE, Madrid, 185\u2013193."},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/3126908.3126924"},{"key":"e_1_3_2_40_2","first-page":"706","volume-title":"International Conference for High Performance Computing, Networking, Storage and Analysis","author":"Lin Heng","year":"2018","unstructured":"Heng Lin, Xiaowei Zhu, Bowen Yu, Xiongchao Tang, Wei Xue, Wenguang Chen, Lufei Zhang, Torsten Hoefler, Xiaosong Ma, Xin Liu, Weimin Zheng, and Jingfang Xu. 2018. ShenTu: Processing multi-trillion edge graphs on millions of cores in seconds. In International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, Dallas, 706\u2013716."},{"key":"e_1_3_2_41_2","first-page":"213","volume-title":"Conference on File and Storage Technologies","author":"Liu Yang","year":"2014","unstructured":"Yang Liu, Raghul Gunasekaran, Xiaosong Ma, and Sudharshan S. Vazhkudai. 2014. Automatic identification of application I\/O signatures from noisy server-side traces. In Conference on File and Storage Technologies. USENIX, Oakland, 213\u2013228."},{"key":"e_1_3_2_42_2","first-page":"819","volume-title":"International Conference for High Performance Computing, Networking, Storage and Analysis","author":"Liu Yang","year":"2016","unstructured":"Yang Liu, Raghul Gunasekaran, Xiaosong Ma, and Sudharshan S. Vazhkudai. 2016. Server-side log data analytics for I\/O workload characterization and coordination on large shared storage systems. In International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, Salt Lake City, 819\u2013829."},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/2934872.2934906"},{"key":"e_1_3_2_44_2","first-page":"55","volume-title":"Joint International Workshop on Parallel Data Storage and Data Intensive Scalable Computing Systems","author":"Lockwood Glenn K.","year":"2017","unstructured":"Glenn K. Lockwood, Wucherl Yoo, Suren Byna, Nicholas J. Wright, Shane Snyder, Kevin Harms, Zachary Nault, and Philip Carns. 2017. UMAMI: A recipe for generating meaningful metrics through holistic I\/O performance analysis. In Joint International Workshop on Parallel Data Storage and Data Intensive Scalable Computing Systems. ACM, Denver, 55\u201360."},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2016.49"},{"key":"e_1_3_2_46_2","first-page":"1","volume-title":"International Conference for High Performance Computing, Networking, Storage and Analysis","author":"Lofstead Jay","year":"2010","unstructured":"Jay Lofstead, Fang Zheng, Qing Liu, Scott Klasky, Ron Oldfield, Todd Kordenbrock, Karsten Schwan, and Matthew Wolf. 2010. Managing variability in the IO performance of Petascale storage systems. In International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, New Orleans, 1\u201312."},{"key":"e_1_3_2_47_2","first-page":"1","volume-title":"International Conference on Cluster Computing","author":"Luu Huong","year":"2013","unstructured":"Huong Luu, Babak Behzad, Ruth Aydt, and Marianne Winslett. 2013. A multi-level approach for understanding I\/O activity in HPC applications. In International Conference on Cluster Computing. IEEE, Indianapolis, 1\u20135."},{"key":"e_1_3_2_48_2","first-page":"33","volume-title":"International Symposium on High-Performance Parallel and Distributed Computing","author":"Luu Huong","year":"2015","unstructured":"Huong Luu, Marianne Winslett, William Gropp, Robert Ross, Philip Carns, Kevin Harms, Mr Prabhat, Suren Byna, and Yushu Yao. 2015. A multiplatform study of I\/O behavior on Petascale supercomputers. In International Symposium on High-Performance Parallel and Distributed Computing. ACM, Portland, 33\u201344."},{"key":"e_1_3_2_49_2","first-page":"410","volume-title":"International Workshop on Applied Parallel Computing","author":"Mueller Frank","year":"2010","unstructured":"Frank Mueller, Xing Wu, Martin Schulz, Bronis R. De Supinski, and Todd Gamblin. 2010. ScalaTrace: Tracing, analysis and modeling of HPC codes at scale. In International Workshop on Applied Parallel Computing. Springer, Reykjav\u00edk, 410\u2013418."},{"key":"e_1_3_2_50_2","first-page":"1","volume-title":"Proceedings of the Workshop on Challenges and Opportunities of Efficient and Performant Storage Systems","author":"Naas Mohammed Islam","year":"2021","unstructured":"Mohammed Islam Naas, Fran\u00e7ois Trahay, Alexis Colin, Pierre Olivier, St\u00e9phane Rubini, Frank Singhoff, and Jalil Boukhobza. 2021. EZIOTracer: Unifying kernel and user space I\/O tracing for data-intensive applications. In Proceedings of the Workshop on Challenges and Opportunities of Efficient and Performant Storage Systems. ACM, Edinburgh, 1\u201311."},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3123878.3131985"},{"key":"e_1_3_2_52_2","unstructured":"NERSC. 2014. Edison. https:\/\/www.top500.org\/system\/178443\/."},{"key":"e_1_3_2_53_2","first-page":"9","volume-title":"International Symposium on Computer Architecture and High Performance Computing","author":"Neuwirth Sarah","year":"2016","unstructured":"Sarah Neuwirth, Feiyi Wang, Sarp Oral, Sudharshan Vazhkudai, James Rogers, and Ulrich Bruening. 2016. Using balanced data placement to address I\/O contention in production environments. In International Symposium on Computer Architecture and High Performance Computing. IEEE, Los Angeles, 9\u201317."},{"key":"e_1_3_2_54_2","doi-asserted-by":"crossref","unstructured":"L. H. Newman. 2014. Piz Daint Supercomputer Shows the Way Ahead on Efficiency.","DOI":"10.1109\/MSPEC.2014.6729361"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpdc.2008.09.001"},{"key":"e_1_3_2_56_2","unstructured":"Alliance OpenFabrics. 2010. OpenFabrics enterprise distribution (OFED). http:\/\/www.openfabrics.org\/."},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2014.23"},{"key":"e_1_3_2_58_2","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1145\/2749246.2749273","volume-title":"International Symposium on High-Performance Parallel and Distributed Computing","author":"Ouyang Jiannan","year":"2015","unstructured":"Jiannan Ouyang, Brian Kocoloski, John R. Lange, and Kevin Pedretti. 2015. Achieving performance isolation with lightweight co-kernels. In International Symposium on High-Performance Parallel and Distributed Computing. ACM, Portland, 149\u2013160."},{"key":"e_1_3_2_59_2","volume-title":"Mira: Argonne\u2019s 10-Petaflops Supercomputer","author":"Papka Michael","year":"2013","unstructured":"Michael Papka, Susan Coghlan, Eric Isaacs, Mark Peters, and Paul Messina. 2013. Mira: Argonne\u2019s 10-Petaflops Supercomputer. Technical Report. ANL (Argonne National Laboratory (ANL), Argonne, IL (United States))."},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/3295500.3356183"},{"key":"e_1_3_2_61_2","first-page":"91","volume-title":"Conference on File and Storage Technologies","author":"Patel Tirthak","year":"2020","unstructured":"Tirthak Patel, Suren Byna, Glenn K. Lockwood, Nicholas J. Wright, Philip Carns, Robert Ross, and Devesh Tiwari. 2020. Uncovering access, reuse, and sharing characteristics of I\/O-intensive files on large-scale production \\(\\lbrace\\) HPC \\(\\rbrace\\) systems. In Conference on File and Storage Technologies. USENIX, Santa Clara, 91\u2013101."},{"key":"e_1_3_2_62_2","first-page":"202","volume-title":"International Conference on High Performance Computing, Data, and Analytics","author":"Paul Arnab K.","year":"2020","unstructured":"Arnab K. Paul, Olaf Faaland, Adam Moody, Elsa Gonsiorowski, Kathryn Mohror, and Ali R. Butt. 2020. Understanding HPC application I\/O behavior using system level statistics. In International Conference on High Performance Computing, Data, and Analytics. IEEE, Pune, 202\u2013211."},{"key":"e_1_3_2_63_2","first-page":"233","volume-title":"International Conference on Big Data","author":"Paul Arnab K.","year":"2017","unstructured":"Arnab K. Paul, Arpit Goyal, Feiyi Wang, Sarp Oral, Ali R. Butt, Michael J. Brim, and Sangeetha B. Srinivasa. 2017. I\/O load balancing for big data HPC applications. In International Conference on Big Data. IEEE, Boston, 233\u2013242."},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.5555\/3433701.3433715"},{"key":"e_1_3_2_65_2","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1145\/3431379.3460640","volume-title":"International Symposium on High-Performance Parallel and Distributed Computing","author":"Rajesh Neeraj","year":"2021","unstructured":"Neeraj Rajesh, Hariharan Devarajan, Jaime Cernuda Garcia, Keith Bateman, Luke Logan, Jie Ye, Anthony Kougkas, and Xian-He Sun. 2021. Apollo: An ML-assisted real-time storage resource observer. In International Symposium on High-Performance Parallel and Distributed Computing. ACM, Stockholm, 147\u2013159."},{"key":"e_1_3_2_66_2","unstructured":"W. G. Redis. 2016. Redis. http:\/\/redis.io\/topics\/faqAccessedNovember."},{"key":"e_1_3_2_67_2","first-page":"1","volume-title":"Conference on File and Storage Technologies","author":"Schmuck Frank","year":"2002","unstructured":"Frank Schmuck and Roger Haskin. 2002. GPFS: A shared-disk file system for large computing clusters. In Conference on File and Storage Technologies. USENIX, Monterey, 1\u201315."},{"key":"e_1_3_2_68_2","first-page":"137","volume-title":"Pacific Rim International Symposium on Dependable Computing","author":"Sergent Nicole","year":"2001","unstructured":"Nicole Sergent, Xavier D\u00e9fago, and Andr\u00e9 Schiper. 2001. Impact of a failure detection mechanism on the performance of consensus. In Pacific Rim International Symposium on Dependable Computing. IEEE, Seoul, 137\u2013145."},{"key":"e_1_3_2_69_2","first-page":"1","volume-title":"International Workshop on Quality of Service","author":"Shen Shan-Hsiang","year":"2012","unstructured":"Shan-Hsiang Shen and Aditya Akella. 2012. DECOR: A distributed coordinated resource monitoring system. In International Workshop on Quality of Service. IEEE, Coimbra, 1\u20139."},{"key":"e_1_3_2_70_2","volume-title":"A Description of the Advanced Research WRF Version 2","author":"Skamarock William C.","year":"2005","unstructured":"William C. Skamarock, Joseph B. Klemp, Jimy Dudhia, David O. Gill, Dale M. Barker, Wei Wang, and Jordan G. Powers. 2005. A Description of the Advanced Research WRF Version 2. Technical Report. National Center For Atmospheric Research Boulder Co Mesoscale and Microscale."},{"key":"e_1_3_2_71_2","first-page":"9","volume-title":"Workshop on Extreme-scale Programming Tools","author":"Snyder Shane","year":"2016","unstructured":"Shane Snyder, Philip Carns, Kevin Harms, Robert Ross, Glenn K. Lockwood, and Nicholas J. Wright. 2016. Modular HPC I\/O characterization with Darshan. In Workshop on Extreme-scale Programming Tools. IEEE, Salt Lake City, 9\u201317."},{"key":"e_1_3_2_72_2","first-page":"1","volume-title":"International Conference for High Performance Computing, Networking, Storage and Analysis","author":"Song Huaiming","year":"2011","unstructured":"Huaiming Song, Yanlong Yin, Xian-He Sun, Rajeev Thakur, and Samuel Lang. 2011. Server-side I\/O coordination for parallel file systems. In International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, Seattle, 1\u201311."},{"key":"e_1_3_2_73_2","unstructured":"Sugon. 2018. Pai system Sugon. https:\/\/www.top500.org\/system\/179425\/."},{"key":"e_1_3_2_74_2","unstructured":"Sungon. 2015. ParaStor200 Distributed Parallel Storage System. http:\/\/hpc.sugon.com\/en\/HPC-Components\/parastor.html."},{"key":"e_1_3_2_75_2","first-page":"805","volume-title":"International Conference on Dependable Systems and Networks","author":"Tai Ann T.","year":"2004","unstructured":"Ann T. Tai, Kam S. Tso, and William H. Sanders. 2004. Cluster-based failure detection service for large-scale ad hoc wireless network applications. In International Conference on Dependable Systems and Networks. IEEE, Florence, 805\u2013814."},{"key":"e_1_3_2_76_2","first-page":"233","volume-title":"Symposium on Operating Systems Design and Implementation","author":"Tammana Praveen","year":"2016","unstructured":"Praveen Tammana, Rachit Agarwal, and Myungjin Lee. 2016. Simplifying datacenter network debugging with pathdump. In Symposium on Operating Systems Design and Implementation. USENIX, Savannah, 233\u2013248."},{"key":"e_1_3_2_77_2","first-page":"453","volume-title":"Symposium on Networked Systems Design and Implementation","author":"Tammana Praveen","year":"2018","unstructured":"Praveen Tammana, Rachit Agarwal, and Myungjin Lee. 2018. Distributed network monitoring and debugging with SwitchPointer. In Symposium on Networked Systems Design and Implementation. USENIX, Renton, 453\u2013456."},{"key":"e_1_3_2_78_2","first-page":"22","volume-title":"Conference on File and Storage Technologies","author":"Tarasov Vasily","year":"2012","unstructured":"Vasily Tarasov, Santhosh Kumar, Jack Ma, Dean Hildebrand, Anna Povzner, Geoff Kuenning, and Erez Zadok. 2012. Extracting flexible, replayable models from large block traces. In Conference on File and Storage Technologies. USENIX, San Jose, 22."},{"key":"e_1_3_2_79_2","volume-title":"The Logstash Book","author":"Turnbull James","year":"2013","unstructured":"James Turnbull. 2013. The Logstash Book. James Turnbull."},{"key":"e_1_3_2_80_2","first-page":"1","volume-title":"International Symposium on Parallel and Distributed Processing","author":"Uselton Andrew","year":"2010","unstructured":"Andrew Uselton, Mark Howison, Nicholas J. Wright, David Skinner, Noel Keen, John Shalf, Karen L. Karavanic, and Leonid Oliker. 2010. Parallel I\/O performance: From events to ensembles. In International Symposium on Parallel and Distributed Processing. IEEE, Atlanta, 1\u201311."},{"key":"e_1_3_2_81_2","first-page":"1","volume-title":"International Conference for High Performance Computing, Networking, Storage and Analysis","author":"Vazhkudai Sudharshan S.","year":"2017","unstructured":"Sudharshan S. Vazhkudai, Ross Miller, Devesh Tiwari, Christopher Zimmer, Feiyi Wang, Sarp Oral, Raghul Gunasekaran, and Deryl Steinert. 2017. GUIDE: A scalable information directory service to collect, federate, and analyze logs for operational insights into a leadership HPC facility. In International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, Denver, 1\u201312."},{"key":"e_1_3_2_82_2","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1145\/1713072.1713080","volume-title":"Annual Workshop on Petascale Data Storage","author":"Vijayakumar Karthik","year":"2009","unstructured":"Karthik Vijayakumar, Frank Mueller, Xiaosong Ma, and Philip C. Roth. 2009. Scalable I\/O tracing and analysis. In Annual Workshop on Petascale Data Storage. IEEE, Portland, 26\u201331."},{"key":"e_1_3_2_83_2","first-page":"1","volume-title":"International Conference for High Performance Computing, Networking, Storage and Analysis","author":"Vishwanath Venkatram","year":"2010","unstructured":"Venkatram Vishwanath, Mark Hereld, Kamil Iskra, Dries Kimpe, Vitali Morozov, Michael E. Papka, Robert Ross, and Kazutomo Yoshii. 2010. Accelerating I\/O forwarding in IBM Blue Gene\/p systems. In International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, New Orleans, 1\u201310."},{"key":"e_1_3_2_84_2","volume-title":"BlueGene\/Q Sequoia and Mira","author":"Vranas P.","year":"2012","unstructured":"P. Vranas. 2012. BlueGene\/Q Sequoia and Mira. Technical Report. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)."},{"key":"e_1_3_2_85_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpc.2017.07.009"},{"key":"e_1_3_2_86_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00450-012-0221-5"},{"key":"e_1_3_2_87_2","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/bxs044"},{"key":"e_1_3_2_88_2","first-page":"59","volume-title":"International Conference on Supercomputing","author":"Wu Xing","year":"2013","unstructured":"Xing Wu and Frank Mueller. 2013. Elastic and scalable tracing and accurate replay of non-deterministic events. In International Conference on Supercomputing. ACM, Eugene, 59\u201368."},{"key":"e_1_3_2_89_2","first-page":"196","volume-title":"International Conference on Parallel Processing","author":"Wu Xing","year":"2011","unstructured":"Xing Wu, Karthik Vijayakumar, Frank Mueller, Xiaosong Ma, and Philip C. Roth. 2011. Probabilistic communication and I\/O tracing with deterministic replay at scale. In International Conference on Parallel Processing. IEEE, Taipei, 196\u2013205."},{"key":"e_1_3_2_90_2","doi-asserted-by":"publisher","DOI":"10.1145\/3458817.3487398"},{"key":"e_1_3_2_91_2","doi-asserted-by":"publisher","DOI":"10.5555\/2388996.2389007"},{"key":"e_1_3_2_92_2","first-page":"1","volume-title":"Cray User Group Meeting","author":"Xu Cong","year":"2016","unstructured":"Cong Xu, Suren Byna, Vishwanath Venkatesan, Robert Sisneros, Omkar Kulkarni, Mohamad Chaarawi, and Kalyana Chadalavada. 2016. LIOProf: Exposing lustre file system behavior for I\/O middleware. In Cray User Group Meeting. Cray, London, 1\u20139."},{"key":"e_1_3_2_93_2","first-page":"750","volume-title":"International Parallel and Distributed Processing Symposium","author":"Yildiz Orcun","year":"2016","unstructured":"Orcun Yildiz, Matthieu Dorier, Shadi Ibrahim, Rob Ross, and Gabriel Antoniu. 2016. On the root causes of cross-application I\/O interference in HPC storage systems. In International Parallel and Distributed Processing Symposium. IEEE, Chicago, 750\u2013759."},{"key":"e_1_3_2_94_2","unstructured":"E. You. 2020. Vuejs framework. https:\/\/vuejs.org."},{"key":"e_1_3_2_95_2","first-page":"5","volume-title":"Symposium on Networked Systems Design and Implementation","author":"Yu Minlan","year":"2011","unstructured":"Minlan Yu, Albert G. Greenberg, David A. Maltz, Jennifer Rexford, Lihua Yuan, Srikanth Kandula, and Changhoon Kim. 2011. Profiling network performance for multi-tier data center applications. In Symposium on Networked Systems Design and Implementation. USENIX, Boston, 5\u20135."},{"key":"e_1_3_2_96_2","first-page":"1","volume-title":"International Symposium on Parallel and Distributed Processing","author":"Yu Weikuan","year":"2008","unstructured":"Weikuan Yu, J. S Vetter, and H. S Oral. 2008. Performance characterization and optimization of parallel I\/O on the cray XT. In International Symposium on Parallel and Distributed Processing. IEEE, Sydney, 1\u201311."},{"key":"e_1_3_2_97_2","first-page":"1","volume-title":"International Conference on High Performance Computing, Networking, Storage and Analysis","author":"Zheng Fang","year":"2013","unstructured":"Fang Zheng, Hongfeng Yu, Can Hantas, Matthew Wolf, Greg Eisenhauer, Karsten Schwan, Hasan Abbasi, and Scott Klasky. 2013. GoldRush: Resource efficient in situ scientific data analytics using fine-grained interference aware execution. In International Conference on High Performance Computing, Networking, Storage and Analysis. IEEE, Denver, 1\u201312."}],"container-title":["ACM Transactions on Storage"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3568425","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3568425","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:33Z","timestamp":1750182693000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3568425"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,11]]},"references-count":96,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,2,28]]}},"alternative-id":["10.1145\/3568425"],"URL":"https:\/\/doi.org\/10.1145\/3568425","relation":{},"ISSN":["1553-3077","1553-3093"],"issn-type":[{"value":"1553-3077","type":"print"},{"value":"1553-3093","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,11]]},"assertion":[{"value":"2021-12-09","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-05-24","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-01-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}