{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:34:39Z","timestamp":1750307679133,"version":"3.41.0"},"reference-count":28,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2008,10,1]],"date-time":"2008-10-01T00:00:00Z","timestamp":1222819200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGOPS Oper. Syst. Rev."],"published-print":{"date-parts":[[2008,10]]},"abstract":"<jats:p>Many scientific applications use parallel I\/O to meet the low latency and high bandwidth I\/O requirement. Among many available parallel I\/O operations, collective I\/O is one of the most popular methods when the storage layouts and access patterns of data do not match. The implementation of collective I\/O typically involves disk I\/O operations followed by interprocessor communications. Also, in many I\/O-intensive applications, parallel I\/O operations are usually followed by parallel computations. This paper presents a comparative study of different overlap strategies in parallel applications. We have experimented with four different overlap strategies 1) Overlapping I\/O and communication; 2) Overlapping I\/O and computation; 3) Overlapping computation and communication; and 4) Overlapping I\/O, communication, and computation. All experiments have been conducted on a Linux Cluster and the performance results obtained are very encouraging. On an average, we have enhanced the performance of a generic collective read call by 38%, the MxM benchmark by 26%, and the FFT benchmark by 34%.<\/jats:p>","DOI":"10.1145\/1453775.1453784","type":"journal-article","created":{"date-parts":[[2008,10,22]],"date-time":"2008-10-22T12:25:40Z","timestamp":1224678340000},"page":"43-49","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["Comparative evaluation of overlap strategies with study of I\/O overlap in MPI-IO"],"prefix":"10.1145","volume":"42","author":[{"given":"Christina M.","family":"Patrick","sequence":"first","affiliation":[{"name":"Pennsylvania State University"}]},{"given":"SeungWoo","family":"Son","sequence":"additional","affiliation":[{"name":"Pennsylvania State University"}]},{"given":"Mahmut","family":"Kandemir","sequence":"additional","affiliation":[{"name":"Pennsylvania State University"}]}],"member":"320","published-online":{"date-parts":[[2008,10]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"92","volume-title":"Conf. on Paral. and Dist. Comp. and Sys.","author":"Caglar Benson","year":"2003","unstructured":"Caglar , Benson , Huang , and Chu . Usfmpi : A multi-threaded implementation of mpi for linux clusters. In Proc's of the 15th Inter . Conf. on Paral. and Dist. Comp. and Sys. , pages 92 -- 103 , 2003 . Caglar, Benson, Huang, and Chu. Usfmpi: A multi-threaded implementation of mpi for linux clusters. In Proc's of the 15th Inter. Conf. on Paral. and Dist. Comp. and Sys., pages 92--103, 2003."},{"key":"e_1_2_1_2_1","first-page":"317","volume-title":"Proc's of the 4th Annual Linux Showcase and Conf.","author":"Carns Ligon","year":"2000","unstructured":"Carns , Ligon , Ross , and Thakur . Pvfs: A parallel file system for linux clusters . In Proc's of the 4th Annual Linux Showcase and Conf. , pages 317 -- 327 , 2000 . Carns, Ligon, Ross, and Thakur. Pvfs: A parallel file system for linux clusters. In Proc's of the 4th Annual Linux Showcase and Conf., pages 317--327, 2000."},{"key":"e_1_2_1_4_1","first-page":"119","volume-title":"Proc's of the Intel Supercomputer User's Group Conf.","author":"Choudhary Bordawekar","year":"1995","unstructured":"Choudhary , Bordawekar , More , and Sivaram . Passion runtime library for the intel paragon . In Proc's of the Intel Supercomputer User's Group Conf. , pages 119 -- 128 , 1995 . Choudhary, Bordawekar, More, and Sivaram. Passion runtime library for the intel paragon. In Proc's of the Intel Supercomputer User's Group Conf., pages 119--128, 1995."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2005.75"},{"key":"e_1_2_1_6_1","first-page":"38","volume-title":"13th Inter. and 10th Symp. on Paral. and Dist. Processing","author":"Thakur","year":"1999","unstructured":"Dickens and Thakur . Improving collective i\/o performance using threads . 13th Inter. and 10th Symp. on Paral. and Dist. Processing , pages 38 -- 45 , 1999 . Dickens and Thakur. Improving collective i\/o performance using threads. 13th Inter. and 10th Symp. on Paral. and Dist. Processing, pages 38--45, 1999."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1006\/jpdc.2000.1733"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1048935.1050207"},{"key":"e_1_2_1_9_1","volume-title":"Workshop on Paral. Proc.","author":"Foster Kesselman","year":"1994","unstructured":"Foster , Kesselman , and Tuecke . The nexus task-parallel runtime system. In Proc's of the 1st Inter . Workshop on Paral. Proc. , 1994 . Foster, Kesselman, and Tuecke. The nexus task-parallel runtime system. In Proc's of the 1st Inter. Workshop on Paral. Proc., 1994."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/11846802_11"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/11942634_17"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1147\/rd.482.0255"},{"key":"e_1_2_1_13_1","first-page":"19","volume-title":"IPDPS '02: Proc's of the 16th Inter. Symp. on Paral. and Dist. Proc.","author":"Choudhary","unstructured":"Kandemir and Choudhary . Compiler-directed i\/o optimization. In IPDPS '02: Proc's of the 16th Inter. Symp. on Paral. and Dist. Proc. , page 19 .2, 2002. Kandemir and Choudhary. Compiler-directed i\/o optimization. In IPDPS '02: Proc's of the 16th Inter. Symp. on Paral. and Dist. Proc., page 19.2, 2002."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1014156327748"},{"key":"e_1_2_1_15_1","first-page":"159","volume-title":"HPDC '95: Proc's of the 4th IEEE Inter. Symp. on High Perf. Dist. Comp.","author":"Kotz","year":"1995","unstructured":"Kotz . Disk-directed i\/o for an out-of-core computation . In HPDC '95: Proc's of the 4th IEEE Inter. Symp. on High Perf. Dist. Comp. , page 159 , 1995 . Kotz. Disk-directed i\/o for an out-of-core computation. In HPDC '95: Proc's of the 4th IEEE Inter. Symp. on High Perf. Dist. Comp., page 159, 1995."},{"key":"e_1_2_1_16_1","volume-title":"Ruprecht-Karls Universitt Heidelberg","author":"Krempel","year":"2006","unstructured":"Krempel . Tracing the connections between mpi-io calls and their corresponding pvfs2 disk operations. Bachelor's thesis , Ruprecht-Karls Universitt Heidelberg , 2006 . Krempel. Tracing the connections between mpi-io calls and their corresponding pvfs2 disk operations. Bachelor's thesis, Ruprecht-Karls Universitt Heidelberg, 2006."},{"key":"e_1_2_1_17_1","volume-title":"MPI-2: Extensions to the Message Passing Interface","author":"Message Passing Interface Forum","year":"1997","unstructured":"Message Passing Interface Forum . MPI-2: Extensions to the Message Passing Interface . 1997 . Message Passing Interface Forum. MPI-2: Extensions to the Message Passing Interface. 1997."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/645607.661496"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1345206.1345254"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/16\/1\/069"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1188455.1188585"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/224170.224371"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1122971.1122978"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/795668.796733"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/301816.301826"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8191(01)00129-6"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1177\/109434209801200401"},{"key":"e_1_2_1_28_1","volume-title":"Users guide for romio: A high-performance, portable mpi-io implementation","author":"Thakur Lusk","year":"2002","unstructured":"Thakur , Lusk , and Gropp . Users guide for romio: A high-performance, portable mpi-io implementation , 2002 . Thakur, Lusk, and Gropp. Users guide for romio: A high-performance, portable mpi-io implementation, 2002."},{"key":"e_1_2_1_29_1","volume-title":"Effective nonblocking mpi-i\/o in remote i\/o operations using a multithreaded mechanism. Technical report","author":"Tsujita","year":"2004","unstructured":"Tsujita . Effective nonblocking mpi-i\/o in remote i\/o operations using a multithreaded mechanism. Technical report , 2004 Tsujita. Effective nonblocking mpi-i\/o in remote i\/o operations using a multithreaded mechanism. Technical report, 2004"}],"container-title":["ACM SIGOPS Operating Systems Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1453775.1453784","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1453775.1453784","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T13:29:45Z","timestamp":1750253385000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1453775.1453784"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,10]]},"references-count":28,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2008,10]]}},"alternative-id":["10.1145\/1453775.1453784"],"URL":"https:\/\/doi.org\/10.1145\/1453775.1453784","relation":{},"ISSN":["0163-5980"],"issn-type":[{"type":"print","value":"0163-5980"}],"subject":[],"published":{"date-parts":[[2008,10]]},"assertion":[{"value":"2008-10-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}