{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T22:57:34Z","timestamp":1777676254539,"version":"3.51.4"},"reference-count":14,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2005,5,1]],"date-time":"2005-05-01T00:00:00Z","timestamp":1114905600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["The International Journal of High Performance Computing Applications"],"published-print":{"date-parts":[[2005,5]]},"abstract":"<jats:p>In this paper, we present a new scheme, Send Gather Receive Scatter (SGRS), to perform zero-copy datatype communication over InfiniBand. This scheme leverages the gather\/scatter feature provided by InfiniBand channel semantics. It takes advantage of the capability of processing non-contiguity on both send and receive sides in the Send Gather and Receive Scatter operations. We have implemented this new design and evaluated the performance for Message Passing Interface level point-to-point microbenchmarks and collectives, on PCI-X and upcoming high performance PCI-Express systems. In our previous work we had come up with an alternate zero-copy approach using multiple RDMA Writes (Multi-W). Compared to the existing Multi-W zero-copy datatype scheme, the SGRS scheme can overcome the drawbacks of low network utilization and high startup cost. On PCI-X platforms, our experimental results show significant improvement in both point-to-point and collective datatype communication. The latency of a vector datatype can be reduced by up to 62% and the bandwidth shows improvement up to 400% as compared with the Multi-W scheme. The Alltoall collective shows up to 23% reduction in latency. Further, the SGRS scheme shows low CPU overhead with a potential promise for better computation and communication overlap. The experimental results on PCI-Express platforms demonstrate the relevance of zero-copy protocols to overcome memory bandwidth limitations. The trends we observe in PCI-X platform are magnified on PCI-Express platforms with even higher improvement for the microbenchmarks and collectives.<\/jats:p>","DOI":"10.1177\/1094342005054259","type":"journal-article","created":{"date-parts":[[2005,5,18]],"date-time":"2005-05-18T10:00:06Z","timestamp":1116410406000},"page":"129-142","source":"Crossref","is-referenced-by-count":9,"title":["Designing Zero-Copy Message Passing Interface Derived Datatype Communication                 Over Infiniband: Alternative Approaches and Performance Evaluation"],"prefix":"10.1177","volume":"19","author":[{"given":"Gopalakrishnan","family":"Santhanaraman","sequence":"first","affiliation":[{"name":"Network-Based Computing Laboratory, Department of Computer Science and\r                        Engineering, The Ohio State University, Columbus, OH 43210, USA,"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiesheng","family":"Wu","sequence":"additional","affiliation":[{"name":"Network-Based Computing Laboratory, Department of Computer Science and\r                        Engineering, The Ohio State University, Columbus, OH 43210, USA,"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Huang","sequence":"additional","affiliation":[{"name":"Network-Based Computing Laboratory, Department of Computer Science and\r                        Engineering, The Ohio State University, Columbus, OH 43210, USA,"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dhabaleswar K.","family":"Panda","sequence":"additional","affiliation":[{"name":"Network-Based Computing Laboratory, Department of Computer Science and\r                        Engineering, The Ohio State University, Columbus, OH 43210, USA,"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2005,5,1]]},"reference":[{"key":"atypb1","volume-title":"Deliverable D.4.1.b","author":"Ashworth, M.","year":"1996"},{"key":"atypb2","volume-title":"Proceedings of the IEEE International Conference on Cluster Computing","author":"Byna, S."},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1086\/317361"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1016\/0167-8191(96)00024-5"},{"key":"atypb5","volume-title":"Message Passing Interface Developer\u2019s and User\u2019s Conference (MPIDC)","author":"Gropp, W."},{"key":"atypb6","volume-title":"Proceedings of the 17th Annual ACM International Conference on Supercomputing","author":"Liu, J."},{"key":"atypb7","volume-title":"Employing MPI-derived datatypes to the NAS benchmarks: a case study","author":"Lu, Q.","year":"2004"},{"issue":"3","key":"atypb8","first-page":"165","volume":"8","author":"MPI Forum","year":"1994","journal-title":"International Journal of Supercomputer Applications and High Performance Computing"},{"key":"atypb9","volume-title":"Proceedings of the 10th European PVM\/MPI Users\u2019 Group conference (EuroPVM\/MPI)","author":"Ross, R."},{"key":"atypb10","volume-title":"International Parallel and Distributed Processing Symposium (IPDPS\u201904)","author":"Tipparaju, V."},{"key":"atypb11","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2000.10023"},{"key":"atypb12","volume-title":"Workshop on Communication Architecture for Clusters 2002 (in conjunction with the International Parallel and Distributed Processing Symposium)","author":"Worringen, J."},{"key":"atypb13","volume-title":"Proceedings of the IEEE International Conference on Cluster Computing","author":"Wu, J."},{"key":"atypb14","volume-title":"International Parallel and Distributed Processing Symposium (IPDPS\u201904)","author":"Wu, J."}],"container-title":["The International Journal of High Performance Computing Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1094342005054259","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1094342005054259","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T08:18:10Z","timestamp":1777450690000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1094342005054259"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2005,5]]},"references-count":14,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2005,5]]}},"alternative-id":["10.1177\/1094342005054259"],"URL":"https:\/\/doi.org\/10.1177\/1094342005054259","relation":{},"ISSN":["1094-3420","1741-2846"],"issn-type":[{"value":"1094-3420","type":"print"},{"value":"1741-2846","type":"electronic"}],"subject":[],"published":{"date-parts":[[2005,5]]}}}