{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T12:40:42Z","timestamp":1761396042405,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":59,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,6,3]],"date-time":"2021-06-03T00:00:00Z","timestamp":1622678400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"U.S. Department of Energy","award":["DE-AC02-06CH11357"],"award-info":[{"award-number":["DE-AC02-06CH11357"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,6,3]]},"DOI":"10.1145\/3447818.3460380","type":"proceedings-article","created":{"date-parts":[[2021,6,4]],"date-time":"2021-06-04T15:09:36Z","timestamp":1622819376000},"page":"354-366","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Topology-aware optimizations for multi-GPU ptychographic image reconstruction"],"prefix":"10.1145","author":[{"given":"Xiaodong","family":"Yu","sequence":"first","affiliation":[{"name":"Argonne National Laboratory"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tekin","family":"Bicer","sequence":"additional","affiliation":[{"name":"Argonne National Laboratory"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rajkumar","family":"Kettimuthu","sequence":"additional","affiliation":[{"name":"Argonne National Laboratory"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ian","family":"Foster","sequence":"additional","affiliation":[{"name":"Argonne National Laboratory"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,6,4]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"AMD. (accessed Oct. 20 2020). Workload Tuning Guide for AMD EPYC\u2122 7002 Series Processor Based Servers. https:\/\/developer.amd.com\/wp-content\/resources\/56745_0.80.pdf.  AMD. (accessed Oct. 20 2020). Workload Tuning Guide for AMD EPYC\u2122 7002 Series Processor Based Servers. https:\/\/developer.amd.com\/wp-content\/resources\/56745_0.80.pdf."},{"key":"e_1_3_2_1_2_1","volume-title":"Distributed optimization with tunable learned priors for robust ptycho-tomography. arXiv preprint arXiv:2009.09498","author":"Aslan Selin","year":"2020","unstructured":"Selin Aslan , Zhengchun Liu , Viktor Nikitin , Tekin Bicer , Sven Leyffer , and Doga Gursoy . 2020. Distributed optimization with tunable learned priors for robust ptycho-tomography. arXiv preprint arXiv:2009.09498 ( 2020 ). Selin Aslan, Zhengchun Liu, Viktor Nikitin, Tekin Bicer, Sven Leyffer, and Doga Gursoy. 2020. Distributed optimization with tunable learned priors for robust ptycho-tomography. arXiv preprint arXiv:2009.09498 (2020)."},{"key":"e_1_3_2_1_3_1","volume-title":"Joint ptycho-tomography reconstruction through alternating direction method of multipliers. Optics express 27, 6","author":"Aslan Selin","year":"2019","unstructured":"Selin Aslan , Viktor Nikitin , Daniel J Ching , Tekin Bicer , Sven Leyffer , and Do\u011fa G\u00fcrsoy . 2019. Joint ptycho-tomography reconstruction through alternating direction method of multipliers. Optics express 27, 6 ( 2019 ), 9128--9143. Selin Aslan, Viktor Nikitin, Daniel J Ching, Tekin Bicer, Sven Leyffer, and Do\u011fa G\u00fcrsoy. 2019. Joint ptycho-tomography reconstruction through alternating direction method of multipliers. Optics express 27, 6 (2019), 9128--9143."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/CCGRID.2019.00064"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3018743.3018769"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807591.2807611"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3155284.3018756"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3392717.3392771"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1051\/epn:2008003"},{"key":"e_1_3_2_1_10_1","volume-title":"Ptychographic X-ray computed tomography at the nanoscale. Nature 467, 7314","author":"Dierolf Martin","year":"2010","unstructured":"Martin Dierolf , Andreas Menzel , Pierre Thibault , Philipp Schneider , Cameron M Kewish , Roger Wepf , Oliver Bunk , and Franz Pfeiffer . 2010. Ptychographic X-ray computed tomography at the nanoscale. Nature 467, 7314 ( 2010 ), 436--439. Martin Dierolf, Andreas Menzel, Pierre Thibault, Philipp Schneider, Cameron M Kewish, Roger Wepf, Oliver Bunk, and Franz Pfeiffer. 2010. Ptychographic X-ray computed tomography at the nanoscale. Nature 467, 7314 (2010), 436--439."},{"key":"e_1_3_2_1_11_1","volume-title":"High-Performance Multi-Mode Ptychography Reconstruction on Distributed GPUs. arXiv preprint arXiv:1808.10375","author":"Dong Zhihua","year":"2018","unstructured":"Zhihua Dong , Yao-Lung L Fang , Xiaojing Huang , Hanfei Yan , Sungsoo Ha , Wei Xu , Yong S Chu , Stuart I Campbell , and Meifeng Lin . 2018. High-Performance Multi-Mode Ptychography Reconstruction on Distributed GPUs. arXiv preprint arXiv:1808.10375 ( 2018 ). Zhihua Dong, Yao-Lung L Fang, Xiaojing Huang, Hanfei Yan, Sungsoo Ha, Wei Xu, Yong S Chu, Stuart I Campbell, and Meifeng Lin. 2018. High-Performance Multi-Mode Ptychography Reconstruction on Distributed GPUs. arXiv preprint arXiv:1808.10375 (2018)."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1098\/rspa.2016.0640"},{"key":"e_1_3_2_1_13_1","volume-title":"High Performance Partial Coherent X-Ray Ptychography. In International Conference on Computational Science. Springer, 46--59","author":"Enfedaque Pablo","year":"2019","unstructured":"Pablo Enfedaque , Huibin Chang , Bjoern Enders , David Shapiro , and Stefano Marchesini . 2019 . High Performance Partial Coherent X-Ray Ptychography. In International Conference on Computational Science. Springer, 46--59 . Pablo Enfedaque, Huibin Chang, Bjoern Enders, David Shapiro, and Stefano Marchesini. 2019. High Performance Partial Coherent X-Ray Ptychography. In International Conference on Computational Science. Springer, 46--59."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/MM.2017.37"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2019.00087"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/CCGrid.2012.51"},{"key":"e_1_3_2_1_17_1","unstructured":"William Gropp. (accessed Oct. 20 2020). Strategies for Parallelism and Halo Exchange. https:\/\/wgropp.cs.illinois.edu\/courses\/cs598-s15\/lectures\/lecture25.pdf.  William Gropp. (accessed Oct. 20 2020). Strategies for Parallelism and Halo Exchange. https:\/\/wgropp.cs.illinois.edu\/courses\/cs598-s15\/lectures\/lecture25.pdf."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.parco.2019.01.001"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/SC41405.2020.00041"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3295500.3356220"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.1643"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1995896.1995909"},{"key":"e_1_3_2_1_23_1","volume-title":"Highly Efficient Compensation-Based Parallelism for Wavefront Loops on GPUs. In 2018 IEEE International Parallel and Distributed Processing Symposium (IPDPS). IEEE, 276--285","author":"Hou Kaixi","year":"2018","unstructured":"Kaixi Hou , Hao Wang , Wu-chun Feng, Jeffrey S Vetter , and Seyong Lee . 2018 . Highly Efficient Compensation-Based Parallelism for Wavefront Loops on GPUs. In 2018 IEEE International Parallel and Distributed Processing Symposium (IPDPS). IEEE, 276--285 . Kaixi Hou, Hao Wang, Wu-chun Feng, Jeffrey S Vetter, and Seyong Lee. 2018. Highly Efficient Compensation-Based Parallelism for Wavefront Loops on GPUs. In 2018 IEEE International Parallel and Distributed Processing Symposium (IPDPS). IEEE, 276--285."},{"key":"e_1_3_2_1_24_1","unstructured":"IBM. 2018 (accessed Oct. 20 2020). IBM Spectrum MPI: Accelerating high-performance application parallelization. https:\/\/www.ibm.com\/us-en\/marketplace\/spectrum-mpi.  IBM. 2018 (accessed Oct. 20 2020). IBM Spectrum MPI: Accelerating high-performance application parallelization. https:\/\/www.ibm.com\/us-en\/marketplace\/spectrum-mpi."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS47924.2020.00019"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2000.846009"},{"key":"e_1_3_2_1_27_1","unstructured":"Network-Based Computing Laboratory. 2001 (accessed Oct. 20 2020). MVAPICH: MPI over InfiniBand Omni-Path Ethernet\/iWARP and RoCE. http:\/\/mvapich.cse.ohio-state.edu\/.  Network-Based Computing Laboratory. 2001 (accessed Oct. 20 2020). MVAPICH: MPI over InfiniBand Omni-Path Ethernet\/iWARP and RoCE. http:\/\/mvapich.cse.ohio-state.edu\/."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2019.2928289"},{"volume-title":"2018 IEEE International Symposium on Workload Characterization (IISWC). IEEE, 191--202","author":"Li Ang","key":"e_1_3_2_1_29_1","unstructured":"Ang Li , Shuaiwen Leon Song , Jieyang Chen , Xu Liu , Nathan Tallent , and Kevin Barker . [n.d.]. Tartan : evaluating modern GPU interconnect via a multi-GPU benchmark suite . In 2018 IEEE International Symposium on Workload Characterization (IISWC). IEEE, 191--202 . Ang Li, Shuaiwen Leon Song, Jieyang Chen, Xu Liu, Nathan Tallent, and Kevin Barker. [n.d.]. Tartan: evaluating modern GPU interconnect via a multi-GPU benchmark suite. In 2018 IEEE International Symposium on Workload Characterization (IISWC). IEEE, 191--202."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ultramic.2009.05.012"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1107\/S1600576716012279"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1107\/S1600576716008074"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/HiPC.2017.00047"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"crossref","unstructured":"Dmitriy Morozov and Tom Peterka. 2016. Block-Parallel Data Analysis with DIY2. (2016).  Dmitriy Morozov and Tom Peterka. 2016. Block-Parallel Data Analysis with DIY2. (2016).","DOI":"10.1109\/LDAV.2016.7874307"},{"key":"e_1_3_2_1_35_1","unstructured":"Open MPI. 2004 (accessed Oct. 20 2020). Open MPI: Open Source High Performance Computing. https:\/\/www.open-mpi.org\/.  Open MPI. 2004 (accessed Oct. 20 2020). Open MPI: Open Source High Performance Computing. https:\/\/www.open-mpi.org\/."},{"key":"e_1_3_2_1_36_1","volume-title":"Parallel ptychographic reconstruction. Optics express 22, 26","author":"Nashed Youssef SG","year":"2014","unstructured":"Youssef SG Nashed , David J Vine , Tom Peterka , Junjing Deng , Rob Ross , and Chris Jacobsen . 2014. Parallel ptychographic reconstruction. Optics express 22, 26 ( 2014 ), 32082--32097. Youssef SG Nashed, David J Vine, Tom Peterka, Junjing Deng, Rob Ross, and Chris Jacobsen. 2014. Parallel ptychographic reconstruction. Optics express 22, 26 (2014), 32082--32097."},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1364\/OSAC.2.002948"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3079079.3079100"},{"key":"e_1_3_2_1_39_1","unstructured":"NVIDIA. (accessed Oct. 20 2020)a. NVIDIA Collective Communication Library (NCCL) Documentation. https:\/\/docs.nvidia.com\/deeplearning\/nccl\/user-guide\/docs\/.  NVIDIA. (accessed Oct. 20 2020)a. NVIDIA Collective Communication Library (NCCL) Documentation. https:\/\/docs.nvidia.com\/deeplearning\/nccl\/user-guide\/docs\/."},{"key":"e_1_3_2_1_40_1","unstructured":"NVIDIA. (accessed Oct. 20 2020)b. NVIDIA Collective Communication Library (NCCL) Documentation. https:\/\/docs.nvidia.com\/deeplearning\/nccl\/user-guide\/docs\/usage\/p2p.html\\#neighbor-exchange.  NVIDIA. (accessed Oct. 20 2020)b. NVIDIA Collective Communication Library (NCCL) Documentation. https:\/\/docs.nvidia.com\/deeplearning\/nccl\/user-guide\/docs\/usage\/p2p.html\\#neighbor-exchange."},{"key":"e_1_3_2_1_41_1","volume-title":"Iterative least-squares solver for generalized maximum-likelihood ptychography. Optics express 26, 3","author":"Odstr\u010dil Michal","year":"2018","unstructured":"Michal Odstr\u010dil , Andreas Menzel , and Manuel Guizar-Sicairos . 2018. Iterative least-squares solver for generalized maximum-likelihood ptychography. Optics express 26, 3 ( 2018 ), 3108--3123. Michal Odstr\u010dil, Andreas Menzel, and Manuel Guizar-Sicairos. 2018. Iterative least-squares solver for generalized maximum-likelihood ptychography. Optics express 26, 3 (2018), 3108--3123."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2017.117"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/LDAV.2011.6092324"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41566-017-0072-5"},{"key":"e_1_3_2_1_45_1","volume-title":"High-resolution scanning x-ray diffraction microscopy. Science 321, 5887","author":"Thibault Pierre","year":"2008","unstructured":"Pierre Thibault , Martin Dierolf , Andreas Menzel , Oliver Bunk , Christian David , and Franz Pfeiffer . 2008. High-resolution scanning x-ray diffraction microscopy. Science 321, 5887 ( 2008 ), 379--382. Pierre Thibault, Martin Dierolf, Andreas Menzel, Oliver Bunk, Christian David, and Franz Pfeiffer. 2008. High-resolution scanning x-ray diffraction microscopy. Science 321, 5887 (2008), 379--382."},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3410463.3414624"},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1107\/S1600576720001776"},{"key":"e_1_3_2_1_48_1","volume-title":"Proceedings of Machine Learning and Systems, I. Dhillon, D. Papailiopoulos, and V. Sze (Eds.)","volume":"2","author":"Wang Guanhua","year":"2020","unstructured":"Guanhua Wang , Shivaram Venkataraman , Amar Phanishayee , Nikhil Devanur , Jorgen Thelin , and Ion Stoica . 2020 . Blink: Fast and Generic Collectives for Distributed ML . In Proceedings of Machine Learning and Systems, I. Dhillon, D. Papailiopoulos, and V. Sze (Eds.) , Vol. 2 . 172--186. https:\/\/proceedings.mlsys.org\/paper\/2020\/file\/43ec517d68b6edd3015b3edc9a11367b-Paper.pdf Guanhua Wang, Shivaram Venkataraman, Amar Phanishayee, Nikhil Devanur, Jorgen Thelin, and Ion Stoica. 2020. Blink: Fast and Generic Collectives for Distributed ML. In Proceedings of Machine Learning and Systems, I. Dhillon, D. Papailiopoulos, and V. Sze (Eds.), Vol. 2. 172--186. https:\/\/proceedings.mlsys.org\/paper\/2020\/file\/43ec517d68b6edd3015b3edc9a11367b-Paper.pdf"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2013.222"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2925426.2926256"},{"key":"e_1_3_2_1_51_1","volume-title":"Image quality assessment: from error visibility to structural similarity","author":"Wang Zhou","year":"2004","unstructured":"Zhou Wang , Alan C Bovik , Hamid R Sheikh , and Eero P Simoncelli . 2004. Image quality assessment: from error visibility to structural similarity . IEEE transactions on image processing 13, 4 ( 2004 ), 600--612. Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli. 2004. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing 13, 4 (2004), 600--612."},{"volume-title":"Deep packet inspection on large datasets: algorithmic and parallelization techniques for accelerating regular expression matching on many-core processors","author":"Xiaodong Yu.","key":"e_1_3_2_1_52_1","unstructured":"Xiaodong Yu. 2013. Deep packet inspection on large datasets: algorithmic and parallelization techniques for accelerating regular expression matching on many-core processors . University of Missouri-Columbia . Xiaodong Yu. 2013. Deep packet inspection on large datasets: algorithmic and parallelization techniques for accelerating regular expression matching on many-core processors. University of Missouri-Columbia."},{"key":"e_1_3_2_1_54_1","unstructured":"Xiaodong Yu and Michela Becchi. 2013a. Exploring Different Automata Representations for Efficient Regular Expression Matching on GPUs. SIGPLAN Not. (2013).  Xiaodong Yu and Michela Becchi. 2013a. Exploring Different Automata Representations for Efficient Regular Expression Matching on GPUs. SIGPLAN Not. (2013)."},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/2482767.2482791"},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/CCGrid.2016.96"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3075564.3078889"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11265-018-1352-0"},{"key":"e_1_3_2_1_59_1","volume-title":"GPU-Based Static Data-Flow Analysis for Fast and Scalable Android App Vetting. In The 34th IEEE International Parallel and Distributed Processing Symposium (IPDPS). IEEE.","author":"Yu Xiaodong","year":"2020","unstructured":"Xiaodong Yu , Fengguo Wei , Xinming Ou , Michela Becchi , Tekin Bicer , and Danfeng (Daphne) Yao . 2020 . GPU-Based Static Data-Flow Analysis for Fast and Scalable Android App Vetting. In The 34th IEEE International Parallel and Distributed Processing Symposium (IPDPS). IEEE. Xiaodong Yu, Fengguo Wei, Xinming Ou, Michela Becchi, Tekin Bicer, and Danfeng (Daphne) Yao. 2020. GPU-Based Static Data-Flow Analysis for Fast and Scalable Android App Vetting. In The 34th IEEE International Parallel and Distributed Processing Symposium (IPDPS). IEEE."},{"key":"e_1_3_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCBB.2015.2489662"}],"event":{"name":"ICS '21: 2021 International Conference on Supercomputing","sponsor":["SIGARCH ACM Special Interest Group on Computer Architecture"],"location":"Virtual Event USA","acronym":"ICS '21"},"container-title":["Proceedings of the ACM International Conference on Supercomputing"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447818.3460380","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3447818.3460380","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3447818.3460380","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T17:49:27Z","timestamp":1750268967000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447818.3460380"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,3]]},"references-count":59,"alternative-id":["10.1145\/3447818.3460380","10.1145\/3447818"],"URL":"https:\/\/doi.org\/10.1145\/3447818.3460380","relation":{},"subject":[],"published":{"date-parts":[[2021,6,3]]},"assertion":[{"value":"2021-06-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}