{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T19:31:11Z","timestamp":1783107071451,"version":"3.54.6"},"publisher-location":"New York, NY, USA","reference-count":33,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,9,14]],"date-time":"2022-09-14T00:00:00Z","timestamp":1663113600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["265191195"],"award-info":[{"award-number":["265191195"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,9,14]]},"DOI":"10.1145\/3555819.3555853","type":"proceedings-article","created":{"date-parts":[[2022,9,14]],"date-time":"2022-09-14T22:06:08Z","timestamp":1663193168000},"page":"46-56","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Towards a Hybrid MPI Correctness Benchmark Suite"],"prefix":"10.1145","author":[{"given":"Tim","family":"Jammer","sequence":"first","affiliation":[{"name":"Technical University of Darmstadt, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"H\u00fcck","sequence":"additional","affiliation":[{"name":"Technical University of Darmstadt, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jan-Patrick","family":"Lehr","sequence":"additional","affiliation":[{"name":"Technical University of Darmstadt, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joachim","family":"Protze","sequence":"additional","affiliation":[{"name":"RWTH Aachen University, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Simon","family":"Schwitanski","sequence":"additional","affiliation":[{"name":"RWTH Aachen University, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christian","family":"Bischof","sequence":"additional","affiliation":[{"name":"Technical University of Darmstadt, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,9,14]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"2022. MPI Forum Issue Tracker. https:\/\/github.com\/mpi-forum\/mpi-issues\/issues\/117. Accessed: 2022-08-15. 2022. MPI Forum Issue Tracker. https:\/\/github.com\/mpi-forum\/mpi-issues\/issues\/117. Accessed: 2022-08-15."},{"key":"e_1_3_2_1_2_1","unstructured":"2022. ThreadSanitizer. https:\/\/clang.llvm.org\/docs\/ThreadSanitizer.html. Accessed: 2022-08-15. 2022. ThreadSanitizer. https:\/\/clang.llvm.org\/docs\/ThreadSanitizer.html. Accessed: 2022-08-15."},{"key":"e_1_3_2_1_3_1","volume-title":"ARCHER: Effectively Spotting Data Races in Large OpenMP Applications. In 2016 IEEE international parallel and distributed processing symposium (IPDPS)","author":"Atzeni Simone","year":"2016","unstructured":"Simone Atzeni , Ganesh Gopalakrishnan , Zvonimir Rakamaric , Dong\u00a0 H Ahn , Ignacio Laguna , Martin Schulz , Gregory\u00a0 L Lee , Joachim Protze , and Matthias\u00a0 S M\u00fcller . 2016 . ARCHER: Effectively Spotting Data Races in Large OpenMP Applications. In 2016 IEEE international parallel and distributed processing symposium (IPDPS) . IEEE , 53\u201362. Simone Atzeni, Ganesh Gopalakrishnan, Zvonimir Rakamaric, Dong\u00a0H Ahn, Ignacio Laguna, Martin Schulz, Gregory\u00a0L Lee, Joachim Protze, and Matthias\u00a0S M\u00fcller. 2016. ARCHER: Effectively Spotting Data Races in Large OpenMP Applications. In 2016 IEEE international parallel and distributed processing symposium (IPDPS). IEEE, 53\u201362."},{"key":"e_1_3_2_1_4_1","volume-title":"Programming with POSIX threads","author":"Butenhof R","unstructured":"David\u00a0 R Butenhof . 1997. Programming with POSIX threads . Addison-Wesley Professional . David\u00a0R Butenhof. 1997. Programming with POSIX threads. Addison-Wesley Professional."},{"key":"e_1_3_2_1_5_1","volume-title":"Tools for High Performance Computing","author":"Cramer Tim","year":"2015","unstructured":"Tim Cramer , Felix M\u00fcnchhalfen , Christian Terboven , Tobias Hilbrich , and Matthias\u00a0 S M\u00fcller . 2016. Extending MUST to Check Hybrid-Parallel Programs for Correctness Using the OpenMP Tools Interface . In Tools for High Performance Computing 2015 . Springer , 85\u2013101. Tim Cramer, Felix M\u00fcnchhalfen, Christian Terboven, Tobias Hilbrich, and Matthias\u00a0S M\u00fcller. 2016. Extending MUST to Check Hybrid-Parallel Programs for Correctness Using the OpenMP Tools Interface. In Tools for High Performance Computing 2015. Springer, 85\u2013101."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/99.660313"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2833157.2833159"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.parco.2007.07.002"},{"key":"e_1_3_2_1_9_1","volume-title":"Dynamic Data Race Detection for OpenMP Programs. In SC18: International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, 767\u2013778","author":"Gu Yizi","year":"2018","unstructured":"Yizi Gu and John Mellor-Crummey . 2018 . Dynamic Data Race Detection for OpenMP Programs. In SC18: International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, 767\u2013778 . Yizi Gu and John Mellor-Crummey. 2018. Dynamic Data Race Detection for OpenMP Programs. In SC18: International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, 767\u2013778."},{"key":"e_1_3_2_1_10_1","unstructured":"Tobias Hilbrich Bronis\u00a0R de Supinski Andreas Kn\u00fcpfer Robert Dietrich Christian Terboven Felix M\u00fcnchhalfen and Wolfgang\u00a0E Nagel. 2015. A Deadlock Detection Concept for OpenMP Tasks and Fully Hybrid MPI-OpenMP Applications. http:\/\/sc15.supercomputing.org\/sites\/all\/themes\/SC15images\/tech_poster\/poster_files\/post149s2-file3.pdf. Tobias Hilbrich Bronis\u00a0R de Supinski Andreas Kn\u00fcpfer Robert Dietrich Christian Terboven Felix M\u00fcnchhalfen and Wolfgang\u00a0E Nagel. 2015. A Deadlock Detection Concept for OpenMP Tasks and Fully Hybrid MPI-OpenMP Applications. http:\/\/sc15.supercomputing.org\/sites\/all\/themes\/SC15images\/tech_poster\/poster_files\/post149s2-file3.pdf."},{"key":"e_1_3_2_1_11_1","volume-title":"MUST: A scalable approach to runtime error detection in MPI programs. In Tools for high performance computing","author":"Hilbrich Tobias","year":"2010","unstructured":"Tobias Hilbrich , Martin Schulz , Bronis\u00a0 R de Supinski , and Matthias\u00a0 S M\u00fcller . 2010 . MUST: A scalable approach to runtime error detection in MPI programs. In Tools for high performance computing 2009. Springer , 53\u201366. Tobias Hilbrich, Martin Schulz, Bronis\u00a0R de Supinski, and Matthias\u00a0S M\u00fcller. 2010. MUST: A scalable approach to runtime error detection in MPI programs. In Tools for high performance computing 2009. Springer, 53\u201366."},{"key":"e_1_3_2_1_12_1","volume-title":"Recent Advances in the Message Passing Interface","author":"Hoefler Torsten","unstructured":"Torsten Hoefler , Greg Bronevetsky , Brian Barrett , Bronis\u00a0 R. de Supinski , and Andrew Lumsdaine . 2010. Efficient MPI Support for Advanced Hybrid Programming Models . In Recent Advances in the Message Passing Interface , Rainer Keller, Edgar Gabriel, Michael Resch, and Jack Dongarra (Eds.). Springer , Berlin, Heidelberg , 50\u201361. https:\/\/doi.org\/10.1007\/978-3-642-15646-5_6 10.1007\/978-3-642-15646-5_6 Torsten Hoefler, Greg Bronevetsky, Brian Barrett, Bronis\u00a0R. de Supinski, and Andrew Lumsdaine. 2010. Efficient MPI Support for Advanced Hybrid Programming Models. In Recent Advances in the Message Passing Interface, Rainer Keller, Edgar Gabriel, Michael Resch, and Jack Dongarra (Eds.). Springer, Berlin, Heidelberg, 50\u201361. https:\/\/doi.org\/10.1007\/978-3-642-15646-5_6"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/Correctness.2018.00011"},{"key":"e_1_3_2_1_14_1","unstructured":"Intel. 2022. Intel Inspector. https:\/\/software.intel.com\/content\/www\/us\/en\/develop\/tools\/oneapi\/components\/inspector.html. Accessed: 2022-08-15. Intel. 2022. Intel Inspector. https:\/\/software.intel.com\/content\/www\/us\/en\/develop\/tools\/oneapi\/components\/inspector.html. Accessed: 2022-08-15."},{"key":"e_1_3_2_1_15_1","unstructured":"Intel. 2022. Intel Trace Analyzer and Collector. https:\/\/software.intel.com\/content\/www\/us\/en\/develop\/tools\/oneapi\/components\/trace-analyzer.html. Accessed: 2022-08-15. Intel. 2022. Intel Trace Analyzer and Collector. https:\/\/software.intel.com\/content\/www\/us\/en\/develop\/tools\/oneapi\/components\/trace-analyzer.html. Accessed: 2022-08-15."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3295500.3356176"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/Correctness54621.2021.00008"},{"key":"e_1_3_2_1_18_1","volume-title":"Proceedings of the 30th International Symposium on High-Performance Parallel and Distributed Computing","author":"Lehr Jan-Patrick","year":"2020","unstructured":"Jan-Patrick Lehr , Tim Jammer , and Christian Bischof . 2020 . MPI-CorrBench: Towards an MPI Correctness Benchmark Suite . In Proceedings of the 30th International Symposium on High-Performance Parallel and Distributed Computing ( Virtual Event, Sweden) (HPDC \u201921). ACM, 69\u201380. https:\/\/doi.org\/10.1145\/3431379.3460652 10.1145\/3431379.3460652 Jan-Patrick Lehr, Tim Jammer, and Christian Bischof. 2020. MPI-CorrBench: Towards an MPI Correctness Benchmark Suite. In Proceedings of the 30th International Symposium on High-Performance Parallel and Distributed Computing (Virtual Event, Sweden) (HPDC \u201921). ACM, 69\u201380. https:\/\/doi.org\/10.1145\/3431379.3460652"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3126908.3126958"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/1064978.1065034"},{"key":"e_1_3_2_1_21_1","volume-title":"MPI: A Message-Passing Interface Standard Version 4.0. https:\/\/www.mpi-forum.org\/docs\/mpi-4.0\/mpi40-report.pdf.","author":"Interface Forum Message Passing","year":"2021","unstructured":"Message Passing Interface Forum . 2021 . MPI: A Message-Passing Interface Standard Version 4.0. https:\/\/www.mpi-forum.org\/docs\/mpi-4.0\/mpi40-report.pdf. Message Passing Interface Forum. 2021. MPI: A Message-Passing Interface Standard Version 4.0. https:\/\/www.mpi-forum.org\/docs\/mpi-4.0\/mpi40-report.pdf."},{"key":"e_1_3_2_1_22_1","volume-title":"Using and Improving OpenMP for Devices, Tasks, and More, Luiz DeRose, Bronis\u00a0R. de\u00a0Supinski, Stephen\u00a0L","author":"M\u00fcnchhalfen Jan\u00a0Felix","unstructured":"Jan\u00a0Felix M\u00fcnchhalfen , Tobias Hilbrich , Joachim Protze , Christian Terboven , and Matthias\u00a0 S. M\u00fcller . 2014. Classification of Common Errors in OpenMP Applications . In Using and Improving OpenMP for Devices, Tasks, and More, Luiz DeRose, Bronis\u00a0R. de\u00a0Supinski, Stephen\u00a0L . Olivier, Barbara\u00a0M. Chapman, and Matthias\u00a0S. M\u00fcller (Eds.). Springer International Publishing , Cham , 58\u201372. Jan\u00a0Felix M\u00fcnchhalfen, Tobias Hilbrich, Joachim Protze, Christian Terboven, and Matthias\u00a0S. M\u00fcller. 2014. Classification of Common Errors in OpenMP Applications. In Using and Improving OpenMP for Devices, Tasks, and More, Luiz DeRose, Bronis\u00a0R. de\u00a0Supinski, Stephen\u00a0L. Olivier, Barbara\u00a0M. Chapman, and Matthias\u00a0S. M\u00fcller (Eds.). Springer International Publishing, Cham, 58\u201372."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1250734.1250746"},{"key":"e_1_3_2_1_24_1","unstructured":"OpenMP Architecture Review Board. 2020. OpenMP - Application Programming Interface Version 5.1. https:\/\/www.openmp.org\/wp-content\/uploads\/OpenMP-API-Specification-5-1.pdf. OpenMP Architecture Review Board. 2020. OpenMP - Application Programming Interface Version 5.1. https:\/\/www.openmp.org\/wp-content\/uploads\/OpenMP-API-Specification-5-1.pdf."},{"key":"e_1_3_2_1_25_1","unstructured":"[ 25 ] Paradyn Project.[n.d.]. [25] Paradyn Project.[n.d.]."},{"key":"e_1_3_2_1_26_1","volume-title":"IWOMP(Lecture Notes in Computer Science, Vol.\u00a010468)","author":"Protze Joachim","unstructured":"Joachim Protze , Jonas Hahnfeld , Dong\u00a0 H. Ahn , Martin Schulz , and Matthias\u00a0 S. M\u00fcller . 2017. OpenMP Tools Interface: Synchronization Information for Data Race Detection . In IWOMP(Lecture Notes in Computer Science, Vol.\u00a010468) . Springer , 249\u2013265. Joachim Protze, Jonas Hahnfeld, Dong\u00a0H. Ahn, Martin Schulz, and Matthias\u00a0S. M\u00fcller. 2017. OpenMP Tools Interface: Synchronization Information for Data Race Detection. In IWOMP(Lecture Notes in Computer Science, Vol.\u00a010468). Springer, 249\u2013265."},{"key":"e_1_3_2_1_27_1","volume-title":"Hybrid MPI\/OpenMP Parallel Programming on Clusters of Multi-Core SMP Nodes. In 2009 17th Euromicro International Conference on Parallel, Distributed and Network-based Processing. 427\u2013436","author":"Rabenseifner R.","year":"2009","unstructured":"R. Rabenseifner , G. Hager , and G. Jost . 2009 . Hybrid MPI\/OpenMP Parallel Programming on Clusters of Multi-Core SMP Nodes. In 2009 17th Euromicro International Conference on Parallel, Distributed and Network-based Processing. 427\u2013436 . https:\/\/doi.org\/10.1109\/PDP. 2009 .43 10.1109\/PDP.2009.43 R. Rabenseifner, G. Hager, and G. Jost. 2009. Hybrid MPI\/OpenMP Parallel Programming on Clusters of Multi-Core SMP Nodes. In 2009 17th Euromicro International Conference on Parallel, Distributed and Network-based Processing. 427\u2013436. https:\/\/doi.org\/10.1109\/PDP.2009.43"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1177\/1094342014552204"},{"key":"e_1_3_2_1_29_1","volume-title":"Dynamic Race Detection with LLVM Compiler. In International Conference on Runtime Verification. Springer, 110\u2013114","author":"Serebryany Konstantin","year":"2011","unstructured":"Konstantin Serebryany , Alexander Potapenko , Timur Iskhodzhanov , and Dmitriy Vyukov . 2011 . Dynamic Race Detection with LLVM Compiler. In International Conference on Runtime Verification. Springer, 110\u2013114 . Konstantin Serebryany, Alexander Potapenko, Timur Iskhodzhanov, and Dmitriy Vyukov. 2011. Dynamic Race Detection with LLVM Compiler. In International Conference on Runtime Verification. Springer, 110\u2013114."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2377978.2377981"},{"key":"e_1_3_2_1_31_1","volume-title":"International Workshop on OpenMP. Springer, 312\u2013323","author":"S\u00fc\u00df Michael","year":"2005","unstructured":"Michael S\u00fc\u00df and Claudia Leopold . 2005 . Common mistakes in OpenMP and how to avoid them . In International Workshop on OpenMP. Springer, 312\u2013323 . Michael S\u00fc\u00df and Claudia Leopold. 2005. Common mistakes in OpenMP and how to avoid them. In International Workshop on OpenMP. Springer, 312\u2013323."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"crossref","unstructured":"Jesper\u00a0Larsson Tr\u00e4ff. 2016. A Library for Advanced Datatype Programming. In EuroMPI. ACM 98\u2013107. Jesper\u00a0Larsson Tr\u00e4ff. 2016. A Library for Advanced Datatype Programming. In EuroMPI. ACM 98\u2013107.","DOI":"10.1145\/2966884.2966904"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/370049.370462"}],"event":{"name":"EuroMPI\/USA'22: 29th European MPI Users' Group Meeting","location":"Chattanooga TN USA","acronym":"EuroMPI\/USA'22"},"container-title":["Proceedings of the 29th European MPI Users' Group Meeting"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3555819.3555853","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3555819.3555853","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:36Z","timestamp":1750182696000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3555819.3555853"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,14]]},"references-count":33,"alternative-id":["10.1145\/3555819.3555853","10.1145\/3555819"],"URL":"https:\/\/doi.org\/10.1145\/3555819.3555853","relation":{},"subject":[],"published":{"date-parts":[[2022,9,14]]},"assertion":[{"value":"2022-09-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}