{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T23:51:20Z","timestamp":1787701880465,"version":"build-2784847793"},"reference-count":70,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"2","funder":[{"name":"Platform for Advanced Scientific Computing"},{"DOI":"10.13039\/501100021847","name":"Swiss National Supercomputing Centre","doi-asserted-by":"crossref","award":["s922"],"award-info":[{"award-number":["s922"]}],"id":[{"id":"10.13039\/501100021847","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100021847","name":"Swiss National Supercomputing Centre","doi-asserted-by":"crossref","award":["s961"],"award-info":[{"award-number":["s961"]}],"id":[{"id":"10.13039\/501100021847","id-type":"DOI","asserted-by":"crossref"}]},{"name":"eu center of excellence","award":["823844"],"award-info":[{"award-number":["823844"]}]},{"DOI":"10.13039\/100010663","name":"H2020 European Research Council","doi-asserted-by":"publisher","award":["714069"],"award-info":[{"award-number":["714069"]}],"id":[{"id":"10.13039\/100010663","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001711","name":"Schweizerischer Nationalfonds zur F\u00f6rderung der Wissenschaftlichen Forschung","doi-asserted-by":"publisher","award":["175322"],"award-info":[{"award-number":["175322"]}],"id":[{"id":"10.13039\/501100001711","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1931524"],"award-info":[{"award-number":["1931524"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000015","name":"U.S. Department of Energy","doi-asserted-by":"publisher","award":["DE-AC02-06CH11357"],"award-info":[{"award-number":["DE-AC02-06CH11357"]}],"id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM J. Sci. Comput."],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:p>Large-scale PDE simulations using high-order finite-element methods on unstructured meshes are an indispensable tool in science and engineering. The widely used open-source PETSc library offers an efficient representation of generic unstructured meshes within its DMPlex module. This paper details our recent implementation of parallel mesh reading and topological interpolation (computation of edges and faces from a cell-vertex mesh) into DMPlex. We apply these developments to seismic wave propagation scenarios on Mars as an example application. The principal motivation is to overcome single-node memory limits and reach mesh sizes which were impossible before. Moreover, we demonstrate that scalability of I\/O and topological interpolation goes beyond 12,000 cores, and memory-imposed limits on mesh size vanish.<\/jats:p>","DOI":"10.1137\/20m1332748","type":"journal-article","created":{"date-parts":[[2021,3,11]],"date-time":"2021-03-11T10:44:55Z","timestamp":1615459495000},"page":"C127-C153","source":"Crossref","is-referenced-by-count":19,"title":["Fully Parallel Mesh I\/O Using PETSc DMPlex with an Application to Waveform Modeling"],"prefix":"10.1137","volume":"43","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9190-2207","authenticated-orcid":true,"given":"Vaclav","family":"Hapla","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew G.","family":"Knepley","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Afanasiev","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christian","family":"Boehm","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martin","family":"van Driel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lion","family":"Krischer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andreas","family":"Fichtner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2021,3,11]]},"reference":[{"key":"atypb1","volume-title":"https:\/\/fenicsproject.org\/ (10","author":"Project CS","year":"2020"},{"key":"atypb2","volume-title":"User's Guide, https:\/\/ftp.mcs.anl.gov\/pub\/fathom\/moab-docs\/contents.html (10","author":"MOAB","year":"2020"},{"key":"atypb3","volume-title":"https:\/\/scorec.rpi.edu\/pumi\/PUMI.pdf (11","author":"User's Guide The PUMI","year":"2020"},{"key":"atypb4","volume-title":"https:\/\/github.com\/MeshToolkit\/MSTK (11","author":"MSTK","year":"2020"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1093\/gji\/ggy469"},{"key":"atypb6","volume-title":"Arch. Numer. Softw., 3","author":"M. S.","year":"2015"},{"key":"atypb7","volume-title":"MFEM: A Modular Finite Element Methods Library","author":"Anderson R.","year":"2020"},{"key":"atypb8","volume-title":"PETSc, https:\/\/www.mcs.anl.gov\/petsc (30","author":"Balay S.","year":"2020"},{"key":"atypb9","volume-title":"Argonne National Laboratory, 2020","author":"Balay S.","year":"2020"},{"key":"atypb10","first-page":"163","volume-title":"Birkh\u00e4user","author":"Balay S.","year":"1997"},{"key":"atypb11","doi-asserted-by":"publisher","DOI":"10.1038\/s41561-020-0544-y"},{"key":"atypb12","volume-title":"Anisotropic Mesh Adaptation in Firedrake with PETSc DMPlex","author":"Barral N.","year":"2016"},{"key":"atypb13","volume-title":"Sandia National Laboratories","author":"Baur D. G.","year":"2010"},{"key":"atypb14","volume-title":"Zoltan, https:\/\/cs.sandia.gov\/Zoltan","author":"Boman E.","year":"1999"},{"key":"atypb15","volume-title":"Sandia National Laboratories","author":"Boman E.","year":"2007"},{"key":"atypb16","doi-asserted-by":"publisher","DOI":"10.1002\/nme.5172"},{"key":"atypb17","volume-title":"Star Forests as a Parallel Communication Model","author":"Brown J.","year":"2011"},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1109\/ISPDC.2012.16"},{"key":"atypb19","doi-asserted-by":"publisher","DOI":"10.1109\/MCSE.2014.95"},{"key":"atypb20","doi-asserted-by":"publisher","DOI":"10.1137\/110827077"},{"key":"atypb21","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2010.25"},{"key":"atypb22","doi-asserted-by":"publisher","DOI":"10.1137\/100791634"},{"key":"atypb23","doi-asserted-by":"publisher","DOI":"10.1115\/1.2052830"},{"key":"atypb24","doi-asserted-by":"publisher","DOI":"10.1016\/j.parco.2007.12.001"},{"key":"atypb25","volume-title":"Sonexion Administration Guide","author":"Enterprise Hewlett-Packard","year":"2018"},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2016.05.011"},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1137\/18M1219370"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.1093\/gji\/ggx384"},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-15807-0"},{"key":"atypb30","doi-asserted-by":"publisher","DOI":"10.1006\/jpdc.1997.1412"},{"key":"atypb31","volume-title":"Technical report, https:\/\/github.com\/MeshToolkit\/MSTK\/blob\/master\/docs\/MSTK.pdf (11","author":"Garimella R. V.","year":"2020"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1002\/nme.509"},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1038\/s41561-020-0539-8"},{"key":"atypb34","volume-title":"https:\/\/portal.hdfgroup.org\/display\/HDF5\/HDF5 (20","author":"HDF5 Group","year":"2020"},{"key":"atypb35","volume-title":"https:\/\/portal.hdfgroup.org\/display\/HDF5\/Parallel+HDF5 (20","author":"HDF5 Group","year":"2020"},{"key":"atypb36","volume-title":"The Finite Element Method: Linear Static and Dynamic Finite Element Analysis","author":"Hughes T.","year":"2000"},{"key":"atypb37","doi-asserted-by":"publisher","DOI":"10.1137\/140970963"},{"key":"atypb38","volume-title":"Support for Non-Conformal Meshes in PETSc's DMPlex Interface","author":"Isaac T.","year":"2015"},{"key":"atypb39","volume-title":"HPDDM---High-Performance Unified Framework for Domain Decomposition Methods, https:\/\/github.com\/hpddm\/hpddm (18","author":"Jolivet P.","year":"2020"},{"key":"atypb40","unstructured":"G. Karypis et al.\n                      METIS-Serial Graph Partitioning and Fill-Reducing Matrix Ordering\n                      ,http:\/\/glaros.dtc.umn.edu\/gkhome\/metis\/metis\/overview(17 March 2020)."},{"key":"atypb41","unstructured":"G. Karypis et al.\n                      ParMETIS-Parallel Graph Partitioning and Fill-Reducing Matrix Ordering\n                      ,http:\/\/glaros.dtc.umn.edu\/gkhome\/metis\/parmetis\/overview(17 March 2020)."},{"key":"atypb42","doi-asserted-by":"publisher","DOI":"10.1137\/S1064827595287997"},{"key":"atypb43","doi-asserted-by":"publisher","DOI":"10.1006\/jpdc.1997.1403"},{"key":"atypb44","doi-asserted-by":"publisher","DOI":"10.1155\/2009\/948613"},{"key":"atypb45","volume-title":"Unstructured Overlapping Mesh Distribution in Parallel","author":"Knepley M. G.","year":"2015"},{"key":"atypb46","doi-asserted-by":"publisher","DOI":"10.5194\/gmd-11-4359-2018"},{"key":"atypb47","first-page":"71","volume-title":"Proceedings of the 3rd International Conference on Exascale Applications and Software, EASC '15","author":"Lange M.","year":"2015"},{"key":"atypb48","doi-asserted-by":"publisher","DOI":"10.1137\/15M1026092"},{"key":"atypb49","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33287-6"},{"key":"atypb50","doi-asserted-by":"publisher","DOI":"10.1504\/IJCSE.2009.029164"},{"key":"atypb51","doi-asserted-by":"publisher","DOI":"10.1145\/1731022.1731030"},{"key":"atypb52","doi-asserted-by":"publisher","DOI":"10.1007\/s11214-018-0574-6"},{"key":"atypb53","volume-title":"MPI: A Message-Passing Interface Standard. Version 3.1","author":"Interface Forum Message Passing","year":"2015"},{"key":"atypb54","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-246X.2008.03813.x"},{"key":"atypb55","volume-title":"Lustre Software Release 2.x - Operations Manual","author":"Oracle and Intel Corporation","year":"2017"},{"key":"atypb56","doi-asserted-by":"publisher","DOI":"10.1016\/0021-9991(84)90128-1"},{"key":"atypb57","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-246X.2011.05044.x"},{"key":"atypb58","first-page":"10","volume":"43","author":"Rathgeber F.","year":"2016","journal-title":"ACM Trans. Math. Software"},{"key":"atypb59","unstructured":"C. Richardson and G. Wells,\n                      Parallel I\/O and parallel refinement\n                      ,https:\/\/fenicsproject.org\/pub\/workshops\/fenics13\/slides\/Richardson.pdf(accessed 2020-09-10)."},{"key":"atypb60","doi-asserted-by":"publisher","DOI":"10.1145\/2807591.2807675"},{"key":"atypb61","doi-asserted-by":"publisher","DOI":"10.1142\/S021819590000022X"},{"key":"atypb62","doi-asserted-by":"publisher","DOI":"10.2172\/10102115"},{"key":"atypb63","doi-asserted-by":"crossref","unstructured":"S. Seol, C. W. Smith, D. A. Ibanez, and M. S. Shephard,\n                      A parallel unstructured mesh infrastructure\n                      , in 2012 SC Companion: High Performance Computing, Networking Storage and Analysis, Salt Lake City, UT, 2012, IEEE, pp. 1124-1132,https:\/\/doi.org\/10.1109\/SC.Companion.2012.135.","DOI":"10.1109\/SC.Companion.2012.135"},{"key":"atypb64","doi-asserted-by":"publisher","DOI":"10.1002\/9780470558027.ch19"},{"key":"atypb65","volume-title":"Technical report","author":"Development Team Sierra Toolkit","year":"2018"},{"key":"atypb66","volume-title":"Sandia National Laboratories","author":"Tautges T. J.","year":"2004"},{"key":"atypb67","unstructured":"T. Jones,\n                      CPFDSoftware\/gmv\n                      , 2020,https:\/\/github.com\/CPFDSoftware\/gmv(accessed 2020-09-11)."},{"key":"atypb68","doi-asserted-by":"publisher","DOI":"10.1093\/gji\/ggaa058"},{"key":"atypb69","unstructured":"XDMF - eXtensible Data Model and Format\n                      ,http:\/\/www.xdmf.org\/(accessed 2020-03-20)."},{"key":"atypb70","volume-title":"The Finite Element Method: its Basis and Fundamentals (Seventh Edition)","author":"Zienkiewicz O.","year":"2013","edition":"7"}],"container-title":["SIAM Journal on Scientific Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/20M1332748","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T17:35:19Z","timestamp":1787333719000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/20M1332748"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1]]},"references-count":70,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["10.1137\/20M1332748"],"URL":"https:\/\/doi.org\/10.1137\/20m1332748","relation":{},"ISSN":["1064-8275","1095-7197"],"issn-type":[{"value":"1064-8275","type":"print"},{"value":"1095-7197","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1]]}}}