{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T04:19:13Z","timestamp":1778645953522,"version":"3.51.4"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2020,3,31]],"date-time":"2020-03-31T00:00:00Z","timestamp":1585612800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Argonne Leadership Computing Facility"},{"name":"DOE Office of Science User Facility","award":["DE-AC02-06CH11357"],"award-info":[{"award-number":["DE-AC02-06CH11357"]}]},{"name":"Office of Science of the U.S. Department of Energy","award":["DE-AC02-05CH11231"],"award-info":[{"award-number":["DE-AC02-05CH11231"]}]},{"DOI":"10.13039\/100006132","name":"Office of Science","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100006132","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100006192","name":"Advanced Scientific Computing Research","doi-asserted-by":"crossref","award":["DE-AC02-06CH11357"],"award-info":[{"award-number":["DE-AC02-06CH11357"]}],"id":[{"id":"10.13039\/100006192","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Argonne\u2019s Resilient Infrastructure Initiative and Laboratory Directed Research and Development","award":["2017-088-R1"],"award-info":[{"award-number":["2017-088-R1"]}]},{"DOI":"10.13039\/100017223","name":"National Energy Research Scientific Computing Center","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100017223","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000015","name":"U.S. Department of Energy","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Math. Softw."],"published-print":{"date-parts":[[2020,3,31]]},"abstract":"<jats:p>We present DMNetwork, a high-level package included in the PETSc library for the simulation of multiphysics phenomena over large-scale networked systems. The library aims at applications that have networked structures such as those in electrical, gas, and water distribution systems. DMNetwork provides data and topology management, parallelization for multiphysics systems over a network, and hierarchical and composable solvers to exploit the problem structure. DMNetwork eases the simulation development cycle by providing the necessary infrastructure through simple abstractions to define and query the network components. This article presents the design of DMNetwork, illustrates its user interface, and demonstrates its ability to solve multiphysics systems, such as an electric circuit, a network of power grid and water subnetworks, and transient hydraulic systems over large networks with more than 2 billion variables on extreme-scale computers using up to 30,000 processors.<\/jats:p>","DOI":"10.1145\/3344587","type":"journal-article","created":{"date-parts":[[2020,5,4]],"date-time":"2020-05-04T14:37:58Z","timestamp":1588603078000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["PETSc DMNetwork"],"prefix":"10.1145","volume":"46","author":[{"given":"Shrirang","family":"Abhyankar","sequence":"first","affiliation":[{"name":"Argonne National Laboratory, Lemont, IL"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Getnet","family":"Betrie","sequence":"additional","affiliation":[{"name":"Argonne National Laboratory, Lemont, IL"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel Adrian","family":"Maldonado","sequence":"additional","affiliation":[{"name":"Argonne National Laboratory, Lemont, IL"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lois C.","family":"Mcinnes","sequence":"additional","affiliation":[{"name":"Argonne National Laboratory, Lemont, IL"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Barry","family":"Smith","sequence":"additional","affiliation":[{"name":"Argonne National Laboratory, Lemont, IL"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hong","family":"Zhang","sequence":"additional","affiliation":[{"name":"Argonne National Laboratory, Lemont, IL"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,4,26]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Basco","author":"Abbott Michael Barry","year":"1989","unstructured":"Michael Barry Abbott and David R . Basco . 1989 . Computational Fluid Dynamics: An Introduction for Engineers. Longman Pub Group . Michael Barry Abbott and David R. Basco. 1989. Computational Fluid Dynamics: An Introduction for Engineers. Longman Pub Group."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the 1st International Workshop on High Performance Computing, Networking, and Analytics for the Power Grid. ACM","author":"Abhyankar Shrirang","year":"1957","unstructured":"Shrirang Abhyankar , Barry Smith , Hong Zhang , and A. Flueck . 2011. Using PETSc to develop scalable applications for next-generation power grid . In Proceedings of the 1st International Workshop on High Performance Computing, Networking, and Analytics for the Power Grid. ACM , New York, NY. http:\/\/www.mcs.anl.gov\/uploads\/cels\/papers\/P 1957 -0911.pdf. Shrirang Abhyankar, Barry Smith, Hong Zhang, and A. Flueck. 2011. Using PETSc to develop scalable applications for next-generation power grid. In Proceedings of the 1st International Workshop on High Performance Computing, Networking, and Analytics for the Power Grid. ACM, New York, NY. http:\/\/www.mcs.anl.gov\/uploads\/cels\/papers\/P1957-0911.pdf."},{"key":"e_1_2_1_3_1","volume-title":"Retrieved on","author":"ALCF.","year":"2018","unstructured":"ALCF. 2018 . Argonne Leadership Computing Facility . Retrieved on March 17, 2020 from https:\/\/www.alcf.anl.gov\/. ALCF. 2018. Argonne Leadership Computing Facility. Retrieved on March 17, 2020 from https:\/\/www.alcf.anl.gov\/."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1137\/S0895479899358194"},{"key":"e_1_2_1_5_1","volume-title":"Retrieved","author":"Modelica Association","year":"2017","unstructured":"Modelica Association . 2017 . Modelica Web Page . Retrieved March 17, 2020 from https:\/\/www.modelica.org\/. Modelica Association. 2017. Modelica Web Page. Retrieved March 17, 2020 from https:\/\/www.modelica.org\/."},{"key":"e_1_2_1_6_1","first-page":"12","article-title":"PETSc Users Manual","volume":"3","author":"Balay Satish","year":"2019","unstructured":"Satish Balay , Shrirang Abhyankar , Mark F. Adams , Jed Brown , Peter Brune , Kris Buschelman , Lisandro Dalcin , 2019 . PETSc Users Manual : Revision 3 . 12 . Technical Report ANL-95\/11\u2014Rev 3.12. Argonne National Laboratory. Satish Balay, Shrirang Abhyankar, Mark F. Adams, Jed Brown, Peter Brune, Kris Buschelman, Lisandro Dalcin, et al. 2019. PETSc Users Manual: Revision 3.12. Technical Report ANL-95\/11\u2014Rev 3.12. Argonne National Laboratory.","journal-title":"Revision"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1137\/17M1113643"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the AGU Fall Meeting.","author":"Betrie Getnet","year":"2018","unstructured":"Getnet Betrie , Hong Zhang , Barry Simith , and Eugene Yan . 2018 . A scalable river network simulator for extereme scale computers using the PETSc library . In Proceedings of the AGU Fall Meeting. Getnet Betrie, Hong Zhang, Barry Simith, and Eugene Yan. 2018. A scalable river network simulator for extereme scale computers using the PETSc library. In Proceedings of the AGU Fall Meeting."},{"key":"e_1_2_1_9_1","volume-title":"Proceeedings of the 11th International Symposium on Parallel and Distributed Computing (ISPDC\u201912)","author":"Brown Jed","year":"2012","unstructured":"Jed Brown , Matthew G. Knepley , David A. May , Lois C. McInnes , and Barry F. Smith . 2012. Composable linear solvers for multiphysics . In Proceeedings of the 11th International Symposium on Parallel and Distributed Computing (ISPDC\u201912) . IEEE, Los Alamitos, CA, 55--62. DOI:https:\/\/doi.org\/10.1109\/ISPDC. 2012 .16 10.1109\/ISPDC.2012.16 Jed Brown, Matthew G. Knepley, David A. May, Lois C. McInnes, and Barry F. Smith. 2012. Composable linear solvers for multiphysics. In Proceeedings of the 11th International Symposium on Parallel and Distributed Computing (ISPDC\u201912). IEEE, Los Alamitos, CA, 55--62. DOI:https:\/\/doi.org\/10.1109\/ISPDC.2012.16"},{"key":"e_1_2_1_10_1","volume-title":"Applied Hydraulic Transients","author":"Chaudhry M. Hanif","unstructured":"M. Hanif Chaudhry . 1979. Applied Hydraulic Transients . Van Nostrand Reinhold Company . M. Hanif Chaudhry. 1979. Applied Hydraulic Transients. Van Nostrand Reinhold Company."},{"key":"e_1_2_1_11_1","volume-title":"Applied Hydraulic Transients","author":"Chaudhry M. Hanif","unstructured":"M. Hanif Chaudhry . 2014. Applied Hydraulic Transients ( 3 rd ed.). Springer . M. Hanif Chaudhry. 2014. Applied Hydraulic Transients (3rd ed.). Springer.","edition":"3"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1137\/0720013"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1175\/2011JHM1345.1"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11269-013-0485-y"},{"key":"e_1_2_1_15_1","volume-title":"Retrieved","author":"Standard Development Team FMI","year":"2017","unstructured":"FMI Standard Development Team . 2017 . FMI: Functional Mock-Up Interface . Retrieved March 17, 2020 from https:\/\/fmi-standard.org\/. FMI Standard Development Team. 2017. FMI: Functional Mock-Up Interface. Retrieved March 17, 2020 from https:\/\/fmi-standard.org\/."},{"key":"e_1_2_1_16_1","volume-title":"Wave Propagation in Fluids: Models and Numerical Techniques","author":"Guinot Vincent","unstructured":"Vincent Guinot . 2012. Wave Propagation in Fluids: Models and Numerical Techniques . John Wiley 8 Sons. Vincent Guinot. 2012. Wave Propagation in Fluids: Models and Numerical Techniques. John Wiley 8 Sons."},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the 7th Python in Science Conference (SciPy\u201908)","author":"Hagberg Aric A.","unstructured":"Aric A. Hagberg , Daniel A. Schult , and Pieter J. Swart . 2008. Exploring network structure, dynamics, and function using NetworkX . In Proceedings of the 7th Python in Science Conference (SciPy\u201908) . 11--15. Aric A. Hagberg, Daniel A. Schult, and Pieter J. Swart. 2008. Exploring network structure, dynamics, and function using NetworkX. In Proceedings of the 7th Python in Science Conference (SciPy\u201908). 11--15."},{"key":"e_1_2_1_18_1","volume-title":"Retrieved","author":"Development Team HELICS","year":"2017","unstructured":"HELICS Development Team . 2017 . HELICS Web Page . Retrieved March 17, 2020 from https:\/\/github.com\/GMLC-TDC\/HELICS-src. HELICS Development Team. 2017. HELICS Web Page. Retrieved March 17, 2020 from https:\/\/github.com\/GMLC-TDC\/HELICS-src."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/224170.224228"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1049\/iet-gtd.2016.1582"},{"key":"e_1_2_1_22_1","volume-title":"Technical Report 97-060. Department of Computer Science","author":"Karypis George","year":"1997","unstructured":"George Karypis and V. Kumar . 1997 . ParMETIS: Parallel Graph Partitioning and Sparse Matrix Ordering Library . Technical Report 97-060. Department of Computer Science , University of Minnesota . http:\/\/www.cs.umn.edu\/ metis. George Karypis and V. Kumar. 1997. ParMETIS: Parallel Graph Partitioning and Sparse Matrix Ordering Library. Technical Report 97-060. Department of Computer Science, University of Minnesota. http:\/\/www.cs.umn.edu\/ metis."},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Carl T. Kelley. 2003. Solving Nonlinear Equations with Newton\u2019s Method. SIAM.  Carl T. Kelley. 2003. Solving Nonlinear Equations with Newton\u2019s Method. SIAM.","DOI":"10.1137\/1.9780898718898"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1137\/15M1026092"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2898361"},{"key":"e_1_2_1_26_1","volume-title":"Retrieved","year":"2017","unstructured":"MathWorks. 2017 . Simulink Web Page . Retrieved March 17, 2020 from https:\/\/www.mathworks.com\/products\/simulink.html. MathWorks. 2017. Simulink Web Page. Retrieved March 17, 2020 from https:\/\/www.mathworks.com\/products\/simulink.html."},{"key":"e_1_2_1_27_1","unstructured":"L. McKay T. Bondelid T. Dewald J. Johnston R. Moore and A. Rea. 2012. NHDPlus Version 2: User Guide. National Operational Hydrologic Remote Sensing Center Washington DC.  L. McKay T. Bondelid T. Dewald J. Johnston R. Moore and A. Rea. 2012. NHDPlus Version 2: User Guide. National Operational Hydrologic Remote Sensing Center Washington DC."},{"key":"e_1_2_1_28_1","volume-title":"Retrieved","author":"National Instruments.","year":"2017","unstructured":"National Instruments. 2017 . LabVIEW Web Page . Retrieved March 17, 2020 from http:\/\/www.ni.com\/labview\/. National Instruments. 2017. LabVIEW Web Page. Retrieved March 17, 2020 from http:\/\/www.ni.com\/labview\/."},{"key":"e_1_2_1_29_1","volume-title":"Retrieved","author":"NERSC.","year":"2017","unstructured":"NERSC. 2017 . Edison Supercomputer . Retrieved March 17, 2020 from https:\/\/www.nersc.gov\/. NERSC. 2017. Edison Supercomputer. Retrieved March 17, 2020 from https:\/\/www.nersc.gov\/."},{"key":"e_1_2_1_30_1","volume-title":"Retrieved","author":"Development Team NetworKit","year":"2017","unstructured":"NetworKit Development Team . 2017 . NetworKit Web Page . Retrieved March 17, 2020 from http:\/\/network-analysis.info. NetworKit Development Team. 2017. NetworKit Web Page. Retrieved March 17, 2020 from http:\/\/network-analysis.info."},{"key":"e_1_2_1_31_1","volume-title":"Retrieved","author":"Team X Development","year":"2018","unstructured":"Network X Development Team . 2018 . NetworkX Web Page . Retrieved March 17, 2020 from https:\/\/networkx.github.io\/. NetworkX Development Team. 2018. NetworkX Web Page. Retrieved March 17, 2020 from https:\/\/networkx.github.io\/."},{"key":"e_1_2_1_32_1","volume-title":"Retrieved","author":"Development Team OpSim","year":"2017","unstructured":"OpSim Development Team . 2017 . OpSim: Test and Simulation Environment for Grid Control and Aggregation Strategies . Retrieved March 17, 2020 from https:\/\/www.iee.fraunhofer.de\/en\/schnelleinstieg-wirtschaft\/themen\/opsim-homepage.html. OpSim Development Team. 2017. OpSim: Test and Simulation Environment for Grid Control and Aggregation Strategies. Retrieved March 17, 2020 from https:\/\/www.iee.fraunhofer.de\/en\/schnelleinstieg-wirtschaft\/themen\/opsim-homepage.html."},{"key":"e_1_2_1_33_1","unstructured":"Stefano Guido Rinaldo and Andrea Ceresoli. 2018. Newton\u2013Krylov\u2013Schwarz Methods for Distributed Power Flow and Related Applications. Master\u2019s Thesis. Politecnico di Milano.  Stefano Guido Rinaldo and Andrea Ceresoli. 2018. Newton\u2013Krylov\u2013Schwarz Methods for Distributed Power Flow and Related Applications. Master\u2019s Thesis. Politecnico di Milano."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1137\/090750688"},{"key":"e_1_2_1_36_1","volume-title":"Emil Constantinescu, Mark Adams, Satish Balay, Jed Brown, Matthew Knepley, and Hong Zhang.","author":"Smith Barry","year":"2012","unstructured":"Barry Smith , Lois Curfman McInnes , Emil Constantinescu, Mark Adams, Satish Balay, Jed Brown, Matthew Knepley, and Hong Zhang. 2012 . PETSc\u2019s Software Strategy for the Design Space of Composable Extreme-Scale Solvers. Preprint ANL\/MCS-P2059-0312. Argonne National Laboratory . Barry Smith, Lois Curfman McInnes, Emil Constantinescu, Mark Adams, Satish Balay, Jed Brown, Matthew Knepley, and Hong Zhang. 2012. PETSc\u2019s Software Strategy for the Design Space of Composable Extreme-Scale Solvers. Preprint ANL\/MCS-P2059-0312. Argonne National Laboratory."},{"key":"e_1_2_1_37_1","volume-title":"Smith and Xumin Tu","author":"Barry","year":"2016","unstructured":"Barry F. Smith and Xumin Tu . 2016 . Domain decomposition. Encyclopedia of Applied and Computational Mathematics. Springer . https:\/\/dl.acm.org\/doi\/book\/10.5555\/3086999 Barry F. Smith and Xumin Tu. 2016. Domain decomposition. Encyclopedia of Applied and Computational Mathematics. Springer. https:\/\/dl.acm.org\/doi\/book\/10.5555\/3086999"},{"key":"e_1_2_1_38_1","volume-title":"Computational Science and Engineering","author":"Strang Gilbert","unstructured":"Gilbert Strang . 2007. Computational Science and Engineering . Wellesley-Cambridge Press . Gilbert Strang. 2007. Computational Science and Engineering. Wellesley-Cambridge Press."},{"key":"e_1_2_1_39_1","unstructured":"Ven Te Chow. 1959. Open-Channel Hydraulics. McGraw-Hill.  Ven Te Chow. 1959. Open-Channel Hydraulics. McGraw-Hill."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/CCWC.2019.8666551"},{"key":"e_1_2_1_41_1","volume-title":"Streeter","author":"Benjamin Wylie E.","year":"1978","unstructured":"E. Benjamin Wylie and Victor L . Streeter . 1978 . Fluid Transients. McGraw-Hill . E. Benjamin Wylie and Victor L. Streeter. 1978. Fluid Transients. McGraw-Hill."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPWRS.2010.2051168"}],"container-title":["ACM Transactions on Mathematical Software"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3344587","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3344587","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3344587","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:25Z","timestamp":1750203865000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3344587"}},"subtitle":["A Library for Scalable Network PDE-Based Multiphysics Simulations"],"short-title":[],"issued":{"date-parts":[[2020,3,31]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,3,31]]}},"alternative-id":["10.1145\/3344587"],"URL":"https:\/\/doi.org\/10.1145\/3344587","relation":{},"ISSN":["0098-3500","1557-7295"],"issn-type":[{"value":"0098-3500","type":"print"},{"value":"1557-7295","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,31]]},"assertion":[{"value":"2017-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-04-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}