{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T02:11:51Z","timestamp":1777601511505,"version":"3.51.4"},"reference-count":55,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2019,1,23]],"date-time":"2019-01-23T00:00:00Z","timestamp":1548201600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computation"],"abstract":"<jats:p>Parallel multiphysics simulations often suffer from load imbalances originating from the applied coupling of algorithms with spatially and temporally varying workloads. It is, thus, desirable to minimize these imbalances to reduce the time to solution and to better utilize the available hardware resources. Taking particulate flows as an illustrating example application, we present and evaluate load balancing techniques that tackle this challenging task. This involves a load estimation step in which the currently generated workload is predicted. We describe in detail how such a workload estimator can be developed. In a second step, load distribution strategies like space-filling curves or graph partitioning are applied to dynamically distribute the load among the available processes. To compare and analyze their performance, we employ these techniques to a benchmark scenario and observe a reduction of the load imbalances by almost a factor of four. This results in a decrease of the overall runtime by 14% for space-filling curves.<\/jats:p>","DOI":"10.3390\/computation7010009","type":"journal-article","created":{"date-parts":[[2019,1,24]],"date-time":"2019-01-24T11:12:48Z","timestamp":1548328368000},"page":"9","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Dynamic Load Balancing Techniques for Particulate Flow Simulations"],"prefix":"10.3390","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0605-3731","authenticated-orcid":false,"given":"Christoph","family":"Rettinger","sequence":"first","affiliation":[{"name":"Chair for System Simulation, Friedrich\u2013Alexander\u2013Universit\u00e4t Erlangen\u2013N\u00fcrnberg, Cauerstra\u00dfe 11, 91058 Erlangen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8796-8599","authenticated-orcid":false,"given":"Ulrich","family":"R\u00fcde","sequence":"additional","affiliation":[{"name":"Chair for System Simulation, Friedrich\u2013Alexander\u2013Universit\u00e4t Erlangen\u2013N\u00fcrnberg, Cauerstra\u00dfe 11, 91058 Erlangen, Germany"},{"name":"CERFACS, 42 Avenue Gaspard Coriolis, 31057 Toulouse, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1017\/jfm.2015.697","article-title":"Moving contact line dynamics: From diffuse to sharp interfaces","volume":"788","author":"Kusumaatmaja","year":"2016","journal-title":"J. Fluid Mech."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1016\/j.compfluid.2017.05.033","article-title":"A comparative study of fluid\u2013particle coupling methods for fully resolved lattice Boltzmann simulations","volume":"154","author":"Rettinger","year":"2017","journal-title":"Comput. Fluids"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.jcp.2017.03.035","article-title":"A collision model for grain-resolving simulations of flows over dense, mobile, polydisperse granular sediment beds","volume":"340","author":"Biegert","year":"2017","journal-title":"J. Comput. Phys."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1016\/j.camwa.2013.06.007","article-title":"Free surface lattice Boltzmann with enhanced bubble model","volume":"67","author":"Anderl","year":"2014","journal-title":"Comput. Math. Appl."},{"key":"ref_5","unstructured":"Kunkel, J.M., Yokota, R., Balaji, P., and Keyes, D. (2017). Fully Resolved Simulations of Dune Formation in Riverbeds. High Performance Computing, Springer International Publishing."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1016\/j.powtec.2018.02.026","article-title":"Powder layer deposition algorithm for additive manufacturing simulations","volume":"330","author":"Markl","year":"2018","journal-title":"Powder Technol."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Long, G., Liu, S., Xu, G., Wong, S.W., Chen, H., and Xiao, B. (2018). A Perforation-Erosion Model for Hydraulic-Fracturing Applications. SPE Prod. Oper., 33.","DOI":"10.2118\/174959-PA"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Godenschwager, C., Schornbaum, F., Bauer, M., K\u00f6stler, H., and R\u00fcde, U. (2013, January 17\u201322). A Framework for Hybrid Parallel Flow Simulations with a Trillion Cells in Complex Geometries. Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis (SC \u201913), Denver, CO, USA.","DOI":"10.1145\/2503210.2503273"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1016\/S0045-7825(99)00241-8","article-title":"Dynamic load balancing in computational mechanics","volume":"184","author":"Hendrickson","year":"2000","journal-title":"Comput. Methods Appl. Mech. Eng."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1680\/geot.1979.29.1.47","article-title":"A discrete numerical model for granular assemblies","volume":"29","author":"Cundall","year":"1979","journal-title":"G\u00e9otechnique"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"558","DOI":"10.1016\/j.jqsrt.2007.01.034","article-title":"The discrete dipole approximation: An overview and recent developments","volume":"106","author":"Yurkin","year":"2007","journal-title":"J. Quant. Spectrosc. Radiat. Transf."},{"key":"ref_12","unstructured":"Owen, D., Feng, Y., Han, K., and Peric, D. (2000). Dynamic Domain Decomposition and Load Balancing in Parallel Simulation of Finite\/Discrete Elements, ECCOMAS 2000."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1504\/PCFD.2012.047457","article-title":"Models, algorithms and validation for opensource DEM and CFD\u2013DEM","volume":"12","author":"Kloss","year":"2012","journal-title":"Prog. Comput. Fluid Dyn. Int. J."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Eibl, S., and R\u00fcde, U. (arXiv, 2018). A Systematic Comparison of Dynamic Load Balancing Algorithms for Massively Parallel Rigid Particle Dynamics, arXiv.","DOI":"10.1016\/j.cpc.2019.06.020"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1051\/proc\/201134002","article-title":"Block-structured adaptive mesh refinement-theory, implementation and application","volume":"34","author":"Deiterding","year":"2011","journal-title":"ESAIM Proc."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/j.cma.2014.04.009","article-title":"Massively parallel grid generation on HPC systems","volume":"277","author":"Lintermann","year":"2014","journal-title":"Comput. Methods Appl. Mech. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"C96","DOI":"10.1137\/15M1035240","article-title":"Massively Parallel Algorithms for the Lattice Boltzmann Method on NonUniform Grids","volume":"38","author":"Schornbaum","year":"2016","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_18","unstructured":"Qi, J., Klimach, H., and Roller, S. (2016). Implementation of the compact interpolation within the octree based Lattice Boltzmann solver Musubi. Comput. Math. Appl."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"082005","DOI":"10.1088\/1742-6596\/753\/8\/082005","article-title":"Predictive wind turbine simulation with an adaptive lattice Boltzmann method for moving boundaries","volume":"753","author":"Deiterding","year":"2016","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"C358","DOI":"10.1137\/17M1128411","article-title":"Extreme-Scale Block-Structured Adaptive Mesh Refinement","volume":"40","author":"Schornbaum","year":"2018","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_21","unstructured":"Bader, M. (2012). Space-Filling Curves: An Introduction with Applications in Scientific Computing, Springer Science & Business Media."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Kliemann, L., and Sanders, P. (2016). Recent Advances in Graph Partitioning. Algorithm Engineering: Selected Results and Surveys, Springer International Publishing.","DOI":"10.1007\/978-3-319-49487-6"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1002\/pamm.201510238","article-title":"An efficient numerical method for fully-resolved particle simulations on high-performance computers","volume":"15","author":"Schneiders","year":"2015","journal-title":"PAMM"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1080\/00221686.2016.1140683","article-title":"Entrainment of single particles in a turbulent open-channel flow: A numerical study","volume":"54","author":"Vowinckel","year":"2016","journal-title":"J. Hydraul. Res."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1017\/jfm.2017.370","article-title":"Shear-induced incipient motion of a single sphere on uniform substrates at low particle Reynolds numbers","volume":"825","author":"Agudo","year":"2017","journal-title":"J. Fluid Mech."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"645","DOI":"10.2118\/185173-PA","article-title":"The effects of perforation erosion on practical hydraulic-fracturing applications","volume":"22","author":"Long","year":"2017","journal-title":"SPE J."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"124001","DOI":"10.1088\/1361-648X\/aa5a40","article-title":"Lattice Boltzmann simulations of the bead-spring microswimmer with a responsive stroke - from an individual to swarms","volume":"29","author":"Pickl","year":"2017","journal-title":"J. Phys. Condens. Matter"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Buwa, V.V., Roy, S., and Ranade, V.V. (2016). Three-phase slurry reactors. Multiphase Catalytic Reactors, John Wiley & Sons, Ltd.. Chapter 6.","DOI":"10.1002\/9781119248491.ch6"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ge, W., Chang, Q., Li, C., and Wang, J. (2019). Multiscale structures in particle\u2013fluid systems: Characterization, modeling, and simulation. Chem. Eng. Sci.","DOI":"10.1016\/j.ces.2018.12.037"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1108\/02644409510799532","article-title":"A combined finite-discrete element method in transient dynamics of fracturing solids","volume":"12","author":"Munjiza","year":"1995","journal-title":"Eng. Comput."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1146\/annurev.fluid.30.1.329","article-title":"Lattice Boltzmann Method for Fluid Flows","volume":"30","author":"Chen","year":"1998","journal-title":"Annu. Rev. Fluid Mech."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kr\u00fcger, T., Kusumaatmaja, H., Kuzmin, A., Shardt, O., Silva, G., and Viggen, E.M. (2017). The Lattice Boltzmann Method, Springer.","DOI":"10.1007\/978-3-319-44649-3"},{"key":"ref_33","first-page":"427","article-title":"Two-relaxation-time lattice Boltzmann scheme: About parametrization, velocity, pressure and mixed boundary conditions","volume":"3","author":"Ginzburg","year":"2008","journal-title":"Commun. Comput. Phys."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1209\/0295-5075\/17\/6\/001","article-title":"Lattice BGK Models for Navier-Stokes Equation","volume":"17","author":"Qian","year":"1992","journal-title":"EPL (Europhys. Lett.)"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1007\/s40571-015-0047-6","article-title":"Ultrascale simulations of non-smooth granular dynamics","volume":"2","author":"Preclik","year":"2015","journal-title":"Comput. Part. Mech."},{"key":"ref_36","unstructured":"Preclik, T. (2014). Models and Algorithms for Ultrascale Simulations of Non-Smooth Granular Dynamics. [Ph.D. Thesis, Friedrich-Alexander-Universit\u00e4t Erlangen-N\u00fcrnberg]."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1017\/S0022112098002493","article-title":"Direct analysis of particulate suspensions with inertia using the discrete Boltzmann equation","volume":"373","author":"Aidun","year":"1998","journal-title":"J. Fluid Mech."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/j.jcp.2014.02.018","article-title":"Galilean invariant fluid-solid interfacial dynamics in lattice Boltzmann simulations","volume":"266","author":"Wen","year":"2014","journal-title":"J. Comput. Phys."},{"key":"ref_39","unstructured":"(2018, November 26). The waLBerla Framework. Available online: http:\/\/walberla.net."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1007\/s00450-009-0066-8","article-title":"Massively parallel rigid body dynamics simulations","volume":"23","author":"Iglberger","year":"2009","journal-title":"Comput. Sci. Res. Dev."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"910","DOI":"10.1016\/j.compfluid.2005.02.008","article-title":"On the single processor performance of simple lattice Boltzmann kernels","volume":"35","author":"Wellein","year":"2006","journal-title":"Comput. Fluids"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"582","DOI":"10.1016\/j.compfluid.2018.03.030","article-title":"Lattice Boltzmann benchmark kernels as a testbed for performance analysis","volume":"172","author":"Wittmann","year":"2018","journal-title":"Comput. Fluids"},{"key":"ref_43","unstructured":"(2018, November 26). LIKWID. Available online: https:\/\/github.com\/RRZE-HPC\/likwid."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Treibig, J., Hager, G., and Wellein, G. (2010, January 13\u201316). LIKWID: A Lightweight Performance-Oriented Tool Suite for x86 Multicore Environments. Proceedings of the 2010 39th International Conference on Parallel Processing Workshops, San Diego, CA, USA.","DOI":"10.1109\/ICPPW.2010.38"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.parco.2014.12.003","article-title":"Performance modeling and analysis of heterogeneous lattice Boltzmann simulations on CPU\u2013GPU clusters","volume":"46","author":"Feichtinger","year":"2015","journal-title":"Parallel Comput."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Riesinger, C., Bakhtiari, A., Schreiber, M., Neumann, P., and Bungartz, H.J. (2017). A Holistic Scalable Implementation Approach of the Lattice Boltzmann Method for CPU\/GPU Heterogeneous Clusters. Computation, 5.","DOI":"10.3390\/computation5040048"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1142\/S0129626403001501","article-title":"Optimization and profiling of the cache performance of parallel lattice Boltzmann codes","volume":"13","author":"Pohl","year":"2003","journal-title":"Parallel Process. Lett."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Niethammer, C., Gracia, J., Hilbrich, T., Kn\u00fcpfer, A., Resch, M.M., and Nagel, W.E. (2017). Kerncraft: A Tool for Analytic Performance Modeling of Loop Kernels. Tools for High Performance Computing 2016, Springer International Publishing.","DOI":"10.1007\/978-3-319-56702-0"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1137\/S1064827595287997","article-title":"A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs","volume":"20","author":"Karypis","year":"1998","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_50","unstructured":"(2018, November 26). ParMETIS. Available online: http:\/\/glaros.dtc.umn.edu\/gkhome\/views\/metis\/."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Karypis, G., and Kumar, V. (1998, January 7\u201313). Multilevel Algorithms for Multi-constraint Graph Partitioning. Proceedings of the 1998 ACM\/IEEE Conference on Supercomputing (SC \u201998), Orlando, FL, USA.","DOI":"10.1109\/SC.1998.10018"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1002\/cpe.605","article-title":"Parallel static and dynamic multi-constraint graph partitioning","volume":"14","author":"Kirk","year":"2002","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_53","first-page":"129","article-title":"The Zoltan and Isorropia Parallel Toolkits for Combinatorial Scientific Computing: Partitioning, Ordering, and Coloring","volume":"20","author":"Boman","year":"2012","journal-title":"Sci. Program."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1016\/j.parco.2007.12.001","article-title":"PT-Scotch: A tool for efficient parallel graph ordering","volume":"34","author":"Chevalier","year":"2008","journal-title":"Parallel Comput."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Von Looz, M., Tzovas, C., and Meyerhenke, H. (arXiv, 2018). Balanced k-means for Parallel Geometric Partitioning, arXiv.","DOI":"10.1145\/3225058.3225148"}],"container-title":["Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3197\/7\/1\/9\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:28:16Z","timestamp":1760185696000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3197\/7\/1\/9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,23]]},"references-count":55,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,3]]}},"alternative-id":["computation7010009"],"URL":"https:\/\/doi.org\/10.3390\/computation7010009","relation":{},"ISSN":["2079-3197"],"issn-type":[{"value":"2079-3197","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,23]]}}}