{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T17:20:40Z","timestamp":1781889640303,"version":"3.54.5"},"reference-count":47,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2015,5,22]],"date-time":"2015-05-22T00:00:00Z","timestamp":1432252800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"King Abdullah University of Science and Technology (KAUST)","award":["UK-c0020"],"award-info":[{"award-number":["UK-c0020"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computation"],"abstract":"<jats:p>The development of parallel Computational Fluid Dynamics (CFD) codes is a challenging task that entails efficient parallelization concepts and strategies in order to achieve good scalability values when running those codes on modern supercomputers with several thousands to millions of cores. In this paper, we present a hierarchical data structure for massive parallel computations that supports the coupling of a Navier\u2013Stokes-based fluid flow code with the Boussinesq approximation in order to address complex thermal scenarios for energy-related assessments. The newly designed data structure is specifically designed with the idea of interactive data exploration and visualization during runtime of the simulation code; a major shortcoming of traditional high-performance computing (HPC) simulation codes. We further show and discuss speed-up values obtained on one of Germany\u2019s top-ranked supercomputers with up to 140,000 processes and present simulation results for different engineering-based thermal problems.<\/jats:p>","DOI":"10.3390\/computation3020235","type":"journal-article","created":{"date-parts":[[2015,5,26]],"date-time":"2015-05-26T04:16:36Z","timestamp":1432613796000},"page":"235-261","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Engineering-Based Thermal CFD Simulations on Massive Parallel Systems"],"prefix":"10.3390","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0509-5275","authenticated-orcid":false,"given":"J\u00e9r\u00f4me","family":"Frisch","sequence":"first","affiliation":[{"name":"Energy Efficient and Sustainable Building E3D, RWTH Aachen University, Mathieustra\u00dfe 30, 52074 Aachen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ralf-Peter","family":"Mundani","sequence":"additional","affiliation":[{"name":"Computation in Engineering, Technische Universit\u00e4t M\u00fcnchen, Arcisstra\u00dfe 21, 80333 M\u00fcnchen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ernst","family":"Rank","sequence":"additional","affiliation":[{"name":"Computation in Engineering, Technische Universit\u00e4t M\u00fcnchen, Arcisstra\u00dfe 21, 80333 M\u00fcnchen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christoph","family":"Van Treeck","sequence":"additional","affiliation":[{"name":"Energy Efficient and Sustainable Building E3D, RWTH Aachen University, Mathieustra\u00dfe 30, 52074 Aachen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2015,5,22]]},"reference":[{"key":"ref_1","unstructured":"Adams, M., Colella, P., Graves, D.T., Johnson, J.N., Keen, N.D., Ligocki, T.J., Martin, D.F., McCorquodale, P.W., Modiano, D., and Schwartz, P.O. (2014). Chombo Software Package for AMR Applications\u2014Design Document, Lawrence Berkeley National Laboratory."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Parker, S.G., and Johnson, C.R. (1995, January 3\u20138). SCIRun: A Scientific Programming Environment for Computational Steering, San Diego, CA, USA.","DOI":"10.1145\/224170.224354"},{"key":"ref_3","unstructured":"Available online: http:\/\/www.openfoam.org."},{"key":"ref_4","unstructured":"Rivi, M., Calori, L., Muscianisi, G., and Slavnic, V. (2012). In-situ visualization: State-of-the-art and some use cases, PRACE."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1109\/MCG.2010.55","article-title":"In Situ Visualization for Large-Scale Combustion Simulations","volume":"30","author":"Yu","year":"2010","journal-title":"Comput. Graph. Appl. IEEE"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Fabian, N., Moreland, K., Thompson, D., Bauer, A., Marion, P., Geveci, B., Rasquin, M., and Jansen, K. (2011, January 23\u201324). The ParaView Coprocessing Library: A scalable, general purpose in situ visualization library, Providence, Rl, USA.","DOI":"10.1109\/LDAV.2011.6092322"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Bennett, J.C., Abbasi, H., Bremer, P.T., Grout, R., Gyulassy, A., Jin, T., Klasky, S., Kolla, H., Parashar, M., and Pascucci, V. (2012, January 10\u201316). Combining in-situ and in-transit processing to enable extreme-scale scientific analysis, Salt Lake City, UT, USA.","DOI":"10.1109\/SC.2012.31"},{"key":"ref_8","unstructured":"Frisch, J. (2014). Towards Massive Parallel Fluid Flow Simulations in Computational Engineering. [Ph.D. Thesis, Technische Universitat]."},{"key":"ref_9","unstructured":"Batchelor, G. (2000). An Introduction to Fluid Dynamics, Cambridge Mathematical Library, Cambridge University Press."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ferziger, J.H., and Peric\u00b4, M. (2002). Computational Methods for Fluid Dynamics, Springer-Verlag. [3rd ed].","DOI":"10.1007\/978-3-642-56026-2"},{"key":"ref_11","unstructured":"Hirsch, C. (2007). Numerical Computation of Internal and External Flows, Butterworth-Heinemann. [2nd ed]."},{"key":"ref_12","unstructured":"Lienhard, J., and Lienhard, J. (2011). A Heat Transfer Textbook, Dover Publications. [4th ed]."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2182","DOI":"10.1063\/1.1761178","article-title":"Numerical Calculation of Time-Dependent Viscous Incompressible Flow of Fluid with Free Surface","volume":"8","author":"Harlow","year":"1965","journal-title":"Phys. Fluids"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"745","DOI":"10.1090\/S0025-5718-1968-0242392-2","article-title":"Numerical solution of the Navier-Stokes equations","volume":"22","author":"Chorin","year":"1967","journal-title":"Math. Comput"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Schwarz, H.R., and Kockler, N. (2011). Numerische Mathematik, Vieweg + Teubner. [8th ed].","DOI":"10.1007\/978-3-8348-8166-3"},{"key":"ref_16","unstructured":"Ferziger, J.H. (1998). Numerical Methods for Engineering Applications."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1016\/0021-9991(85)90148-2","article-title":"Application of a fractional-step method to incompressible Navier-Stokes equations","volume":"59","author":"Kim","year":"1985","journal-title":"J. Comput. Phys"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1006\/jcph.1994.1112","article-title":"Effects of the computational time step on numerical solutions of turbulent flow","volume":"113","author":"Choi","year":"1994","journal-title":"J. Comput. Phys"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1007\/BF01448839","article-title":"Uber die partiellen Differenzengleichungen der mathematischen Physik","volume":"100","author":"Courant","year":"1928","journal-title":"Math. Ann"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Peyret, R., and Taylor, T. (1983). Computational Methods for Fluid Flow, Springer-Verlag.","DOI":"10.1007\/978-3-642-85952-6"},{"key":"ref_21","first-page":"272","article-title":"Uber einen Grenzubergang durch alternierendes Verfahren","volume":"15","author":"Schwarz","year":"1870","journal-title":"Vierteljahrsschr. Naturforschenden Ges. Zur"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Frisch, J., Mundani, R.P., and Rank, E. (2011, January 26\u201329). Communication Schemes of a Parallel Fluid Solver for Multi-Scale Environmental Simulations, Timis\u00b8oara, Romania.","DOI":"10.1109\/SYNASC.2011.7"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1090\/S0025-5718-1977-0431719-X","article-title":"Multi-Level Adaptive Solutions to Boundary-Value Problems","volume":"31","author":"Brandt","year":"1977","journal-title":"Math. Comput"},{"key":"ref_24","unstructured":"Trottenberg, U., Oosterlee, C.W., and Sch\u00fcller, A. (2001). Multigrid, Academic Press."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Briggs, W.L., Henson, V.E., and McCormick, S.F. (2000). A Multigrid Tutorial, Society for Industrial and Applied Mathematics. [2nd ed].","DOI":"10.1137\/1.9780898719505"},{"key":"ref_26","unstructured":"Frisch, J., Mundani, R.P., and Rank, E. (2013, January 23\u201325). Parallel Multi-Grid like Solver for the Pressure Poisson Equation in Fluid Flow Applications, Fort Worth, TX, USA."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.advengsoft.2015.02.003","article-title":"A sliding window technique for interactive high-performance computing scenarios","volume":"84","author":"Mundani","year":"2015","journal-title":"Adv. Eng. Softw"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/S0167-739X(98)00047-8","article-title":"A Survey of Computational Steering Environments","volume":"15","author":"Mulder","year":"1999","journal-title":"Future Gener. Comput. Syst. Spec. Issue Sci. Vis"},{"key":"ref_29","unstructured":"Schafer, M., and Turek, S. (1996). Flow Simulation with High-Performance Computers II, Vieweg."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1002\/fld.1650030305","article-title":"Natural convection of air in a square cavity: A benchmark numerical solution","volume":"3","year":"1983","journal-title":"Int. J. Numer. Methods Fluids"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1016\/0021-9991(84)90123-2","article-title":"Natural convection in an enclosed cavity","volume":"54","author":"Phillips","year":"1984","journal-title":"J. Comput. Phys"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1016\/0142-727X(95)00052-R","article-title":"Numerical simulation of free convective flow using the Lattice-Boltzmann scheme","volume":"6","author":"Eggels","year":"1995","journal-title":"Int. J. Heat Fluid Flow"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"863","DOI":"10.1016\/j.compfluid.2005.03.006","article-title":"Extension of a hybrid thermal LBE scheme for large-eddy simulations of turbulent convective flows","volume":"35","author":"Rank","year":"2006","journal-title":"Comput. Fluids"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/0045-7930(91)90025-D","article-title":"Accurate solutions to the square thermally driven cavity at high Rayleigh number","volume":"20","year":"1991","journal-title":"Comput. Fluids"},{"key":"ref_35","unstructured":"Van Treeck, C. (2004). Gebaudemodell-Basierte Simulation von Raumluftstromungen. [Ph.D. Thesis, Technische Universitat]."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Hirt, C.W., Nichols, B.D., and Romero, N.C. (1975). SOLA: A numerical solution algorithm for transient fluid flows, Los Alamos National Laboratory.","DOI":"10.2172\/4205348"},{"key":"ref_37","unstructured":"Janssen, R.J.A. (1994). Instabilities in Natural-Convection Flows in Cavities. [Ph.D. Thesis, Technische Hogeschool]."},{"key":"ref_38","unstructured":"B\u00e9nard, H. (1901). Les Tourbillons Cellulaires Dans une Nappe Liquide Propageant de la Chaleur par Convection, en R\u00e9gime Permanent, Gauthier-Villars. In French."},{"key":"ref_39","first-page":"312","article-title":"On Maintained Convective Motion in a Fluid Heated from below","volume":"76","author":"Pellew","year":"1940","journal-title":"Proc. R. Soc. Lond. Ser. A Math. Phys. Sci"},{"key":"ref_40","unstructured":"VDI 6020 Part 1 (2001). Requirements on Methods of Calculation to Thermal and Energy Simulation of Buildings and Plants, Verein Deutscher Ingenieure."},{"key":"ref_41","unstructured":"Clarke, J.A. (2001). Energy Simulation in Building Design, Butterworth-Heinemann. [2nd ed]."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1957","DOI":"10.1152\/jappl.1999.87.5.1957","article-title":"A computer model of human thermoregulation for a wide range of environmental conditions: The passive system","volume":"87","author":"Fiala","year":"1999","journal-title":"J. Appl. Physiol"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1007\/s004840100099","article-title":"Computer prediction of human thermoregulatory and temperature responses to a wide range of environmental conditions","volume":"45","author":"Fiala","year":"2001","journal-title":"Int. J. Biometeorol"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Bejan, A. (2013). Convection Heat Transfer, John Wiley & Sons. [4th ed].","DOI":"10.1002\/9781118671627"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"2142","DOI":"10.1016\/j.buildenv.2007.12.012","article-title":"Radiative and convective heat transfer coefficients of the human body in natural convection","volume":"43","author":"Kurazumi","year":"2008","journal-title":"Build. Environ"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1002\/bapi.201310043","article-title":"Methodik zur Quantifizierung der Auswirkung von moderater Warmebelastung auf die menschliche Leistungsfahigkeit","volume":"35","author":"Urlaub","year":"2013","journal-title":"Bauphysik"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1080\/19401490902914637","article-title":"Integrated thermal comfort analysis using a parametric manikin model for interactive real-time simulation","volume":"2","author":"Frisch","year":"2009","journal-title":"J. Build. Perform. Simul"}],"container-title":["Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3197\/3\/2\/235\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:46:50Z","timestamp":1760215610000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3197\/3\/2\/235"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,5,22]]},"references-count":47,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2015,6]]}},"alternative-id":["computation3020235"],"URL":"https:\/\/doi.org\/10.3390\/computation3020235","relation":{},"ISSN":["2079-3197"],"issn-type":[{"value":"2079-3197","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,5,22]]}}}