{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T02:52:27Z","timestamp":1780714347436,"version":"3.54.1"},"reference-count":51,"publisher":"SAGE Publications","issue":"5","license":[{"start":{"date-parts":[[2023,2,22]],"date-time":"2023-02-22T00:00:00Z","timestamp":1677024000000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004359","name":"Vetenskapsr\u00e5det","doi-asserted-by":"publisher","award":["2018-0597"],"award-info":[{"award-number":["2018-0597"]}],"id":[{"id":"10.13039\/501100004359","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004359","name":"Vetenskapsr\u00e5det","doi-asserted-by":"publisher","award":["2019- 0472"],"award-info":[{"award-number":["2019- 0472"]}],"id":[{"id":"10.13039\/501100004359","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100017156","name":"Swedish e-Science Research Centre","doi-asserted-by":"publisher","award":["Exascale Simulation Software Initiative"],"award-info":[{"award-number":["Exascale Simulation Software Initiative"]}],"id":[{"id":"10.13039\/100017156","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of High Performance Computing Applications"],"published-print":{"date-parts":[[2023,9]]},"abstract":"<jats:p>We present our approach to making direct numerical simulations of turbulence with applications in sustainable shipping. We use modern Fortran and the spectral element method to leverage and scale on supercomputers powered by the Nvidia A100 and the recent AMD Instinct MI250X GPUs, while still providing support for user software developed in Fortran. We demonstrate the efficiency of our approach by performing the world\u2019s first direct numerical simulation of the flow around a Flettner rotor at Re = 30,000 and its interaction with a turbulent boundary layer. We present a performance comparison between the AMD Instinct MI250X and Nvidia A100 GPUs for scalable computational fluid dynamics. Our results show that one MI250X offers performance on par with two A100 GPUs and has a similar power efficiency based on readings from on-chip energy sensors.<\/jats:p>","DOI":"10.1177\/10943420231158616","type":"journal-article","created":{"date-parts":[[2023,2,22]],"date-time":"2023-02-22T19:53:11Z","timestamp":1677095591000},"page":"487-502","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":18,"title":["Large-Scale direct numerical simulations of turbulence using GPUs and modern Fortran"],"prefix":"10.1177","volume":"37","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3374-8093","authenticated-orcid":false,"given":"Martin","family":"Karp","sequence":"first","affiliation":[{"name":"Division of Computational Science and Technology, EECS, KTH Royal Institute of Technology, Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6712-8944","authenticated-orcid":false,"given":"Daniele","family":"Massaro","sequence":"additional","affiliation":[{"name":"SimEx\/FLOW, Engineering Mechanics, KTH Royal Institute of Technology, Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5020-1631","authenticated-orcid":false,"given":"Niclas","family":"Jansson","sequence":"additional","affiliation":[{"name":"PDC Centre for High Performance Computing, EECS, KTH Royal Institute of Technology, Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alistair","family":"Hart","sequence":"additional","affiliation":[{"name":"Hewlett Packard Enterpise (HPE), UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jacob","family":"Wahlgren","sequence":"additional","affiliation":[{"name":"Division of Computational Science and Technology, EECS, KTH Royal Institute of Technology, Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9627-5903","authenticated-orcid":false,"given":"Philipp","family":"Schlatter","sequence":"additional","affiliation":[{"name":"SimEx\/FLOW, Engineering Mechanics, KTH Royal Institute of Technology, Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefano","family":"Markidis","sequence":"additional","affiliation":[{"name":"Division of Computational Science and Technology, EECS, KTH Royal Institute of Technology, Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2023,2,22]]},"reference":[{"key":"bibr1-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1016\/j.camwa.2020.06.009"},{"key":"bibr2-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1515\/jnma-2020-0043"},{"key":"bibr3-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevFluids.6.113904"},{"key":"bibr4-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-022-28957-7"},{"key":"bibr5-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1016\/j.jweia.2019.02.006"},{"key":"bibr6-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1016\/j.jweia.2019.104024"},{"key":"bibr7-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpc.2015.02.008"},{"key":"bibr8-10943420231158616","unstructured":"Chevalier M, Lundbladh A, Henningson D (2007) SIMSON\u2013a pseudo-spectral solver for incompressible boundary layer flow. Technical report."},{"key":"bibr9-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1155\/2016\/3458750"},{"key":"bibr10-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511546792"},{"key":"bibr11-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1109\/P3HPC54578.2021.00005"},{"key":"bibr12-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpdc.2014.07.003"},{"key":"bibr13-10943420231158616","volume-title":"NekRS, a GPU-Accelerated Spectral Element Navier-Stokes Solver","author":"Fischer P","year":"2021"},{"key":"bibr14-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1016\/S0045-7825(98)00012-7"},{"key":"bibr15-10943420231158616","volume-title":"nek5000 Web Page","author":"Fischer PF","year":"2008"},{"key":"bibr16-10943420231158616","volume-title":"Green500 Web Page","author":"Green500","year":"2021"},{"key":"bibr17-10943420231158616","volume":"1","author":"Hart A","year":"2014","journal-title":"Proceedings of the Cray User Group (CUG)"},{"key":"bibr18-10943420231158616","doi-asserted-by":"publisher","DOI":"10.2172\/1169830"},{"key":"bibr19-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1145\/3432261.3432265"},{"key":"bibr20-10943420231158616","volume-title":"Neko: A Modern, Portable, and Scalable Framework for High-Fidelity Computational Fluid Dynamics","author":"Jansson N","year":"2021"},{"key":"bibr21-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1016\/0021-9991(91)90007-8"},{"key":"bibr22-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1145\/3539781.3539785"},{"key":"bibr23-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS49936.2021.00116"},{"key":"bibr24-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1145\/3492805.3492808"},{"key":"bibr25-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1145\/2791321.2791345"},{"key":"bibr26-10943420231158616","volume-title":"ECP milestone report high-order algorithmic developments and optimizations for more robust exascale applications wbs 2.2","author":"Kolev T","year":"2022"},{"key":"bibr27-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1177\/10943420211020803"},{"key":"bibr28-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1007\/s10915-004-4787-3"},{"key":"bibr29-10943420231158616","unstructured":"Maday Y, Patera AT (1989) Spectral Element Methods for the Incompressible Navier-Stokes Equations. State-of-the-Art Surveys on Computational Mechanics (A90-47176 21-64). New York, pp. 71\u2013143."},{"key":"bibr30-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1002\/andp.18531640102"},{"key":"bibr31-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1103\/APS.DFD.2022"},{"key":"bibr32-10943420231158616","volume-title":"OCCA: A Unified Approach to Multi-Threading Languages","author":"Medina DS","year":"2014"},{"key":"bibr33-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1145\/2938615.2938617"},{"key":"bibr34-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-546050-7.50014-9"},{"key":"bibr35-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1007\/BF01061454"},{"key":"bibr36-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpdc.2019.05.010"},{"key":"bibr37-10943420231158616","volume-title":"IPCC Fourth Assessment Report","author":"Pachauri RK","year":"2007"},{"key":"bibr38-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1016\/0021-9991(84)90128-1"},{"key":"bibr39-10943420231158616","unstructured":"Peplinski A (2022) KTH Framework for Nek5000. https:\/\/github.com\/KTH-Nek5000\/KTH\\textunderscoreFramework"},{"key":"bibr40-10943420231158616","doi-asserted-by":"crossref","unstructured":"Reid J (2008) The new features of Fortran 2008. New York, NY, USA: ACM, pp. 8\u201321.","DOI":"10.1145\/1408643.1408645"},{"key":"bibr41-10943420231158616","first-page":"673","volume-title":"Parallel Computing: On the Road to Exascale","author":"Reyes R","year":"2016"},{"key":"bibr42-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1137\/0907058"},{"key":"bibr43-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1017\/jfm.2012.324"},{"key":"bibr44-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1007\/s11356-021-12791-3"},{"key":"bibr45-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1016\/j.paerosci.2012.07.001"},{"key":"bibr46-10943420231158616","volume-title":"CO2 Targets, Trajectories and Trends for International Shipping","author":"Smith T","year":"2015"},{"key":"bibr47-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1177\/1094342018816368"},{"key":"bibr48-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1017\/jfm.2019.838"},{"key":"bibr49-10943420231158616","doi-asserted-by":"crossref","unstructured":"Tufo HM, Fischer PF (1999) Terascale spectral element algorithms and implementations. In: Proceedings of the 1999 ACM\/IEEE Conference on Supercomputing, p. 68.","DOI":"10.1145\/331532.331599"},{"key":"bibr50-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2014.21"},{"key":"bibr51-10943420231158616","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-32820-6_85"}],"updated-by":[{"DOI":"10.1177\/10943420231173573","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2023,5,5]],"date-time":"2023-05-05T00:00:00Z","timestamp":1683244800000}}],"container-title":["The International Journal of High Performance Computing Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420231158616","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/10943420231158616","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420231158616","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T08:17:26Z","timestamp":1777450646000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/10943420231158616"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,22]]},"references-count":51,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2023,9]]}},"alternative-id":["10.1177\/10943420231158616"],"URL":"https:\/\/doi.org\/10.1177\/10943420231158616","relation":{},"ISSN":["1094-3420","1741-2846"],"issn-type":[{"value":"1094-3420","type":"print"},{"value":"1741-2846","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,22]]}}}