{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T16:17:27Z","timestamp":1778084247499,"version":"3.51.4"},"reference-count":48,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2025,12,23]],"date-time":"2025-12-23T00:00:00Z","timestamp":1766448000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["32171357"],"award-info":[{"award-number":["32171357"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"publisher","award":["2022YFC2402601"],"award-info":[{"award-number":["2022YFC2402601"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Membranes"],"abstract":"<jats:p>The membrane oxygenator serves as the core component of extracorporeal life support systems, and its gas exchange efficiency critically influences clinical outcomes. However, gas transfer is predominantly limited by the diffusion barrier within the blood-side boundary layer, where saturated red blood cells accumulate. Current research focuses mainly on static approaches such as optimizing fiber bundle configuration to promote passive blood mixing or modifying material properties, which are fixed after fabrication. In contrast, dynamic blood flow control remains an underexplored avenue for enhancing oxygenator performance. This study proposes an active pulsatile flow control method that disrupts the boundary layer barrier by optimizing periodic flow profiles, thereby directly improving gas exchange. A deep reinforcement learning framework integrating proximal policy optimization and long short-term memory networks was developed to autonomously search for optimal flow waveforms under constant flow conditions. A simplified stacked-plate membrane oxygenator was specially designed as the experimental platform to minimize flow path interference. Experimental results demonstrate that the optimized pulsatile profile increases the oxygen transfer rate by 20.64% without compromising hemocompatibility.<\/jats:p>","DOI":"10.3390\/membranes16010004","type":"journal-article","created":{"date-parts":[[2025,12,23]],"date-time":"2025-12-23T14:05:22Z","timestamp":1766498722000},"page":"4","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["A Deep Reinforcement Learning-Optimized Blood Flow Profile for Enhanced Oxygenation Efficiency in Membrane Oxygenators"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-5720-4796","authenticated-orcid":false,"given":"Junwen","family":"Yu","sequence":"first","affiliation":[{"name":"College of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuan","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huaiyuan","family":"Guo","sequence":"additional","affiliation":[{"name":"College of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qingyang","family":"Cheng","sequence":"additional","affiliation":[{"name":"College of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Junlong","family":"Meng","sequence":"additional","affiliation":[{"name":"College of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ming","family":"Yang","sequence":"additional","affiliation":[{"name":"College of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,12,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"101287","DOI":"10.1016\/j.aucc.2025.101287","article-title":"Cycle ergometers in extracorporeal membrane oxygenation patient rehabilitation: A scoping review","volume":"38","author":"Rodrigues","year":"2025","journal-title":"Aust. Crit. Care"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1016\/j.healun.2007.01.031","article-title":"Extracorporeal membrane oxygenation for primary graft dysfunction after lung transplantation: Analysis of the Extracorporeal Life Support Organization (ELSO) registry","volume":"26","author":"Fischer","year":"2007","journal-title":"J. Heart Lung Transplant."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1016\/j.ijid.2020.03.058","article-title":"Extracorporeal membrane oxygenation (ECMO): Does it have a role in the treatment of severe COVID-19?","volume":"94","author":"Hong","year":"2020","journal-title":"Int. J. Infect. Dis."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"e1","DOI":"10.1097\/PCC.0000000000003496","article-title":"The Influence of the Extracorporeal Membrane Oxygenation Circuit and Components on Anticoagulation Management: The Pediatric Extracorporeal Membrane Oxygenation Anticoagulation CollaborativE Consensus Conference","volume":"25","author":"Himebauch","year":"2024","journal-title":"Pediatr. Crit. Care Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"13985","DOI":"10.1038\/s41598-018-32247-y","article-title":"Flow-induced platelet activation in components of the extracorporeal membrane oxygenation circuit","volume":"8","author":"Fuchs","year":"2018","journal-title":"Sci. Rep."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"124377","DOI":"10.1016\/j.memsci.2025.124377","article-title":"Surface-functionalized composite hollow fiber membrane for extracorporeal membrane oxygenation","volume":"733","author":"Zhao","year":"2025","journal-title":"J. Membr. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1111\/aor.14081","article-title":"Three-dimensional Membranes for Artificial Lungs: Comparison of Flow-Induced Hemolysis","volume":"46","author":"Hesselmann","year":"2021","journal-title":"Artif. Organs"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1111\/j.1525-1594.2008.00672.x","article-title":"Functional and biocompatibility performances of an integrated Maglev pump-oxygenator","volume":"33","author":"Zhang","year":"2009","journal-title":"Artif. Organs"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1046","DOI":"10.1111\/aor.12705","article-title":"Extracorporeal Respiratory Support With a Miniature Integrated Pediatric Pump-Lung Device in an Acute Ovine Respiratory Failure Model","volume":"40","author":"Wei","year":"2016","journal-title":"Artif. Organs"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"704","DOI":"10.1097\/MAT.0000000000002173","article-title":"In-Vivo Evaluation of a Novel Integrated Pediatric Pump Lung in a 30 Day Ovine Animal Model","volume":"70","author":"Leibowitz","year":"2024","journal-title":"ASAIO J."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1111\/aor.12611","article-title":"Comparison of a New Miniaturized Extracorporeal Membrane Oxygenation System With Integrated Rotary Blood Pump to a Standard System in a Porcine Model of Acute Lung Injury","volume":"40","author":"Pilarczyk","year":"2016","journal-title":"Artif. Organs"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"904","DOI":"10.1111\/j.1525-1594.2010.01123.x","article-title":"Description of a flow optimized oxygenator with integrated pulsatile pump","volume":"34","author":"Borchardt","year":"2010","journal-title":"Artif. Organs"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"121742","DOI":"10.1016\/j.memsci.2023.121742","article-title":"Effect of hollow fiber configuration and replacement on the gas exchange performance of artificial membrane lungs","volume":"680","author":"Costa","year":"2023","journal-title":"J. Membr. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"123147","DOI":"10.1016\/j.memsci.2024.123147","article-title":"The Influence of Membrane Fiber Arrangement on Gas Exchange in Blood Oxygenators: A Combined Numerical and Experimental Analysis","volume":"710","author":"Focke","year":"2024","journal-title":"J. Membr. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"106907","DOI":"10.1016\/j.compbiomed.2023.106907","article-title":"Comparison of hemodynamic features and thrombosis risk of membrane oxygenators with different structures: A numerical study","volume":"159","author":"Fu","year":"2023","journal-title":"Comput. Biol. Med."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"122101","DOI":"10.1016\/j.memsci.2023.122101","article-title":"Green citrate-based binary diluents for blood oxygenation membranes with high gas permeability","volume":"687","author":"Yang","year":"2023","journal-title":"J. Membr. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"122088","DOI":"10.1016\/j.memsci.2023.122088","article-title":"Engineering metal-covalent organic framework-based hybrid oxygenation membranes for facilitated blood-gas exchange","volume":"687","author":"Guo","year":"2023","journal-title":"J. Membr. Sci."},{"key":"ref_18","first-page":"121162","article-title":"In-Situ Modified Polyethersulfone Oxygenation Membrane with Improved Hemocompatibility and Gas Transfer Efficiency","volume":"667","author":"Zhi","year":"2022","journal-title":"SSRN Electron. J."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"121728","DOI":"10.1016\/j.memsci.2023.121728","article-title":"Mixed matrix membranes (MMMs) comprising the CO2-Philic wavelike layer of hydrogen-bonded organic frameworks (HOFs) for highly efficient blood oxygenation","volume":"680","author":"Wang","year":"2023","journal-title":"J. Membr. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"122183","DOI":"10.1016\/j.memsci.2023.122183","article-title":"Amphiphilic PDMS-HEMA membrane surface for improved gas selectivity and blood compatibility","volume":"690","author":"Zhang","year":"2023","journal-title":"J. Membr. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1111\/aor.12588","article-title":"Effect of the Pulsatile Extracorporeal Membrane Oxygenation on Hemodynamic Energy and Systemic Microcirculation in a Piglet Model of Acute Cardiac Failure","volume":"40","author":"Itoh","year":"2016","journal-title":"Artif. Organs"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Sakurai, H., Fujiwara, T., Ohuchi, K., Hijikata, W., Toda, D., Tanaka, Y., Bumerdene, O., Suzuki, S., Iwanaga, T., and Fujita, T. (2025). New Findings on Pulsatile ECMO: Verification of the Potential to Improve Antithrombogenicity of a Membrane Oxygenator Using Pump-Generated Pulsatile Flow in an Innovative Animal Model. Artif. Organs, ahead of print.","DOI":"10.1111\/aor.15043"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"34873","DOI":"10.1007\/s11071-025-11852-3","article-title":"Nonlinear hemodynamics modeling of fractional Jeffery ternary hybrid nanofluid flow in multi-stenosed arteries with ANN-based simulation","volume":"113","author":"Parida","year":"2025","journal-title":"Nonlinear Dynamics"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1016\/j.jacbts.2025.01.012","article-title":"A Novel Transaortic Pulsatile Pump to Unload the Left Ventricle","volume":"10","author":"Kim","year":"2025","journal-title":"JACC Basic Transl. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"966","DOI":"10.1007\/s10439-024-03672-0","article-title":"A Novel Valveless Pulsatile Flow Pump for Extracorporeal Blood Circulation","volume":"53","author":"Anatol","year":"2025","journal-title":"Ann. Biomed. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Fujii, Y., Akamatsu, N., Yamasaki, Y., Miki, K., Banno, M., Minami, K., and Inamori, S. (2020). Development of a Pulsatile Flow-Generating Circulatory Assist Device (K-Beat) for Use with Veno-Arterial Extracorporeal Membrane Oxygenation in a Pig Model Study. Biology, 9.","DOI":"10.3390\/biology9060121"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"678","DOI":"10.1097\/01.MAT.0000094041.69991.0D","article-title":"Blood Flow Pulsatility Effects upon Oxygen Transfer in Artificial Lungs","volume":"49","author":"Boschetti","year":"2003","journal-title":"ASAIO J."},{"key":"ref_28","first-page":"561","article-title":"Augmentation of gas transfer with pulsatile flow in the coiled tube membrane oxygenator design","volume":"26","author":"Tanishita","year":"1980","journal-title":"Trans.-Am. Soc. Artif. Intern. Organs"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1111\/aor.13088","article-title":"Effects of Pulsatile Blood Flow on Oxygenator Performance","volume":"42","author":"Schraven","year":"2018","journal-title":"Artif. Organs"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"E247","DOI":"10.1111\/aor.13935","article-title":"A High Gas Transfer Efficiency Microfluidic Oxygenator for Extracorporeal Respiratory Assist Applications in Critical Care Medicine","volume":"45","author":"Gimbel","year":"2021","journal-title":"Artif. Organs"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"762","DOI":"10.1007\/s10439-018-1995-9","article-title":"Effects of Hollow Fiber Membrane Oscillation on an Artificial Lung","volume":"46","author":"Orizondo","year":"2018","journal-title":"Ann. Biomed. Eng."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1007\/s42241-020-0028-y","article-title":"Deep reinforcement learning in fluid mechanics: A promising method for both active flow control and shape optimization","volume":"32","author":"Rabault","year":"2020","journal-title":"J. Hydrodyn."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"063607","DOI":"10.1063\/5.0052524","article-title":"From active learning to deep reinforcement learning: Intelligent active flow control in suppressing vortex-induced vibration","volume":"33","author":"Zheng","year":"2021","journal-title":"Phys. Fluids"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1921","DOI":"10.1007\/s10483-022-2940-9","article-title":"Active control of flow past an elliptic cylinder using an artificial neural network trained by deep reinforcement learning","volume":"43","author":"Wang","year":"2022","journal-title":"Appl. Math. Mech."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"3103","DOI":"10.1109\/TCYB.2020.2977661","article-title":"Deep Reinforcement Learning for Multiobjective Optimization","volume":"51","author":"Li","year":"2019","journal-title":"IEEE Trans. Cybern."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"081916","DOI":"10.1063\/5.0227077","article-title":"A comprehensive study of oxygenator gas transfer efficiency and thrombosis risk","volume":"36","author":"Li","year":"2024","journal-title":"Phys. Fluids"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"e70076","DOI":"10.1002\/cnm.70076","article-title":"Effect of Pulsatile Blood Flow Parameters on Membrane Oxygenator Performance: A Cross-Scale Simulation Study","volume":"41","author":"Liu","year":"2025","journal-title":"Int. J. Numer. Methods Biomed. Eng."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1016\/j.memsci.2006.11.041","article-title":"Characterization of membrane blood oxygenation devices using computational fluid dynamics","volume":"288","author":"Zhang","year":"2007","journal-title":"J. Membr. Sci."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1111\/j.1525-1594.2004.00015.x","article-title":"The power-law mathematical model for blood damage prediction: Analytical developments and physical inconsistencies","volume":"285","author":"Grigioni","year":"2004","journal-title":"Artif. Organs"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1177\/039139889001300507","article-title":"Estimation of Shear Stress-related Blood Damage in Heart Valve Prostheses\u2014in Vitro Comparison of 25 Aortic Valves","volume":"13","author":"Giersiepen","year":"1990","journal-title":"Int. J. Artif. Organs"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.jcp.2019.05.041","article-title":"Recovering missing CFD data for high-order discretizations using deep neural networks and dynamics learning","volume":"395","author":"Carlberg","year":"2018","journal-title":"J. Comput. Phys."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"112355","DOI":"10.1016\/j.jcp.2023.112355","article-title":"A Non-Intrusive Data-Driven Reduced Order Model for Parametrized CFD-DEM Numerical Simulations","volume":"491","author":"Hajisharifi","year":"2023","journal-title":"J. Comput. Phys."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"113500","DOI":"10.1016\/j.jcp.2024.113500","article-title":"A DSMC-CFD coupling method using surrogate modelling for low-speed rarefied gas flows","volume":"520","author":"Tatsios","year":"2023","journal-title":"J. Comput. Phys."},{"key":"ref_44","first-page":"1.J058291","article-title":"Deep Learning Methods for Reynolds-Averaged Navier-Stokes Simulations of Airfoil Flows","volume":"58","author":"Thuerey","year":"2018","journal-title":"AIAA J."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"108628","DOI":"10.1016\/j.icheatmasstransfer.2025.108628","article-title":"Numerical modeling of pulsatile blood flow in the pulmonary artery under the influence of pulmonary hypertension and concomitant pathologies","volume":"163","author":"Issakhov","year":"2025","journal-title":"Int. Commun. Heat Mass Transf."},{"key":"ref_46","unstructured":"Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2017). Proximal Policy Optimization Algorithms. arXiv."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Yang, M. (2020). Artificial Hearts: Technology and Therapy Management, Springer Singapore Pte. Limited. [1st ed.].","DOI":"10.1007\/978-981-15-4378-4"},{"key":"ref_48","unstructured":"(2019). Standard Practice for Assessment of Hemolysis in Continuous Flow Blood Pumps (Standard No. ASTM F1841-19e1)."}],"container-title":["Membranes"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2077-0375\/16\/1\/4\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,23]],"date-time":"2025-12-23T14:26:00Z","timestamp":1766499960000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2077-0375\/16\/1\/4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,23]]},"references-count":48,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1]]}},"alternative-id":["membranes16010004"],"URL":"https:\/\/doi.org\/10.3390\/membranes16010004","relation":{},"ISSN":["2077-0375"],"issn-type":[{"value":"2077-0375","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,23]]}}}