{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T13:57:27Z","timestamp":1779890247798,"version":"3.53.1"},"reference-count":41,"publisher":"IOP Publishing","issue":"6","license":[{"start":{"date-parts":[[2023,10,30]],"date-time":"2023-10-30T00:00:00Z","timestamp":1698624000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/page\/copyright"},{"start":{"date-parts":[[2023,10,30]],"date-time":"2023-10-30T00:00:00Z","timestamp":1698624000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"DOI":"10.13039\/100018928","name":"Westlake University","doi-asserted-by":"crossref","award":["103110556022101"],"award-info":[{"award-number":["103110556022101"]}],"id":[{"id":"10.13039\/100018928","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Bioinspir. Biomim."],"published-print":{"date-parts":[[2023,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Developing hybrid aerial-aquatic vehicles that can interact with water surfaces while remaining aloft is valuable for various tasks, including ecological monitoring, water quality sampling, and search and rescue operations. Storm petrels are a group of pelagic seabirds that exhibit a unique locomotion pattern known as \u2018pattering\u2019 or \u2018sea-anchoring,\u2019 which is hypothesized to support forward locomotion and\/or stationary posture at the water surface. In this study, we use morphological measurements of three storm petrel species and aero\/hydrodynamic models to develop a computational storm petrel model and interact it with a hybrid fluid environment. Using deep reinforcement learning algorithms, we find that the storm petrel model exhibits high maneuverability and stability under a wide range of constant wind velocities after training. We also verify in the simulation that the storm petrel can use its \u2018pattering\u2019 or \u2018sea-anchoring\u2019 behavior to achieve different biomechanical sub-tasks (e.g. weight support, forward locomotion, stabilization) and adapt it under different wind speeds and optimization objectives. Specifically, we observe an adjustment in storm petrel\u2019s movement patterns as wind velocity increases and quantitively analyze its biomechanics underneath. Our results provide new insights into how storm petrels achieve efficient locomotion and dynamic stability at the air\u2013water interface and adapt their behaviors to different wind velocities and tasks in open environments. Ultimately, our study will guide the design of next-generation biomimetic petrel-inspired robots for tasks requiring proximity to the water interface and efficiency.<\/jats:p>","DOI":"10.1088\/1748-3190\/ad00a2","type":"journal-article","created":{"date-parts":[[2023,10,5]],"date-time":"2023-10-05T22:47:25Z","timestamp":1696546045000},"page":"066016","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Exploring storm petrel pattering and sea-anchoring using deep reinforcement learning"],"prefix":"10.1088","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8590-3764","authenticated-orcid":false,"given":"Jiaqi","family":"Xue","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-7982-1870","authenticated-orcid":true,"given":"Fei","family":"Han","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4347-5391","authenticated-orcid":false,"given":"Brett","family":"Klaassen van Oorschot","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5806-7254","authenticated-orcid":false,"given":"Glenna","family":"Clifton","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6201-5860","authenticated-orcid":false,"given":"Dixia","family":"Fan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"266","published-online":{"date-parts":[[2023,10,30]]},"reference":[{"key":"bbad00a2bib1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10661-022-10095-8","article-title":"Comparison of drone and vessel-based collection of microbiological water samples in marine environments","volume":"194","author":"Horricks","year":"2022","journal-title":"Environ. Monit. Assess."},{"key":"bbad00a2bib2","doi-asserted-by":"publisher","first-page":"5052","DOI":"10.3390\/s22135052","article-title":"Eco-environmental effect evaluation of tamarix chinesis forest on coastal saline-alkali land based on RSEI model","volume":"22","author":"Wang","year":"2022","journal-title":"Sensors"},{"key":"bbad00a2bib3","first-page":"pp 1638","article-title":"Automatic detection of rescue targets in maritime search and rescue missions using UAVs","author":"Gon\u00e7alves","year":"2022"},{"key":"bbad00a2bib4","first-page":"pp 351","article-title":"euRathlon 2015: a multi-domain multi-robot grand challenge for search and rescue robots","author":"Winfield","year":"2016"},{"key":"bbad00a2bib5","doi-asserted-by":"publisher","first-page":"16784","DOI":"10.1073\/pnas.0405736101","article-title":"Running on water: three-dimensional force generation by basilisk lizards","volume":"101","author":"Hsieh","year":"2004","journal-title":"Proc. Natl Acad. Sci."},{"key":"bbad00a2bib6","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1146\/annurev.fluid.38.050304.092157","article-title":"Walking on water: biolocomotion at the interface","volume":"38","author":"Bush","year":"2006","journal-title":"Ann. Rev. Fluid Mech."},{"key":"bbad00a2bib7","doi-asserted-by":"publisher","first-page":"231","DOI":"10.24272\/j.issn.2095-8137.2020.029","article-title":"Interfacial phenomena of water striders on water surfaces: a review from biology to biomechanics","volume":"41","author":"Ma","year":"2020","journal-title":"Zool. Res."},{"key":"bbad00a2bib8","doi-asserted-by":"publisher","first-page":"427","DOI":"10.1146\/annurev-ecolsys-122120-122554","article-title":"The emerging phylogenetic perspective on the evolution of actinopterygian fishes","volume":"52","author":"Dornburg","year":"2021","journal-title":"Annu. Rev. Ecol. Evol. Syst."},{"key":"bbad00a2bib9","doi-asserted-by":"publisher","first-page":"1235","DOI":"10.1242\/jeb.118745","article-title":"Western and clark\u2019s grebes use novel strategies for running on water","volume":"218","author":"Clifton","year":"2015","journal-title":"J. Exp. Biol."},{"key":"bbad00a2bib10","doi-asserted-by":"publisher","first-page":"1601","DOI":"10.1242\/jeb.00908","article-title":"Paradox lost: answers and questions about walking on water","volume":"207","author":"Denny","year":"2004","journal-title":"J. Exp. Biol."},{"key":"bbad00a2bib11","doi-asserted-by":"publisher","first-page":"3269","DOI":"10.1242\/jeb.046052","article-title":"Aerodynamic characteristics of flying fish in gliding flight","volume":"213","author":"Park","year":"2010","journal-title":"J. Exp. Biol."},{"key":"bbad00a2bib12","doi-asserted-by":"publisher","first-page":"397","DOI":"10.1642\/AUK-15-158.1","article-title":"Ecomorphological differences in foraging and pattering behavior among storm-petrels in the eastern Pacific Ocean","volume":"133","author":"Sausner","year":"2016","journal-title":"Auk"},{"key":"bbad00a2bib13","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1006\/jtbi.1998.0669","article-title":"A theoretical analysis of sea-anchor soaring","volume":"192","author":"Sugimoto","year":"1998","journal-title":"J. Theor. Biol."},{"key":"bbad00a2bib14","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1242\/jeb.80.1.83","article-title":"Aerodynamics and hydrodynamics of the \u2018hovering\u2019 flight of Wilson\u2019s storm petrel","volume":"80","author":"Withers","year":"1979","journal-title":"J. Exp. Biol."},{"key":"bbad00a2bib15","article-title":"Continuous control with deep reinforcement learning","author":"Lillicrap","year":"2015"},{"key":"bbad00a2bib16","author":"Sutton","year":"2018"},{"key":"bbad00a2bib17","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"bbad00a2bib18","doi-asserted-by":"publisher","first-page":"484","DOI":"10.1038\/nature16961","article-title":"Mastering the game of go with deep neural networks and tree search","volume":"529","author":"Silver","year":"2016","journal-title":"Nature"},{"key":"bbad00a2bib19","doi-asserted-by":"crossref","DOI":"10.1109\/TNNLS.2022.3207346","article-title":"Deep reinforcement learning: a survey","author":"Wang","year":"2022"},{"key":"bbad00a2bib20","doi-asserted-by":"publisher","first-page":"674","DOI":"10.26599\/TST.2021.9010012","article-title":"Deep reinforcement learning based mobile robot navigation: a review","volume":"26","author":"Zhu","year":"2021","journal-title":"Tsinghua Sci. Technol."},{"key":"bbad00a2bib21","doi-asserted-by":"publisher","first-page":"4741","DOI":"10.1109\/LRA.2022.3146903","article-title":"Closed-loop dynamic control of a soft manipulator using deep reinforcement learning","volume":"7","author":"Centurelli","year":"2022","journal-title":"IEEE Robot. Autom. Lett."},{"key":"bbad00a2bib22","doi-asserted-by":"publisher","first-page":"7193","DOI":"10.1109\/LRA.2021.3092647","article-title":"CPG-based hierarchical locomotion control for modular quadrupedal robots using deep reinforcement learning","volume":"6","author":"Wang","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"bbad00a2bib23","doi-asserted-by":"publisher","first-page":"2770","DOI":"10.1242\/jeb.101428","article-title":"Long-axis rotation: a missing degree of freedom in avian bipedal locomotion","volume":"217","author":"Kambic","year":"2014","journal-title":"J. Exp. Biol."},{"key":"bbad00a2bib24","doi-asserted-by":"publisher","first-page":"2159","DOI":"10.1242\/jeb.203.14.2159","article-title":"Terrestrial locomotion in the black-billed magpie: kinematic analysis of walking, running and out-of-phase hopping","volume":"203","author":"Verstappen","year":"2000","journal-title":"J. Exp. Biol."},{"key":"bbad00a2bib25","article-title":"White-faced Storm-Petrel (ML201429031). The macaulay library at the cornell lab of ornithology","author":"Hoyo","year":"2013"},{"key":"bbad00a2bib26","author":"Munson","year":"2013"},{"key":"bbad00a2bib27","doi-asserted-by":"publisher","first-page":"R1","DOI":"10.1017\/jfm.2021.361","article-title":"Scaling laws for the propulsive performance of a purely pitching foil in ground effect","volume":"919","author":"Mivehchi","year":"2021","journal-title":"J. Fluid Mech."},{"key":"bbad00a2bib28","doi-asserted-by":"publisher","first-page":"A36","DOI":"10.1017\/jfm.2021.307","article-title":"Aspect ratio affects the equilibrium altitude of near-ground swimmers","volume":"917","author":"Zhong","year":"2021","journal-title":"J. Fluid Mech."},{"key":"bbad00a2bib29","doi-asserted-by":"publisher","first-page":"645","DOI":"10.1016\/S1001-6058(13)60409-6","article-title":"Practical evaluation of the drag of a ship for design and optimization","volume":"25","author":"Yang","year":"2013","journal-title":"J. Hydrodyn."},{"key":"bbad00a2bib30","article-title":"Fluid-dynamic drag. Theoretical, experimental and statistical information","author":"Hoerner","year":"1965"},{"key":"bbad00a2bib31","first-page":"pp 4900","article-title":"Study and simulation of control method based biped robot walking on water","author":"Wei","year":"2012"},{"key":"bbad00a2bib32","doi-asserted-by":"publisher","first-page":"3146","DOI":"10.1242\/jeb.136721","article-title":"Aerodynamic consequences of wing morphing during emulated take-off and gliding in birds","volume":"219","author":"Klaassen van Oorschot","year":"2016","journal-title":"J. Exp. Biol."},{"key":"bbad00a2bib33","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1098\/rstb.1993.0079","article-title":"On the aerodynamics of birds\u2019 tails","volume":"340","author":"Thomas","year":"1993","journal-title":"Phil. Trans. R. Soc. B"},{"key":"bbad00a2bib34","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1242\/jeb.165.1.21","article-title":"Pitching equilibrium, wing span and tail span in a gliding harris\u2019 hawk, parabuteo unicinctus","volume":"165","author":"Tucker","year":"1992","journal-title":"J. Exp. Biol."},{"key":"bbad00a2bib35","doi-asserted-by":"publisher","DOI":"10.1242\/jeb.223743","article-title":"Aquatic and terrestrial takeoffs require different hindlimb kinematics and muscle function in mallard ducks","volume":"223","author":"Taylor-Burt","year":"2020","journal-title":"J. Exp. Biol."},{"key":"bbad00a2bib36","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.jenvman.2013.01.025","article-title":"Assessing vulnerability of marine bird populations to offshore wind farms","volume":"119","author":"Furness","year":"2013","journal-title":"J. Environ. Manag."},{"key":"bbad00a2bib37","first-page":"pp 2369","article-title":"Self-supervised online reward shaping in sparse-reward environments","author":"Memarian","year":"2021"},{"key":"bbad00a2bib38","first-page":"pp 1","article-title":"Reward shaping with dynamic trajectory aggregation","author":"Okudo","year":"2021"},{"key":"bbad00a2bib39","doi-asserted-by":"publisher","first-page":"422","DOI":"10.1109\/JOE.2011.2151370","article-title":"Simultaneous determination of drag coefficient and added mass","volume":"36","author":"Leung Chan","year":"2011","journal-title":"IEEE J. Ocean. Eng."},{"key":"bbad00a2bib40","doi-asserted-by":"publisher","first-page":"A7","DOI":"10.1017\/jfm.2019.1076","article-title":"Effect of trailing-edge shape on the self-propulsive performance of heaving flexible plates","volume":"887","author":"Zhang","year":"2020","journal-title":"J. Fluid Mech."},{"key":"bbad00a2bib41","doi-asserted-by":"publisher","DOI":"10.1063\/1.5129274","article-title":"Hydrodynamics of median-fin interactions in fish-like locomotion: effects of fin shape and movement","volume":"32","author":"Han","year":"2020","journal-title":"Phys. Fluids"}],"container-title":["Bioinspiration &amp; Biomimetics"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1748-3190\/ad00a2","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1748-3190\/ad00a2\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1748-3190\/ad00a2","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1748-3190\/ad00a2\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1748-3190\/ad00a2\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1748-3190\/ad00a2\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1748-3190\/ad00a2\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1748-3190\/ad00a2\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,30]],"date-time":"2023-10-30T12:24:41Z","timestamp":1698668681000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1748-3190\/ad00a2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,30]]},"references-count":41,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,10,30]]},"published-print":{"date-parts":[[2023,11,1]]}},"URL":"https:\/\/doi.org\/10.1088\/1748-3190\/ad00a2","relation":{},"ISSN":["1748-3182","1748-3190"],"issn-type":[{"value":"1748-3182","type":"print"},{"value":"1748-3190","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,30]]},"assertion":[{"value":"Exploring storm petrel pattering and sea-anchoring using deep reinforcement learning","name":"article_title","label":"Article Title"},{"value":"Bioinspiration & Biomimetics","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2023 IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2023-05-15","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2023-10-05","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2023-10-30","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}