{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,25]],"date-time":"2026-01-25T04:43:52Z","timestamp":1769316232099,"version":"3.49.0"},"reference-count":45,"publisher":"IOP Publishing","issue":"4","license":[{"start":{"date-parts":[[2022,12,16]],"date-time":"2022-12-16T00:00:00Z","timestamp":1671148800000},"content-version":"vor","delay-in-days":15,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,12,16]],"date-time":"2022-12-16T00:00:00Z","timestamp":1671148800000},"content-version":"tdm","delay-in-days":15,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"crossref","award":["LO 418\/25-1"],"award-info":[{"award-number":["LO 418\/25-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Mach. Learn.: Sci. Technol."],"published-print":{"date-parts":[[2022,12,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>As the length scales of the smallest technology continue to advance beyond the micron scale it becomes increasingly important to equip robotic components with the means for intelligent and autonomous decision making with limited information. With the help of a tabular Q-learning algorithm, we design a model for training a microswimmer, to navigate quickly through an environment given by various different scalar motility fields, while receiving a limited amount of local information. We compare the performances of the microswimmer, defined via time of first passage to a target, with performances of suitable reference cases. We show that the strategy obtained with our reinforcement learning model indeed represents an efficient navigation strategy, that outperforms the reference cases. By confronting the swimmer with a variety of unfamiliar environments after the finalised training, we show that the obtained strategy generalises to different classes of random fields.<\/jats:p>","DOI":"10.1088\/2632-2153\/aca7b0","type":"journal-article","created":{"date-parts":[[2022,11,30]],"date-time":"2022-11-30T22:41:20Z","timestamp":1669848080000},"page":"045024","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Active particles using reinforcement learning to navigate in complex motility landscapes"],"prefix":"10.1088","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5244-1586","authenticated-orcid":true,"given":"Paul A","family":"Monderkamp","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5779-3772","authenticated-orcid":false,"given":"Fabian Jan","family":"Schwarzendahl","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1029-5960","authenticated-orcid":false,"given":"Michael A","family":"Klatt","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5376-8062","authenticated-orcid":false,"given":"Hartmut","family":"L\u00f6wen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"266","published-online":{"date-parts":[[2022,12,16]]},"reference":[{"key":"mlstaca7b0bib1","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1146\/annurev-bioeng-010510-103409","volume":"12","author":"Nelson","year":"2010","journal-title":"Annu. Rev. Biomed. Eng."},{"key":"mlstaca7b0bib2","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1038\/s4225 6-020-0146-9","volume":"2","author":"Cichos","year":"2020","journal-title":"Nat. Mach. Intell."},{"key":"mlstaca7b0bib3","doi-asserted-by":"publisher","first-page":"3991","DOI":"10.1039\/D0SM01686A","volume":"17","author":"Clegg","year":"2021","journal-title":"Soft Matter"},{"key":"mlstaca7b0bib4","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevResearch.3.033291","volume":"3","author":"Falk","year":"2021","journal-title":"Phys. Rev. Res."},{"key":"mlstaca7b0bib5","doi-asserted-by":"publisher","DOI":"10.1103\/RevModPhys.88.045006","volume":"88","author":"Bechinger","year":"2016","journal-title":"Rev. Mod. Phys."},{"key":"mlstaca7b0bib6","doi-asserted-by":"publisher","first-page":"3170","DOI":"10.1021\/nn500077a","volume":"8","author":"Gao","year":"2014","journal-title":"ACS Nano"},{"key":"mlstaca7b0bib7","doi-asserted-by":"publisher","first-page":"2395","DOI":"10.1039\/C3TB21451F","volume":"2","author":"Abdelmohsen","year":"2014","journal-title":"J. Mater. Chem. B"},{"key":"mlstaca7b0bib8","doi-asserted-by":"publisher","first-page":"1273","DOI":"10.1039\/C2NR32600K","volume":"5","author":"Patra","year":"2013","journal-title":"Nanoscale"},{"key":"mlstaca7b0bib9","doi-asserted-by":"publisher","first-page":"3006","DOI":"10.1021\/acs.accounts.8b00291","volume":"51","author":"You","year":"2018","journal-title":"Acc. Chem. Res."},{"key":"mlstaca7b0bib10","doi-asserted-by":"publisher","DOI":"10.1209\/0295-5075\/127\/64003","volume":"127","author":"Schneider","year":"2019","journal-title":"Europhys. Lett."},{"key":"mlstaca7b0bib11","doi-asserted-by":"publisher","DOI":"10.1021\/acsnano.8b05371","volume":"12","author":"Yang","year":"2018","journal-title":"ACS Nano"},{"key":"mlstaca7b0bib12","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1109\/TCST.2014.2312392","volume":"23","author":"La","year":"2014","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"mlstaca7b0bib13","doi-asserted-by":"publisher","DOI":"10.1209\/0295-5075\/127\/34003","volume":"127","author":"Liebchen","year":"2019","journal-title":"Europhys. Lett."},{"key":"mlstaca7b0bib14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s42005-021-00522-6","volume":"4","author":"Daddi-Moussa-Ider","year":"2021","journal-title":"Commun. Phys."},{"key":"mlstaca7b0bib15","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.126.018001","volume":"126","author":"Zanovello","year":"2021","journal-title":"Phys. Rev. Lett."},{"key":"mlstaca7b0bib16","doi-asserted-by":"publisher","DOI":"10.1088\/1367-2630\/ac8013","volume":"24","author":"Nasiri","year":"2022","journal-title":"New J. Phys."},{"key":"mlstaca7b0bib17","doi-asserted-by":"publisher","first-page":"E4877","DOI":"10.1073\/pnas.1606075113","volume":"113","author":"Reddy","year":"2016","journal-title":"Proc. Natl Acad. Sci."},{"key":"mlstaca7b0bib18","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1038\/s41586-018-0533-0","volume":"562","author":"Reddy","year":"2018","journal-title":"Nature"},{"key":"mlstaca7b0bib19","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.118.158004","volume":"118","author":"Colabrese","year":"2017","journal-title":"Phys. Rev. Lett."},{"key":"mlstaca7b0bib20","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevFluids.3.084301","volume":"3","author":"Colabrese","year":"2018","journal-title":"Phys. Rev. Fluids"},{"key":"mlstaca7b0bib21","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1140\/epje\/i2017-11602-9","volume":"40","author":"Gustavsson","year":"2017","journal-title":"Eur. Phys. J. E"},{"key":"mlstaca7b0bib22","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.101.043110","volume":"101","author":"Alageshan","year":"2020","journal-title":"Phys. Rev. E"},{"key":"mlstaca7b0bib23","doi-asserted-by":"publisher","DOI":"10.1007\/s11433-019-1502-2","volume":"63","author":"Qiu","year":"2020","journal-title":"Sci. China Phys. Mech. Astron."},{"key":"mlstaca7b0bib24","doi-asserted-by":"publisher","DOI":"10.1063\/1.5120370","volume":"29","author":"Biferale","year":"2019","journal-title":"Chaos"},{"key":"mlstaca7b0bib25","doi-asserted-by":"publisher","first-page":"eabd9285","DOI":"10.1126\/scirobotics.abd9285","volume":"6","author":"Mui\u00f1os-Landin","year":"2021","journal-title":"Sci. Robot."},{"key":"mlstaca7b0bib26","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1126\/science.aau5347","volume":"364","author":"Lavergne","year":"2019","journal-title":"Science"},{"key":"mlstaca7b0bib27","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.102.062604","volume":"102","author":"Breoni","year":"2020","journal-title":"Phys. Rev. E"},{"key":"mlstaca7b0bib28","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.123.158006","volume":"123","author":"Datt","year":"2019","journal-title":"Phys. Rev. Lett."},{"key":"mlstaca7b0bib29","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.120.208002","volume":"120","author":"Liebchen","year":"2018","journal-title":"Phys. Rev. Lett."},{"key":"mlstaca7b0bib30","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1099\/00221287-118-2-429","volume":"118","author":"Daniels","year":"1980","journal-title":"Microbiology"},{"key":"mlstaca7b0bib31","doi-asserted-by":"publisher","first-page":"656","DOI":"10.1038\/255656a0","volume":"255","author":"Kaiser","year":"1975","journal-title":"Nature"},{"key":"mlstaca7b0bib32","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1099\/00221287-109-1-113","volume":"109","author":"Petrino","year":"1978","journal-title":"Microbiology"},{"key":"mlstaca7b0bib33","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1099\/mic.0.000420","volume":"163","author":"Takabe","year":"2017","journal-title":"Microbiology"},{"key":"mlstaca7b0bib34","doi-asserted-by":"publisher","first-page":"7066","DOI":"10.1021\/acs.langmuir.9b03617","volume":"36","author":"Sprenger","year":"2020","journal-title":"Langmuir"},{"key":"mlstaca7b0bib35","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.physrep.2018.03.001","volume":"745","author":"Torquato","year":"2018","journal-title":"Phys. Rep."},{"key":"mlstaca7b0bib36","doi-asserted-by":"publisher","DOI":"10.1063\/1.4989492","volume":"121","author":"Ma","year":"2017","journal-title":"J. Appl. Phys."},{"key":"mlstaca7b0bib37","doi-asserted-by":"publisher","first-page":"5360","DOI":"10.1364\/OL.437936","volume":"46","author":"Chen","year":"2021","journal-title":"Opt. Lett."},{"key":"mlstaca7b0bib38","doi-asserted-by":"publisher","DOI":"10.1088\/1742-5468\/ac5dc1","volume":"2022","author":"Klatt","year":"2022","journal-title":"J. Stat. Mech.: Theory Exp."},{"key":"mlstaca7b0bib39","author":"Sutton","year":"2018"},{"key":"mlstaca7b0bib40","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1023\/A:1008102230551","volume":"27","author":"Louste","year":"2000","journal-title":"JINT"},{"key":"mlstaca7b0bib41","doi-asserted-by":"publisher","first-page":"1263","DOI":"10.1002\/oca.2234","volume":"37","author":"Reynoso-Mora","year":"2016","journal-title":"Optim. Control Appl. Methods"},{"key":"mlstaca7b0bib42","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1016\/S1468-1218(03)00020-8","volume":"5","author":"McGough","year":"2004","journal-title":"Nonlinear Anal. Real World Appl."},{"key":"mlstaca7b0bib43","author":"Gray","year":"1990"},{"key":"mlstaca7b0bib44","doi-asserted-by":"publisher","first-page":"4976","DOI":"10.1021\/jacs.5b02700","volume":"137","author":"Ma","year":"2015","journal-title":"J. Am. Chem. Soc."},{"key":"mlstaca7b0bib45","doi-asserted-by":"publisher","first-page":"4741","DOI":"10.1039\/C8SM00513C","volume":"14","author":"Demir\u00f6rs","year":"2018","journal-title":"Soft Matter"}],"container-title":["Machine Learning: Science and Technology"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/aca7b0","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/aca7b0\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/aca7b0","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/aca7b0\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/aca7b0\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/aca7b0\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/aca7b0\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/aca7b0\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,16]],"date-time":"2022-12-16T10:50:20Z","timestamp":1671187820000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/aca7b0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,1]]},"references-count":45,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2022,12,16]]},"published-print":{"date-parts":[[2022,12,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2632-2153\/aca7b0","relation":{},"ISSN":["2632-2153"],"issn-type":[{"value":"2632-2153","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,1]]},"assertion":[{"value":"Active particles using reinforcement learning to navigate in complex motility landscapes","name":"article_title","label":"Article Title"},{"value":"Machine Learning: Science and Technology","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2022 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2022-09-07","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2022-11-30","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2022-12-16","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}