{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T09:50:35Z","timestamp":1773827435804,"version":"3.50.1"},"reference-count":37,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2021,3,5]],"date-time":"2021-03-05T00:00:00Z","timestamp":1614902400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","doi-asserted-by":"publisher","award":["UIDB\/00099\/2020"],"award-info":[{"award-number":["UIDB\/00099\/2020"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,3,27]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n               <jats:p>Predictive wavefront control is an important and rapidly developing field of adaptive optics (AO). Through the prediction of future wavefront effects, the inherent AO system servo-lag caused by the measurement, computation, and application of the wavefront correction can be significantly mitigated. This lag can impact the final delivered science image, including reduced strehl and contrast, and inhibits our ability to reliably use faint guide stars. We summarize here a novel method for training deep neural networks for predictive control based on an adversarial prior. Unlike previous methods in the literature, which have shown results based on previously generated data or for open-loop systems, we demonstrate our network\u2019s performance simulated in closed loop. Our models are able to both reduce effects induced by servo-lag and push the faint end of reliable control with natural guide stars, improving K-band Strehl performance compared to classical methods by over 55\u00a0per\u2009cent for 16th magnitude guide stars on an 8-m telescope. We further show that LSTM based approaches may be better suited in high-contrast scenarios where servo-lag error is most pronounced, while traditional feed forward models are better suited for high noise scenarios. Finally, we discuss future strategies for implementing our system in real-time and on astronomical telescope systems.<\/jats:p>","DOI":"10.1093\/mnras\/stab632","type":"journal-article","created":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T04:16:40Z","timestamp":1614745000000},"page":"2944-2954","source":"Crossref","is-referenced-by-count":30,"title":["Closed loop predictive control of adaptive optics systems with convolutional neural networks"],"prefix":"10.1093","volume":"503","author":[{"given":"Robin","family":"Swanson","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Toronto, 40 St George Street, Toronto, M5S 2E4, Canada"},{"name":"Dunlap Institute for Astronomy and Astrophysics, University of Toronto, 50 St George Street, Toronto, M5S 3H4, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2621-9655","authenticated-orcid":false,"given":"Masen","family":"Lamb","sequence":"additional","affiliation":[{"name":"Dunlap Institute for Astronomy and Astrophysics, University of Toronto, 50 St George Street, Toronto, M5S 3H4, Canada"},{"name":"David A. Dunlap Department of Astronomy and Astrophysics, University of Toronto, 50 St George Street, Toronto, M5S 3H4, Canada"}]},{"given":"Carlos M","family":"Correia","sequence":"additional","affiliation":[{"name":"Space ODT, Rua A. C. Monteiro, 65, P-4050-014 Porto, Portugal"},{"name":"CENTRA, Faculdade de Engenharia da Universidade do Porto, Rua Dr. Roberto Frias s\/n, P-4200-465 Porto, Portugal"}]},{"given":"Suresh","family":"Sivanandam","sequence":"additional","affiliation":[{"name":"Dunlap Institute for Astronomy and Astrophysics, University of Toronto, 50 St George Street, Toronto, M5S 3H4, Canada"},{"name":"David A. Dunlap Department of Astronomy and Astrophysics, University of Toronto, 50 St George Street, Toronto, M5S 3H4, Canada"}]},{"given":"Kiriakos","family":"Kutulakos","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Toronto, 40 St George Street, Toronto, M5S 2E4, Canada"}]}],"member":"286","published-online":{"date-parts":[[2021,3,5]]},"reference":[{"key":"2021032709463105200_bib1","author":"Abadi","year":"2015","journal-title":"TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems"},{"key":"2021032709463105200_bib2","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPR)","author":"Claus","year":"2019"},{"key":"2021032709463105200_bib3","first-page":"91486C","volume-title":"Adaptive optics systems IV, Vol. 9148","author":"Conan","year":"2014"},{"key":"2021032709463105200_bib4","doi-asserted-by":"publisher","first-page":"1877","DOI":"10.1364\/JOSAA.34.001877","volume":"34","author":"Correia","year":"2017","journal-title":"J. Opt. Soc. Am. A"},{"key":"2021032709463105200_bib5","doi-asserted-by":"publisher","first-page":"4380","DOI":"10.1093\/mnras\/staa843","volume":"495","author":"Correia","year":"2020","journal-title":"MNRAS"},{"key":"2021032709463105200_bib6","doi-asserted-by":"publisher","first-page":"1441","DOI":"10.1093\/mnras\/stv632","volume":"450","author":"Dieleman","year":"2015","journal-title":"MNRAS"},{"key":"2021032709463105200_bib7","doi-asserted-by":"publisher","first-page":"165","DOI":"10.1086\/316120","volume":"110","author":"Ellerbroek","year":"1998","journal-title":"PASP"},{"key":"2021032709463105200_bib8","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1117\/12.506580","volume-title":"Astronomical Adaptive Optics Systems and Applications, Vol. 5169","author":"Ellerbroek","year":"2003"},{"key":"2021032709463105200_bib9","first-page":"64","volume-title":"Advances in neural information processing systems (NIPS)","author":"Finn","year":"2016"},{"key":"2021032709463105200_bib10","doi-asserted-by":"publisher","first-page":"L2","DOI":"10.1051\/0004-6361\/201116658","volume":"529","author":"Gendron","year":"2011","journal-title":"A&A"},{"key":"2021032709463105200_bib11","first-page":"2672","volume-title":"Advances in neural information processing systems (NIPS)","author":"Goodfellow","year":"2014"},{"key":"2021032709463105200_bib12","first-page":"1026","volume-title":"Proceedings of the IEEE international conference on computer vision (ICCV)","author":"He","year":"2015"},{"key":"2021032709463105200_bib13","first-page":"770","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR)","author":"He","year":"2016"},{"key":"2021032709463105200_bib14","first-page":"1389","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV)","author":"He","year":"2017"},{"key":"2021032709463105200_bib15","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"2021032709463105200_bib16","first-page":"12627","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"James","year":"2019"},{"key":"2021032709463105200_bib17","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Karras","year":"2020"},{"key":"2021032709463105200_bib18","author":"Kingma","year":"2014"},{"key":"2021032709463105200_bib19","author":"Lacey","year":"2016"},{"key":"2021032709463105200_bib20","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"2021032709463105200_bib21","first-page":"1744","volume-title":"Proceedings of the IEEE International Conference on Computer Vision (ICCV)","author":"Liang","year":"2017"},{"key":"2021032709463105200_bib22","first-page":"864","volume":"11448","author":"Liu","year":"2020","journal-title":"MNRAS"},{"key":"2021032709463105200_bib23","first-page":"95","volume-title":"European Southern Observatory Conference and Workshop Proceedings","author":"Lloyd-Hart","year":"1995"},{"key":"2021032709463105200_bib24","author":"Lotter","year":"2016"},{"key":"2021032709463105200_bib25","doi-asserted-by":"publisher","first-page":"019001","DOI":"10.1117\/1.JATIS.4.1.019001","volume":"4","author":"Males","year":"2018","journal-title":"J. Astron. Telesc. Instrum. Syst."},{"key":"2021032709463105200_bib26","author":"Mathieu","year":"2015"},{"key":"2021032709463105200_bib27","doi-asserted-by":"publisher","first-page":"4238","DOI":"10.1364\/AO.35.004238","volume":"35","author":"Montera","year":"1996","journal-title":"Appl. Opt."},{"key":"2021032709463105200_bib28","author":"Olah","year":"2015","journal-title":"Understanding LSTM Networks"},{"key":"2021032709463105200_bib29","doi-asserted-by":"publisher","first-page":"2420","DOI":"10.1364\/OE.20.002420","volume":"20","author":"Osborn","year":"2012","journal-title":"Opt. Express"},{"key":"2021032709463105200_bib30","author":"Radford","year":"2015"},{"key":"2021032709463105200_bib31","first-page":"234","volume-title":"International Conference on Medical image computing and computer-assisted intervention (MICCAI)","author":"Ronneberger","year":"2015"},{"key":"2021032709463105200_bib32","first-page":"2107","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR)","author":"Shrivastava","year":"2017"},{"key":"2021032709463105200_bib33","first-page":"107031F","volume-title":"Adaptive Optics Systems VI","author":"Swanson","year":"2018"},{"key":"2021032709463105200_bib34","author":"van\u00a0Kooten","year":"2020"},{"key":"2021032709463105200_bib35","first-page":"802","volume-title":"Proceedings of the 28th International Conference on Neural Information Processing Systems - Volume 1","author":"Xingjian","year":"2015"},{"key":"2021032709463105200_bib36","author":"Zhao","year":"2015"},{"key":"2021032709463105200_bib37","first-page":"2223","volume-title":"Proceedings of the IEEE international conference on computer vision (ICCV)","author":"Zhu","year":"2017"}],"container-title":["Monthly Notices of the Royal Astronomical Society"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/mnras\/advance-article-pdf\/doi\/10.1093\/mnras\/stab632\/36462674\/stab632.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/mnras\/article-pdf\/503\/2\/2944\/36757195\/stab632.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/mnras\/article-pdf\/503\/2\/2944\/36757195\/stab632.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,27]],"date-time":"2021-03-27T09:46:57Z","timestamp":1616838417000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/mnras\/article\/503\/2\/2944\/6159481"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,5]]},"references-count":37,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,3,27]]}},"URL":"https:\/\/doi.org\/10.1093\/mnras\/stab632","relation":{},"ISSN":["0035-8711","1365-2966"],"issn-type":[{"value":"0035-8711","type":"print"},{"value":"1365-2966","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,5]]},"published":{"date-parts":[[2021,3,5]]}}}