{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T00:35:39Z","timestamp":1777422939661,"version":"3.51.4"},"reference-count":30,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2024,6,29]],"date-time":"2024-06-29T00:00:00Z","timestamp":1719619200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["12103052"],"award-info":[{"award-number":["12103052"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["20230101066JC"],"award-info":[{"award-number":["20230101066JC"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Natural Science Foundation of Jilin Province","award":["12103052"],"award-info":[{"award-number":["12103052"]}]},{"name":"Natural Science Foundation of Jilin Province","award":["20230101066JC"],"award-info":[{"award-number":["20230101066JC"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The segmented mirror co-phase error identification technique based on supervised learning methods has the advantages of simple application conditions, no dependence on custom sensors, a fast calculation speed, and low computing power requirements compared with other methods. However, it is often difficult to obtain a high accuracy in practical application situations with this method because of the difference between the training model and the actual model. The reinforcement learning algorithm does not need to model the real system when operating the system. However, it still retains the advantages of supervised learning. Thus, in this paper, we placed a mask on the pupil plane of the segmented telescope optical system. Moreover, based on the wide spectrum, point spread function, and modulation transfer function of the optical system and deep reinforcement learning\u2014without modeling the optical system\u2014a large-range and high-precision piston error automatic co-phase method with multiple-submirror parallelization was proposed. Finally, we carried out relevant simulation experiments, and the results indicate that the method is effective.<\/jats:p>","DOI":"10.3390\/s24134236","type":"journal-article","created":{"date-parts":[[2024,7,1]],"date-time":"2024-07-01T10:14:46Z","timestamp":1719828886000},"page":"4236","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Piston Error Automatic Correction for Segmented Mirrors via Deep Reinforcement Learning"],"prefix":"10.3390","volume":"24","author":[{"given":"Dequan","family":"Li","sequence":"first","affiliation":[{"name":"Space Optics Department, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dong","family":"Wang","sequence":"additional","affiliation":[{"name":"Space Optics Department, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dejie","family":"Yan","sequence":"additional","affiliation":[{"name":"Space Optics Department, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,6,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"E101","DOI":"10.1364\/AO.57.00E101","article-title":"Development of a prototype active optics system for future space telescopes","volume":"57","author":"Devaney","year":"2018","journal-title":"Appl. Opt."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1563","DOI":"10.1364\/JOSAA.20.001563","article-title":"Analytical study of diffraction effects in extremely large segmented telescopes","volume":"20","author":"Yaitskova","year":"2003","journal-title":"J. Opt. Soc. Am. A"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4540","DOI":"10.1364\/AO.39.004540","article-title":"Experimental comparison of a Shack\u2013Hartmann sensor and a phase-shifting interferometer for large-optics metrology applications","volume":"39","author":"Koch","year":"2000","journal-title":"Appl. Opt."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1223","DOI":"10.1364\/AO.27.001223","article-title":"Curvature sensing and compensation: A new concept in adaptive optics","volume":"27","author":"Roddier","year":"1988","journal-title":"Appl. Opt."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Lilley, S., Wizinowich, P., Mawet, D., Chun, M., Cond, C., Wallace, J., Jovanovic, N., Delorme, J.-R., Jacobson, S., and Taheri, M. (2018, January 10\u201315). Near-Infrared Pyramid Wavefront Sensor for Keck Adaptive Optics: Opto-Mechanical Design. Proceedings of the SPIE Astronomical Telescopes + Instrumentation, Austin, TX, USA.","DOI":"10.1117\/12.2312838"},{"key":"ref_6","unstructured":"Gary, C., Mitchell, T., and Nasrat, R. (July, January 26). Phasing the segments of the Keck and Thirty Meter Telescopes via the narrowband phasing algorithm: Chromatic effects. Proceedings of the SPIE Astronomical Telescopes + Instrumentation, Edinburgh, UK."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"8212","DOI":"10.1364\/AO.57.008212","article-title":"Variable step size adaptive cuckoo search optimization algorithm for phase diversity","volume":"57","author":"Li","year":"2018","journal-title":"Appl. Opt."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1170","DOI":"10.1364\/OL.44.001170","article-title":"Large-scale piston error detection technology for segmented optical mirrors via convolutional neural networks","volume":"44","author":"Li","year":"2019","journal-title":"Opt. Lett."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"22846","DOI":"10.1364\/OE.27.022846","article-title":"Phase diversity algorithm with high noise robust based on deep denoising convolutional neural network","volume":"27","author":"Li","year":"2019","journal-title":"Opt. Express"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4706","DOI":"10.1364\/AO.39.004706","article-title":"Phasing the mirror segments of the Keck telescopes II: The narrow-band phasing algorithm","volume":"39","author":"Chanan","year":"2000","journal-title":"Appl. Opt."},{"key":"ref_11","first-page":"215829","article-title":"Phase Retrieval and Diversity In Adaptive Optics","volume":"21","author":"Robert","year":"1982","journal-title":"Opt. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"5423","DOI":"10.1364\/BOE.427970","article-title":"Wavefront sensor-less adaptive optics using deep reinforcement learning","volume":"12","author":"Durech","year":"2021","journal-title":"Biomed. Opt. Express"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1603","DOI":"10.1364\/OPTCON.462667","article-title":"Asymmetric sparse telescope","volume":"1","author":"Kaplun","year":"2022","journal-title":"Opt. Contin."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Sutton, R., and Barto, A. (1998). Reinforcement Learning: An Introduction, MIT Press.","DOI":"10.1109\/TNN.1998.712192"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Guerra, D., Trujillo-Sevilla, J., and Rodr\u00edguez-Ramos, J. (2020). Towards Piston Fine Tuning of Segmented Mirrors through Reinforcement Learning. Appl. Sci., 10.","DOI":"10.3390\/app10093207"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"484","DOI":"10.1038\/nature16961","article-title":"Mastering the game of Go with deep neural networks and tree search","volume":"529","author":"Silver","year":"2016","journal-title":"Nature"},{"key":"ref_17","unstructured":"Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2017). Proximal Policy Optimization Algorithms. arXiv."},{"key":"ref_18","first-page":"9","article-title":"Language Models are Unsupervised Multitask Learners","volume":"1","author":"Radford","year":"2019","journal-title":"OpenAI blog"},{"key":"ref_19","unstructured":"Schulman, J., Moritz, P., Levine, S., Jordan, M., and Abbeel, P. (2015). High-Dimensional Continuous Control Using Generalized Advantage Estimation. Comput. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1364\/AO.37.000140","article-title":"Phasing the mirror segments of the Keck telescopes: The broadbandphasing algorithm","volume":"37","author":"Chanan","year":"1998","journal-title":"Appl. Opt."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"16058","DOI":"10.1364\/OE.27.016058","article-title":"Piston sensing of sparse aperture systems with a single broadband image via deep learning","volume":"27","author":"Ma","year":"2019","journal-title":"Opt. Express"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"41670","DOI":"10.1364\/OE.444501","article-title":"Object-independent tilt detection for optical sparse aperture system with large-scale piston error via deep convolution neural network","volume":"29","author":"Tang","year":"2021","journal-title":"Opt. Express"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"4264","DOI":"10.1364\/OL.43.004264","article-title":"Piston alignment of segmented optical mirrors via convolutional neural networks","volume":"43","year":"2018","journal-title":"Opt. Lett."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"19123","DOI":"10.1364\/OE.24.019123","article-title":"Phasing piston error in segmented telescopes","volume":"24","author":"Jiang","year":"2016","journal-title":"Opt. Express"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"24540","DOI":"10.1364\/OE.25.024540","article-title":"Simultaneous multi-piston measurement method in segmented telescopes","volume":"25","author":"Zhao","year":"2017","journal-title":"Opt. Express"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"129182","DOI":"10.1016\/j.optcom.2022.129182","article-title":"Non-redundant MTF distribution method for sensing multi-piston simultaneously in segmented telescopes","volume":"530","author":"Zhang","year":"2023","journal-title":"Opt. Commun."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Li, D., Wang, D., and Li, J. (2024). Large Range of a High-Precision, Independent, Sub-Mirror Three-Dimensional Co-Phase Error Sensing and Correction Method via a Mask and Population Algorithm. Sensors, 24.","DOI":"10.3390\/s24010279"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"106005","DOI":"10.1016\/j.optlaseng.2020.106005","article-title":"Piston sensing for sparse aperture systems with broadband extended objects via a single convolutional neural network","volume":"128","author":"Ma","year":"2020","journal-title":"Opt. Lasers Eng."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"3279","DOI":"10.1364\/AO.43.003279","article-title":"Efficient method for the reduction of large piston errors in segmented-mirror telescopes","volume":"43","author":"Chanan","year":"2004","journal-title":"Appl. Opt."},{"key":"ref_30","unstructured":"Cohen, W.W., and Hirsh, H. (1994). Markov games as a framework for multi-agent reinforcement learning. Machine Learning Proceedings 1994, Morgan Kaufmann."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/13\/4236\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:07:42Z","timestamp":1760108862000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/13\/4236"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,29]]},"references-count":30,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2024,7]]}},"alternative-id":["s24134236"],"URL":"https:\/\/doi.org\/10.3390\/s24134236","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,29]]}}}