{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,27]],"date-time":"2025-10-27T16:24:16Z","timestamp":1761582256112,"version":"build-2065373602"},"reference-count":31,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,1,24]],"date-time":"2023-01-24T00:00:00Z","timestamp":1674518400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62101160","61975043"],"award-info":[{"award-number":["62101160","61975043"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The novel rotating synthetic aperture (RSA) is a new optical imaging system that uses the method of rotating the rectangular primary mirror for dynamic imaging. It has the advantage of being lightweight, with no need for splicing and real-time surface shape maintenance on orbit. The novel imaging method leads to complex image quality degradation characteristics. Therefore, it is vital to use the image quality improvement method to restore and improve the image quality to meet the application requirements. For the RSA system, a new system that has not been applied in orbit, it is difficult to construct suitable large datasets. Therefore, it is necessary to study and establish the dynamic imaging characteristic model of the RSA system, and on this basis provide data support for the corresponding image super resolution and restoration method through simulation. In this paper, we first analyze the imaging characteristics and mathematically model the rectangular rotary pupil of the RSA system. On this basis, combined with the analysis of the physical interpretation of the blur kernel, we find that the optimal blur kernel is not the point spread function (PSF) of the imaging system. Therefore, the simulation method of convolving the input image directly with the PSF is flawed. Furthermore, the weights of a convolutional neural network (CNN) are the same for each input. This means that the normal convolutional layer is not only difficult to accurately estimate the time-varying blur kernel, but also difficult to adapt to the change in the length\u2013width ratio of the primary mirror. To that end, we propose a blur kernel estimation conditional convolutional neural network (CCNN) that is equivalent to multiple normal CNNs. We extend the CNN to a conditional model by taking an encoding as an additional input and using conditionally parameterized convolutions instead of normal convolutions. The CCNN can simulate the imaging characteristics of the rectangular pupil with different length\u2013width ratios and different rotation angles in a controllable manner. The results of semi-physical experiments show that the proposed simulation method achieves a satisfactory performance, which can provide data and theoretical support for the image restoration and super-resolution method of the RSA system.<\/jats:p>","DOI":"10.3390\/rs15030688","type":"journal-article","created":{"date-parts":[[2023,1,25]],"date-time":"2023-01-25T04:22:16Z","timestamp":1674620536000},"page":"688","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Imaging Simulation Method for Novel Rotating Synthetic Aperture System Based on Conditional Convolutional Neural Network"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2306-7200","authenticated-orcid":false,"given":"Yu","family":"Sun","sequence":"first","affiliation":[{"name":"Research Center for Space Optical Engineering, Harbin Institute of Technology, Harbin 150001, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5504-8480","authenticated-orcid":false,"given":"Xiyang","family":"Zhi","sequence":"additional","affiliation":[{"name":"Research Center for Space Optical Engineering, Harbin Institute of Technology, Harbin 150001, China"}]},{"given":"Shikai","family":"Jiang","sequence":"additional","affiliation":[{"name":"Research Center for Space Optical Engineering, Harbin Institute of Technology, Harbin 150001, China"}]},{"given":"Jinnan","family":"Gong","sequence":"additional","affiliation":[{"name":"Research Center for Space Optical Engineering, Harbin Institute of Technology, Harbin 150001, China"}]},{"given":"Tianjun","family":"Shi","sequence":"additional","affiliation":[{"name":"Research Center for Space Optical Engineering, Harbin Institute of Technology, Harbin 150001, China"}]},{"given":"Nan","family":"Wang","sequence":"additional","affiliation":[{"name":"Foreign Studies College of Northeastern University, Shenyang 110001, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/j.isprsjprs.2014.03.009","article-title":"Who launched what, when and why; trends in global land-cover observation capacity from civilian earth observation satellites","volume":"103","author":"Belward","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"9643","DOI":"10.1109\/TGRS.2019.2928327","article-title":"Normalized projection models for geostationary remote sensing satellite: A comprehensive comparative analysis (January 2019)","volume":"57","author":"Tong","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Yang, X., Li, F., Xin, L., Lu, X., Lu, M., and Zhang, N. (2020). An improved mapping with super-resolved multispectral images for geostationary satellites. Remote Sens., 12.","DOI":"10.3390\/rs12030466"},{"key":"ref_4","first-page":"P54B\u20131756","article-title":"Satellite Observations of Coastal Processes from a Geostationary Orbit: Application to estuarine, coastal, and ocean resource management","volume":"2016","author":"Tzortziou","year":"2016","journal-title":"Am. Geophys. Union"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Guo, J., Zhao, J., Zhu, L., and Gong, D. (2018, January 5\u20138). Status and trends of the large aperture space optical remote sensor. Proceedings of the 2018 IEEE International Conference on Mechatronics and Automation (ICMA), Changchun, China.","DOI":"10.1109\/ICMA.2018.8484563"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"106500","DOI":"10.1016\/j.optlaseng.2020.106500","article-title":"Imaging mechanism and degradation characteristic analysis of novel rotating synthetic aperture system","volume":"139","author":"Zhi","year":"2021","journal-title":"Opt. Lasers Eng."},{"key":"ref_7","first-page":"1","article-title":"Global Information Transmission Model-Based Multiobjective Image Inversion Restoration Method for Space Diffractive Membrane Imaging Systems","volume":"60","author":"Jiang","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"9096","DOI":"10.1364\/AO.57.009096","article-title":"Influence of ambient temperature on the modulation transfer function of an infrared membrane diffraction optical system","volume":"57","author":"Wang","year":"2018","journal-title":"Appl. Opt."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"104884","DOI":"10.1016\/j.rinp.2021.104884","article-title":"Imaging characteristics and image restoration method for large field circular scanning system","volume":"31","author":"Zhi","year":"2021","journal-title":"Results Phys."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1712","DOI":"10.1364\/OL.417765","article-title":"Optical incoherent synthetic aperture imaging by superposition of phase-shifted optical transfer functions","volume":"46","author":"Rai","year":"2021","journal-title":"Opt. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"103991","DOI":"10.1016\/j.rinp.2021.103991","article-title":"Multi-frame image restoration method for novel rotating synthetic aperture imaging system","volume":"23","author":"Zhi","year":"2021","journal-title":"Results Phys."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"106463","DOI":"10.1016\/j.optlaseng.2020.106463","article-title":"RestoreNet: A deep learning framework for image restoration in optical synthetic aperture imaging system","volume":"139","author":"Tang","year":"2021","journal-title":"Opt. Lasers Eng."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"4129","DOI":"10.1109\/TIP.2021.3069317","article-title":"Deep shearlet residual learning network for single image super-resolution","volume":"30","author":"Geng","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Courtrai, L., Pham, M.-T., and Lef\u00e8vre, S. (2020). Small Object Detection in Remote Sensing Images Based on Super-Resolution with Auxiliary Generative Adversarial Networks. Remote Sens., 12.","DOI":"10.3390\/rs12193152"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhang, K., Gool, L.V., and Timofte, R. (2020, January 13\u201319). Deep unfolding network for image super-resolution. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00328"},{"key":"ref_16","unstructured":"Zhang, K., Zuo, W., and Zhang, L. (June, January 18). Learning a single convolutional super-resolution network for multiple degradations. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wang, X., Xie, L., Dong, C., and Shan, Y. (2021, January 11\u201317). Real-esrgan: Training real-world blind super-resolution with pure synthetic data. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, Canada.","DOI":"10.1109\/ICCVW54120.2021.00217"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Liang, J., Cao, J., Sun, G., Zhang, K., Van Gool, L., and Timofte, R. (2021, January 11\u201317). Swinir: Image restoration using swin transformer. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, Canada.","DOI":"10.1109\/ICCVW54120.2021.00210"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Xu, Y., Luo, W., Hu, A., Xie, Z., Xie, X., and Tao, L. (2022). TE-SAGAN: An Improved Generative Adversarial Network for Remote Sensing Super-Resolution Images. Remote Sens., 14.","DOI":"10.3390\/rs14102425"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Liu, A., Liu, Y., Gu, J., Qiao, Y., and Dong, C. (2021). Blind image super-resolution: A survey and beyond. arXiv.","DOI":"10.1109\/TPAMI.2022.3203009"},{"key":"ref_21","unstructured":"Yang, J., Wright, J., Huang, T., and Ma, Y. (2008, January 23\u201328). Image super-resolution as sparse representation of raw image patches. Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA."},{"key":"ref_22","unstructured":"Zeyde, R., Elad, M., and Protter, M. (2010, January 24\u201330). On single image scale-up using sparse-representations. Proceedings of the International Conference on Curves and Surfaces, Avignon, France."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2889","DOI":"10.1109\/TIP.2010.2049927","article-title":"Super-resolution with sparse mixing estimators","volume":"19","author":"Mallat","year":"2010","journal-title":"IEEE Trans. Image Process."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1109\/38.988747","article-title":"Example-based super-resolution","volume":"22","author":"Freeman","year":"2002","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Michaeli, T., and Irani, M. (2013, January 1\u20138). Nonparametric blind super-resolution. Proceedings of the IEEE International Conference on Computer Vision, Sydney, Australia.","DOI":"10.1109\/ICCV.2013.121"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zontak, M., and Irani, M. (2011, January 20\u201325). Internal statistics of a single natural image. Proceedings of the CVPR 2011, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995401"},{"key":"ref_27","unstructured":"Yang, B., Bender, G., Le, Q.V., and Ngiam, J. (2019, January 8\u201314). Condconv: Conditionally parameterized convolutions for efficient inference. Proceedings of the 33rd International Conference on Neural Information Processing Systems, Vancouver, Canada."},{"key":"ref_28","unstructured":"Mirza, M., and Osindero, S. (2014). Conditional generative adversarial nets. arXiv."},{"key":"ref_29","unstructured":"Bell-Kligler, S., Shocher, A., and Irani, M. (2019, January 8\u201314). Blind super-resolution kernel estimation using an internal-gan. Proceedings of the 33rd International Conference on Neural Information Processing Systems, Vancouver, Canada."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/3\/688\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:14:35Z","timestamp":1760120075000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/3\/688"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,24]]},"references-count":31,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["rs15030688"],"URL":"https:\/\/doi.org\/10.3390\/rs15030688","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2023,1,24]]}}}