{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T15:07:28Z","timestamp":1775228848855,"version":"3.50.1"},"reference-count":39,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2023,10,30]],"date-time":"2023-10-30T00:00:00Z","timestamp":1698624000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Atmospheric turbulence (AT) can change the path and direction of light during video capturing of a target in space due to the random motion of the turbulent medium, a phenomenon that is most noticeable when shooting videos at long ranges, resulting in severe video dynamic distortion and blur. To mitigate geometric distortion and reduce spatially and temporally varying blur, we propose a novel Atmospheric Turbulence Video Restoration Generative Adversarial Network (ATVR-GAN) with a specialized Recurrent Neural Network (RNN) generator, which is trained to predict the scene\u2019s turbulent optical flow (OF) field and utilizes a recurrent structure to catch both spatial and temporal dependencies. The new architecture is trained using a newly combined loss function that counts for the spatiotemporal distortions, specifically tailored to the AT problem. Our network was tested on synthetic and real imaging data and compared against leading algorithms in the field of AT mitigation and image restoration. The proposed method outperformed these methods for both synthetic and real data examined.<\/jats:p>","DOI":"10.3390\/s23218815","type":"journal-article","created":{"date-parts":[[2023,10,30]],"date-time":"2023-10-30T13:26:55Z","timestamp":1698672415000},"page":"8815","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Atmospheric Turbulence Degraded Video Restoration with Recurrent GAN (ATVR-GAN)"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-4774-6980","authenticated-orcid":false,"given":"Bar","family":"Ettedgui","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, Tel Aviv University, Tel Aviv 69978, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4974-9683","authenticated-orcid":false,"given":"Yitzhak","family":"Yitzhaky","sequence":"additional","affiliation":[{"name":"Department of Electro Optics Engineering, School of Electrical and Computer Engineering, Ben Gurion University of the Negev, Be\u2019er Sheva 8410501, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"101710","DOI":"10.1117\/1.OE.51.10.101710","article-title":"Classification of Moving Objects in Atmospherically Degraded Video","volume":"51","author":"Chen","year":"2012","journal-title":"Opt. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"8562","DOI":"10.1364\/AO.46.008562","article-title":"Effects of Image Restoration on Automatic Acquisition of Moving Objects in Thermal Video Sequences Degraded by the Atmosphere","volume":"46","author":"Haik","year":"2007","journal-title":"Appl. Opt."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1181","DOI":"10.1364\/AO.53.001181","article-title":"Detecting and Tracking Moving Objects in Long-Distance Imaging through Turbulent Medium","volume":"53","author":"Chen","year":"2014","journal-title":"Appl. Opt."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2094","DOI":"10.1016\/j.patrec.2007.06.006","article-title":"Blind restoration of atmospherically degraded images by automatic best step edge detection","volume":"28","author":"Shacham","year":"2007","journal-title":"Pattern Recognit. Lett."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3422","DOI":"10.1049\/iet-ipr.2019.1442","article-title":"Blind Atmospheric Turbulence Deconvolution","volume":"14","author":"Deledalle","year":"2020","journal-title":"IET Image Process."},{"key":"ref_6","unstructured":"Bai, X., Liu, M., He, C., Dong, L., Zhao, Y., and Liu, X. (2019). Applications of Machine Learning, SPIE."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"106131","DOI":"10.1016\/j.asoc.2020.106131","article-title":"Blind De-Convolution of Images Degraded by Atmospheric Turbulence","volume":"89","author":"Chen","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Lau, C.P., Souri, H., and Chellappa, R. (2020, January 16\u201320). ATFaceGAN: Single Face Image Restoration and Recognition from Atmospheric Turbulence. Proceedings of the 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), Buenos Aires, Argentina.","DOI":"10.1109\/FG47880.2020.00012"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Yasarla, R., and Patel, V.M. (2021, January 19\u201322). Learning to Restore Images Degraded by Atmospheric Turbulence Using Uncertainty. Proceedings of the 2021 IEEE International Conference on Image Processing (ICIP), Anchorage, AK, USA.","DOI":"10.1109\/ICIP42928.2021.9506614"},{"key":"ref_10","unstructured":"Zhu, X., and Milanfar, P. (2010). Visual Information Processing and Communication, SPIE."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1109\/TPAMI.2012.82","article-title":"Removing Atmospheric Turbulence via Space-Invariant Deconvolution","volume":"35","author":"Zhu","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2398","DOI":"10.1109\/TIP.2013.2249078","article-title":"Atmospheric Turbulence Mitigation Using Complex Wavelet-Based Fusion","volume":"22","author":"Anantrasirichai","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"074002","DOI":"10.1088\/1361-6420\/ab0e4b","article-title":"Restoration of Atmospheric Turbulence-Distorted Images via RPCA and Quasiconformal Maps","volume":"35","author":"Lau","year":"2019","journal-title":"Inverse Probl."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1488","DOI":"10.1007\/s10915-018-0833-4","article-title":"Variational Models for Joint Subsampling and Reconstruction of Turbulence-Degraded Images","volume":"78","author":"Lau","year":"2019","journal-title":"J. Sci. Comput."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1415","DOI":"10.1109\/TCI.2020.3029401","article-title":"Image Reconstruction of Static and Dynamic Scenes Through Anisoplanatic Turbulence","volume":"6","author":"Mao","year":"2020","journal-title":"IEEE Trans. Comput. Imaging"},{"key":"ref_16","unstructured":"Frakes, D., Monaco, J.W., and Smith, M.J.T. (2001, January 7\u201311). Suppression of Atmospheric Turbulence in Video Using an Adaptive Control Grid Interpolation Approach. Proceedings of the 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing, Salt Lake City, UT, USA."},{"key":"ref_17","unstructured":"Gepshtein, S., Shtainman, A., Fishbain, B., and Yaroslavsky, L.P. (2004, January 6\u201310). Restoration of Atmospheric Turbulent Video Containing Real Motion Using Rank Filtering and Elastic Image Registration. Proceedings of the 12th European Signal Processing Conference, EUSIPCO 2004, New York, NY, USA."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"839","DOI":"10.3934\/ipi.2013.7.839","article-title":"Video Stabilization of Atmospheric Turbulence Distortion","volume":"7","author":"Lou","year":"2013","journal-title":"Inverse Probl. Imaging"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.patrec.2023.05.017","article-title":"Atmospheric Turbulence Removal with Complex-Valued Convolutional Neural Network","volume":"171","author":"Anantrasirichai","year":"2023","journal-title":"Pattern Recognit. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Bansal, A., Ma, S., Ramanan, D., and Sheikh, Y. (2018, January 8\u201314). Recycle-GAN: Unsupervised Video Retargeting. Proceedings of the 15th European Conference, Munich, Germany. Proceedings, Part V.","DOI":"10.1007\/978-3-030-01228-1_8"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1007\/s41095-020-0175-7","article-title":"ISeeBetter: Spatio-Temporal Video Super-Resolution Using Recurrent Generative Back-Projection Networks","volume":"6","author":"Chadha","year":"2020","journal-title":"Comput. Vis. Media"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.-Y., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-Image Translation with Conditional Adversarial Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ilg, E., Mayer, N., Saikia, T., Keuper, M., Dosovitskiy, A., and Brox, T. (2016, January 27\u201330). FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2017.179"},{"key":"ref_24","unstructured":"Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W., and WOO, W. (2015). Proceedings of the Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_25","unstructured":"Gilles, J., and Osher, S. (2012). Infrared Imaging Systems: Design, Analysis, Modeling, and Testing XXIII, SPIE."},{"key":"ref_26","first-page":"711","article-title":"Perceptual Losses for Real-Time Style Transfer and Super-Resolution","volume":"Volume 9906","author":"Johnson","year":"2016","journal-title":"Computer Vision\u2014ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, 11\u201314 October 2016, Proceedings, Part II 14"},{"key":"ref_27","unstructured":"Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Proceedings of the Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_28","first-page":"241","article-title":"U-Net: Convolutional Networks for Biomedical Image Segmentation","volume":"Volume 9351","author":"Ronneberger","year":"2015","journal-title":"Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2015: 18th International Conference, Munich, Germany, 5\u20139 October 2015, Proceedings, Part III 18"},{"key":"ref_29","unstructured":"Arjovsky, M., Chintala, S., and Bottou, L. (2017, January 6\u201311). Wasserstein Generative Adversarial Networks. Proceedings of the 34th International Conference on Machine Learning, PMLR, Sydney, Australia."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kupyn, O., Budzan, V., Mykhailych, M., Mishkin, D., and Matas, J. (2018, January 18\u201323). DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00854"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/0167-2789(92)90242-F","article-title":"Nonlinear Total Variation Based Noise Removal Algorithms","volume":"60","author":"Rudin","year":"1992","journal-title":"Phys. D Nonlinear Phenom."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"083101","DOI":"10.1117\/1.OE.59.8.083101","article-title":"Simulating Anisoplanatic Turbulence by Sampling Inter-Modal and Spatially Correlated Zernike Coefficients","volume":"59","author":"Chimitt","year":"2020","journal-title":"Opt. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Chen, Y., Pan, Y., Yao, T., Tian, X., and Mei, T. (2019). Mocycle-GAN: Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks Video-to-Video Translation, IEEE.","DOI":"10.1145\/3343031.3350937"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Jiang, S., Campbell, D., Lu, Y., Li, H., and Hartley, R. (2021, January 11\u201317). Learning to Estimate Hidden Motions with Global Motion Aggregation. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00963"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Liu, S., and Deng, W. (2015, January 3\u20136). Very Deep Convolutional Neural Network Based Image Classification Using Small Training Sample Size. Proceedings of the 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), Kuala Lumpur, Malaysia.","DOI":"10.1109\/ACPR.2015.7486599"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zamir, S.W., Arora, A., Khan, S., Hayat, M., Khan, F.S., Yang, M.-H., and Shao, L. (2021, January 20\u201325). Multi-Stage Progressive Image Restoration. Proceedings of the 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01458"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Anantrasirichai, N., Achim, A., and Bull, D. (2018). Atmospheric Turbulence Mitigation for Sequences with Moving Objects Using Recursive Image Fusion, IEEE.","DOI":"10.1109\/ICIP.2018.8451755"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Wang, Y., Jodoin, P.-M., Porikli, F., Konrad, J., Benezeth, Y., and Ishwar, P. (2014, January 23\u201328). CDnet 2014: An Expanded Change Detection Benchmark Dataset. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Columbus, OH, USA.","DOI":"10.1109\/CVPRW.2014.126"},{"key":"ref_39","unstructured":"Kingma, D., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/21\/8815\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:14:08Z","timestamp":1760130848000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/21\/8815"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,30]]},"references-count":39,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2023,11]]}},"alternative-id":["s23218815"],"URL":"https:\/\/doi.org\/10.3390\/s23218815","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,30]]}}}