{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,28]],"date-time":"2025-11-28T12:32:41Z","timestamp":1764333161674,"version":"build-2065373602"},"reference-count":53,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2022,7,29]],"date-time":"2022-07-29T00:00:00Z","timestamp":1659052800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Guangxi National Science Foundation","award":["2018GXNSFAA294056","2022KY0703"],"award-info":[{"award-number":["2018GXNSFAA294056","2022KY0703"]}]},{"name":"Guangxi Young and Middle-Aged Teachers\u2019 Basic Research Ability Improvement Project","award":["2018GXNSFAA294056","2022KY0703"],"award-info":[{"award-number":["2018GXNSFAA294056","2022KY0703"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Imaging through a wavy water\u2013air interface is challenging since light rays are bent by unknown amounts, leading to complex geometric distortions. Considering the restoration of instantaneous distorted images, this paper proposes an image recovery model via structured light projection. The algorithm is composed of two separate parts. In the first part, an algorithm for the determination of the instantaneous shape of the water surface via structured light projection is developed. Then, we synchronously recover the distorted airborne scene image through reverse ray tracing in the second part. The experimental results show that, compared with the state-of-the-art methods, the proposed method not only can overcome the influence of changes in natural illumination conditions for WAI reconstruction, but also can significantly reduce the distortion and achieve better performance.<\/jats:p>","DOI":"10.3390\/fi14080236","type":"journal-article","created":{"date-parts":[[2022,7,31]],"date-time":"2022-07-31T23:37:29Z","timestamp":1659310649000},"page":"236","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Seeing through Wavy Water\u2013Air Interface: A Restoration Model for Instantaneous Images Distorted by Surface Waves"],"prefix":"10.3390","volume":"14","author":[{"given":"Bijian","family":"Jian","sequence":"first","affiliation":[{"name":"School of Information and Communication, Guilin University of Electronic Technology, Guilin 541000, China"},{"name":"School of Artificial Intelligence, Hezhou University, Hezhou 542800, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chunbo","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Information and Communication, Guilin University of Electronic Technology, Guilin 541000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dejian","family":"Zhu","sequence":"additional","affiliation":[{"name":"School of Information and Communication, Guilin University of Electronic Technology, Guilin 541000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yixiao","family":"Sun","sequence":"additional","affiliation":[{"name":"School of Information and Communication, Guilin University of Electronic Technology, Guilin 541000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Ao","sequence":"additional","affiliation":[{"name":"School of Information and Communication, Guilin University of Electronic Technology, Guilin 541000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1109\/TPAMI.2012.192","article-title":"Detecting motion through dynamic refraction","volume":"35","author":"Alterman","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"26009","DOI":"10.1364\/OE.26.026009","article-title":"Synthetic imaging through wavy water surface with centroid evolution","volume":"26","author":"Zhang","year":"2018","journal-title":"Opt. Express"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Molkov, A.A., and Dolin, L.S. (2019). The Snell\u2019s window image for remote sensing of the upper sea layer: Results of practical application. J. Mar. Sci. Eng., 7.","DOI":"10.3390\/jmse7030070"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1007\/s00138-021-01188-4","article-title":"Water\u2013air imaging: Distorted image reconstruction based on a twice registration algorithm","volume":"32","author":"Cai","year":"2021","journal-title":"Mach. Vis. Appl."},{"key":"ref_5","unstructured":"Tian, Y., and Narasimhan, S.G. (October, January 27). Seeing through water: Image restoration using model-based tracking. Proceedings of the IEEE 12th International Conference on Computer Vision, Kyoto, Japan."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1007\/s11263-011-0509-0","article-title":"Globally optimal estimation of nonrigid image distortion","volume":"98","author":"Tian","year":"2012","journal-title":"Int. J. Comput. Vis."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Halder, K.K., Tahtali, M., and Anavatti, S.G. (2014, January 15\u201317). An Artificial Neural Network Approach for Underwater Warp Prediction. Proceedings of the 8th Hellenic Conference on Artificial Intelligence, Ioannina, Greece.","DOI":"10.1007\/978-3-319-07064-3_31"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1046","DOI":"10.1109\/TIP.2015.2395814","article-title":"Deskewing of Underwater Images","volume":"24","author":"Seemakurthy","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Li, Z., Murez, Z., Kriegman, D., Ramamoorthi, R., and Chandraker, M. (2018, January 12\u201315). Learning to see through turbulent water In Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV) (2018). Lake Tahoe, NV, USA.","DOI":"10.1109\/WACV.2018.00062"},{"key":"ref_10","unstructured":"James, J.G., Agrawal, P., and Rajwade, A. (November, January 27). Restoration of Non-rigidly Distorted Underwater Images using a Combination of Compressive Sensing and Local Polynomial Image Representations. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Korea."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"James, J.G., and Rajwade, A. (2020, January 1\u20135). Fourier Based Pre-Processing for Seeing through Water. Proceedings of the IEEE Winter Conference on Applications of Computer Vision, Snowmass, CO, USA.","DOI":"10.1109\/WACV45572.2020.9093496"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Thapa, S., Li, N., and Ye, J. (2021, January 11\u201317). Learning to Remove Refractive Distortions from Underwater Images. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00496"},{"key":"ref_13","first-page":"401","article-title":"Slopes of the sea surface deduced from photographs of sun glitter","volume":"6","author":"Cox","year":"1956","journal-title":"Bull. Scripps Inst. Oceanogr."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zapevalov, A., Pokazeev, K., and Chaplina, T. (2021). Simulation of the Sea Surface for Remote Sensing, Springer.","DOI":"10.1007\/978-3-030-58752-9"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1080\/17455030600557202","article-title":"Reconstruction of through-surface underwater imagery","volume":"16","author":"Milder","year":"2006","journal-title":"Waves Random Complex Media"},{"key":"ref_16","unstructured":"Schultz, H., and Corrada-Emmanuel, A. (2009). System and Method for Imaging through an Irregular Water Surface. (7,630,077), U.S. Patent."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"6650","DOI":"10.1364\/AO.47.006650","article-title":"Correction of an image distorted by a wavy water surface: Laboratory experiment","volume":"47","author":"Levin","year":"2008","journal-title":"Appl. Opt."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1007\/s11141-005-0046-1","article-title":"Observation of underwater objects through glitter parts of the sea surface","volume":"48","author":"Weber","year":"2005","journal-title":"Radiophys. Quantum Electron."},{"key":"ref_19","first-page":"756","article-title":"Algorithm of reconstructing underwater object images distorted by surface waving","volume":"40","author":"Dolin","year":"2004","journal-title":"Izv. Atmos. Ocean. Phys."},{"key":"ref_20","first-page":"247","article-title":"Correction of images of submerged objects on the basis of incomplete information about surface roughness","volume":"41","author":"Luchinin","year":"2005","journal-title":"Izv. Atmos. Ocean. Phys."},{"key":"ref_21","unstructured":"Dolin, L., Gilbert, G., Levin, I., and Luchini, A. (2006). Theory Imaging Through Wavy Sea Surf, IAP RAS."},{"key":"ref_22","first-page":"181","article-title":"Correcting images of underwater objects distorted by sea surface roughness","volume":"Volume 66150","author":"Dolin","year":"2007","journal-title":"Current Research on Remote Sensing, Laser Probing, and Imagery in Natural Waters"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Alterman, M., Swirski, Y., and Schechner, Y.Y. (2014, January 2\u20134). STELLA MARIS: Stellar marine refractive imaging sensor. Proceedings of the 2014 IEEE International Conference on Computational Photography (ICCP), Santa Clara, CA, USA.","DOI":"10.1109\/ICCPHOT.2014.6831816"},{"key":"ref_24","unstructured":"Javidi, B., and Son, J.-Y. (2016). 3D in Natural Random Refractive Distortions, International Society for Optics and Photonics."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1080\/09500340.2021.1874555","article-title":"Recovering the instantaneous images of underwater objects distorted by surface waves","volume":"68","author":"Gardashov","year":"2021","journal-title":"J. Mod. Opt."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Suiter, H., Flacco, N., Carter, P., Tong, K., Ries, R., and Gershenson, M. (October, January 29). Optics near the snell angle in a water-to-air change of medium. Proceedings of the OCEANS 2007, Vancouver, BC, Canada.","DOI":"10.1109\/OCEANS.2007.4449337"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"B8","DOI":"10.1364\/AO.54.0000B8","article-title":"Snell\u2019s window in wavy water","volume":"54","author":"Lynch","year":"2015","journal-title":"Appl. Opt."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Gabriel, C., Khalighi, M.-A., Bourennane, S., Leon, P., and Rigaud, V. (2011, January 5\u20139). Channel modeling for underwater optical communication. Proceedings of the 2011 IEEE GLOBECOM Workshops (GC Wkshps), Houston, TX, USA.","DOI":"10.1109\/GLOCOMW.2011.6162571"},{"key":"ref_29","unstructured":"Martin, M., Esemann, T., and Hellbr\u00fcck, H. (2015, January 22\u201324). Simulation and evaluation of an optical channel model for underwater communication. Proceedings of the 10th International Conference on Underwater Networks & Systems, Arlington, VA, USA."},{"key":"ref_30","first-page":"437","article-title":"Characteristics of optical channel for underwater optical wireless communication based on visible light","volume":"9","year":"2015","journal-title":"Aust. J. Basic Appl. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"217","DOI":"10.4319\/lo.2007.52.1.0217","article-title":"Optical properties of the \u201cclearest\u201d natural waters","volume":"52","author":"Morel","year":"2007","journal-title":"Limnol. Oceanogr."},{"key":"ref_32","unstructured":"Born, M., and Wolf, E. (2013). Principles of Optics: Electromagnetic Theory of Propagation, Interference and Diffraction of Light, Elsevier."},{"key":"ref_33","unstructured":"Sonka, M., Hlavac, V., and Boyle, R. (2014). Image Processing, Analysis, and Machine Vision, Cengage Learning."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_35","unstructured":"Ma, C., Sun, Y., Ao, J., Jian, B., and Qin, F. (2021). A Centroid-Based Corner Detection Method for Structured Light. (CN113409334A)."},{"key":"ref_36","unstructured":"Richard, L., Burden, J., Faires, D., and Annette, M.B. (2015). Numerical Analysis, Cengage Learning."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1090\/qam\/10666","article-title":"A method for the solution of certain non-linear problems in least squares","volume":"2","author":"Levenberg","year":"1944","journal-title":"Q. Appl. Math."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"26161","DOI":"10.1364\/OE.19.026161","article-title":"Bilinear and bicubic interpolation methods for division of focal plane polarimeters","volume":"19","author":"Gao","year":"2011","journal-title":"Opt. Express"},{"key":"ref_39","unstructured":"Jian, B. (2022, July 07). A Restoration Model for the Instantaneous Images Distorted by Surface Waves, version 2022. Available online: https:\/\/doi.org\/10.6084\/m9.figshare.20264520.v2."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1016\/0011-7471(64)90001-4","article-title":"Radiation stresses in water waves; a physical discussion, with applications","volume":"11","author":"Stewart","year":"1964","journal-title":"Deep.-Sea Res. Oceanogr. Abstr."},{"key":"ref_41","unstructured":"Neumann, G. (1953). On Ocean Wave Spectra and a New Method of Forecasting Wind-Generated Sea, Coastal Engineering Research Center."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"750","DOI":"10.1175\/1520-0485(1975)005<0750:OOTDSO>2.0.CO;2","article-title":"Observations of the directional spectrum of ocean WavesUsing a cloverleaf buoy","volume":"5","author":"Mitsuyasu","year":"1975","journal-title":"J. Phys. Oceanogr."},{"key":"ref_43","first-page":"1","article-title":"Measurements of wind-wave growth and swell decay during the Joint North Sea Wave Project (JONSWAP)","volume":"12","author":"Hasselmann","year":"1973","journal-title":"Ergaenzungsheft Zur Dtsch. Hydrogr. Z. Reihe A"},{"key":"ref_44","unstructured":"Poser, S.W. (2003). Applying Elliot Wave Theory Profitably, John Wiley & Sons."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"5181","DOI":"10.1029\/JZ069i024p05181","article-title":"A proposed spectral form for fully developed wind seas based on the similarity theory of SA Kitaigorodskii","volume":"69","author":"Willard","year":"1964","journal-title":"J. Geophys. Res."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"800","DOI":"10.1049\/el:20080522","article-title":"Scope of validity of PSNR in image\/video quality assessment","volume":"44","author":"Quan","year":"2008","journal-title":"Electron. Lett."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Hore, A., and Ziou, D. (2010, January 23\u201326). Image quality metrics: PSNR vs. SSIM. In Proceedings of International Conference on Pattern Recognition (ICPR), Istanbul, Turkey.","DOI":"10.1109\/ICPR.2010.579"},{"key":"ref_48","unstructured":"Efros, A., Isler, V., Shi, J., and Visontai, M. (2005). Seeing through Water. Advances in Neural Information Processing Systems, MIT Press."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"6376","DOI":"10.1364\/AO.49.006376","article-title":"Bispectral analysis and recovery of images distorted by a moving water surface","volume":"49","author":"Wen","year":"2010","journal-title":"Appl. Opt."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Kanaev, A.V., Hou, W., and Woods, S. (2011). Multi-frame underwater image restoration. Electro-Optical and Infrared Systems: Technology and Applications VIII, International Society for Optics and Photonics.","DOI":"10.1117\/12.898914"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Kanaev, A.V., Hou, W., Restaino, S.R., Matt, S., and G\u0142adysz, S. (2014). Correction methods for underwater turbulence degraded imaging. SPIE Remote Sensing, International Society for Optics and Photonics.","DOI":"10.1117\/12.2066479"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/TPAMI.1987.4767869","article-title":"Color-Encoded Structured Light for Rapid Active Ranging","volume":"PAMI-9","author":"Boyer","year":"1987","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1007\/BF01420984","article-title":"Performance of optical flow techniques","volume":"12","author":"Barron","year":"1994","journal-title":"Int. J. Comput. Vis."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/14\/8\/236\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:59:34Z","timestamp":1760140774000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/14\/8\/236"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,29]]},"references-count":53,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["fi14080236"],"URL":"https:\/\/doi.org\/10.3390\/fi14080236","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2022,7,29]]}}}