{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,26]],"date-time":"2026-03-26T19:55:59Z","timestamp":1774554959278,"version":"3.50.1"},"reference-count":42,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2024,11,5]],"date-time":"2024-11-05T00:00:00Z","timestamp":1730764800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China (NSFC) and Research Grants Council (RGC) of Hong Kong Joint Research Scheme","award":["62261160387"],"award-info":[{"award-number":["62261160387"]}]},{"name":"National Natural Science Foundation of China (NSFC) and Research Grants Council (RGC) of Hong Kong Joint Research Scheme","award":["42227901"],"award-info":[{"award-number":["42227901"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62261160387"],"award-info":[{"award-number":["62261160387"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["42227901"],"award-info":[{"award-number":["42227901"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Sea surface temperature (SST) prediction has received increasing attention in recent years due to its paramount importance in the various fields of oceanography. Existing studies have shown that neural networks are particularly effective in making accurate SST predictions by efficiently capturing spatiotemporal dependencies in SST data. Among various models, the ConvLSTM framework is notably prominent. This model skillfully combines convolutional neural networks (CNNs) with recurrent neural networks (RNNs), enabling it to simultaneously capture spatiotemporal dependencies within a single computational framework. To overcome the limitation that CNNs primarily capture local spatial information, in this paper we propose a novel model named DatLSTM that integrates a deformable attention transformer (DAT) module into the ConvLSTM framework, thereby enhancing its ability to process more complex spatial relationships effectively. Specifically, the DAT module adaptively focuses on salient features in space, while ConvLSTM further captures the temporal dependencies of spatial correlations in the SST data. In this way, DatLSTM can adaptively capture complex spatiotemporal dependencies between the preceding and current states within ConvLSTM. To evaluate the performance of the DatLSTM model, we conducted short-term SST forecasts in the Bohai Sea region with forecast lead times ranging from 1 to 10 days and compared its efficacy against several benchmark models, including ConvLSTM, PredRNN, TCTN, and SwinLSTM. Our experimental results show that the proposed model outperforms all of these models in terms of multiple evaluation metrics short-term SST prediction. The proposed model offers a new predictive learning method for improving the accuracy of spatiotemporal predictions in various domains, including meteorology, oceanography, and climate science.<\/jats:p>","DOI":"10.3390\/rs16224126","type":"journal-article","created":{"date-parts":[[2024,11,5]],"date-time":"2024-11-05T08:25:14Z","timestamp":1730795114000},"page":"4126","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Sea Surface Temperature Prediction Using ConvLSTM-Based Model with Deformable Attention"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2734-3794","authenticated-orcid":false,"given":"Benyun","family":"Shi","sequence":"first","affiliation":[{"name":"College of Computer and Information Engineering, Nanjing Tech University, Nanjing 211816, China"},{"name":"College of Artificial Intelligence, Nanjing Tech University, Nanjing 211816, China"}]},{"given":"Conghui","family":"Ge","sequence":"additional","affiliation":[{"name":"College of Computer and Information Engineering, Nanjing Tech University, Nanjing 211816, China"},{"name":"College of Artificial Intelligence, Nanjing Tech University, Nanjing 211816, China"}]},{"given":"Hongwang","family":"Lin","sequence":"additional","affiliation":[{"name":"College of Computer and Information Engineering, Nanjing Tech University, Nanjing 211816, China"},{"name":"College of Artificial Intelligence, Nanjing Tech University, Nanjing 211816, China"}]},{"given":"Yanpeng","family":"Xu","sequence":"additional","affiliation":[{"name":"College of Computer and Information Engineering, Nanjing Tech University, Nanjing 211816, China"},{"name":"College of Artificial Intelligence, Nanjing Tech University, Nanjing 211816, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0831-7999","authenticated-orcid":false,"given":"Qi","family":"Tan","sequence":"additional","affiliation":[{"name":"College of Computer and Information Engineering, Nanjing Tech University, Nanjing 211816, China"},{"name":"College of Artificial Intelligence, Nanjing Tech University, Nanjing 211816, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-7857-2221","authenticated-orcid":false,"given":"Yue","family":"Peng","sequence":"additional","affiliation":[{"name":"College of Computer and Information Engineering, Nanjing Tech University, Nanjing 211816, China"},{"name":"College of Artificial Intelligence, Nanjing Tech University, Nanjing 211816, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0690-6252","authenticated-orcid":false,"given":"Hailun","family":"He","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Satellite Ocean Environment Dynamics, Second Institute of Oceanography, Ministry of Natural Resources, Hangzhou 310012, China"},{"name":"Southern Marine Science and Engineering Guangdong Laboratory, Zhuhai 519082, China"}]}],"member":"1968","published-online":{"date-parts":[[2024,11,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1146\/annurev-marine-120408-151453","article-title":"Sea surface temperature variability: Patterns and mechanisms","volume":"2","author":"Deser","year":"2010","journal-title":"Annu. Rev. Mar. Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1558","DOI":"10.1007\/s11430-017-9054-5","article-title":"Interpreting the sea surface temperature warming trend in the Yellow Sea and East China Sea","volume":"60","author":"Pei","year":"2017","journal-title":"Sci. China Earth Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/S0034-4257(02)00103-7","article-title":"Remote sensing of Southern Ocean sea surface temperature: Implications for marine biophysical models","volume":"84","author":"Sumner","year":"2003","journal-title":"Remote Sens. Environ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3145","DOI":"10.1175\/JCLI-D-22-0623.1","article-title":"On the Role of Sea Surface Temperature in the Clustering of Global Tropical Cyclone Formation","volume":"36","author":"Kieu","year":"2023","journal-title":"J. Clim."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1126\/science.288.5467.847","article-title":"Satellite measurements of sea surface temperature through clouds","volume":"288","author":"Wentz","year":"2000","journal-title":"Science"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1357\/002224017821836770","article-title":"Coupled ocean\u2013atmosphere modeling and predictions","volume":"75","author":"Miller","year":"2017","journal-title":"J. Mar. Res."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"102158","DOI":"10.1016\/j.ocemod.2022.102158","article-title":"A deep learning approach to predict sea surface temperature based on multiple modes","volume":"181","author":"Xu","year":"2023","journal-title":"Ocean. Model."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1029\/177GM21","article-title":"Eddy-resolving global ocean prediction","volume":"177","author":"Hurlburt","year":"2008","journal-title":"Ocean. Model. Eddying Regime Geophys. Monogr."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"073008","DOI":"10.1088\/1748-9326\/ac0eb0","article-title":"Bridging observations, theory and numerical simulation of the ocean using machine learning","volume":"16","author":"Sonnewald","year":"2021","journal-title":"Environ. Res. Lett."},{"key":"ref_10","unstructured":"Xiong, W., Xiang, Y., Wu, H., Zhou, S., Sun, Y., Ma, M., and Huang, X. (2023). AI-GOMS: Large AI-Driven Global Ocean Modeling System. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"103347","DOI":"10.1016\/j.jmarsys.2020.103347","article-title":"Statistical and machine learning ensemble modelling to forecast sea surface temperature","volume":"208","author":"Wolff","year":"2020","journal-title":"J. Mar. Syst."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40645-020-00400-9","article-title":"Applications of soft computing models for predicting sea surface temperature: A comprehensive review and assessment","volume":"8","author":"Haghbin","year":"2021","journal-title":"Prog. Earth Planet. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2701","DOI":"10.1029\/1999GL011107","article-title":"Forecasts of tropical Pacific SST and sea level using a Markov model","volume":"27","author":"Xue","year":"2000","journal-title":"Geophys. Res. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"909","DOI":"10.1109\/TGRS.2008.2005993","article-title":"Automatic parameter optimization for support vector regression for land and sea surface temperature estimation from remote sensing data","volume":"47","author":"Moser","year":"2009","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1715","DOI":"10.1175\/JTECH-D-15-0213.1","article-title":"Prediction of sea surface temperature by combining numerical and neural techniques","volume":"33","author":"Patil","year":"2016","journal-title":"J. Atmos. Ocean. Technol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"111358","DOI":"10.1016\/j.rse.2019.111358","article-title":"Short and mid-term sea surface temperature prediction using time-series satellite data and LSTM-AdaBoost combination approach","volume":"233","author":"Xiao","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_17","unstructured":"Lin, Z., Li, M., Zheng, Z., Cheng, Y., and Yuan, C. (2020, January 7\u201312). Self-attention ConvLSTM for spatiotemporal prediction. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA."},{"key":"ref_18","first-page":"879","article-title":"PredRNN: Recurrent neural networks for predictive learning using spatiotemporal LSTMs","volume":"30","author":"Wang","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Wei, L., and Guan, L. (2022). Seven-day sea surface temperature prediction using a 3DConv-LSTM model. Front. Mar. Sci., 9.","DOI":"10.3389\/fmars.2022.905848"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"61","DOI":"10.5194\/npg-15-61-2008","article-title":"Artificial Neural Networks to reconstruct incomplete satellite data: Application to the Mediterranean Sea Surface Temperature","volume":"15","author":"Pisoni","year":"2008","journal-title":"Nonlinear Process. Geophys."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"L20308","DOI":"10.1029\/2004GL021192","article-title":"Estimation of ocean subsurface thermal structure from surface parameters: A neural network approach","volume":"31","author":"Ali","year":"2004","journal-title":"Geophys. Res. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1007\/s00773-009-0081-2","article-title":"A new approach for deriving temperature and salinity fields in the Indian Ocean using artificial neural networks","volume":"15","author":"Bhaskaran","year":"2010","journal-title":"J. Mar. Sci. Technol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1745","DOI":"10.1109\/LGRS.2017.2733548","article-title":"Prediction of sea surface temperature using long short-term memory","volume":"14","author":"Zhang","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Pan, X., Jiang, T., Sui, B., Liu, C., and Sun, W. (2020). Monthly and quarterly sea surface temperature prediction based on gated recurrent unit neural network. J. Mar. Sci. Eng., 8.","DOI":"10.3390\/jmse8040249"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2853","DOI":"10.1109\/JSTARS.2020.2998461","article-title":"A deep learning method with merged LSTM neural networks for SSHA prediction","volume":"13","author":"Song","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_26","first-page":"802","article-title":"Convolutional LSTM network: A machine learning approach for precipitation nowcasting","volume":"28","author":"Shi","year":"2015","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_27","unstructured":"Wang, L., Ammons, S., Hur, V.M., Sriver, R.L., and Zhao, Z. (2023). Convolutional GRU Network for Seasonal Prediction of the El Ni\u00f1o-Southern Oscillation. arXiv."},{"key":"ref_28","first-page":"5998","article-title":"Attention is all you need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_29","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16 \u00d7 16 words: Transformers for image recognition at scale. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11\u201317). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_31","unstructured":"Touvron, H., Cord, M., Douze, M., Massa, F., Sablayrolles, A., and J\u00e9gou, H. (2021, January 18\u201324). Training data-efficient image transformers & distillation through attention. Proceedings of the International Conference on Machine Learning. PMLR, Virtual Event."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., and Torr, P.H. (2021, January 20\u201325). Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00681"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"12760","DOI":"10.1109\/TPAMI.2022.3202765","article-title":"P2T: Pyramid pooling transformer for scene understanding","volume":"45","author":"Wu","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Xia, Z., Pan, X., Song, S., Li, L.E., and Huang, G. (2022, January 18\u201324). Vision transformer with deformable attention. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00475"},{"key":"ref_35","unstructured":"Yang, Z., Yang, X., and Lin, Q. (2021). TCTN: A 3D-temporal convolutional transformer network for spatiotemporal predictive learning. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Tang, S., Li, C., Zhang, P., and Tang, R. (2023, January 2\u20136). SwinLSTM: Improving spatiotemporal prediction accuracy using swin transformer and LSTM. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Paris, France.","DOI":"10.1109\/ICCV51070.2023.01239"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wanigasekara, R., Zhang, Z., Wang, W., Luo, Y., and Pan, G. (2024). Application of Fast MEEMD\u2013ConvLSTM in Sea Surface Temperature Predictions. Remote Sens., 16.","DOI":"10.3390\/rs16132468"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"107578","DOI":"10.1016\/j.atmosres.2024.107578","article-title":"Forecasting sea surface temperature during typhoon events in the Bohai Sea using spatiotemporal neural networks","volume":"309","author":"He","year":"2024","journal-title":"Atmos. Res."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1016\/j.rse.2010.10.017","article-title":"The operational sea surface temperature and sea ice analysis (OSTIA) system","volume":"116","author":"Donlon","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Cao, H., Wang, Y., Chen, J., Jiang, D., Zhang, X., Tian, Q., and Wang, M. (2022, January 23\u201327). Swin-unet: Unet-like pure transformer for medical image segmentation. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-25066-8_9"},{"key":"ref_41","unstructured":"Srivastava, N., Mansimov, E., and Salakhudinov, R. (2015, January 7\u20139). Unsupervised learning of video representations using LSTMs. Proceedings of the International Conference on Machine Learning. PMLR, Lille, France."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"4007","DOI":"10.1109\/TIP.2013.2266579","article-title":"Sparse Feature Fidelity for Perceptual Image Quality Assessment","volume":"22","author":"Chang","year":"2013","journal-title":"IEEE Trans. Image Process."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/22\/4126\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:26:43Z","timestamp":1760113603000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/22\/4126"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,5]]},"references-count":42,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2024,11]]}},"alternative-id":["rs16224126"],"URL":"https:\/\/doi.org\/10.3390\/rs16224126","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,5]]}}}