{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T22:02:18Z","timestamp":1771020138054,"version":"3.50.1"},"reference-count":44,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2022,8,27]],"date-time":"2022-08-27T00:00:00Z","timestamp":1661558400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["41574146"],"award-info":[{"award-number":["41574146"]}]},{"name":"National Natural Science Foundation of China","award":["41774162"],"award-info":[{"award-number":["41774162"]}]},{"name":"National Natural Science Foundation of China","award":["42074187"],"award-info":[{"award-number":["42074187"]}]},{"name":"National Natural Science Foundation of China","award":["41804026"],"award-info":[{"award-number":["41804026"]}]},{"name":"National Natural Science Foundation of China","award":["41931075"],"award-info":[{"award-number":["41931075"]}]},{"name":"National Natural Science Foundation of China","award":["2018YFC1503506"],"award-info":[{"award-number":["2018YFC1503506"]}]},{"name":"National Natural Science Foundation of China","award":["6142403180204"],"award-info":[{"award-number":["6142403180204"]}]},{"name":"National Natural Science Foundation of China","award":["2019CFA054"],"award-info":[{"award-number":["2019CFA054"]}]},{"name":"National Key R&amp;D Program of China","award":["41574146"],"award-info":[{"award-number":["41574146"]}]},{"name":"National Key R&amp;D Program of China","award":["41774162"],"award-info":[{"award-number":["41774162"]}]},{"name":"National Key R&amp;D Program of China","award":["42074187"],"award-info":[{"award-number":["42074187"]}]},{"name":"National Key R&amp;D Program of China","award":["41804026"],"award-info":[{"award-number":["41804026"]}]},{"name":"National Key R&amp;D Program of China","award":["41931075"],"award-info":[{"award-number":["41931075"]}]},{"name":"National Key R&amp;D Program of China","award":["2018YFC1503506"],"award-info":[{"award-number":["2018YFC1503506"]}]},{"name":"National Key R&amp;D Program of China","award":["6142403180204"],"award-info":[{"award-number":["6142403180204"]}]},{"name":"National Key R&amp;D Program of China","award":["2019CFA054"],"award-info":[{"award-number":["2019CFA054"]}]},{"name":"foundation of National Key Laboratory of Electromagnetic Environment","award":["41574146"],"award-info":[{"award-number":["41574146"]}]},{"name":"foundation of National Key Laboratory of Electromagnetic Environment","award":["41774162"],"award-info":[{"award-number":["41774162"]}]},{"name":"foundation of National Key Laboratory of Electromagnetic Environment","award":["42074187"],"award-info":[{"award-number":["42074187"]}]},{"name":"foundation of National Key Laboratory of Electromagnetic Environment","award":["41804026"],"award-info":[{"award-number":["41804026"]}]},{"name":"foundation of National Key Laboratory of Electromagnetic Environment","award":["41931075"],"award-info":[{"award-number":["41931075"]}]},{"name":"foundation of National Key Laboratory of Electromagnetic Environment","award":["2018YFC1503506"],"award-info":[{"award-number":["2018YFC1503506"]}]},{"name":"foundation of National Key Laboratory of Electromagnetic Environment","award":["6142403180204"],"award-info":[{"award-number":["6142403180204"]}]},{"name":"foundation of National Key Laboratory of Electromagnetic Environment","award":["2019CFA054"],"award-info":[{"award-number":["2019CFA054"]}]},{"name":"Excellent Youth Foundation of Hubei Provincial Natural Science Foundation","award":["41574146"],"award-info":[{"award-number":["41574146"]}]},{"name":"Excellent Youth Foundation of Hubei Provincial Natural Science Foundation","award":["41774162"],"award-info":[{"award-number":["41774162"]}]},{"name":"Excellent Youth Foundation of Hubei Provincial Natural Science Foundation","award":["42074187"],"award-info":[{"award-number":["42074187"]}]},{"name":"Excellent Youth Foundation of Hubei Provincial Natural Science Foundation","award":["41804026"],"award-info":[{"award-number":["41804026"]}]},{"name":"Excellent Youth Foundation of Hubei Provincial Natural Science Foundation","award":["41931075"],"award-info":[{"award-number":["41931075"]}]},{"name":"Excellent Youth Foundation of Hubei Provincial Natural Science Foundation","award":["2018YFC1503506"],"award-info":[{"award-number":["2018YFC1503506"]}]},{"name":"Excellent Youth Foundation of Hubei Provincial Natural Science Foundation","award":["6142403180204"],"award-info":[{"award-number":["6142403180204"]}]},{"name":"Excellent Youth Foundation of Hubei Provincial Natural Science Foundation","award":["2019CFA054"],"award-info":[{"award-number":["2019CFA054"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>In recent years, transformer has been widely used in natural language processing (NLP) and computer vision (CV). Comparatively, forecasting image time sequences using transformer has received less attention. In this paper, we propose the conv-attentional image time sequence transformer (CAiTST), a transformer-based image time sequences prediction model equipped with convolutional networks and an attentional mechanism. Specifically, we employ CAiTST to forecast the International GNSS Service (IGS) global total electron content (TEC) maps. The IGS TEC maps from 2005 to 2017 (except 2014) are divided into the training dataset (90% of total) and validation dataset (10% of total), and TEC maps in 2014 (high solar activity year) and 2018 (low solar activity year) are used to test the performance of CAiTST. The input of CAiTST is presented as one day\u2019s 12 TEC maps (time resolution is 2 h), and the output is the next day\u2019s 12 TEC maps. We compare the results of CAiTST with those of the 1-day Center for Orbit Determination in Europe (CODE) prediction model. The root mean square errors (RMSEs) from CAiTST with respect to the IGS TEC maps are 4.29 and 1.41 TECU in 2014 and 2018, respectively, while the RMSEs of the 1-day CODE prediction model are 4.71 and 1.57 TECU. The results illustrate CAiTST performs better than the 1-day CODE prediction model both in high and low solar activity years. The CAiTST model has less accuracy in the equatorial ionization anomaly (EIA) region but can roughly predict the features and locations of EIA. Additionally, due to the input only including past TEC maps, CAiTST performs poorly during magnetic storms. Our study shows that the transformer model and its unique attention mechanism are very suitable for images of a time sequence forecast, such as the prediction of ionospheric TEC map sequences.<\/jats:p>","DOI":"10.3390\/rs14174223","type":"journal-article","created":{"date-parts":[[2022,8,30]],"date-time":"2022-08-30T01:37:55Z","timestamp":1661823475000},"page":"4223","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["CAiTST: Conv-Attentional Image Time Sequence Transformer for Ionospheric TEC Maps Forecast"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2174-5904","authenticated-orcid":false,"given":"Guozhen","family":"Xia","sequence":"first","affiliation":[{"name":"Department of Space Physics, School of Electronic Information, Wuhan University, Wuhan 430072, China"}]},{"given":"Moran","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Space Physics, School of Electronic Information, Wuhan University, Wuhan 430072, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8192-8924","authenticated-orcid":false,"given":"Fubin","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Space Physics, School of Electronic Information, Wuhan University, Wuhan 430072, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2692-9451","authenticated-orcid":false,"given":"Chen","family":"Zhou","sequence":"additional","affiliation":[{"name":"Department of Space Physics, School of Electronic Information, Wuhan University, Wuhan 430072, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"8168","DOI":"10.1002\/2017GL075063","article-title":"Long-term trends in the total electron content","volume":"44","author":"Lastovicka","year":"2017","journal-title":"Geophys. Res. Lett."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"66954","DOI":"10.1109\/ACCESS.2018.2876795","article-title":"Ionospheric gradients estimation and analysis of S-band navigation signals for NAVIC system","volume":"6","author":"Ratnam","year":"2018","journal-title":"IEEE Access"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1007\/s10291-018-0701-6","article-title":"Assessment of a TEC calibration procedure by single-frequency PPP","volume":"22","author":"Prol","year":"2018","journal-title":"GPS Solut."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1659","DOI":"10.1007\/s00190-019-01275-5","article-title":"Regional ionospheric TEC modeling based on a two-layer spherical harmonic approximation for real-time single-frequency PPP","volume":"93","author":"Li","year":"2019","journal-title":"J. Geod."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Poniatowski, M., and Nykiel, G. (2020). Degradation of kinematic PPP of GNSS stations in central Europe caused by medium-scale traveling ionospheric disturbances during the st. patrick\u2019s day 2015 geomagnetic storm. Remote Sens., 12.","DOI":"10.3390\/rs12213582"},{"key":"ref_6","first-page":"1","article-title":"Global Ionospheric Propagation Model (GIM): A propagation model for scintillations of transmitted signals","volume":"37","year":"2002","journal-title":"Radio Sci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"6138","DOI":"10.1109\/TGRS.2020.2974749","article-title":"Quantitative evaluation of channel micro-Doppler capacity for MIMO UWB radar human activity signals based on time\u2013frequency signatures","volume":"58","author":"Qi","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Feng, J., Han, B., Zhao, Z., and Wang, Z. (2019). A new global total electron content empirical model. Remote Sens., 11.","DOI":"10.3390\/rs11060706"},{"key":"ref_9","unstructured":"Feltens, J., and Schaer, S. (1998, January 9). IGS Products for the Ionosphere. Proceedings of the 1998 IGS Analysis Center Workshop Darmstadt, Darmstadt, Germany."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"A10","DOI":"10.1029\/2010JA015432","article-title":"Assessment of GPS global ionosphere maps (GIM) by comparison between CODE GIM and TOPEX\/Jason TEC data: Ionospheric perspective","volume":"115","author":"Jee","year":"2010","journal-title":"J. Geophys. Res. Space Phys."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2242","DOI":"10.1109\/LGRS.2015.2463081","article-title":"Temporal and spatial ionospheric variations of 20 April 2013 earthquake in Yaan, China","volume":"12","author":"Tang","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1427","DOI":"10.1016\/j.asr.2020.05.025","article-title":"Ionospheric response to the 26 August 2018 geomagnetic storm using GPS-TEC observations along 80 E and 120 E longitudes in the Asian sector","volume":"66","author":"Lissa","year":"2020","journal-title":"Adv. Space Res."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1007\/s00190-008-0266-1","article-title":"The IGS VTEC maps: A reliable source of ionospheric information since 1998","volume":"83","author":"Juan","year":"2009","journal-title":"J. Geod."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1698","DOI":"10.1016\/j.asr.2012.03.016","article-title":"An improved approach to model ionospheric delays for single-frequency precise point positioning","volume":"49","author":"Shi","year":"2012","journal-title":"Adv. Space Res."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"4596","DOI":"10.1109\/TGRS.2015.2402598","article-title":"A worldwide ionospheric model for fast precise point positioning","volume":"53","author":"Juan","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","unstructured":"Schaer, S. (1999). Mapping and Predicting the Earth\u2019s Ionosphere Using the Global Positioning System. [Ph.D. Thesis, University Bern]."},{"key":"ref_17","first-page":"1","article-title":"Global prediction of the vertical total electron content of the ionosphere based on GPS data","volume":"46","author":"Monte","year":"2011","journal-title":"Radio Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1029\/2010RS004620","article-title":"Total electron content models and their use in ionosphere monitoring","volume":"46","author":"Jakowski","year":"2011","journal-title":"Radio Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1186\/s40623-017-0762-8","article-title":"Prediction of global ionospheric VTEC maps using an adaptive autoregressive model","volume":"70","author":"Wang","year":"2018","journal-title":"Earth Planets Space"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"e2020SW002501","DOI":"10.1029\/2020SW002501","article-title":"Forecasting global ionospheric TEC using deep learning approach","volume":"18","author":"Liu","year":"2020","journal-title":"Space Weather"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Tang, J., Li, Y., Yang, D., and Ding, M. (2022). An Approach for Predicting Global Ionospheric TEC Using Machine Learning. Remote Sens., 14.","DOI":"10.3390\/rs14071585"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2020SW002600","DOI":"10.1029\/2020SW002600","article-title":"One-Day Forecasting of Global TEC Using a Novel Deep Learning Model","volume":"19","author":"Lee","year":"2021","journal-title":"Space Weather"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Lin, X., Wang, H., Zhang, Q., Yao, C., Chen, C., Cheng, L., and Li, Z. (2022). A Spatiotemporal Network Model for Global Ionospheric TEC Forecasting. Remote Sens., 14.","DOI":"10.3390\/rs14071717"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e2021SW002854","DOI":"10.1029\/2021SW002854","article-title":"Prediction of global ionospheric TEC based on deep learning","volume":"20","author":"Chen","year":"2022","journal-title":"Space Weather"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"e2021SW002959","DOI":"10.1029\/2021SW002959","article-title":"ED-ConvLSTM: A Novel Global Ionospheric Total Electron Content Medium-term Forecast Model","volume":"20","author":"Xia","year":"2022","journal-title":"Space Weather"},{"key":"ref_26","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141, and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_27","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16 \u00d7 16 words: Transformers for image recognition at scale. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"A01301","DOI":"10.1029\/2003JA010058","article-title":"Analysis of TEC data from the TOPEX\/Poseidon mission","volume":"109","author":"Jee","year":"2004","journal-title":"J. Geophys. Res. Space Phys."},{"key":"ref_29","unstructured":"Ba, J.L., Kiros, J.R., and Hinton, G.E. (2016). Layer normalization. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Wang, H., Zhu, Y., Green, B., Adam, H., Yuille, A., and Chen, L.C. (2020). Axial-deeplab: Stand-alone axial-attention for panoptic segmentation. Computer Vision\u2014ECCV 2020, Proceedings of the 16th European Conference, Glasgow, UK, 23\u201328 August 2020, Springer International Publishing.","DOI":"10.1007\/978-3-030-58548-8_7"},{"key":"ref_31","unstructured":"Baevski, A., and Auli, M. (2018). Adaptive Input Representations for Neural Language Modeling. arXiv."},{"key":"ref_32","unstructured":"Ioffe, S., and Normalization, C.S. (2014). Batch Normalization: Accelerating deep network training by reducing internal covariate shift. arXiv."},{"key":"ref_33","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20138). Imagenet classification with deep convolutional neural networks. Proceedings of the Twenty-Sixth Annual Conference on Neural Information Processing Systems (NIPS), Lake Tahoe, NV, USA."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhang, J., Chen, L., Zhuo, L., Liang, X., and Li, J. (2018). An efficient hyperspectral image retrieval method: Deep spectral-spatial feature extraction with DCGAN and dimensionality reduction using t-SNE-based NM hashing. Remote Sens., 10.","DOI":"10.3390\/rs10020271"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhang, C., Zhou, J., Wang, H., Tan, T., Cui, M., Huang, Z., Wang, P., and Zhang, L. (2022). Multi-Species Individual Tree Segmentation and Identification Based on Improved Mask R-CNN and UAV Imagery in Mixed Forests. Remote Sens., 14.","DOI":"10.3390\/rs14040874"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1109\/LGRS.2020.2992633","article-title":"Implementation of hybrid deep learning model (LSTM-CNN) for ionospheric TEC forecasting using GPS data","volume":"18","author":"Ruwali","year":"2020","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1007\/s10291-018-0721-2","article-title":"Performance of various predicted GNSS global ionospheric maps relative to GPS and JASON TEC data","volume":"22","author":"Li","year":"2018","journal-title":"GPS Solut."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Li, W., Huang, L., Zhang, S., and Chai, Y. (2019). Assessing global ionosphere TEC maps with satellite altimetry and ionospheric radio occultation observations. Sensors, 19.","DOI":"10.3390\/s19245489"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"e2021SW002741","DOI":"10.1029\/2021SW002741","article-title":"Potential of Regional Ionosphere Prediction Using a Long Short-Term Memory Deep-Learning Algorithm Specialized for Geomagnetic Storm Period","volume":"19","author":"Kim","year":"2021","journal-title":"Space Weather"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"5771","DOI":"10.1029\/93JA02867","article-title":"What is a geomagnetic storm?","volume":"99","author":"Gonzalez","year":"1994","journal-title":"J. Geophys. Res. Space Phys."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"6666","DOI":"10.1002\/jgra.50576","article-title":"Global empirical model of TEC response to geomagnetic activity","volume":"118","author":"Mukhtarov","year":"2013","journal-title":"J. Geophys. Res. Space Phys."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"3365","DOI":"10.1016\/j.asr.2021.06.002","article-title":"Analysis of spatiotemporal characteristics of internal coincidence accuracy in global TEC grid data","volume":"68","author":"Feng","year":"2021","journal-title":"Adv. Space Res."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1377","DOI":"10.1016\/j.asr.2021.03.021","article-title":"Ionospheric TEC forecast model based on support vector machine with GPU acceleration in the China region","volume":"68","author":"Xia","year":"2021","journal-title":"Adv. Space Res."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1038\/s41586-021-03854-z","article-title":"Skilful precipitation nowcasting using deep generative models of radar","volume":"597","author":"Ravuri","year":"2021","journal-title":"Nature"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/17\/4223\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:16:22Z","timestamp":1760141782000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/17\/4223"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,27]]},"references-count":44,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["rs14174223"],"URL":"https:\/\/doi.org\/10.3390\/rs14174223","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,27]]}}}