{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T15:25:43Z","timestamp":1780586743270,"version":"3.54.1"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,8,18]],"date-time":"2022-08-18T00:00:00Z","timestamp":1660780800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,8,18]],"date-time":"2022-08-18T00:00:00Z","timestamp":1660780800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Scientific research project of Beijing Municipal Education Commission - General Project of science and technology plan","award":["Grant Z20018"],"award-info":[{"award-number":["Grant Z20018"]}]},{"name":"Basic scientific research business fee project of municipal colleges and Universities - special subsidy for youth scientific research and innovation","award":["Grant x18258"],"award-info":[{"award-number":["Grant x18258"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Intell Syst"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Electrical load forecasting is of vital importance in intelligent power management and has been a hot spot in industrial Internet application field. Due to the complex patterns and dynamics of the data, accurate short-term load forecasting is still a challenging task. Currently, many tasks use deep neural networks for power load forecasting, and most use recurrent neural network as the basic architecture, including Long Short-Term Memory (LSTM), Sequence to Sequence (Seq2Seq), etc. However, the performance of these models is not as good as expected due to the gradient vanishing problem in recurrent neural network. Transformer is a deep learning model initially designed for natural language processing, it calculates input\u2013output representations and captures long dependencies entirely on attention mechanisms which has great performance for capturing the complex dynamic nonlinear sequence dependence on long sequence input. In this work, we proposed a model Time Augmented Transformer (TAT) for short-term electrical load forecasting. A temporal augmented module in TAT is designed to learn the temporal relationships representation between the input history series to adapt to the short-term power load forecasting task. We evaluate our approach on a real-word dataset for electrical load and extensively compared it to the performance of the existed electrical load forecasting model including statistical approach, traditional machine learning and deep learning methods, the experimental results show that the proposed TAT model results in higher precision and accuracy in short-term load forecasting.<\/jats:p>","DOI":"10.1007\/s44196-022-00128-y","type":"journal-article","created":{"date-parts":[[2022,8,18]],"date-time":"2022-08-18T20:04:31Z","timestamp":1660853071000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":45,"title":["Short-Term Electrical Load Forecasting Based on Time Augmented Transformer"],"prefix":"10.1007","volume":"15","author":[{"given":"Guangqi","family":"Zhang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0352-3002","authenticated-orcid":false,"given":"Chuyuan","family":"Wei","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Changfeng","family":"Jing","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanxue","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,8,18]]},"reference":[{"key":"128_CR1","doi-asserted-by":"publisher","first-page":"624","DOI":"10.17577\/ijertv6is050443","volume":"6","author":"M Reddy","year":"2017","unstructured":"Reddy, M., Vishali, N.: Load forecasting using linear regression analysis in time series model for RGUKT, R.K. Valley campus HT feeder. Int J Eng Sci. 6, 624\u2013625 (2017). https:\/\/doi.org\/10.17577\/ijertv6is050443","journal-title":"Int J Eng Sci."},{"key":"128_CR2","doi-asserted-by":"publisher","first-page":"6105","DOI":"10.3390\/en13226105","volume":"13","author":"IS Jahan","year":"2020","unstructured":"Jahan, I.S., Snasel, V., Misak, S.: Intelligent systems for power load forecasting: a study review. Energies 13, 6105 (2020). https:\/\/doi.org\/10.3390\/en13226105","journal-title":"Energies"},{"key":"128_CR3","doi-asserted-by":"publisher","first-page":"106995","DOI":"10.1016\/j.epsr.2020.106995","volume":"192","author":"G Memarzadeh","year":"2021","unstructured":"Memarzadeh, G., Keynia, F.: Short-term electricity load and price forecasting by a new optimal LSTM-NN based prediction algorithm. Elector Pow Syst Res. 192, 106995 (2021). https:\/\/doi.org\/10.1016\/j.epsr.2020.106995","journal-title":"Elector Pow Syst Res."},{"key":"128_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s43067-020-00021-8","volume":"7","author":"IK Nti","year":"2020","unstructured":"Nti, I.K., Teimeh, M., Nyarko-Boateng, O., Adekoya, A.F.: Electricity load forecasting: a systematic review. J Electr Syst Inf Technol 7, 1\u201319 (2020). https:\/\/doi.org\/10.1186\/s43067-020-00021-8","journal-title":"J Electr Syst Inf Technol"},{"key":"128_CR5","doi-asserted-by":"publisher","first-page":"91","DOI":"10.3390\/forecast3010006","volume":"3","author":"A Nespoli","year":"2021","unstructured":"Nespoli, A., Ogliari, E., Pretto, S., Gavazzeni, M., Vigani, S., Paccanelli, F.: Electrical load forecast by means of LSTM: the impact of data quality. Forecasting 3, 91\u2013101 (2021). https:\/\/doi.org\/10.3390\/forecast3010006","journal-title":"Forecasting"},{"key":"128_CR6","doi-asserted-by":"publisher","first-page":"1002","DOI":"10.1002\/tee.23144","volume":"15","author":"G Sun","year":"2020","unstructured":"Sun, G., Jiang, C., Wang, X., Yang, X.: Short-term building load forecast based on a data-mining feature selection and LSTM-RNN method. Ieej T Electr Electr 15, 1002\u20131010 (2020). https:\/\/doi.org\/10.1002\/tee.23144","journal-title":"Ieej T Electr Electr"},{"key":"128_CR7","doi-asserted-by":"publisher","first-page":"56","DOI":"10.26599\/bdma.2020.9020027","volume":"4","author":"YN Malek","year":"2021","unstructured":"Malek, Y.N., Najib, M., Bakhouya, M., Essaaidi, M.: Multivariate deep learning approach for electric vehicle speed forecasting. Big Data Min Anal 4, 56\u201364 (2021). https:\/\/doi.org\/10.26599\/bdma.2020.9020027","journal-title":"Big Data Min Anal"},{"key":"128_CR8","doi-asserted-by":"publisher","first-page":"134911","DOI":"10.1109\/ACCESS.2020.3010702","volume":"8","author":"AA Mamun","year":"2020","unstructured":"Mamun, A.A., Sohel, M., Mohammad, N., Sunny, M., Hossain, E.: A comprehensive review of the load forecasting techniques using single and hybrid predictive models. IEEE Access 8, 134911\u2013134939 (2020). https:\/\/doi.org\/10.1109\/ACCESS.2020.3010702","journal-title":"IEEE Access"},{"key":"128_CR9","doi-asserted-by":"publisher","unstructured":"Chen, J., Wu, Y., Lin, Z., Zhao, L., Deng, X.: Review of Load Forecasting Based on Artificial Intelligence Models. 2021 6th Asia Conference on Power and Electrical Engineering 2021, 340\u2013344 (2021). https:\/\/doi.org\/10.1109\/acpee51499.2021.9436916","DOI":"10.1109\/acpee51499.2021.9436916"},{"key":"128_CR10","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1016\/j.knosys.2018.08.027","volume":"163","author":"A Yang","year":"2019","unstructured":"Yang, A., Li, W., Yang, X.: Short-term electricity load forecasting based on feature selection and Least Squares Support Vector Machines. Knowl Based Syst 163, 159\u2013173 (2019). https:\/\/doi.org\/10.1016\/j.knosys.2018.08.027","journal-title":"Knowl Based Syst"},{"key":"128_CR11","doi-asserted-by":"publisher","first-page":"3183","DOI":"10.1109\/icmlc.2004.1378583","volume":"5","author":"JC Lu","year":"2005","unstructured":"Lu, J.C., Niu, D.X., Jia, Z.Y.: A study of short-term load forecasting based on ARIMA-ANN. Int Conf Mach Learn Cybernet 5, 3183\u20133187 (2005). https:\/\/doi.org\/10.1109\/icmlc.2004.1378583","journal-title":"Int Conf Mach Learn Cybernet"},{"key":"128_CR12","doi-asserted-by":"publisher","unstructured":"Zhou, D., Chen, S., Dong, S.: Network traffic prediction based on ARIMA model. arXiv preprint arXiv:1302.6324 (2013). https:\/\/doi.org\/10.48550\/arXiv.1302.6324","DOI":"10.48550\/arXiv.1302.6324"},{"issue":"2","key":"128_CR13","first-page":"30","volume":"24","author":"JF Yang","year":"2004","unstructured":"Yang, J.F., Cheng, H.Z.: Application of SVM to power system short-term load forecast. Electric Power Automat Equip 24(2), 30\u201332 (2004)","journal-title":"Electric Power Automat Equip"},{"key":"128_CR14","doi-asserted-by":"publisher","unstructured":"Huo,J., Shi,T.T., Chang, J.: Comparison of Random Forest and SVM for Electrical Short-term Load Forecast with Different Data Sources. In: 2016 IEEE 7th International Conference on Software Engineering and Service Science. 2016, 1077\u20131080 (2016). https:\/\/doi.org\/10.1109\/ICSESS.2016.7883252","DOI":"10.1109\/ICSESS.2016.7883252"},{"issue":"12","key":"128_CR15","doi-asserted-by":"publisher","first-page":"4045","DOI":"10.13335\/j.1000-3673.pst.2018.0433","volume":"42","author":"LI Peng","year":"2018","unstructured":"Peng, L.I., Shuai, H.E., Han, P., Zheng, M., Huang, M., Sun, J.: Short-term load forecasting of smart grid based on long-short-term memory recurrent neural networks in condition of real-time electricity price. Power Syst Technol 42(12), 4045\u20134052 (2018). https:\/\/doi.org\/10.13335\/j.1000-3673.pst.2018.0433","journal-title":"Power Syst Technol"},{"key":"128_CR16","doi-asserted-by":"publisher","first-page":"3199","DOI":"10.3390\/en12163199","volume":"12","author":"G Gong","year":"2019","unstructured":"Gong, G., An, X., Mahato, N.K., Sun, S., Wen, Y.: Research on Short-term load prediction based on Seq2seq model. Energies 12, 3199 (2019). https:\/\/doi.org\/10.3390\/en12163199","journal-title":"Energies"},{"key":"128_CR17","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N.: Attention Is All You Need. arXiv preprint arXiv:1706.03762 (2017). https:\/\/arxiv.org\/abs\/1706.03762"},{"key":"128_CR18","doi-asserted-by":"publisher","unstructured":"Pooniwala, N., Sutar, R.: Forecasting Short-Term Electric Load with a Hybrid of ARIMA Model and LSTM Network. In: 2021 International Conference on Computer Communication and Informatics (ICCCI). 2021, 1\u20136 (2021). https:\/\/doi.org\/10.1109\/ICCCI50826.2021.9402461","DOI":"10.1109\/ICCCI50826.2021.9402461"},{"key":"128_CR19","doi-asserted-by":"publisher","unstructured":"Marrero, L., Garc\u00eda-Santander, L., Carrizo, D., Ulloa, F.: An application of load forecasting based on ARIMA models and particle swarm optimization. In: 2019 11th International Symposium on Advanced Topics in Electrical Engineering (ATEE). 2019, 1\u20136 (2019). https:\/\/doi.org\/10.1109\/atee.2019.8724891","DOI":"10.1109\/atee.2019.8724891"},{"key":"128_CR20","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1109\/ICRCSS.2009.12","volume":"2009","author":"L Wei","year":"2009","unstructured":"Wei, L., Zhang, Z.G.: Based on time sequence of ARIMA model in the application of short-term electricity load forecasting. Int Conf Res Challenge Comp Sci 2009, 11\u201314 (2009). https:\/\/doi.org\/10.1109\/ICRCSS.2009.12","journal-title":"Int Conf Res Challenge Comp Sci"},{"key":"128_CR21","doi-asserted-by":"publisher","first-page":"827","DOI":"10.3390\/en9100827","volume":"9","author":"L Yi","year":"2016","unstructured":"Yi, L., Niu, D., Ye, M., Hong, W.C.: Short-term load forecasting based on wavelet transform and least squares support vector machine optimized by improved cuckoo search. Energies 9, 827 (2016). https:\/\/doi.org\/10.3390\/en9100827","journal-title":"Energies"},{"key":"128_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/irec.2015.7110975","volume":"2015","author":"A Lahouar","year":"2015","unstructured":"Lahouar, A., Slama, J.: Random forests model for one day ahead load forecasting. Renew Energ Congress 2015, 1\u20136 (2015). https:\/\/doi.org\/10.1109\/irec.2015.7110975","journal-title":"Renew Energ Congress"},{"key":"128_CR23","doi-asserted-by":"publisher","first-page":"116358","DOI":"10.1016\/j.energy.2019.116358","volume":"189","author":"N Zhang","year":"2019","unstructured":"Zhang, N., Li, Z., Zou, X., Quiring, S.M.: Comparison of three short-term load forecast models in Southern California. Energy 189, 116358 (2019). https:\/\/doi.org\/10.1016\/j.energy.2019.116358","journal-title":"Energy"},{"key":"128_CR24","doi-asserted-by":"publisher","first-page":"938","DOI":"10.13195\/j.kzyjc.2017.1632","volume":"33","author":"QY Sun","year":"2018","unstructured":"Sun, Q.Y., Yang, L.X., Zhang, H.G.: Smart energy \u2014 Applications and prospects of artificial intelligence technology in power system. Kongzhi yu Juece\/Control Decis 33, 938\u2013949 (2018). https:\/\/doi.org\/10.13195\/j.kzyjc.2017.1632","journal-title":"Kongzhi yu Juece\/Control Decis"},{"issue":"1","key":"128_CR25","doi-asserted-by":"publisher","first-page":"100379","DOI":"10.1016\/j.cosrev.2021.100379","volume":"40","author":"S Dong","year":"2021","unstructured":"Dong, S., Wang, P., Abbas, K.: A survey on deep learning and its applications. Comput Sci Rev 40(1), 100379 (2021). https:\/\/doi.org\/10.1016\/j.cosrev.2021.100379","journal-title":"Comput Sci Rev"},{"key":"128_CR26","doi-asserted-by":"publisher","first-page":"111799","DOI":"10.1016\/j.enconman.2019.111799","volume":"198","author":"H Wang","year":"2019","unstructured":"Wang, H., Lei, Z., Zhang, X., Zhou, B., Peng, J.: A review of deep learning for renewable energy forecasting. Energ Convers Managf. 198, 111799 (2019). https:\/\/doi.org\/10.1016\/j.enconman.2019.111799","journal-title":"Energ Convers Managf."},{"key":"128_CR27","doi-asserted-by":"publisher","first-page":"134911","DOI":"10.1109\/ACCESS.2020.3010702","volume":"8","author":"A Mamun","year":"2020","unstructured":"Mamun, A., Sohel, M., Mohammad, N., Sunny, M.S.H., Dipta, D.R., Hossain, E.: A comprehensive review of the load forecasting techniques using single and hybrid predictive models. IEEE Access 8, 134911\u2013134939 (2020). https:\/\/doi.org\/10.1109\/ACCESS.2020.3010702","journal-title":"IEEE Access"},{"key":"128_CR28","doi-asserted-by":"publisher","unstructured":"Tokg\u00f6z, A., \u00dcnal, G.: A RNN based time series approach for forecasting turkish electricity load. 2018 26th Signal Processing and Communications Applications Conference (SIU). 2018, 1\u20134 (2018): IEEE https:\/\/doi.org\/10.1109\/siu.2018.8404313","DOI":"10.1109\/siu.2018.8404313"},{"issue":"8","key":"128_CR29","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput 9(8), 1735\u20131780 (1997). https:\/\/doi.org\/10.1162\/neco.1997.9.8.1735","journal-title":"Neural Comput"},{"key":"128_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.2991\/ijcis.d.201027.001","volume":"14","author":"R Wang","year":"2021","unstructured":"Wang, R., Zhao, J.: Deep learning-based short-term load forecasting for transformers in distribution grid. Int J Comput Int Sys 14, 1\u201310 (2021). https:\/\/doi.org\/10.2991\/ijcis.d.201027.001","journal-title":"Int J Comput Int Sys"},{"key":"128_CR31","doi-asserted-by":"publisher","unstructured":"Wu, N., Green, B., Xue, B., O'Banion, S.: Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Case. arXiv preprint arXiv: 2001.08317 (2020). https:\/\/doi.org\/10.48550\/arXiv.2001.08317","DOI":"10.48550\/arXiv.2001.08317"},{"key":"128_CR32","doi-asserted-by":"publisher","unstructured":"He, K., Zhang, X., Ren, S., Sun, J.: Deep Residual Learning for Image Recognition. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2016, 770\u2013780 (2016). https:\/\/doi.org\/10.1109\/CVPR.2016.90","DOI":"10.1109\/CVPR.2016.90"},{"key":"128_CR33","doi-asserted-by":"publisher","unstructured":"Ba, J.L., Kiros, J.R., Hinton, G.E.: Layer Normalization. arXiv preprint arXiv:1607.06450. (2016). https:\/\/doi.org\/10.48550\/arXiv.1607.06450","DOI":"10.48550\/arXiv.1607.06450"},{"key":"128_CR34","doi-asserted-by":"publisher","unstructured":"Luong, M.T., Pham, H., Manning, C.D.: Effective Approaches to Attention-based Neural Machine Translation. Comput Sci. (2015). https:\/\/doi.org\/10.18653\/v1\/D15-1166","DOI":"10.18653\/v1\/D15-1166"},{"key":"128_CR35","doi-asserted-by":"publisher","unstructured":"Bahdanau, D., Cho, K., Bengio, Y.: Neural Machine Translation by Jointly Learning to Align and Translate. arXiv preprint arXiv:1409.0473 (2014). https:\/\/doi.org\/10.48550\/arXiv.1409.0473","DOI":"10.48550\/arXiv.1409.0473"},{"key":"128_CR36","doi-asserted-by":"publisher","unstructured":"Kingma, D., Ba, J.: Adam: A Method for Stochastic Optimization. arXiv preprint arXiv:1412.6980 (2014). https:\/\/doi.org\/10.48550\/arXiv.1412.6980","DOI":"10.48550\/arXiv.1412.6980"}],"container-title":["International Journal of Computational Intelligence Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-022-00128-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44196-022-00128-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-022-00128-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,8,18]],"date-time":"2022-08-18T20:13:40Z","timestamp":1660853620000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44196-022-00128-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,18]]},"references-count":36,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["128"],"URL":"https:\/\/doi.org\/10.1007\/s44196-022-00128-y","relation":{},"ISSN":["1875-6883"],"issn-type":[{"value":"1875-6883","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,18]]},"assertion":[{"value":"26 November 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 July 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 August 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval and Consent to Participate"}},{"value":"The authors consent to this work for publication.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for Publication"}}],"article-number":"67"}}