{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T06:58:56Z","timestamp":1775890736628,"version":"3.50.1"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"12","license":[{"start":{"date-parts":[[2024,8,6]],"date-time":"2024-08-06T00:00:00Z","timestamp":1722902400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,8,6]],"date-time":"2024-08-06T00:00:00Z","timestamp":1722902400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Australian Catholic University Limited"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int. J. Mach. Learn. &amp; Cyber."],"published-print":{"date-parts":[[2024,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Accurate short-term load forecasting (STLF) is crucial for the power system. Traditional methods generally used signal decomposition techniques for feature extraction. However, these methods are limited in extrapolation performance, and the parameter of decomposition modes needs to be preset. To end this, this paper develops a novel STLF algorithm based on multi-scale perspective decomposition. The proposed algorithm adopts the multi-scale deep neural network (MscaleDNN) to decompose load series into low- and high-frequency components. Considering outliers of load series, this paper introduces the adaptive rescaled lncosh (ARlncosh) loss to fit the distribution of load data and improve the robustness. Furthermore, the attention mechanism (ATTN) extracts the correlations between different moments. In two power load data sets from Portugal and Australia, the proposed model generates competitive forecasting results.<\/jats:p>","DOI":"10.1007\/s13042-024-02302-4","type":"journal-article","created":{"date-parts":[[2024,8,6]],"date-time":"2024-08-06T11:02:56Z","timestamp":1722942176000},"page":"6061-6076","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Multiscale-integrated deep learning approaches for short-term load forecasting"],"prefix":"10.1007","volume":"15","author":[{"given":"Yang","family":"Yang","sequence":"first","affiliation":[]},{"given":"Yuchao","family":"Gao","sequence":"additional","affiliation":[]},{"given":"Zijin","family":"Wang","sequence":"additional","affiliation":[]},{"given":"Xi\u2019an","family":"Li","sequence":"additional","affiliation":[]},{"given":"Hu","family":"Zhou","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2388-3614","authenticated-orcid":false,"given":"Jinran","family":"Wu","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,8,6]]},"reference":[{"key":"2302_CR1","doi-asserted-by":"publisher","first-page":"460","DOI":"10.1016\/j.energy.2019.02.141","volume":"174","author":"P Singh","year":"2019","unstructured":"Singh P, Dwivedi P, Kant V (2019) A hybrid method based on neural network and improved environmental adaptation method using controlled Gaussian mutation with real parameter for short-term load forecasting. Energy 174:460\u2013477","journal-title":"Energy"},{"key":"2302_CR2","doi-asserted-by":"publisher","first-page":"114031","DOI":"10.1016\/j.rser.2023.114031","volume":"189","author":"Y Eren","year":"2024","unstructured":"Eren Y, K\u00fc\u00e7\u00fckdemiral \u0130 (2024) A comprehensive review on deep learning approaches for short-term load forecasting. Renew Sustain Energy Rev 189:114031","journal-title":"Renew Sustain Energy Rev"},{"issue":"3","key":"2302_CR3","doi-asserted-by":"publisher","first-page":"1984","DOI":"10.1109\/TPWRS.2020.3028133","volume":"36","author":"Y Wang","year":"2021","unstructured":"Wang Y, Chen J, Chen X, Zeng X, Kong Y, Sun S et al (2021) Short-term load forecasting for industrial customers based on TCN-LightGBM. IEEE Trans Power Syst 36(3):1984\u20131997","journal-title":"IEEE Trans Power Syst"},{"issue":"9","key":"2302_CR4","doi-asserted-by":"publisher","first-page":"6474","DOI":"10.1109\/TII.2021.3130237","volume":"18","author":"L Lv","year":"2021","unstructured":"Lv L, Wu Z, Zhang J, Zhang L, Tan Z, Tian Z (2021) A VMD and LSTM based hybrid model of load forecasting for power grid security. IEEE Trans Ind Inform 18(9):6474\u20136482","journal-title":"IEEE Trans Ind Inform"},{"key":"2302_CR5","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1016\/j.apenergy.2018.09.190","volume":"232","author":"N Mohan","year":"2018","unstructured":"Mohan N, Soman KP, Sachin KS (2018) A data-driven strategy for short-term electric load forecasting using dynamic mode decomposition model. Appl Energy 232:229\u2013244","journal-title":"Appl Energy"},{"key":"2302_CR6","doi-asserted-by":"publisher","first-page":"108830","DOI":"10.1016\/j.epsr.2022.108830","volume":"214","author":"Y Yang","year":"2023","unstructured":"Yang Y, Wang Z, Zhao S, Wu J (2023) An integrated federated learning algorithm for short-term load forecasting. Electr Power Syst Res 214:108830","journal-title":"Electr Power Syst Res"},{"issue":"1","key":"2302_CR7","first-page":"3","volume":"6","author":"RB Cleveland","year":"1990","unstructured":"Cleveland RB, Cleveland WS (1990) STL: a seasonal-trend decomposition procedure based on Loess. J Off Stat 6(1):3\u201373","journal-title":"J Off Stat"},{"issue":"1","key":"2302_CR8","doi-asserted-by":"publisher","first-page":"549","DOI":"10.1109\/TSG.2012.2235089","volume":"4","author":"L Ghelardoni","year":"2013","unstructured":"Ghelardoni L, Ghio A, Anguita D (2013) Energy load forecasting using empirical mode decomposition and support vector regression. IEEE Trans Smart Grid 4(1):549\u2013556","journal-title":"IEEE Trans Smart Grid"},{"key":"2302_CR9","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1016\/j.neucom.2020.05.075","volume":"410","author":"Z Zhang","year":"2020","unstructured":"Zhang Z, Ding S, Sun Y (2020) A support vector regression model hybridized with chaotic krill herd algorithm and empirical mode decomposition for regression task. Neurocomputing 410:185\u2013201","journal-title":"Neurocomputing"},{"key":"2302_CR10","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1016\/j.ins.2022.03.060","volume":"598","author":"S Ding","year":"2022","unstructured":"Ding S, Zhang Z, Guo L, Sun Y (2022) An optimized twin support vector regression algorithm enhanced by ensemble empirical mode decomposition and gated recurrent unit. Inf Sci 598:101\u2013125","journal-title":"Inf Sci"},{"issue":"2","key":"2302_CR11","doi-asserted-by":"publisher","first-page":"1107","DOI":"10.1007\/s11071-019-05252-7","volume":"98","author":"Z Zhang","year":"2019","unstructured":"Zhang Z, Hong WC (2019) Electric load forecasting by complete ensemble empirical mode decomposition adaptive noise and support vector regression with quantum-based dragonfly algorithm. Nonlinear Dyn 98(2):1107\u20131136","journal-title":"Nonlinear Dyn"},{"key":"2302_CR12","doi-asserted-by":"crossref","unstructured":"Zhang Z, Dong Y, Hong WC (2023) Long short-term memory-based twin support vector regression for probabilistic load forecasting. IEEE Trans Neural Netw Learn Syst 1\u201315","DOI":"10.1109\/TNNLS.2023.3335355"},{"key":"2302_CR13","doi-asserted-by":"publisher","first-page":"107297","DOI":"10.1016\/j.knosys.2021.107297","volume":"228","author":"Z Zhang","year":"2021","unstructured":"Zhang Z, Hong WC (2021) Application of variational mode decomposition and chaotic grey wolf optimizer with support vector regression for forecasting electric loads. Knowl-Based Syst 228:107297","journal-title":"Knowl-Based Syst"},{"key":"2302_CR14","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1016\/j.apenergy.2019.01.055","volume":"237","author":"F He","year":"2019","unstructured":"He F, Zhou J, Feng Z, Liu G, Yang Y (2019) A hybrid short-term load forecasting model based on variational mode decomposition and long short-term memory networks considering relevant factors with Bayesian optimization algorithm. Appl Energy 237:103\u2013116","journal-title":"Appl Energy"},{"key":"2302_CR15","first-page":"22419","volume":"34","author":"H Wu","year":"2021","unstructured":"Wu H, Xu J, Wang J, Long M (2021) Autoformer: decomposition transformers with auto-correlation for long-term series forecasting. Adv Neural Inf Process Syst 34:22419\u201322430","journal-title":"Adv Neural Inf Process Syst"},{"key":"2302_CR16","unstructured":"Oreshkin BN, Carpov D, Chapados N, Bengio Y (2020) N-BEATS: neural basis expansion analysis for interpretable time series forecasting. In: International conference on learning representations"},{"issue":"11","key":"2302_CR17","doi-asserted-by":"publisher","first-page":"7327","DOI":"10.1109\/TPAMI.2021.3116668","volume":"44","author":"S Bond-Taylor","year":"2022","unstructured":"Bond-Taylor S, Leach A, Long Y, Willcocks CG (2022) Deep generative modelling: a comparative review of vaes, gans, normalizing flows, energy-based and autoregressive models. IEEE Trans Pattern Anal Mach Intell 44(11):7327\u20137347","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"4","key":"2302_CR18","doi-asserted-by":"publisher","first-page":"2546","DOI":"10.1109\/TPWRS.2015.2468586","volume":"31","author":"K Yunus","year":"2015","unstructured":"Yunus K, Thiringer T, Chen P (2015) ARIMA-based frequency-decomposed modeling of wind speed time series. IEEE Trans Power Syst 31(4):2546\u20132556","journal-title":"IEEE Trans Power Syst"},{"key":"2302_CR19","doi-asserted-by":"publisher","first-page":"118197","DOI":"10.1016\/j.apenergy.2021.118197","volume":"307","author":"W Yang","year":"2022","unstructured":"Yang W, Shi J, Li S, Song Z, Zhang Z, Chen Z (2022) A combined deep learning load forecasting model of single household resident user considering multi-time scale electricity consumption behavior. Appl Energy 307:118197","journal-title":"Appl Energy"},{"key":"2302_CR20","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1016\/j.energy.2019.03.081","volume":"175","author":"HJ Sadaei","year":"2019","unstructured":"Sadaei HJ, e Silva PCdL, Guimaraes FG, Lee MH (2019) Short-term load forecasting by using a combined method of convolutional neural networks and fuzzy time series. Energy. 175:365\u2013377","journal-title":"Energy."},{"key":"2302_CR21","doi-asserted-by":"publisher","first-page":"774","DOI":"10.1016\/j.energy.2018.06.012","volume":"158","author":"J Zhang","year":"2018","unstructured":"Zhang J, Wei YM, Li D, Tan Z, Zhou J (2018) Short term electricity load forecasting using a hybrid model. Energy 158:774\u2013781","journal-title":"Energy"},{"issue":"4","key":"2302_CR22","doi-asserted-by":"publisher","first-page":"2829","DOI":"10.1109\/TPWRS.2020.3048359","volume":"36","author":"Z Li","year":"2021","unstructured":"Li Z, Li Y, Liu Y, Wang P, Lu R, Gooi HB (2021) Deep learning based densely connected network for load forecasting. IEEE Trans Power Syst 36(4):2829\u20132840","journal-title":"IEEE Trans Power Syst"},{"issue":"2","key":"2302_CR23","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1109\/LSP.2019.2891134","volume":"26","author":"A Esmaeili","year":"2019","unstructured":"Esmaeili A, Marvasti F (2019) A novel approach to quantized matrix completion using huber loss measure. IEEE Signal Process Lett 26(2):337\u2013341","journal-title":"IEEE Signal Process Lett"},{"key":"2302_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.neunet.2017.06.008","volume":"94","author":"O Karal","year":"2017","unstructured":"Karal O (2017) Maximum likelihood optimal and robust Support Vector Regression with lncosh loss function. Neural Netw 94:1\u201312","journal-title":"Neural Netw"},{"issue":"9","key":"2302_CR25","doi-asserted-by":"publisher","first-page":"5658","DOI":"10.1109\/TSMC.2023.3272880","volume":"53","author":"Y Yang","year":"2023","unstructured":"Yang Y, Zhou H, Wu J, Ding Z, Tian YC, Yue D et al (2023) Robust adaptive rescaled Lncosh neural network regression toward time-series forecasting. IEEE Trans Syst Man Cybern Syst 53(9):5658\u20135669","journal-title":"IEEE Trans Syst Man Cybern Syst"},{"issue":"12","key":"2302_CR26","doi-asserted-by":"publisher","first-page":"3641","DOI":"10.1177\/0962280220936310","volume":"29","author":"L Fu","year":"2020","unstructured":"Fu L, Wang YG, Cai F (2020) A working likelihood approach for robust regression. Stat Methods Med Res 29(12):3641\u20133652","journal-title":"Stat Methods Med Res"},{"issue":"5","key":"2302_CR27","doi-asserted-by":"publisher","first-page":"1970","DOI":"10.4208\/cicp.OA-2020-0179","volume":"28","author":"Z Liu","year":"2020","unstructured":"Liu Z, Cai W, Xu ZQJ (2020) Multi-scale deep neural network (MscaleDNN) for solving Poisson\u2013Boltzmann equation in complex domains. Commun Comput Phys 28(5):1970\u20132001","journal-title":"Commun Comput Phys"},{"issue":"5","key":"2302_CR28","doi-asserted-by":"publisher","first-page":"A3285","DOI":"10.1137\/19M1310050","volume":"42","author":"W Cai","year":"2020","unstructured":"Cai W, Li X, Liu L (2020) A phase shift deep neural network for high frequency approximation and wave problems. SIAM J Sci Comput 42(5):A3285\u2013A3312","journal-title":"SIAM J Sci Comput"},{"issue":"5","key":"2302_CR29","doi-asserted-by":"publisher","first-page":"1746","DOI":"10.4208\/cicp.OA-2020-0085","volume":"28","author":"ZQJ Xu","year":"2020","unstructured":"Xu ZQJ, Zhang Y, Luo T, Xiao Y, Ma Z (2020) Frequency principle: Fourier analysis sheds light on deep neural networks. Commun Comput Phys 28(5):1746\u20131767","journal-title":"Commun Comput Phys"},{"key":"2302_CR30","doi-asserted-by":"publisher","first-page":"112242","DOI":"10.1016\/j.jcp.2023.112242","volume":"488","author":"XA Li","year":"2023","unstructured":"Li XA, Xu ZQJ, Zhang L (2023) Subspace decomposition based DNN algorithm for elliptic type multi-scale PDEs. J Comput Phys 488:112242","journal-title":"J Comput Phys"},{"issue":"3","key":"2302_CR31","doi-asserted-by":"publisher","first-page":"681","DOI":"10.1111\/j.1541-0420.2006.00728.x","volume":"63","author":"YG Wang","year":"2007","unstructured":"Wang YG, Zhao Y (2007) A modified pseudolikelihood approach for analysis of longitudinal data. Biometrics 63(3):681\u2013689","journal-title":"Biometrics"},{"key":"2302_CR32","first-page":"6000","volume":"30","author":"A Vaswani","year":"2017","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN et al (2017) Attention is all you need. Adv Neural Inf Process Syst 30:6000\u20136010","journal-title":"Adv Neural Inf Process Syst"},{"issue":"1","key":"2302_CR33","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1007\/s00521-021-06370-3","volume":"34","author":"Y Yang","year":"2022","unstructured":"Yang Y, Zhou H, Gao Y, Wu J, Wang YG, Fu L (2022) Robust penalized extreme learning machine regression with applications in wind speed forecasting. Neural Comput Appl 34(1):391\u2013407","journal-title":"Neural Comput Appl"},{"issue":"4","key":"2302_CR34","doi-asserted-by":"publisher","first-page":"1586","DOI":"10.1109\/TNNLS.2020.2985720","volume":"32","author":"K Bandara","year":"2021","unstructured":"Bandara K, Bergmeir C, Hewamalage H (2021) LSTM-MSNet: leveraging forecasts on sets of related time series with multiple seasonal patterns. IEEE Trans Neural Netw Learn Syst 32(4):1586\u20131599","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"2302_CR35","doi-asserted-by":"crossref","unstructured":"Lai G, Chang WC, Yang Y, Liu H (2017) Modeling long-and short-term temporal patterns with deep neural networks. In: The 41st international ACM SIGIR conference on research & development in information retrieval","DOI":"10.1145\/3209978.3210006"},{"key":"2302_CR36","doi-asserted-by":"crossref","unstructured":"Zhou H, Zhang S, Peng J, Zhang S, Li J, Xiong H et al (2020) Informer: beyond efficient transformer for long sequence time-series forecasting. In: AAAI conference on artificial intelligence","DOI":"10.1609\/aaai.v35i12.17325"},{"key":"2302_CR37","unstructured":"Kitaev N, Kaiser \u0141, Levskaya A (2019) Reformer: the efficient transformer. In: International conference on learning representations"}],"container-title":["International Journal of Machine Learning and Cybernetics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13042-024-02302-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s13042-024-02302-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s13042-024-02302-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,29]],"date-time":"2024-10-29T10:26:38Z","timestamp":1730197598000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s13042-024-02302-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,6]]},"references-count":37,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2024,12]]}},"alternative-id":["2302"],"URL":"https:\/\/doi.org\/10.1007\/s13042-024-02302-4","relation":{},"ISSN":["1868-8071","1868-808X"],"issn-type":[{"value":"1868-8071","type":"print"},{"value":"1868-808X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,6]]},"assertion":[{"value":"20 August 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 July 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 August 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}