{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,22]],"date-time":"2026-03-22T10:51:44Z","timestamp":1774176704340,"version":"3.50.1"},"reference-count":112,"publisher":"Wiley","license":[{"start":{"date-parts":[[2022,6,3]],"date-time":"2022-06-03T00:00:00Z","timestamp":1654214400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Applied Computational Intelligence and Soft Computing"],"published-print":{"date-parts":[[2022,6,3]]},"abstract":"<jats:p>Deep sequential (DS) models are extensively employed for forecasting time series data since the dawn of the deep learning era, and they provide forecasts for the values required in subsequent time steps. DS models, unlike other traditional statistical models for forecasting time series data, can learn hidden patterns in temporal sequences and have the memorizing data from prior time points. Given the widespread usage of deep sequential models in several domains, a comprehensive study describing their applications is necessary. This work presents a comprehensive review of contemporary deep learning time series models, their performance in diverse domains, and an investigation of the models that were employed in various applications. Three deep sequential models, namely, artificial neural network (ANN), long short-term memory (LSTM), and temporal-conventional neural network (TCNN) along with their applications for forecasting time series data, are elaborated. We showed a comprehensive comparison between such models in terms of application fields, model structure and activation functions, optimizers, and implementation, with a goal of learning more about the optimal model used. Furthermore, the challenges and perspectives of future development of deep sequential models are presented and discussed. We conclude that the LSTM model is widely employed, particularly in the form of a hybrid model, in which the most accurate predictions are made when the shape of hybrids is used as the model.<\/jats:p>","DOI":"10.1155\/2022\/6596397","type":"journal-article","created":{"date-parts":[[2022,6,3]],"date-time":"2022-06-03T17:05:07Z","timestamp":1654275907000},"page":"1-19","source":"Crossref","is-referenced-by-count":49,"title":["A Review on Deep Sequential Models for Forecasting Time Series Data"],"prefix":"10.1155","volume":"2022","author":[{"given":"Dozdar Mahdi","family":"Ahmed","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Zakho, Duhok 42001, Kurdistan Region, Iraq"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3461-0942","authenticated-orcid":true,"given":"Masoud Muhammed","family":"Hassan","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Zakho, Duhok 42001, Kurdistan Region, Iraq"},{"name":"College of Art and Science, American University of Kurdistan, Duhok, Kurdistan Region, Iraq"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6122-234X","authenticated-orcid":true,"given":"Ramadhan J.","family":"Mstafa","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Zakho, Duhok 42001, Kurdistan Region, Iraq"},{"name":"Department of Computer Science, College of Science, Nawroz University, Duhok 42001, Kurdistan Region, Iraq"}]}],"member":"311","reference":[{"key":"1","doi-asserted-by":"publisher","DOI":"10.20956\/jmsk.v17i2.11803"},{"key":"2","article-title":"Deep learning for time-series analysis","author":"J. C. B. Gamboa","year":"2017"},{"key":"3","doi-asserted-by":"publisher","DOI":"10.1109\/ICCTIDE.2016.7725358"},{"key":"4","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9892.2012.00805.x"},{"key":"5","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-018-0300-7"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1016\/j.earscirev.2018.12.005"},{"key":"7","doi-asserted-by":"publisher","DOI":"10.1002\/for.3980040103"},{"key":"8","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.6.3.324"},{"key":"9","volume-title":"Time Series Analysis: Forecasting and Control","author":"G. E. P. Box","year":"2015"},{"key":"10","doi-asserted-by":"publisher","DOI":"10.2307\/2583225"},{"key":"11","doi-asserted-by":"publisher","DOI":"10.1080\/07474938.2010.481556"},{"key":"12","doi-asserted-by":"publisher","DOI":"10.1098\/rsta.2020.0209"},{"key":"13","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1423"},{"key":"14","article-title":"Imagenet classification with deep convolutional neural networks","volume":"25","author":"A. Krizhevsky","year":"2012","journal-title":"Advances in Neural Information Processing Systems"},{"key":"15","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2836950"},{"key":"16","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.50"},{"key":"17","doi-asserted-by":"publisher","DOI":"10.1613\/jair.731"},{"key":"18","article-title":"Tensorflow: large-scale machine learning on heterogeneous distributed systems","author":"M. Abadi","year":"2016"},{"key":"19","article-title":"Pytorch: an imperative style, high-performance deep learning library","author":"A. Paszke","year":"2019"},{"key":"20","article-title":"Sequential interpretability: methods, applications, and future direction for understanding deep learning models in the context of sequential data","author":"B. Shickel","year":"2020"},{"key":"21","article-title":"Introduction to sequence learning models: RNN, LSTM, GRU","author":"S. Zargar","year":"2021"},{"key":"22","doi-asserted-by":"publisher","DOI":"10.1109\/ICMLA51294.2020.00140"},{"key":"23","doi-asserted-by":"publisher","DOI":"10.1016\/j.jiph.2021.04.015"},{"key":"24","doi-asserted-by":"publisher","DOI":"10.1007\/s00366-018-00699-5"},{"key":"25","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-59338-4_19"},{"key":"26","doi-asserted-by":"publisher","DOI":"10.1016\/j.jhydrol.2020.125011"},{"key":"27","doi-asserted-by":"publisher","DOI":"10.3390\/w11071387"},{"key":"28","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-030-70542-8","volume-title":"Metaheuristics in Machine Learning: Theory and Applications","author":"D. Oliva","year":"2021"},{"key":"29","article-title":"Deep learning: our miraculous year 1990-1991","author":"J. Schmidhuber","year":"2020"},{"key":"30","doi-asserted-by":"publisher","DOI":"10.1109\/5.58337"},{"key":"31","doi-asserted-by":"publisher","DOI":"10.1109\/BigComp48618.2020.00-98"},{"key":"32","article-title":"On the properties of neural machine translation: encoder-decoder approaches","author":"K. Cho","year":"2014"},{"key":"33","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"34","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3163384"},{"key":"35","doi-asserted-by":"publisher","DOI":"10.1007\/s42979-021-00535-6"},{"key":"36","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2018.10.104"},{"key":"37","doi-asserted-by":"publisher","DOI":"10.1109\/MSIEID52046.2020.00029"},{"key":"38","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2020.103859"},{"key":"39","article-title":"An empirical evaluation of generic convolutional and recurrent networks for sequence modeling","author":"S. Bai","year":"2018"},{"key":"40","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-01119-3"},{"key":"41","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2020.105847"},{"key":"42","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2020.113905"},{"key":"43","doi-asserted-by":"publisher","DOI":"10.1016\/j.rinp.2021.103817"},{"key":"44","doi-asserted-by":"publisher","DOI":"10.1155\/2021\/6927985"},{"key":"45","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2021.107463"},{"key":"46","doi-asserted-by":"publisher","DOI":"10.1016\/j.chaos.2020.110227"},{"key":"47","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2021.115153"},{"key":"48","doi-asserted-by":"publisher","DOI":"10.1007\/s40031-021-00623-4"},{"key":"49","doi-asserted-by":"publisher","DOI":"10.1016\/j.dib.2020.106175"},{"key":"50","doi-asserted-by":"publisher","DOI":"10.1016\/j.egyai.2021.100093"},{"key":"51","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN48605.2020.9206991"},{"key":"52","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN52387.2021.9534351"},{"key":"53","doi-asserted-by":"publisher","DOI":"10.1109\/ICCC47050.2019.9064298"},{"key":"54","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2020.3046629"},{"key":"55","doi-asserted-by":"publisher","DOI":"10.1109\/CSICC52343.2021.9420543"},{"key":"56","doi-asserted-by":"publisher","DOI":"10.1016\/j.seta.2021.101474"},{"key":"57","doi-asserted-by":"publisher","DOI":"10.1109\/I2CACIS.2019.8825097"},{"key":"58","doi-asserted-by":"publisher","DOI":"10.1109\/ITEC48692.2020.9161659"},{"key":"59","doi-asserted-by":"publisher","DOI":"10.3390\/en12183588"},{"key":"60","doi-asserted-by":"publisher","DOI":"10.1016\/j.epsr.2019.106106"},{"key":"61","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2020.106580"},{"key":"62","article-title":"A novel hybrid framework for hourly PM2.5 concentration forecasting using CEEMDAN and deep temporal convolutional neural network","author":"F. Jiang","year":"2020"},{"key":"63","doi-asserted-by":"publisher","DOI":"10.1109\/ICST47872.2019.9166401"},{"key":"64","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2020.03.036"},{"key":"65","doi-asserted-by":"publisher","DOI":"10.1109\/ICADEIS49811.2020.9277393"},{"key":"66","doi-asserted-by":"publisher","DOI":"10.1109\/IHMSC49165.2020.00014"},{"key":"67","doi-asserted-by":"publisher","DOI":"10.1007\/s40003-021-00585-5"},{"key":"68","doi-asserted-by":"publisher","DOI":"10.1016\/j.jhydrol.2021.126607"},{"key":"69","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2020.01.124"},{"key":"70","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2020.106780"},{"key":"71","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2021.01.031"},{"key":"72","doi-asserted-by":"publisher","DOI":"10.1109\/ACIT49673.2020.9208859"},{"key":"73","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-020-04867-x"},{"key":"74","doi-asserted-by":"publisher","DOI":"10.1007\/s00500-021-05775-5"},{"key":"75","doi-asserted-by":"publisher","DOI":"10.1007\/s11227-020-03503-8"},{"key":"76","doi-asserted-by":"publisher","DOI":"10.1007\/s00500-020-04954-0"},{"key":"77","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-13-1822-1_24"},{"key":"78","doi-asserted-by":"publisher","DOI":"10.1109\/ICRITO48877.2020.9197993"},{"key":"79","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.3028259"},{"key":"80","doi-asserted-by":"publisher","DOI":"10.1007\/s00704-020-03177-5"},{"key":"81","doi-asserted-by":"publisher","DOI":"10.1007\/s11269-020-02638-w"},{"key":"82","doi-asserted-by":"publisher","DOI":"10.1016\/j.energy.2020.117081"},{"key":"83","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2020.11.026"},{"key":"84","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2021.3055258"},{"key":"85","doi-asserted-by":"publisher","DOI":"10.1016\/j.physa.2021.126293"},{"key":"86","doi-asserted-by":"publisher","DOI":"10.1109\/ICEIEC.2019.8784513"},{"key":"87","doi-asserted-by":"publisher","DOI":"10.1111\/coin.12291"},{"key":"88","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2021.107091"},{"key":"89","doi-asserted-by":"publisher","DOI":"10.1016\/j.ress.2021.108012"},{"key":"90","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2020.03.011"},{"key":"91","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8683634"},{"key":"92","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpdc.2021.04.006"},{"key":"93","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijforecast.2019.03.017"},{"key":"94","doi-asserted-by":"publisher","DOI":"10.1016\/j.dsp.2020.102731"},{"key":"95","doi-asserted-by":"publisher","DOI":"10.1016\/j.energy.2020.119708"},{"key":"96","doi-asserted-by":"publisher","DOI":"10.1016\/j.jhtm.2021.08.022"},{"key":"97","doi-asserted-by":"publisher","DOI":"10.1007\/s00500-019-04506-1"},{"key":"98","doi-asserted-by":"publisher","DOI":"10.1007\/s41066-018-00143-5"},{"key":"99","doi-asserted-by":"publisher","DOI":"10.1016\/j.fusengdes.2020.112107"},{"key":"100","doi-asserted-by":"publisher","DOI":"10.1016\/j.rser.2017.02.085"},{"key":"101","doi-asserted-by":"publisher","DOI":"10.1089\/big.2020.0159"},{"key":"102","doi-asserted-by":"publisher","DOI":"10.1016\/j.jksuci.2020.09.009"},{"key":"103","doi-asserted-by":"publisher","DOI":"10.1007\/s40305-020-00309-6"},{"key":"104","article-title":"Adam: a method for stochastic optimization","author":"D. P. Kingma","year":"2017"},{"key":"105","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-15-5495-7_11"},{"key":"106","doi-asserted-by":"publisher","DOI":"10.3745\/JIPS.02.0141"},{"key":"107","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/1237\/2\/022030"},{"key":"108","doi-asserted-by":"publisher","DOI":"10.1016\/j.egyai.2021.100060"},{"key":"109","volume-title":"A Comparative Study of Data Splitting Algorithms for Machine Learning Model Selection","author":"D. E. Birba","year":"2020"},{"key":"110","doi-asserted-by":"publisher","DOI":"10.1109\/CiSt49399.2021.9357277"},{"key":"111","doi-asserted-by":"publisher","DOI":"10.1109\/LNET.2020.3016583"},{"key":"112","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2021.115537"}],"container-title":["Applied Computational Intelligence and Soft Computing"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/acisc\/2022\/6596397.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/acisc\/2022\/6596397.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/acisc\/2022\/6596397.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,6,3]],"date-time":"2022-06-03T17:05:16Z","timestamp":1654275916000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/acisc\/2022\/6596397\/"}},"subtitle":[],"editor":[{"given":"Aniello","family":"Minutolo","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2022,6,3]]},"references-count":112,"alternative-id":["6596397","6596397"],"URL":"https:\/\/doi.org\/10.1155\/2022\/6596397","relation":{},"ISSN":["1687-9732","1687-9724"],"issn-type":[{"value":"1687-9732","type":"electronic"},{"value":"1687-9724","type":"print"}],"subject":[],"published":{"date-parts":[[2022,6,3]]}}}