{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T07:34:19Z","timestamp":1784014459150,"version":"3.55.0"},"reference-count":31,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2025,1,17]],"date-time":"2025-01-17T00:00:00Z","timestamp":1737072000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Accurate forecasting of stock market indices is crucial for investors, financial analysts, and policymakers. The integration of encoder and decoder architectures, coupled with an attention mechanism, has emerged as a powerful approach to enhance prediction accuracy. This paper presents a novel framework that leverages these components to capture complex temporal dependencies and patterns within stock price data. The encoder effectively transforms an input sequence into a dense representation, which the decoder then uses to reconstruct future values. The attention mechanism provides an additional layer of sophistication, allowing the model to selectively focus on relevant parts of the input sequence for making predictions. Furthermore, Bayesian optimization is employed to fine-tune hyperparameters, further improving forecast precision. Our results demonstrate a significant improvement in forecast precision over traditional recurrent neural networks. This indicates the potential of our integrated approach to effectively handle the complex patterns and dependencies in stock price data.<\/jats:p>","DOI":"10.3390\/e27010082","type":"journal-article","created":{"date-parts":[[2025,1,21]],"date-time":"2025-01-21T06:53:32Z","timestamp":1737442412000},"page":"82","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Forecasting Stock Market Indices Using Integration of Encoder, Decoder, and Attention Mechanism"],"prefix":"10.3390","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7238-8778","authenticated-orcid":false,"given":"Tien Thanh","family":"Thach","sequence":"first","affiliation":[{"name":"Faculty of Mathematics and Statistics, Ton Duc Thang University, Ho Chi Minh City 700000, Vietnam"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,1,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"18569","DOI":"10.1007\/s11042-016-4159-7","article-title":"Stock prediction using deep learning","volume":"76","author":"Singh","year":"2017","journal-title":"Multimed. Tools Appl."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Nabipour, M., Nayyeri, P., Jabani, H., Mosavi, A., and Salwana, E. (2020). Deep learning for stock market prediction. Entropy, 22.","DOI":"10.20944\/preprints202003.0256.v1"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Ecer, F., Ardabili, S., Band, S.S., and Mosavi, A. (2020). Training multilayer perceptron with genetic algorithms and particle swarm optimization for modeling stock price index prediction. Entropy, 22.","DOI":"10.3390\/e22111239"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Wu, D., Wang, X., Su, J., Tang, B., and Wu, S. (2020). A labeling method for financial time series prediction based on trends. Entropy, 22.","DOI":"10.3390\/e22101162"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"6622927","DOI":"10.1155\/2020\/6622927","article-title":"A CNN-LSTM-based model to forecast stock prices","volume":"2020","author":"Lu","year":"2020","journal-title":"Complexity"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"4741","DOI":"10.1007\/s00521-020-05532-z","article-title":"A CNN-BiLSTM-AM method for stock price prediction","volume":"33","author":"Lu","year":"2021","journal-title":"Neural Comput. Appl."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"118128","DOI":"10.1016\/j.eswa.2022.118128","article-title":"Stock market index prediction using deep Transformer model","volume":"208","author":"Wang","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"117123","DOI":"10.1016\/j.eswa.2022.117123","article-title":"BiCuDNNLSTM-1dCNN - A hybrid deep learning-based predictive model for stock price prediction","volume":"202","author":"Kanwal","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Yang, S., Ding, Y., Xie, B., Guo, Y., Bai, X., Qian, J., Gao, Y., Wang, W., and Ren, J. (2023). Advancing Financial Forecasts: A Deep Dive into Memory Attention and Long-Distance Loss in Stock Price Predictions. Appl. Sci., 13.","DOI":"10.3390\/app132212160"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"108687","DOI":"10.1016\/j.compeleceng.2023.108687","article-title":"Conducting stock market index prediction via the localized spatial\u2013temporal convolutional network","volume":"108","author":"Wang","year":"2023","journal-title":"Comput. Electr. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zhu, W., Dai, W., Tang, C., Zhou, G., Liu, Z., and Zhao, Y. (2024). PMANet: A time series forecasting model for Chinese stock price prediction. Sci. Rep., 14.","DOI":"10.1038\/s41598-024-69303-9"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Chen, X., Yang, F., Sun, Q., and Yi, W. (2024). Research on stock prediction based on CED-PSO-StockNet time series model. Sci. Rep., 14.","DOI":"10.1038\/s41598-024-78984-1"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Xie, L., Chen, Z., and Yu, S. (2024). Deep Convolutional Transformer Network for Stock Movement Prediction. Electronics, 13.","DOI":"10.3390\/electronics13214225"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Li, S., and Xu, S. (2024). Enhancing stock price prediction using GANs and transformer-based attention mechanisms. Empir. Econ., 1\u201331.","DOI":"10.1007\/s00181-024-02644-6"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"13371","DOI":"10.1007\/s00521-022-07366-3","article-title":"Attention mechanism in neural networks: Where it comes and where it goes","volume":"34","author":"Soydaner","year":"2022","journal-title":"Neural Comput. Appl."},{"key":"ref_16","unstructured":"Sutskever, I., Vinyals, O., and Le, Q.V. (2014). Sequence to Sequence Learning with Neural Networks. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Cho, K., van Merri\u00ebnboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014). Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv.","DOI":"10.3115\/v1\/D14-1179"},{"key":"ref_18","unstructured":"Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1875","DOI":"10.1109\/TMM.2015.2477044","article-title":"Describing multimedia content using attention-based encoder-decoder networks","volume":"17","author":"Cho","year":"2015","journal-title":"IEEE Trans. Multimed."},{"key":"ref_20","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A., Kaiser, L., and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_21","first-page":"11106","article-title":"Informer: Beyond efficient transformer for long sequence time-series forecasting","volume":"35","author":"Zhou","year":"2021","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"ref_22","first-page":"22419","article-title":"Autoformer: Decomposition transformers with auto-correlation for long-term series forecasting","volume":"34","author":"Wu","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_23","unstructured":"Zhou, T., Ma, Z., Wen, Q., Wang, X., Sun, L., and Jin, R. (2022, January 17\u201323). Fedformer: Frequency enhanced decomposed transformer for long-term series forecasting. Proceedings of the 39th International Conference on Machine Learning, Baltimore, MD, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1016\/j.neucom.2019.12.118","article-title":"Multivariate time series forecasting via attention-based encoder\u2013decoder framework","volume":"388","author":"Du","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Jin, X.B., Zheng, W.Z., Kong, J.L., Wang, X.Y., Bai, Y.T., Su, T.L., and Lin, S. (2021). Deep-learning forecasting method for electric power load via attention-based encoder-decoder with bayesian optimization. Energies, 14.","DOI":"10.3390\/en14061596"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"126665","DOI":"10.1016\/j.energy.2023.126665","article-title":"Attention-based encoder-decoder networks for state of charge estimation of lithium-ion battery","volume":"268","author":"Wu","year":"2023","journal-title":"Energy"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Klaar, A., Stefenon, S., Seman, L., Mariani, V., and Coelho, L. (2023). Optimized EWT-Seq2Seq-LSTM with attention mechanism to insulators fault prediction. Sensors, 23.","DOI":"10.3390\/s23063202"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"114760","DOI":"10.1109\/ACCESS.2024.3435683","article-title":"Developing a Novel Hybrid Model Double Exponential Smoothing and Dual Attention Encoder-Decoder Based Bi-Directional Gated Recurrent Unit Enhanced with Bayesian Optimization to Forecast Stock Price","volume":"12","author":"Jayanth","year":"2024","journal-title":"IEEE Access"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Cho, K., van Merri\u00ebnboer, B., Bahdanau, D., and Bengio, Y. (2014). On the properties of neural machine translation: Encoder-decoder approaches. arXiv.","DOI":"10.3115\/v1\/W14-4012"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"788","DOI":"10.1016\/j.procs.2020.03.419","article-title":"Analysis of look back period for stock price prediction with RNN variants: A case study on banking sector of NEPSE","volume":"167","author":"Saud","year":"2020","journal-title":"Procedia Comput. Sci."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/27\/1\/82\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T10:30:50Z","timestamp":1759919450000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/27\/1\/82"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,17]]},"references-count":31,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,1]]}},"alternative-id":["e27010082"],"URL":"https:\/\/doi.org\/10.3390\/e27010082","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,17]]}}}