{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,17]],"date-time":"2025-12-17T18:15:57Z","timestamp":1765995357007,"version":"build-2065373602"},"reference-count":92,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2024,5,10]],"date-time":"2024-05-10T00:00:00Z","timestamp":1715299200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61202479"],"award-info":[{"award-number":["61202479"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>In this research, an innovative state space-based Transformer model is proposed to address the challenges of complex system prediction tasks. By integrating state space theory, the model aims to enhance the capability to capture dynamic changes in complex data, thereby improving the accuracy and robustness of prediction tasks. Extensive experimental validations were conducted on three representative tasks, including legal case judgment, legal case translation, and financial data analysis to assess the performance and application potential of the model. The experimental results demonstrate significant performance improvements of the proposed model over traditional Transformer models and other advanced variants such as Bidirectional Encoder Representation from Transformers (BERT) and Finsformer across all evaluated tasks. Specifically, in the task of legal case judgment, the proposed model exhibited a precision of 0.93, a recall of 0.90, and an accuracy of 0.91, significantly surpassing the traditional Transformer model (with precision of 0.78, recall of 0.73, accuracy of 0.76) and performances of other comparative models. In the task of legal case translation, the precision of the proposed model reached 0.95, with a recall of 0.91 and an accuracy of 0.93, also outperforming other models. Likewise, in the task of financial data analysis, the proposed model also demonstrated excellent performance, with a precision of 0.94, recall of 0.90, and accuracy of 0.92. The state space-based Transformer model proposed not only theoretically expands the research boundaries of deep learning models in complex system prediction but also validates its efficiency and broad application prospects through experiments. These achievements provide new insights and directions for future research and development of deep learning models, especially in tasks requiring the understanding and prediction of complex system dynamics.<\/jats:p>","DOI":"10.3390\/systems12050171","type":"journal-article","created":{"date-parts":[[2024,5,13]],"date-time":"2024-05-13T08:33:03Z","timestamp":1715589183000},"page":"171","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Data-Driven Strategies for Complex System Forecasts: The Role of Textual Big Data and State-Space Transformers in Decision Support"],"prefix":"10.3390","volume":"12","author":[{"given":"Huairong","family":"Huo","sequence":"first","affiliation":[{"name":"College of Humanities and Development Studies, China Agricultural University, Beijing 100083, China"}]},{"given":"Wanxin","family":"Guo","sequence":"additional","affiliation":[{"name":"College of Humanities and Development Studies, China Agricultural University, Beijing 100083, China"}]},{"given":"Ruining","family":"Yang","sequence":"additional","affiliation":[{"name":"College of Economics and Management, China Agricultural University, Beijing 100083, China"}]},{"given":"Xuran","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Economics and Management, China Agricultural University, Beijing 100083, China"}]},{"given":"Jingyi","family":"Xue","sequence":"additional","affiliation":[{"name":"College of Economics and Management, China Agricultural University, Beijing 100083, China"}]},{"given":"Qingmiao","family":"Peng","sequence":"additional","affiliation":[{"name":"College of Economics and Management, China Agricultural University, Beijing 100083, China"}]},{"given":"Yiwei","family":"Deng","sequence":"additional","affiliation":[{"name":"College of Information and Electrical Engineering, China Agricultural University, Beijing 100083, China"},{"name":"Renmin University of China, Beijing 100084, China"}]},{"given":"Xinyi","family":"Sun","sequence":"additional","affiliation":[{"name":"College of Food Science Nutritional Engineering, China Agricultural University, Beijing 100083, China"}]},{"given":"Chunli","family":"Lv","sequence":"additional","affiliation":[{"name":"College of Information and Electrical Engineering, China Agricultural University, Beijing 100083, China"}]}],"member":"1968","published-online":{"date-parts":[[2024,5,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s40163-020-00116-7","article-title":"A systematic review on spatial crime forecasting","volume":"9","author":"Kounadi","year":"2020","journal-title":"Crime Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"012065","DOI":"10.1088\/1742-6596\/2161\/1\/012065","article-title":"Machine Learning approaches in stock price prediction: A systematic review","volume":"2161","author":"Soni","year":"2022","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1109\/TAI.2021.3062771","article-title":"A systematic review on the use of AI and ML for fighting the COVID-19 pandemic","volume":"1","author":"Islam","year":"2020","journal-title":"IEEE Trans. Artif. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1016\/j.ins.2022.11.139","article-title":"K-means clustering algorithms: A comprehensive review, variants analysis, and advances in the era of big data","volume":"622","author":"Ikotun","year":"2023","journal-title":"Inf. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1186\/s40537-021-00492-0","article-title":"Text data augmentation for deep learning","volume":"8","author":"Shorten","year":"2021","journal-title":"J. Big Data"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Rana, S., Kanji, R., and Jain, S. (2022, January 26\u201327). Comparison of SVM and Naive Bayes for Sentiment Classification using BERT data. Proceedings of the 2022 5th International Conference On Multimedia, Signal Processing and Communication Technologies (IMPACT), Aligarh, India.","DOI":"10.1109\/IMPACT55510.2022.10029067"},{"key":"ref_7","first-page":"304","article-title":"A Comparison of SVM Against Pre-trained Language Models (PLMs) for Text Classification Tasks","volume":"Volume 13811","author":"Nicosia","year":"2023","journal-title":"Proceedings of the 8th Annual International Conference on Machine Learning, Optimization and Data Science, LOD 2022, PT II"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1586","DOI":"10.1109\/TCYB.2020.2969705","article-title":"Novel efficient RNN and LSTM-like architectures: Recurrent and gated broad learning systems and their applications for text classification","volume":"51","author":"Du","year":"2020","journal-title":"IEEE Trans. Cybern."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Jang, B., Kim, M., Harerimana, G., Kang, S.u., and Kim, J.W. (2020). Bi-LSTM model to increase accuracy in text classification: Combining Word2vec CNN and attention mechanism. Appl. Sci., 10.","DOI":"10.3390\/app10175841"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Atienza, R. (2021, January 5\u201310). Vision transformer for fast and efficient scene text recognition. Proceedings of the International Conference on Document Analysis and Recognition, Lausanne, Switzerland.","DOI":"10.1007\/978-3-030-86549-8_21"},{"key":"ref_11","first-page":"201","article-title":"Quality assessment of text data using C-RNN","volume":"Volume 3","author":"Sharaff","year":"2022","journal-title":"Proceedings of the Sixth International Congress on Information and Communication Technology: ICICT 2021"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Kumar, A. (2022, January 25\u201327). A study: Hate speech and offensive language detection in textual data by using RNN, CNN, LSTM and Bert model. Proceedings of the 2022 6th International Conference on Intelligent Computing and Control Systems (ICICCS), Madurai, India.","DOI":"10.1109\/ICICCS53718.2022.9788347"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"825","DOI":"10.1007\/s41324-021-00397-3","article-title":"Mining tourists\u2019 destinations and preferences through LSTM-based text classification and spatial clustering using Flickr data","volume":"29","author":"Lee","year":"2021","journal-title":"Spat. Inf. Res."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"93048","DOI":"10.1109\/ACCESS.2023.3309697","article-title":"MCNN-LSTM: Combining CNN and LSTM to Classify Multi-Class Text in Imbalanced News Data","volume":"11","author":"Hasib","year":"2023","journal-title":"IEEE Access"},{"key":"ref_15","unstructured":"Kumar, V., Choudhary, A., and Cho, E. (2020). Data augmentation using pre-trained transformer models. arXiv."},{"key":"ref_16","unstructured":"Phan, L.N., Anibal, J.T., Tran, H., Chanana, S., Bahadroglu, E., Peltekian, A., and Altan-Bonnet, G. (2021). Scifive: A text-to-text transformer model for biomedical literature. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"5789","DOI":"10.1007\/s10462-021-09958-2","article-title":"Transformer models for text-based emotion detection: A review of BERT-based approaches","volume":"54","author":"Acheampong","year":"2021","journal-title":"Artif. Intell. Rev."},{"key":"ref_18","unstructured":"Koutnik, J., Greff, K., Gomez, F., and Schmidhuber, J. (2014, January 21\u201326). A clockwork rnn. Proceedings of the International Conference on Machine Learning, PMLR, Beijing, China."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"112797","DOI":"10.1016\/j.measurement.2023.112797","article-title":"A signal recovery method for bridge monitoring system using TVFEMD and encoder-decoder aided LSTM","volume":"214","author":"Xin","year":"2023","journal-title":"Measurement"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zaheer, S., Anjum, N., Hussain, S., Algarni, A.D., Iqbal, J., Bourouis, S., and Ullah, S.S. (2023). A multi parameter forecasting for stock time series data using LSTM and deep learning model. Mathematics, 11.","DOI":"10.3390\/math11030590"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"101984","DOI":"10.1016\/j.jocs.2023.101984","article-title":"Effective RNN-based forecasting methodology design for improving short-term power load forecasts: Application to large-scale power-grid time series","volume":"68","author":"Aseeri","year":"2023","journal-title":"J. Comput. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"109945","DOI":"10.1016\/j.asoc.2022.109945","article-title":"Temporal Convolutional Networks with RNN approach for chaotic time series prediction","volume":"133","author":"Dudukcu","year":"2023","journal-title":"Appl. Soft Comput."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Liu, Y., Wang, Y., and Shi, H. (2023). A convolutional recurrent neural-network-based machine learning for scene text recognition application. Symmetry, 15.","DOI":"10.3390\/sym15040849"},{"key":"ref_24","unstructured":"Shiri, F.M., Perumal, T., Mustapha, N., and Mohamed, R. (2023). A comprehensive overview and comparative analysis on deep learning models: CNN, RNN, LSTM, GRU. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"132306","DOI":"10.1016\/j.physd.2019.132306","article-title":"Fundamentals of recurrent neural network (RNN) and long short-term memory (LSTM) network","volume":"404","author":"Sherstinsky","year":"2020","journal-title":"Phys. D Nonlinear Phenom."},{"key":"ref_26","unstructured":"Zhao, J., Huang, F., Lv, J., Duan, Y., Qin, Z., Li, G., and Tian, G. (2020, January 13\u201318). Do RNN and LSTM have long memory?. Proceedings of the International Conference on Machine Learning, PMLR, Virtual Event. Available online: https:\/\/proceedings.mlr.press\/v119\/zhao20c.html."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"119951","DOI":"10.1016\/j.ins.2023.119951","article-title":"TRNN: An efficient time-series recurrent neural network for stock price prediction","volume":"657","author":"Lu","year":"2024","journal-title":"Inf. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"120346","DOI":"10.1016\/j.eswa.2023.120346","article-title":"Stock price prediction with optimized deep LSTM network with artificial rabbits optimization algorithm","volume":"227","year":"2023","journal-title":"Expert Syst. Appl."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1168","DOI":"10.1016\/j.procs.2020.03.049","article-title":"Stock market prediction using LSTM recurrent neural network","volume":"170","author":"Moghar","year":"2020","journal-title":"Procedia Comput. Sci."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"112666","DOI":"10.1016\/j.enbuild.2022.112666","article-title":"Ultra-short term power load forecasting based on CEEMDAN-SE and LSTM neural network","volume":"279","author":"Li","year":"2023","journal-title":"Energy Build."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"128274","DOI":"10.1016\/j.energy.2023.128274","article-title":"Short-term power load forecasting for combined heat and power using CNN-LSTM enhanced by attention mechanism","volume":"282","author":"Wan","year":"2023","journal-title":"Energy"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Jailani, N.L.M., Dhanasegaran, J.K., Alkawsi, G., Alkahtani, A.A., Phing, C.C., Baashar, Y., Capretz, L.F., Al-Shetwi, A.Q., and Tiong, S.K. (2023). Investigating the power of LSTM-based models in solar energy forecasting. Processes, 11.","DOI":"10.3390\/pr11051382"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"121638","DOI":"10.1016\/j.apenergy.2023.121638","article-title":"COA-CNN-LSTM: Coati optimization algorithm-based hybrid deep learning model for PV\/wind power forecasting in smart grid applications","volume":"349","author":"Bukhari","year":"2023","journal-title":"Appl. Energy"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"107549","DOI":"10.1016\/j.jobe.2023.107549","article-title":"Seismic control of adaptive variable stiffness intelligent structures using fuzzy control strategy combined with LSTM","volume":"78","author":"Zhang","year":"2023","journal-title":"J. Build. Eng."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"129001","DOI":"10.1016\/j.physa.2023.129001","article-title":"Short-term traffic flow prediction based on optimized deep learning neural network: PSO-Bi-LSTM","volume":"625","author":"Redhu","year":"2023","journal-title":"Phys. A Stat. Mech. Its Appl."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Osama, O.M., Alakkari, K., Abotaleb, M., and El-Kenawy, E.S.M. (2023, January 7\u20138). Forecasting Global Monkeypox Infections Using LSTM: A Non-Stationary Time Series Analysis. Proceedings of the 2023 3rd International Conference on Electronic Engineering (ICEEM), Menouf, Egypt.","DOI":"10.1109\/ICEEM58740.2023.10319532"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Wang, J., Ozbayoglu, E., Baldino, S., Liu, Y., and Zheng, D. (2023, January 1\u20134). Time Series Data Analysis with Recurrent Neural Network for Early Kick Detection. Proceedings of the Offshore Technology Conference, OTC, Houston, TX, USA.","DOI":"10.4043\/32428-MS"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"109830","DOI":"10.1016\/j.asoc.2022.109830","article-title":"Novel optimization approach for stock price forecasting using multi-layered sequential LSTM","volume":"134","author":"Md","year":"2023","journal-title":"Appl. Soft Comput."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Wijanarko, B.D., Heryadi, Y., Murad, D.F., Tho, C., and Hashimoto, K. (2023, January 16). Recurrent Neural Network-based Models as Bahasa Indonesia-Sundanese Language Neural Machine Translator. Proceedings of the 2023 International Conference on Computer Science, Information Technology and Engineering (ICCoSITE), Jakarta, Indonesia.","DOI":"10.1109\/ICCoSITE57641.2023.10127817"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"108433","DOI":"10.1109\/ACCESS.2023.3320738","article-title":"Deep-Sentiment: An Effective Deep Sentiment Analysis Using a Decision-Based Recurrent Neural Network (D-RNN)","volume":"11","author":"Durga","year":"2023","journal-title":"IEEE Access"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Tang, J., Yang, R., Dai, Q., Yuan, G., and Mao, Y. (2023). Research on feature extraction of meteorological disaster emergency response capability based on an RNN Autoencoder. Appl. Sci., 13.","DOI":"10.3390\/app13085153"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"100160","DOI":"10.1016\/j.treng.2023.100160","article-title":"Energy management system optimization based on an LSTM deep learning model using vehicle speed prediction","volume":"11","author":"Pulvirenti","year":"2023","journal-title":"Transp. Eng."},{"key":"ref_43","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the Neural Information Processing Systems 30 (NIPS 2017), Long Beach, CA, USA."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Bello, A., Ng, S.C., and Leung, M.F. (2023). A BERT framework to sentiment analysis of tweets. Sensors, 23.","DOI":"10.3390\/s23010506"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"514","DOI":"10.1007\/s11633-022-1393-5","article-title":"Transformer: A general framework from machine translation to others","volume":"20","author":"Zhao","year":"2023","journal-title":"Mach. Intell. Res."},{"key":"ref_46","unstructured":"Friedman, D., Wettig, A., and Chen, D. (2023, January 10\u201316). Learning transformer programs. Proceedings of the Neural Information Processing Systems 36 (NeurIPS 2023), New Orleans, LA, USA."},{"key":"ref_47","unstructured":"Kazemnejad, A., Padhi, I., Natesan Ramamurthy, K., Das, P., and Reddy, S. (2023, January 10\u201316). The impact of positional encoding on length generalization in transformers. Proceedings of the Neural Information Processing Systems 36 (NeurIPS 2023), New Orleans, LA, USA."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Huangliang, K., Li, X., Yin, T., Peng, B., and Zhang, H. (2023, January 26\u201329). Self-adapted positional encoding in the transformer encoder for named entity recognition. Proceedings of the International Conference on Artificial Neural Networks, Crete, Greece.","DOI":"10.1007\/978-3-031-44223-0_43"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"11635","DOI":"10.48084\/etasr.6017","article-title":"Evaluation of Stock Closing Prices using Transformer Learning","volume":"13","author":"Mian","year":"2023","journal-title":"Eng. Technol. Appl. Sci. Res."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Shishehgarkhaneh, M.B., Moehler, R.C., Fang, Y., Hijazi, A.A., and Aboutorab, H. (2023). Transformer-based Named Entity Recognition in Construction Supply Chain Risk Management in Australia. arXiv.","DOI":"10.1109\/ACCESS.2024.3377232"},{"key":"ref_51","first-page":"354","article-title":"COVID-19 Epidemic Prediction Based on Deep Learning","volume":"5","author":"Li","year":"2023","journal-title":"J. Nonlinear Model. Anal."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1049\/cit2.12085","article-title":"Probabilistic time series forecasting with deep non-linear state space models","volume":"8","author":"Du","year":"2023","journal-title":"CAAI Trans. Intell. Technol."},{"key":"ref_53","unstructured":"Shi, Z. (2024). MambaStock: Selective state space model for stock prediction. arXiv."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Benozzo, D., Baggio, G., Baron, G., Chiuso, A., Zampieri, S., and Bertoldo, A. (2023). Analyzing asymmetry in brain hierarchies with a linear state-space model of resting-state fMRI data. bioRxiv.","DOI":"10.1101\/2023.11.04.565625"},{"key":"ref_55","unstructured":"Afandizadeh, S., and Bigdeli Rad, H. (2023). Estimation of parameters affecting traffic accidents using state space models. J. Transp. Res."},{"key":"ref_56","unstructured":"Gu, A., and Dao, T. (2023). Mamba: Linear-time sequence modeling with selective state spaces. arXiv."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Saon, G., Gupta, A., and Cui, X. (2023, January 4\u201310). Diagonal state space augmented transformers for speech recognition. Proceedings of the ICASSP 2023\u20142023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece.","DOI":"10.1109\/ICASSP49357.2023.10096271"},{"key":"ref_58","unstructured":"Gu, A., Goel, K., and R\u00e9, C. (2021). Efficiently modeling long sequences with structured state spaces. arXiv."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"111716","DOI":"10.1016\/j.rse.2020.111716","article-title":"Deep learning in environmental remote sensing: Achievements and challenges","volume":"241","author":"Yuan","year":"2020","journal-title":"Remote Sens. Environ."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"120813","DOI":"10.1016\/j.jclepro.2020.120813","article-title":"A review of the state of health for lithium-ion batteries: Research status and suggestions","volume":"261","author":"Tian","year":"2020","journal-title":"J. Clean. Prod."},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Yu, Y., Wang, C., Fu, Q., Kou, R., Huang, F., Yang, B., Yang, T., and Gao, M. (2023). Techniques and challenges of image segmentation: A review. Electronics, 12.","DOI":"10.3390\/electronics12051199"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1017\/S1351324922000213","article-title":"Comparison of text preprocessing methods","volume":"29","author":"Chai","year":"2023","journal-title":"Nat. Lang. Eng."},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Arisha, A.O., and Wabula, Y. (2023, January 20\u201323). Text Preprocessing Approaches in CNN for Disaster Reports Dataset. Proceedings of the 2023 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), Bali, Indonesia.","DOI":"10.1109\/ICAIIC57133.2023.10067109"},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Yu, L., Liu, B., Lin, Q., Zhao, X., and Che, C. (2024). Semantic Similarity Matching for Patent Documents Using Ensemble BERT-related Model and Novel Text Processing Method. arXiv.","DOI":"10.12720\/jait.15.3.446-450"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"107217","DOI":"10.1016\/j.infsof.2023.107217","article-title":"BERT-and TF-IDF-based feature extraction for long-lived bug prediction in FLOSS: A comparative study","volume":"160","author":"Gomes","year":"2023","journal-title":"Inf. Softw. Technol."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"109860","DOI":"10.1016\/j.asoc.2022.109860","article-title":"LayerLog: Log sequence anomaly detection based on hierarchical semantics","volume":"132","author":"Zhang","year":"2023","journal-title":"Appl. Soft Comput."},{"key":"ref_67","first-page":"503","article-title":"Convolutional neural network based sentiment analysis with tf-idf based vectorization","volume":"11","author":"Kabra","year":"2023","journal-title":"J. Integr. Sci. Technol."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"80416","DOI":"10.1109\/ACCESS.2023.3299824","article-title":"Ensemble transfer learning on augmented domain resources for oncological named entity recognition in Chinese clinical records","volume":"11","author":"Zhou","year":"2023","journal-title":"IEEE Access"},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Zaeem, J.M., Garg, V., Aggarwal, K., and Arora, A. (2023, January 13\u201315). An Intelligent Article Knowledge Graph Formation Framework Using BM25 Probabilistic Retrieval Model. Proceedings of the Iberoamerican Knowledge Graphs and Semantic Web Conference, Zaragoza, Spain.","DOI":"10.1007\/978-3-031-47745-4_3"},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"1414","DOI":"10.1016\/j.csbj.2020.05.017","article-title":"Constructing knowledge graphs and their biomedical applications","volume":"18","author":"Nicholson","year":"2020","journal-title":"Comput. Struct. Biotechnol. J."},{"key":"ref_71","first-page":"71","article-title":"Entity extraction based on the combination of information entropy and TF-IDF","volume":"15","author":"Yilahun","year":"2023","journal-title":"Int. J. Reason.-Based Intell. Syst."},{"key":"ref_72","unstructured":"Pan, J.Z., Razniewski, S., Kalo, J.C., Singhania, S., Chen, J., Dietze, S., Jabeen, H., Omeliyanenko, J., Zhang, W., and Lissandrini, M. (2023). Large language models and knowledge graphs: Opportunities and challenges. arXiv."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3643806","article-title":"Knowledge graph embedding: A survey from the perspective of representation spaces","volume":"56","author":"Cao","year":"2024","journal-title":"ACM Comput. Surv."},{"key":"ref_74","first-page":"1","article-title":"Hyperspectral image classification using spectral\u2013spatial token enhanced transformer with hash-based positional embedding","volume":"61","author":"Wu","year":"2023","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_75","unstructured":"Ge, C., Song, S., and Huang, G. (2023, January 7\u201314). Causal intervention for human trajectory prediction with cross attention mechanism. Proceedings of the AAAI Conference on Artificial Intelligence, Washington, DC, USA."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1111\/2041-210X.13833","article-title":"State-space models for ecological time-series data: Practical model-fitting","volume":"14","author":"Newman","year":"2023","journal-title":"Methods Ecol. Evol."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"24560","DOI":"10.1016\/j.ijhydene.2022.10.031","article-title":"Prediction model for methanation reaction conditions based on a state transition simulated annealing algorithm optimized extreme learning machine","volume":"48","author":"Shen","year":"2023","journal-title":"Int. J. Hydrogen Energy"},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"109996","DOI":"10.1016\/j.asoc.2023.109996","article-title":"Population-based discrete state transition algorithm with decomposition and knowledge guidance applied to electrolytic cell maintenance decision","volume":"135","author":"Shi","year":"2023","journal-title":"Appl. Soft Comput."},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"13724","DOI":"10.1109\/ACCESS.2023.3243081","article-title":"Parameter estimation of fractional-order chaotic power system based on lens imaging learning strategy state transition algorithm","volume":"11","author":"Ai","year":"2023","journal-title":"IEEE Access"},{"key":"ref_80","doi-asserted-by":"crossref","unstructured":"Xu, X., and Zhou, X. (2023). Deep Learning Based Feature Selection and Ensemble Learning for Sintering State Recognition. Sensors, 23.","DOI":"10.3390\/s23229217"},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"120754","DOI":"10.1016\/j.eswa.2023.120754","article-title":"TripletMultiDTI: Multimodal representation learning in drug-target interaction prediction with triplet loss function","volume":"232","author":"Dehghan","year":"2023","journal-title":"Expert Syst. Appl."},{"key":"ref_82","first-page":"1","article-title":"Implicit bias of gradient descent for mean squared error regression with two-layer wide neural networks","volume":"24","author":"Jin","year":"2023","journal-title":"J. Mach. Learn. Res."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1016\/j.ins.2023.03.018","article-title":"Generalized temporal similarity-based nonnegative tensor decomposition for modeling transition matrix of dynamic collaborative filtering","volume":"632","author":"Yu","year":"2023","journal-title":"Inf. Sci."},{"key":"ref_84","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_85","first-page":"15908","article-title":"Transformer in transformer","volume":"34","author":"Han","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_86","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1111\/agec.12624","article-title":"Impacts of COVID-19 on global poverty, food security, and diets: Insights from global model scenario analysis","volume":"52","author":"Laborde","year":"2021","journal-title":"Agric. Econ."},{"key":"ref_87","doi-asserted-by":"crossref","unstructured":"Zhou, M., Kong, Y., and Lin, J. (2022, January 25\u201328). Financial Topic Modeling Based on the BERT-LDA Embedding. Proceedings of the 2022 IEEE 20th International Conference on Industrial Informatics (INDIN), Perth, Australia.","DOI":"10.1109\/INDIN51773.2022.9976145"},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"2840","DOI":"10.4028\/www.scientific.net\/AMR.712-715.2840","article-title":"Application of PLC in the Control System of Fins-former","volume":"712","author":"Zhou","year":"2013","journal-title":"Adv. Mater. Res."},{"key":"ref_89","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv."},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"52","DOI":"10.2478\/seeur-2023-0035","article-title":"Pre-Training MLM Using Bert for the Albanian Language","volume":"18","author":"Kryeziu","year":"2023","journal-title":"SEEU Rev."},{"key":"ref_91","unstructured":"Liang, X., Zhou, Z., Huang, H., Wu, S., Xiao, T., Yang, M., Li, Z., and Bian, C. (2023). Character, Word, or Both? Revisiting the Segmentation Granularity for Chinese Pre-trained Language Models. arXiv."},{"key":"ref_92","doi-asserted-by":"crossref","unstructured":"An, H., Ma, R., Yan, Y., Chen, T., Zhao, Y., Li, P., Li, J., Wang, X., Fan, D., and Lv, C. (2024). Finsformer: A Novel Approach to Detecting Financial Attacks Using Transformer and Cluster-Attention. Appl. Sci., 14.","DOI":"10.3390\/app14010460"}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/12\/5\/171\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:43:48Z","timestamp":1760107428000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/12\/5\/171"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,10]]},"references-count":92,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,5]]}},"alternative-id":["systems12050171"],"URL":"https:\/\/doi.org\/10.3390\/systems12050171","relation":{},"ISSN":["2079-8954"],"issn-type":[{"type":"electronic","value":"2079-8954"}],"subject":[],"published":{"date-parts":[[2024,5,10]]}}}