{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T16:23:14Z","timestamp":1776442994728,"version":"3.51.2"},"reference-count":208,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2024,11,27]],"date-time":"2024-11-27T00:00:00Z","timestamp":1732665600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Deep learning (DL) has become a core component of modern artificial intelligence (AI), driving significant advancements across diverse fields by facilitating the analysis of complex systems, from protein folding in biology to molecular discovery in chemistry and particle interactions in physics. However, the field of deep learning is constantly evolving, with recent innovations in both architectures and applications. Therefore, this paper provides a comprehensive review of recent DL advances, covering the evolution and applications of foundational models like convolutional neural networks (CNNs) and Recurrent Neural Networks (RNNs), as well as recent architectures such as transformers, generative adversarial networks (GANs), capsule networks, and graph neural networks (GNNs). Additionally, the paper discusses novel training techniques, including self-supervised learning, federated learning, and deep reinforcement learning, which further enhance the capabilities of deep learning models. By synthesizing recent developments and identifying current challenges, this paper provides insights into the state of the art and future directions of DL research, offering valuable guidance for both researchers and industry experts.<\/jats:p>","DOI":"10.3390\/info15120755","type":"journal-article","created":{"date-parts":[[2024,11,27]],"date-time":"2024-11-27T10:05:56Z","timestamp":1732701956000},"page":"755","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":187,"title":["A Comprehensive Review of Deep Learning: Architectures, Recent Advances, and Applications"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9353-8894","authenticated-orcid":false,"given":"Ibomoiye Domor","family":"Mienye","sequence":"first","affiliation":[{"name":"Institute for Intelligent Systems, University of Johannesburg, Johannesburg 2006, South Africa"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1525-7728","authenticated-orcid":false,"given":"Theo G.","family":"Swart","sequence":"additional","affiliation":[{"name":"Institute for Intelligent Systems, University of Johannesburg, Johannesburg 2006, South Africa"}]}],"member":"1968","published-online":{"date-parts":[[2024,11,27]]},"reference":[{"key":"ref_1","first-page":"100556","article-title":"A deep learning approach for Maize Lethal Necrosis and Maize Streak Virus disease detection","volume":"16","author":"Obaido","year":"2024","journal-title":"Mach. Learn. Appl."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1145\/3674837","article-title":"Decoupling Deep Learning for Enhanced Image Recognition Interpretability","volume":"20","author":"Peng","year":"2024","journal-title":"ACM Trans. Multimed. Comput. Commun. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"89098","DOI":"10.1109\/ACCESS.2024.3418974","article-title":"An Improved Framework for Detecting Thyroid Disease Using Filter-Based Feature Selection and Stacking Ensemble","volume":"12","author":"Obaido","year":"2024","journal-title":"IEEE Access"},{"key":"ref_4","first-page":"1","article-title":"Imagenet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Al-Jumaili, A.H.A., Muniyandi, R.C., Hasan, M.K., Paw, J.K.S., and Singh, M.J. (2023). Big data analytics using cloud computing based frameworks for power management systems: Status, constraints, and future recommendations. Sensors, 23.","DOI":"10.3390\/s23062952"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"100116","DOI":"10.1016\/j.teler.2024.100116","article-title":"Modern computing: Vision and challenges","volume":"13","author":"Gill","year":"2024","journal-title":"Telemat. Inform. Rep."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Mienye, I.D., Obaido, G., Emmanuel, I.D., and Ajani, A.A. (2024, January 3\u20136). A Survey of Bias and Fairness in Healthcare AI. Proceedings of the 2024 IEEE 12th International Conference on Healthcare Informatics (ICHI), Orlando, FL, USA.","DOI":"10.1109\/ICHI61247.2024.00103"},{"key":"ref_8","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the Advances in Neural Information Processing Systems NIPS, Long Beach, CA, USA."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"14824","DOI":"10.1007\/s11227-024-06030-y","article-title":"An intelligent sequential fraud detection model based on deep learning","volume":"80","author":"Zioviris","year":"2024","journal-title":"J. Supercomput."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Mienye, I.D., and Swart, T.G. (2024). A Hybrid Deep Learning Approach with Generative Adversarial Network for Credit Card Fraud Detection. Technologies, 12.","DOI":"10.3390\/technologies12100186"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1145\/3448250","article-title":"Deep learning for AI","volume":"64","author":"Bengio","year":"2021","journal-title":"Commun. ACM"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1007\/s12525-021-00475-2","article-title":"Machine learning and deep learning","volume":"31","author":"Janiesch","year":"2021","journal-title":"Electron. Mark."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1016\/j.neunet.2022.03.037","article-title":"Deep learning, reinforcement learning, and world models","volume":"152","author":"Matsuo","year":"2022","journal-title":"Neural Netw."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"23729","DOI":"10.1007\/s11042-020-08976-6","article-title":"A review of object detection based on deep learning","volume":"79","author":"Xiao","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"7897","DOI":"10.1109\/TII.2021.3071405","article-title":"Deep learning-based autonomous driving systems: A survey of attacks and defenses","volume":"17","author":"Deng","year":"2021","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3678","DOI":"10.1109\/TITS.2023.3235911","article-title":"Survey of deep learning for autonomous surface vehicles in marine environments","volume":"24","author":"Qiao","year":"2023","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"100614","DOI":"10.1016\/j.cosrev.2023.100614","article-title":"Deep learning for unmanned aerial vehicles detection: A review","volume":"51","author":"Alenezi","year":"2024","journal-title":"Comput. Sci. Rev."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"96893","DOI":"10.1109\/ACCESS.2024.3426955","article-title":"Deep Learning for Credit Card Fraud Detection: A Review of Algorithms, Challenges, and Solutions","volume":"12","author":"Mienye","year":"2024","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"e1519","DOI":"10.1002\/widm.1519","article-title":"Deep learning models for price forecasting of financial time series: A review of recent advancements: 2020\u20132022","volume":"14","author":"Zhang","year":"2024","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Sahu, S.K., Mokhade, A., and Bokde, N.D. (2023). An overview of machine learning, deep learning, and reinforcement learning-based techniques in quantitative finance: Recent progress and challenges. Appl. Sci., 13.","DOI":"10.3390\/app13031956"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2066","DOI":"10.3390\/ai5040101","article-title":"Deep Learning in Finance: A Survey of Applications and Techniques","volume":"5","author":"Mienye","year":"2024","journal-title":"AI"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"5893","DOI":"10.1007\/s11042-023-15805-z","article-title":"Deep learning techniques for detection and prediction of pandemic diseases: A systematic literature review","volume":"83","author":"Ajagbe","year":"2024","journal-title":"Multimed. Tools Appl."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"5975","DOI":"10.1007\/s10462-022-10306-1","article-title":"Deep learning in drug discovery: An integrative review and future challenges","volume":"56","author":"Askr","year":"2023","journal-title":"Artif. Intell. Rev."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","article-title":"Backpropagation applied to handwritten zip code recognition","volume":"1","author":"LeCun","year":"1989","journal-title":"Neural Comput."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_27","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv."},{"key":"ref_28","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"132306","DOI":"10.1016\/j.physd.2019.132306","article-title":"Fundamentals of recurrent neural network (RNN) and long short-term memory (LSTM) network","volume":"404","author":"Sherstinsky","year":"2020","journal-title":"Phys. D Nonlinear Phenom."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1016\/0893-6080(89)90020-8","article-title":"Multilayer feedforward networks are universal approximators","volume":"2","author":"Hornik","year":"1989","journal-title":"Neural Netw."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1007\/s42979-022-01043-x","article-title":"AI-based modeling: Techniques, applications and research issues towards automation, intelligent and smart systems","volume":"3","author":"Sarker","year":"2022","journal-title":"SN Comput. Sci."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Mienye, I.D., Swart, T.G., and Obaido, G. (2024). Recurrent Neural Networks: A Comprehensive Review of Architectures, Variants, and Applications. Information, 15.","DOI":"10.20944\/preprints202408.0748.v1"},{"key":"ref_35","first-page":"100591","article-title":"Artificial intelligence and sustainable development in Africa: A comprehensive review","volume":"18","author":"Mienye","year":"2024","journal-title":"Mach. Learn. Appl."},{"key":"ref_36","first-page":"310","article-title":"Activation functions in neural networks","volume":"6","author":"Sharma","year":"2017","journal-title":"Towards Data Sci."},{"key":"ref_37","unstructured":"Nwankpa, C., Ijomah, W., Gachagan, A., and Marshall, S. (2018). Activation functions: Comparison of trends in practice and research for deep learning. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Dubey, A.K., and Jain, V. (2019). Comparative study of convolution neural network\u2019s relu and leaky-relu activation functions. Applications of Computing, Automation and Wireless Systems in Electrical Engineering: Proceedings of MARC 2018, Springer.","DOI":"10.1007\/978-981-13-6772-4_76"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Shyni, H.M., and Chitra, E. (2024). PulmonNet V1: Leveraging the benefit of Leaky ReLU activation for the local and multi-scale global feature integration of chest radiographs to classify pulmonary diseases. Biomed. Signal Process. Control, 96.","DOI":"10.1016\/j.bspc.2024.106600"},{"key":"ref_40","first-page":"1","article-title":"Generalized cross entropy loss for training deep neural networks with noisy labels","volume":"31","author":"Zhang","year":"2018","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017, January 22\u201329). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Connor, R., Dearle, A., Claydon, B., and Vadicamo, L. (2024). Correlations of cross-entropy loss in machine learning. Entropy, 26.","DOI":"10.3390\/e26060491"},{"key":"ref_43","unstructured":"Jadon, A., Patil, A., and Jadon, S. (2014, January 20\u201322). A Comprehensive Survey of Regression-Based Loss Functions for Time Series Forecasting. Proceedings of the International Conference on Data Management, Analytics & Innovation, Pune, India."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"13902","DOI":"10.1109\/TCYB.2021.3121312","article-title":"An accurate GRU-based power time-series prediction approach with selective state updating and stochastic optimization","volume":"52","author":"Zheng","year":"2021","journal-title":"IEEE Trans. Cybern."},{"key":"ref_45","first-page":"1","article-title":"The marginal value of adaptive gradient methods in machine learning","volume":"30","author":"Wilson","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_46","unstructured":"Liu, M., Mroueh, Y., Ross, J., Zhang, W., Cui, X., Das, P., and Yang, T. (2019). Towards better understanding of adaptive gradient algorithms in generative adversarial nets. arXiv."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"111335","DOI":"10.1016\/j.asoc.2024.111335","article-title":"Practical guidelines for resolving the loss divergence caused by the root-mean-squared propagation optimizer","volume":"153","author":"Peng","year":"2024","journal-title":"Appl. Soft Comput."},{"key":"ref_48","unstructured":"Kingma, D.P. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Zhang, Z. (2018, January 4\u20136). Improved adam optimizer for deep neural networks. Proceedings of the 2018 IEEE\/ACM 26th International Symposium on Quality of Service (IWQoS), Banff, AB, Canada.","DOI":"10.1109\/IWQoS.2018.8624183"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Taye, M.M. (2023). Theoretical understanding of convolutional neural network: Concepts, architectures, applications, future directions. Computation, 11.","DOI":"10.3390\/computation11030052"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Gonz\u00e1lez-Rodr\u00edguez, L., and Plasencia-Salgueiro, A. (2021). Uncertainty-Aware autonomous mobile robot navigation with deep reinforcement learning. Deep Learning for Unmanned Systems, Springer.","DOI":"10.1007\/978-3-030-77939-9_7"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/j.neunet.2019.04.025","article-title":"Differential convolutional neural network","volume":"116","author":"Ozyildirim","year":"2019","journal-title":"Neural Netw."},{"key":"ref_53","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Tsantekidis, A., Passalis, N., and Tefas, A. (2022). Recurrent neural networks. Deep Learning for Robot Perception and Cognition, Elsevier.","DOI":"10.1016\/B978-0-32-385787-1.00010-5"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"16400","DOI":"10.1109\/ACCESS.2022.3148298","article-title":"A neural network ensemble with feature engineering for improved credit card fraud detection","volume":"10","author":"Esenogho","year":"2022","journal-title":"IEEE Access"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"109753","DOI":"10.1016\/j.ress.2023.109753","article-title":"Data-driven bearing health management using a novel multi-scale fused feature and gated recurrent unit","volume":"242","author":"Ni","year":"2024","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1186\/s40537-021-00461-7","article-title":"Modelling customers credit card behaviour using bidirectional LSTM neural networks","volume":"8","author":"Abbod","year":"2021","journal-title":"J. Big Data"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"2673","DOI":"10.1109\/78.650093","article-title":"Bidirectional recurrent neural networks","volume":"45","author":"Schuster","year":"1997","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"5271","DOI":"10.1109\/TSG.2017.2686012","article-title":"Deep learning for household load forecasting\u2014A novel pooling deep RNN","volume":"9","author":"Shi","year":"2017","journal-title":"IEEE Trans. Smart Grid"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"225134","DOI":"10.1109\/ACCESS.2020.3039858","article-title":"Hardware and software optimizations for accelerating deep neural networks: Survey of current trends, challenges, and the road ahead","volume":"8","author":"Capra","year":"2020","journal-title":"IEEE Access"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"68926","DOI":"10.1109\/ACCESS.2024.3399824","article-title":"A suspicious financial transaction detection model using autoencoder and risk-based approach","volume":"12","author":"Koo","year":"2024","journal-title":"IEEE Access"},{"key":"ref_63","doi-asserted-by":"crossref","unstructured":"Wu, D., Hu, Y., Liu, K., Li, J., Wang, X., Deng, S., Zheng, N., and Luo, X. (2024). An Outlier-Resilient Autoencoder for Representing High-Dimensional and Incomplete Data. IEEE Trans. Emerg. Top. Comput. Intell., 1\u201313.","DOI":"10.1109\/TETCI.2024.3437370"},{"key":"ref_64","unstructured":"Zhao, J., Mathieu, M., Goroshin, R., and Lecun, Y. (2015). Stacked what-where auto-encoders. arXiv."},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Hu, H., Liao, M., Mao, W., Liu, W., Zhang, C., and Jing, Y. (2020, January 12\u201314). Variational auto-encoder for text generation. Proceedings of the 2020 IEEE 5th Information Technology and Mechatronics Engineering Conference (ITOEC), Chongqing, China.","DOI":"10.1109\/ITOEC49072.2020.9141571"},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1145\/3672359.3672362","article-title":"Denoising Autoencoder-Based Defensive Distillation as an Adversarial Robustness Algorithm Against Data Poisoning Attacks","volume":"43","author":"Badjie","year":"2024","journal-title":"ACM SIGAda Ada Lett."},{"key":"ref_67","unstructured":"Gao, L., la Tour, T.D., Tillman, H., Goh, G., Troll, R., Radford, A., Sutskever, I., Leike, J., and Wu, J. (2024). Scaling and evaluating sparse autoencoders. arXiv."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1007\/s10462-023-10662-6","article-title":"Autoencoders and their applications in machine learning: A survey","volume":"57","author":"Berahmand","year":"2024","journal-title":"Artif. Intell. Rev."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1109\/TPAMI.2022.3152247","article-title":"A survey on vision transformer","volume":"45","author":"Han","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Van Aken, B., Winter, B., L\u00f6ser, A., and Gers, F.A. (2019, January 3\u20137). How does bert answer questions? a layer-wise analysis of transformer representations. Proceedings of the 28th ACM International Conference on Information and Knowledge Management, Beijing, China.","DOI":"10.1145\/3357384.3358028"},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"54608","DOI":"10.1109\/ACCESS.2024.3389497","article-title":"Gpt (generative pre-trained transformer)\u2014A comprehensive review on enabling technologies, potential applications, emerging challenges, and future directions","volume":"12","author":"Yenduri","year":"2024","journal-title":"IEEE Access"},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1186\/s40537-023-00876-4","article-title":"A review of graph neural networks: Concepts, architectures, techniques, challenges, datasets, applications, and future directions","volume":"11","author":"Khemani","year":"2024","journal-title":"J. Big Data"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"6295","DOI":"10.1007\/s10462-022-10321-2","article-title":"A survey of graph neural networks in various learning paradigms: Methods, applications, and challenges","volume":"56","author":"Waikhom","year":"2023","journal-title":"Artif. Intell. Rev."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/TNNLS.2020.2978386","article-title":"A comprehensive survey on graph neural networks","volume":"32","author":"Wu","year":"2020","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_75","first-page":"1","article-title":"Dynamic routing between capsules","volume":"30","author":"Sabour","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"608","DOI":"10.1109\/TAI.2021.3104791","article-title":"CapsCovNet: A modified capsule network to diagnose Covid-19 from multimodal medical imaging","volume":"2","author":"Saif","year":"2021","journal-title":"IEEE Trans. Artif. Intell."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"69812","DOI":"10.1109\/ACCESS.2024.3397775","article-title":"Advancements in Generative AI: A Comprehensive Review of GANs, GPT, Autoencoders, Diffusion Model, and Transformers","volume":"12","author":"Bengesi","year":"2024","journal-title":"IEEE Access"},{"key":"ref_78","unstructured":"Chen, R.T., Rubanova, Y., Bettencourt, J., and Duvenaud, D.K. (2018). Neural Ordinary Differential Equations. Adv. Neural Inf. Process. Syst., 31, Available online: https:\/\/proceedings.neurips.cc\/paper\/2018\/hash\/69386f6bb1dfed68692a24c8686939b9-Abstract.html."},{"key":"ref_79","unstructured":"Veli\u010dkovi\u0107, P., Cucurull, G., Casanova, A., Romero, A., Lio, P., and Bengio, Y. (2017). Graph attention networks. arXiv."},{"key":"ref_80","unstructured":"Pham, H., Guan, M., Zoph, B., Le, Q., and Dean, J. (2018, January 10\u201315). Efficient neural architecture search via parameters sharing. Proceedings of the International Conference on Machine Learning, PMLR, Stockholm, Sweden."},{"key":"ref_81","unstructured":"Yu, K., Sciuto, C., Jaggi, M., Musat, C., and Salzmann, M. (2019). Evaluating the search phase of neural architecture search. arXiv."},{"key":"ref_82","unstructured":"Liu, H., Simonyan, K., and Yang, Y. (2018). Darts: Differentiable architecture search. arXiv."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"45736","DOI":"10.1109\/ACCESS.2022.3169897","article-title":"Nas-bench-nlp: Neural architecture search benchmark for natural language processing","volume":"10","author":"Klyuchnikov","year":"2022","journal-title":"IEEE Access"},{"key":"ref_84","unstructured":"Jin, W., Derr, T., Liu, H., Wang, Y., Wang, S., Liu, Z., and Tang, J. (2020). Self-supervised learning on graphs: Deep insights and new direction. arXiv."},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"9052","DOI":"10.1109\/TPAMI.2024.3415112","article-title":"A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends","volume":"46","author":"Gui","year":"2024","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_86","unstructured":"Penarrubia, C., Valero-Mas, J.J., and Calvo-Zaragoza, J. (2024). Self-Supervised Learning for Text Recognition: A Critical Survey. arXiv."},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"101599","DOI":"10.1016\/j.csl.2023.101599","article-title":"Improving self-supervised learning model for audio spoofing detection with layer-conditioned embedding fusion","volume":"86","author":"Sinha","year":"2024","journal-title":"Comput. Speech Lang."},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"5185","DOI":"10.1007\/s00170-023-11617-5","article-title":"Anomaly detection in three-axis CNC machines using LSTM networks and transfer learning","volume":"127","author":"Li","year":"2023","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"196197","DOI":"10.1109\/ACCESS.2020.3034343","article-title":"Transfer learning with adaptive fine-tuning","volume":"8","author":"Podgorelec","year":"2020","journal-title":"IEEE Access"},{"key":"ref_90","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1186\/s40537-021-00444-8","article-title":"Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions","volume":"8","author":"Alzubaidi","year":"2021","journal-title":"J. Big Data"},{"key":"ref_91","doi-asserted-by":"crossref","first-page":"2031","DOI":"10.1109\/COMST.2020.2986024","article-title":"Federated learning in mobile edge networks: A comprehensive survey","volume":"22","author":"Lim","year":"2020","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_92","first-page":"1035","article-title":"A Survey of Incentive Mechanism Design for Federated Learning","volume":"10","author":"Zhan","year":"2022","journal-title":"IEEE Trans. Emerg. Top. Comput."},{"key":"ref_93","doi-asserted-by":"crossref","first-page":"106775","DOI":"10.1016\/j.knosys.2021.106775","article-title":"A survey on federated learning","volume":"216","author":"Zhang","year":"2021","journal-title":"Knowl.-Based Syst."},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"83562","DOI":"10.1109\/ACCESS.2023.3301162","article-title":"Advancing federated learning through novel mechanism for privacy preservation in healthcare applications","volume":"11","author":"Abaoud","year":"2023","journal-title":"IEEE Access"},{"key":"ref_95","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/MSP.2017.2743240","article-title":"Deep reinforcement learning: A brief survey","volume":"34","author":"Arulkumaran","year":"2017","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_96","first-page":"1057","article-title":"Policy gradient methods for reinforcement learning with function approximation","volume":"12","author":"Sutton","year":"1999","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_97","unstructured":"Mnih, V. (2016). Asynchronous Methods for Deep Reinforcement Learning. arXiv."},{"key":"ref_98","first-page":"6382","article-title":"Multi-agent actor-critic for mixed cooperative-competitive environments","volume":"30","author":"Lowe","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_99","unstructured":"Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2017). Proximal policy optimization algorithms. arXiv."},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"6595","DOI":"10.1109\/TSMC.2024.3384992","article-title":"Human-Guided Deep Reinforcement Learning for Optimal Decision Making of Autonomous Vehicles","volume":"54","author":"Wu","year":"2024","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_101","doi-asserted-by":"crossref","unstructured":"Kim, Y.J., Ahn, W.J., Jang, S.H., Lim, M.T., and Pae, D.S. (2024). A Reinforcement Learning Approach to Dynamic Trajectory Optimization with Consideration of Imbalanced Sub-Goals in Self-Driving Vehicles. Appl. Sci., 14.","DOI":"10.20944\/preprints202405.1085.v1"},{"key":"ref_102","doi-asserted-by":"crossref","first-page":"7812","DOI":"10.1109\/TVT.2024.3360445","article-title":"Decision-making for autonomous vehicles in random task scenarios at unsignalized intersection using deep reinforcement learning","volume":"73","author":"Xiao","year":"2024","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_103","doi-asserted-by":"crossref","unstructured":"Sung, F., Yang, Y., Zhang, L., Xiang, T., Torr, P.H., and Hospedales, T.M. (2018, January 18\u201323). Learning to compare: Relation network for few-shot learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00131"},{"key":"ref_104","first-page":"1","article-title":"Prototypical networks for few-shot learning","volume":"30","author":"Snell","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_105","doi-asserted-by":"crossref","unstructured":"Sun, Q., Liu, Y., Chua, T.S., and Schiele, B. (2019, January 15\u201320). Meta-transfer learning for few-shot learning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00049"},{"key":"ref_106","doi-asserted-by":"crossref","unstructured":"Chen, X., and He, K. (2021, January 20\u201325). Exploring simple siamese representation learning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01549"},{"key":"ref_107","doi-asserted-by":"crossref","first-page":"1444","DOI":"10.1016\/j.procs.2020.03.355","article-title":"Machine learning in computer vision","volume":"167","author":"Khan","year":"2020","journal-title":"Procedia Comput. Sci."},{"key":"ref_108","doi-asserted-by":"crossref","first-page":"27331","DOI":"10.1109\/ACCESS.2024.3367772","article-title":"Application of semi-supervised learning in image classification: Research on fusion of labeled and unlabeled data","volume":"12","author":"Li","year":"2024","journal-title":"IEEE Access"},{"key":"ref_109","doi-asserted-by":"crossref","unstructured":"Mienye, I.D., and Jere, N. (2024). Optimized ensemble learning approach with explainable AI for improved heart disease prediction. Information, 15.","DOI":"10.3390\/info15070394"},{"key":"ref_110","doi-asserted-by":"crossref","unstructured":"Yuvaraj, N., Rajput, K., Suganyadevi, K., Aeri, M., Shukla, R.P., and Gurjar, H. (2024, January 17\u201318). Multi-Scale Object Detection and Classification using Machine Learning and Image Processing. Proceedings of the 2024 Second International Conference on Data Science and Information System (ICDSIS), Hassan, India.","DOI":"10.1109\/ICDSIS61070.2024.10594673"},{"key":"ref_111","doi-asserted-by":"crossref","first-page":"3212","DOI":"10.1109\/TNNLS.2018.2876865","article-title":"Object detection with deep learning: A review","volume":"30","author":"Zhao","year":"2019","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_112","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1186\/s13638-020-01826-x","article-title":"Object detection in real time based on improved single shot multi-box detector algorithm","volume":"2020","author":"Kumar","year":"2020","journal-title":"EURASIP J. Wirel. Commun. Netw."},{"key":"ref_113","doi-asserted-by":"crossref","first-page":"9658350","DOI":"10.1155\/2019\/9658350","article-title":"Content-Based Image Retrieval and Feature Extraction: A Comprehensive Review","volume":"2019","author":"Latif","year":"2019","journal-title":"Math. Probl. Eng."},{"key":"ref_114","doi-asserted-by":"crossref","unstructured":"Wang, Z., Kim, S., and Joe, I. (2023). An Improved LSTM-Based Failure Classification Model for Financial Companies Using Natural Language Processing. Appl. Sci., 13.","DOI":"10.3390\/app13137884"},{"key":"ref_115","unstructured":"Munikoti, S., Stewart, I., Horawalavithana, S., Kvinge, H., Emerson, T., Thompson, S.E., and Pazdernik, K. (2024). Generalist Multimodal AI: A Review of Architectures, Challenges and Opportunities. arXiv."},{"key":"ref_116","first-page":"23716","article-title":"Flamingo: A visual language model for few-shot learning","volume":"35","author":"Alayrac","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_117","unstructured":"Reed, S., Zolna, K., Parisotto, E., Colmenarejo, S.G., Novikov, A., Barth-Maron, G., Gimenez, M., Sulsky, Y., Kay, J., and Springenberg, J.T. (2022). A generalist agent. arXiv."},{"key":"ref_118","doi-asserted-by":"crossref","first-page":"102422","DOI":"10.1016\/j.inffus.2024.102422","article-title":"Automatic speech recognition using advanced deep learning approaches: A survey","volume":"109","author":"Kheddar","year":"2024","journal-title":"Inf. Fusion"},{"key":"ref_119","doi-asserted-by":"crossref","first-page":"15171","DOI":"10.1007\/s11042-022-13943-4","article-title":"A deep learning approaches in text-to-speech system: A systematic review and recent research perspective","volume":"82","author":"Kumar","year":"2023","journal-title":"Multimed. Tools Appl."},{"key":"ref_120","unstructured":"Amodei, D., Ananthanarayanan, S., Anubhai, R., Bai, J., Battenberg, E., Case, C., Casper, J., Catanzaro, B., Cheng, Q., and Chen, G. (2016, January 19\u201324). Deep speech 2: End-to-end speech recognition in english and mandarin. Proceedings of the International Conference on Machine Learning, PMLR, New York City, NY, USA."},{"key":"ref_121","doi-asserted-by":"crossref","first-page":"2002","DOI":"10.3390\/biomedinformatics4030109","article-title":"Optimizing Lung Condition Categorization through a Deep Learning Approach to Chest X-ray Image Analysis","volume":"4","author":"Sanida","year":"2024","journal-title":"BioMedInformatics"},{"key":"ref_122","doi-asserted-by":"crossref","unstructured":"Manole, I., Butacu, A.I., Bejan, R.N., and Tiplica, G.S. (2024). Enhancing Dermatological Diagnostics with EfficientNet: A Deep Learning Approach. Bioengineering, 11.","DOI":"10.20944\/preprints202407.1322.v1"},{"key":"ref_123","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1038\/s41586-019-1799-6","article-title":"International evaluation of an AI system for breast cancer screening","volume":"577","author":"McKinney","year":"2020","journal-title":"Nature"},{"key":"ref_124","doi-asserted-by":"crossref","first-page":"124780","DOI":"10.1016\/j.eswa.2024.124780","article-title":"Alzheimer\u2019s disease diagnosis from single and multimodal data using machine and deep learning models: Achievements and future directions","volume":"255","author":"Elazab","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref_125","doi-asserted-by":"crossref","first-page":"2588","DOI":"10.1016\/j.acra.2023.02.019","article-title":"A novel artificial intelligence based denoising method for ultra-low dose CT used for lung cancer screening","volume":"30","author":"Gorenstein","year":"2023","journal-title":"Acad. Radiol."},{"key":"ref_126","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1038\/s41586-020-2145-8","article-title":"Video-based AI for beat-to-beat assessment of cardiac function","volume":"580","author":"Ouyang","year":"2020","journal-title":"Nature"},{"key":"ref_127","unstructured":"Liu, X., and Wang, Z. (2024). Deep learning in medical image classification from mri-based brain tumor images. arXiv."},{"key":"ref_128","doi-asserted-by":"crossref","unstructured":"Zhou, L., Wang, M., and Zhou, N. (2024). Distributed federated learning-based deep learning model for privacy mri brain tumor detection. arXiv.","DOI":"10.62836\/jitp.2023.158"},{"key":"ref_129","doi-asserted-by":"crossref","unstructured":"Hroub, N.A., Alsannaa, A.N., Alowaifeer, M., Alfarraj, M., and Okafor, E. (2024). Explainable deep learning diagnostic system for prediction of lung disease from medical images. Comput. Biol. Med., 170.","DOI":"10.1016\/j.compbiomed.2024.108012"},{"key":"ref_130","doi-asserted-by":"crossref","first-page":"15957","DOI":"10.48084\/etasr.8080","article-title":"An Efficient Optimization System for Early Breast Cancer Diagnosis based on Internet of Medical Things and Deep Learning","volume":"14","author":"Naz","year":"2024","journal-title":"Eng. Technol. Appl. Sci. Res."},{"key":"ref_131","doi-asserted-by":"crossref","first-page":"706","DOI":"10.1038\/s41586-019-1923-7","article-title":"Improved protein structure prediction using potentials from deep learning","volume":"577","author":"Senior","year":"2020","journal-title":"Nature"},{"key":"ref_132","doi-asserted-by":"crossref","first-page":"1196","DOI":"10.1038\/s41592-021-01252-x","article-title":"Effective gene expression prediction from sequence by integrating long-range interactions","volume":"18","author":"Avsec","year":"2021","journal-title":"Nat. Methods"},{"key":"ref_133","doi-asserted-by":"crossref","first-page":"4348","DOI":"10.1038\/s41467-022-32007-7","article-title":"ProtGPT2 is a deep unsupervised language model for protein design","volume":"13","author":"Ferruz","year":"2022","journal-title":"Nat. Commun."},{"key":"ref_134","doi-asserted-by":"crossref","unstructured":"Alamdari, S., Thakkar, N., van den Berg, R., Lu, A.X., Fusi, N., Amini, A.P., and Yang, K.K. (2023). Protein generation with evolutionary diffusion: Sequence is all you need. BioRxiv, 1\u201362.","DOI":"10.1101\/2023.09.11.556673"},{"key":"ref_135","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1016\/j.cell.2020.01.021","article-title":"A deep learning approach to antibiotic discovery","volume":"180","author":"Stokes","year":"2020","journal-title":"Cell"},{"key":"ref_136","doi-asserted-by":"crossref","first-page":"015022","DOI":"10.1088\/2632-2153\/ac3ffb","article-title":"Chemformer: A pre-trained transformer for computational chemistry","volume":"3","author":"Irwin","year":"2022","journal-title":"Mach. Learn. Sci. Technol."},{"key":"ref_137","doi-asserted-by":"crossref","first-page":"1160","DOI":"10.1002\/jcc.27315","article-title":"Advances in machine learning with chemical language models in molecular property and reaction outcome predictions","volume":"45","author":"Das","year":"2024","journal-title":"J. Comput. Chem."},{"key":"ref_138","doi-asserted-by":"crossref","first-page":"e39038","DOI":"10.1016\/j.heliyon.2024.e39038","article-title":"Transformer-Based Models For Chemical SMILES Representation: A Comprehensive Literature Review","volume":"10","author":"Mswahili","year":"2024","journal-title":"Heliyon"},{"key":"ref_139","doi-asserted-by":"crossref","first-page":"6259","DOI":"10.1021\/acs.jcim.4c00747","article-title":"Transformers for molecular property prediction: Lessons learned from the past five years","volume":"64","author":"Sultan","year":"2024","journal-title":"J. Chem. Inf. Model."},{"key":"ref_140","doi-asserted-by":"crossref","first-page":"4475","DOI":"10.1039\/C9SC05704H","article-title":"Predicting retrosynthetic pathways using transformer-based models and a hyper-graph exploration strategy","volume":"11","author":"Schwaller","year":"2020","journal-title":"Chem. Sci."},{"key":"ref_141","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1016\/j.ccell.2020.09.014","article-title":"Predicting drug response and synergy using a deep learning model of human cancer cells","volume":"38","author":"Kuenzi","year":"2020","journal-title":"Cancer Cell"},{"key":"ref_142","doi-asserted-by":"crossref","unstructured":"Li, K., Shen, B., Feng, F., Li, X., Wang, Y., Feng, N., Tang, Z., Ma, L., and Li, H. (2024). A disentangled generative model for improved drug response prediction in patients via sample synthesis. J. Pharm. Anal., 101128.","DOI":"10.1016\/j.jpha.2024.101128"},{"key":"ref_143","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1038\/s41586-021-03819-2","article-title":"Highly accurate protein structure prediction with AlphaFold","volume":"596","author":"Jumper","year":"2021","journal-title":"Nature"},{"key":"ref_144","doi-asserted-by":"crossref","first-page":"1853","DOI":"10.1038\/s41467-024-46089-y","article-title":"Drug target prediction through deep learning functional representation of gene signatures","volume":"15","author":"Chen","year":"2024","journal-title":"Nat. Commun."},{"key":"ref_145","doi-asserted-by":"crossref","unstructured":"Sivasubramaniam, S., and Balamurugan, S. (2024). Early detection and prediction of Heart Disease using Wearable devices and Deep Learning algorithms. Multimed. Tools Appl., 1\u201315.","DOI":"10.1007\/s11042-024-19127-6"},{"key":"ref_146","doi-asserted-by":"crossref","first-page":"25616","DOI":"10.1007\/s11227-024-06424-y","article-title":"Attention-based multilayer GRU decoder for on-site glucose prediction on smartphone","volume":"80","author":"Koca","year":"2024","journal-title":"J. Supercomput."},{"key":"ref_147","doi-asserted-by":"crossref","unstructured":"Davidashvilly, S., Cardei, M., Hssayeni, M., Chi, C., and Ghoraani, B. (2024). Deep neural networks for wearable sensor-based activity recognition in Parkinson\u2019s disease: Investigating generalizability and model complexity. BioMedical Eng. OnLine, 23.","DOI":"10.1186\/s12938-024-01214-2"},{"key":"ref_148","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s11571-022-09904-0","article-title":"Artificial intelligence assisted tools for the detection of anxiety and depression leading to suicidal ideation in adolescents: A review","volume":"18","author":"Barua","year":"2024","journal-title":"Cogn. Neurodyn."},{"key":"ref_149","doi-asserted-by":"crossref","unstructured":"Iqbal, T., Simpkin, A.J., Roshan, D., Glynn, N., Killilea, J., Walsh, J., Molloy, G., Ganly, S., Ryman, H., and Coen, E. (2022). Stress monitoring using wearable sensors: A pilot study and stress-predict dataset. Sensors, 22.","DOI":"10.3390\/s22218135"},{"key":"ref_150","doi-asserted-by":"crossref","unstructured":"Ahmed, A.A., Ali, W., Abdullah, T.A., and Malebary, S.J. (2023). Classifying cardiac arrhythmia from ECG signal using 1D CNN deep learning model. Mathematics, 11.","DOI":"10.3390\/math11030562"},{"key":"ref_151","doi-asserted-by":"crossref","unstructured":"Baseer, K., Sivakumar, K., Veeraiah, D., Chhabra, G., Lakineni, P.K., Pasha, M.J., Gandikota, R., and Harikrishnan, G. (2024). Healthcare diagnostics with an adaptive deep learning model integrated with the Internet of medical Things (IoMT) for predicting heart disease. Biomed. Signal Process. Control, 92.","DOI":"10.1016\/j.bspc.2024.105988"},{"key":"ref_152","doi-asserted-by":"crossref","unstructured":"Gaber, A., Abdeltwab, H., and Elbatt, T. (2024, January 26\u201328). FedCVD: Towards a Scalable, Privacy-Preserving Federated Learning Model for Cardiovascular Diseases Prediction. Proceedings of the 2024 8th International Conference on Machine Learning and Soft Computing, Singapore.","DOI":"10.1145\/3647750.3647752"},{"key":"ref_153","doi-asserted-by":"crossref","first-page":"27462","DOI":"10.1109\/ACCESS.2023.3257562","article-title":"A transfer learning approach to breast cancer classification in a federated learning framework","volume":"11","author":"Tan","year":"2023","journal-title":"IEEe Access"},{"key":"ref_154","doi-asserted-by":"crossref","unstructured":"Siganporia, A., Varia, M., Gorimar, U., and Nanade, A. (2023, January 1\u20133). Privacy-Enhanced Federated Learning for Rare Genetic Disorder Classification with EHR. Proceedings of the 2023 Global Conference on Information Technologies and Communications (GCITC), Bengaluru, India.","DOI":"10.1109\/GCITC60406.2023.10426518"},{"key":"ref_155","doi-asserted-by":"crossref","first-page":"684","DOI":"10.1109\/JBHI.2022.3171852","article-title":"Federated learning for privacy preservation of healthcare data from smartphone-based side-channel attacks","volume":"27","author":"Rehman","year":"2022","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_156","doi-asserted-by":"crossref","unstructured":"Saidi, R., Rahmany, I., Dhahri, S., and Moulahi, T. (2024). A Privacy-Enhanced Framework for Chest Disease Classification using Federated Learning and Blockchain. IEEE Access.","DOI":"10.1109\/ACCESS.2024.3419084"},{"key":"ref_157","first-page":"675","article-title":"Deep learning in algorithmic trading: A study on S&P 500 index future forecasting","volume":"39","author":"Zhang","year":"2020","journal-title":"J. Forecast."},{"key":"ref_158","doi-asserted-by":"crossref","unstructured":"Song, H., and Choi, H. (2023). Forecasting stock market indices using the recurrent neural network based hybrid models: CNN-LSTM, GRU-CNN, and ensemble models. Appl. Sci., 13.","DOI":"10.3390\/app13074644"},{"key":"ref_159","doi-asserted-by":"crossref","first-page":"114632","DOI":"10.1016\/j.eswa.2021.114632","article-title":"An application of deep reinforcement learning to algorithmic trading","volume":"173","author":"Ernst","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_160","doi-asserted-by":"crossref","first-page":"121245","DOI":"10.1016\/j.eswa.2023.121245","article-title":"Algorithmic trading using continuous action space deep reinforcement learning","volume":"235","author":"Majidi","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref_161","doi-asserted-by":"crossref","first-page":"6589","DOI":"10.1007\/s00521-022-08011-9","article-title":"Multi-agent deep reinforcement learning algorithm with trend consistency regularization for portfolio management","volume":"35","author":"Ma","year":"2023","journal-title":"Neural Comput. Appl."},{"key":"ref_162","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1080\/14697688.2023.2299466","article-title":"Fin-gan: Forecasting and classifying financial time series via generative adversarial networks","volume":"24","author":"Prenzel","year":"2024","journal-title":"Quant. Financ."},{"key":"ref_163","doi-asserted-by":"crossref","unstructured":"Gambo, M.L., Zainal, A., and Kassim, M.N. (2022, January 6\u20137). A convolutional neural network model for credit card fraud detection. Proceedings of the 2022 International Conference on Data Science and Its Applications (ICoDSA), Bandung, Indonesia.","DOI":"10.1109\/ICoDSA55874.2022.9862930"},{"key":"ref_164","doi-asserted-by":"crossref","unstructured":"Hiremath, A.C., Arya, A., Sriranga, L., Reddy, K.V.S.R., and Nikhil, M. (2024, January 5\u20137). Ensemble of Graph Neural Networks for Enhanced Financial Fraud Detection. Proceedings of the 2024 IEEE 9th International Conference for Convergence in Technology (I2CT), Pune, India.","DOI":"10.1109\/I2CT61223.2024.10543898"},{"key":"ref_165","doi-asserted-by":"crossref","unstructured":"Dang, T.K., Tran, T.C., Tuan, L.M., and Tiep, M.V. (2021). Machine learning based on resampling approaches and deep reinforcement learning for credit card fraud detection systems. Appl. Sci., 11.","DOI":"10.3390\/app112110004"},{"key":"ref_166","doi-asserted-by":"crossref","unstructured":"Yu, C., Xu, Y., Cao, J., Zhang, Y., Jin, Y., and Zhu, M. (2024). Credit card fraud detection using advanced transformer model. arXiv.","DOI":"10.1109\/MetaCom62920.2024.00064"},{"key":"ref_167","doi-asserted-by":"crossref","unstructured":"Yang, X., Zhang, C., Sun, Y., Pang, K., Jing, L., Wa, S., and Lv, C. (2023). FinChain-BERT: A High-Accuracy Automatic Fraud Detection Model Based on NLP Methods for Financial Scenarios. Information, 14.","DOI":"10.3390\/info14090499"},{"key":"ref_168","doi-asserted-by":"crossref","first-page":"30628","DOI":"10.1109\/ACCESS.2023.3262020","article-title":"A deep learning ensemble with data resampling for credit card fraud detection","volume":"11","author":"Mienye","year":"2023","journal-title":"IEEE Access"},{"key":"ref_169","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1080\/01605682.2021.1880296","article-title":"Generative adversarial networks for data augmentation and transfer in credit card fraud detection","volume":"73","author":"Langevin","year":"2022","journal-title":"J. Oper. Res. Soc."},{"key":"ref_170","doi-asserted-by":"crossref","first-page":"118354","DOI":"10.1016\/j.eswa.2022.118354","article-title":"Model interpretability of financial fraud detection by group SHAP","volume":"210","author":"Lin","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"ref_171","doi-asserted-by":"crossref","unstructured":"Mer\u0107ep, A., Mr\u010dela, L., Birov, M., and Kostanj\u010dar, Z. (2020). Deep neural networks for behavioral credit rating. Entropy, 23.","DOI":"10.3390\/e23010027"},{"key":"ref_172","doi-asserted-by":"crossref","unstructured":"Feng, B., Xu, H., Xue, W., and Xue, B. (2022, January 4\u20137). Every corporation owns its structure: Corporate credit rating via graph neural networks. Proceedings of the Chinese Conference on Pattern Recognition and Computer Vision (PRCV), Shenzhen, China.","DOI":"10.1007\/978-3-031-18907-4_53"},{"key":"ref_173","first-page":"1","article-title":"Credit Card Fraud Detection via Intelligent Sampling and Self-supervised Learning","volume":"15","author":"Chen","year":"2024","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_174","doi-asserted-by":"crossref","first-page":"105740","DOI":"10.1016\/j.asoc.2019.105740","article-title":"Application of new deep genetic cascade ensemble of SVM classifiers to predict the Australian credit scoring","volume":"84","author":"Abdar","year":"2019","journal-title":"Appl. Soft Comput."},{"key":"ref_175","doi-asserted-by":"crossref","first-page":"1341","DOI":"10.1109\/TITS.2020.2972974","article-title":"Deep multi-modal object detection and semantic segmentation for autonomous driving: Datasets, methods, and challenges","volume":"22","author":"Feng","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_176","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1007\/s11760-022-02222-2","article-title":"End-to-end deep learning of lane detection and path prediction for real-time autonomous driving","volume":"17","author":"Lee","year":"2023","journal-title":"Signal Image Video Process."},{"key":"ref_177","doi-asserted-by":"crossref","first-page":"2290","DOI":"10.1109\/TIV.2023.3298292","article-title":"Multi-agent deep reinforcement learning for UAVs navigation in unknown complex environment","volume":"9","author":"Xue","year":"2023","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_178","first-page":"12","article-title":"Scalable perception-action-communication loops with convolutional and graph neural networks","volume":"8","author":"Hu","year":"2021","journal-title":"IEEE Trans. Signal Inf. Process. Netw."},{"key":"ref_179","doi-asserted-by":"crossref","unstructured":"Han, D., Mulyana, B., Stankovic, V., and Cheng, S. (2023). A survey on deep reinforcement learning algorithms for robotic manipulation. Sensors, 23.","DOI":"10.3390\/s23073762"},{"key":"ref_180","doi-asserted-by":"crossref","unstructured":"Xu, D., Fan, H., Deng, J., Wei, H., Xu, P., and Zhang, Y. (2024). Virtual Muscle-Model-Modified Reinforcement Learning for Tilt Motion Control of a Novel Magnetic Actuated Flexible-Joint Robotic Surgical Camera System. IEEE\/ASME Trans. Mechatron.","DOI":"10.1109\/TMECH.2024.3444919"},{"key":"ref_181","doi-asserted-by":"crossref","first-page":"905","DOI":"10.1109\/JOE.2024.3350746","article-title":"Sonar image generation by MFA-CycleGAN for boosting underwater object detection of AUVs","volume":"49","author":"Zhou","year":"2024","journal-title":"IEEE J. Ocean. Eng."},{"key":"ref_182","doi-asserted-by":"crossref","unstructured":"Zheng, Y.Y., Kong, J.L., Jin, X.B., Wang, X.Y., Su, T.L., and Zuo, M. (2019). CropDeep: The Crop Vision Dataset for Deep-Learning-Based Classification and Detection in Precision Agriculture. Sensors, 19.","DOI":"10.3390\/s19051058"},{"key":"ref_183","doi-asserted-by":"crossref","first-page":"101710","DOI":"10.1016\/j.aei.2022.101710","article-title":"Digital twin-driven deep reinforcement learning for adaptive task allocation in robotic construction","volume":"53","author":"Lee","year":"2022","journal-title":"Adv. Eng. Inform."},{"key":"ref_184","doi-asserted-by":"crossref","first-page":"102429","DOI":"10.1016\/j.inffus.2024.102429","article-title":"Fusion-driven deep feature network for enhanced object detection and tracking in video surveillance systems","volume":"109","author":"Jain","year":"2024","journal-title":"Inf. Fusion"},{"key":"ref_185","doi-asserted-by":"crossref","first-page":"112067","DOI":"10.1016\/j.ecolind.2024.112067","article-title":"Deep artificial intelligence applications for natural disaster management systems: A methodological review","volume":"163","author":"Akhyar","year":"2024","journal-title":"Ecol. Indic."},{"key":"ref_186","doi-asserted-by":"crossref","first-page":"012024","DOI":"10.1088\/1742-6596\/2507\/1\/012024","article-title":"Predictive maintenance of wind turbine\u2019s main bearing using wind farm SCADA data and LSTM neural networks","volume":"2507","author":"Vidal","year":"2023","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_187","doi-asserted-by":"crossref","first-page":"122012","DOI":"10.1016\/j.eswa.2023.122012","article-title":"A hybrid model for deep learning short-term power load forecasting based on feature extraction statistics techniques","volume":"238","author":"Fan","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref_188","doi-asserted-by":"crossref","first-page":"2751","DOI":"10.1109\/JIOT.2019.2957289","article-title":"Deep Reinforcement Learning for Smart Home Energy Management","volume":"7","author":"Yu","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_189","doi-asserted-by":"crossref","unstructured":"Al-Ali, E.M., Hajji, Y., Said, Y., Hleili, M., Alanzi, A.M., Laatar, A.H., and Atri, M. (2023). Solar Energy Production Forecasting Based on a Hybrid CNN-LSTM-Transformer Model. Mathematics, 11.","DOI":"10.3390\/math11030676"},{"key":"ref_190","doi-asserted-by":"crossref","first-page":"102868","DOI":"10.1016\/j.est.2021.102868","article-title":"Deep-learning- and reinforcement-learning-based profitable strategy of a grid-level energy storage system for the smart grid","volume":"41","author":"Han","year":"2021","journal-title":"J. Energy Storage"},{"key":"ref_191","doi-asserted-by":"crossref","first-page":"110069","DOI":"10.1016\/j.ijepes.2024.110069","article-title":"Development of a real-time fault detection method for electric power system via transformer-based deep learning model","volume":"159","author":"Yoon","year":"2024","journal-title":"Int. J. Electr. Power Energy Syst."},{"key":"ref_192","doi-asserted-by":"crossref","unstructured":"Elsisi, M., Tran, M.Q., Mahmoud, K., Lehtonen, M., and Darwish, M.M.F. (2021). Deep Learning-Based Industry 4.0 and Internet of Things towards Effective Energy Management for Smart Buildings. Sensors, 21.","DOI":"10.3390\/s21041038"},{"key":"ref_193","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.compag.2018.02.016","article-title":"Deep Learning in Agriculture: A Survey","volume":"147","author":"Kamilaris","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_194","doi-asserted-by":"crossref","unstructured":"Gastli, M.S., Nassar, L., and Karray, F. (2021, January 18\u201322). Satellite Images and Deep Learning Tools for Crop Yield Prediction and Price Forecasting. Proceedings of the 2021 International Joint Conference on Neural Networks (IJCNN), Virtual.","DOI":"10.1109\/IJCNN52387.2021.9534388"},{"key":"ref_195","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1016\/j.compag.2018.01.009","article-title":"Deep Learning Models for Plant Disease Detection and Diagnosis","volume":"145","author":"Ferentinos","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_196","doi-asserted-by":"crossref","unstructured":"Sami, M., Khan, S.Q., Khurram, M., Farooq, M.U., Anjum, R., Aziz, S., Qureshi, R., and Sadak, F. (2022). A Deep Learning-Based Sensor Modeling for Smart Irrigation System. Agronomy, 12.","DOI":"10.3390\/agronomy12010212"},{"key":"ref_197","doi-asserted-by":"crossref","first-page":"100483","DOI":"10.1016\/j.atech.2024.100483","article-title":"Enhancing precision agriculture: A comprehensive review of machine learning and AI vision applications in all-terrain vehicle for farm automation","volume":"8","author":"Padhiary","year":"2024","journal-title":"Smart Agric. Technol."},{"key":"ref_198","doi-asserted-by":"crossref","first-page":"109199","DOI":"10.1016\/j.compag.2024.109199","article-title":"Multiple orange detection and tracking with 3-D fruit relocalization and neural-net based yield regression in commercial sweet orange orchards","volume":"224","author":"Santos","year":"2024","journal-title":"Comput. Electron. Agric."},{"key":"ref_199","doi-asserted-by":"crossref","unstructured":"Pavlovic, M., Ilic, S., Ralevic, N., Antonic, N., Raffa, D.W., Bandecchi, M., and Culibrk, D. (2024). A Deep Learning Approach to Estimate Soil Organic Carbon from Remote Sensing. Remote Sens., 16.","DOI":"10.3390\/rs16040655"},{"key":"ref_200","doi-asserted-by":"crossref","unstructured":"Mckay, M., Danilevicz, M.F., Ashworth, M.B., Rocha, R.L., Upadhyaya, S.R., Bennamoun, M., and Edwards, D. (2024). Focus on the Crop Not the Weed: Canola Identification for Precision Weed Management Using Deep Learning. Remote Sens., 16.","DOI":"10.3390\/rs16112041"},{"key":"ref_201","doi-asserted-by":"crossref","first-page":"111009","DOI":"10.1016\/j.asoc.2023.111009","article-title":"Auction-based deep learning-driven smart agricultural supply chain mechanism","volume":"149","author":"Feng","year":"2023","journal-title":"Appl. Soft Comput."},{"key":"ref_202","doi-asserted-by":"crossref","unstructured":"Li, Y., Xiang, Y., Guo, H., Liu, P., and Liu, C. (2022). Swin transformer combined with convolution neural network for surface defect detection. Machines, 10.","DOI":"10.3390\/machines10111083"},{"key":"ref_203","doi-asserted-by":"crossref","unstructured":"Li, S., Wu, C., and Xiong, N. (2022). Hybrid architecture based on CNN and transformer for strip steel surface defect classification. Electronics, 11.","DOI":"10.3390\/electronics11081200"},{"key":"ref_204","doi-asserted-by":"crossref","first-page":"132188","DOI":"10.1109\/ACCESS.2020.3010066","article-title":"Attention-based LSTM network for rotatory machine remaining useful life prediction","volume":"8","author":"Zhang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_205","doi-asserted-by":"crossref","first-page":"102624","DOI":"10.1016\/j.rcim.2023.102624","article-title":"ACWGAN-GP for milling tool breakage monitoring with imbalanced data","volume":"85","author":"Li","year":"2024","journal-title":"Robot. Comput.-Integr. Manuf."},{"key":"ref_206","doi-asserted-by":"crossref","first-page":"122545","DOI":"10.1016\/j.eswa.2023.122545","article-title":"Intelligent fault diagnosis for air handing units based on improved generative adversarial network and deep reinforcement learning","volume":"240","author":"Yan","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref_207","doi-asserted-by":"crossref","first-page":"69217","DOI":"10.1109\/ACCESS.2024.3400970","article-title":"Anomaly Detection in Smart Industrial Machinery through Hidden Markov Models and Autoencoders","volume":"12","author":"Sorostinean","year":"2024","journal-title":"IEEE Access"},{"key":"ref_208","doi-asserted-by":"crossref","unstructured":"Mienye, I.D., Swart, T.G., and Obaido, G. (2024, January 7\u20139). Fairness Metrics in AI Healthcare Applications: A Review. Proceedings of the 2024 IEEE International Conference on Information Reuse and Integration for Data Science (IRI), San Jose, CA, USA.","DOI":"10.1109\/IRI62200.2024.00065"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/15\/12\/755\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:40:41Z","timestamp":1760114441000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/15\/12\/755"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,27]]},"references-count":208,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["info15120755"],"URL":"https:\/\/doi.org\/10.3390\/info15120755","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,27]]}}}