{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T02:29:44Z","timestamp":1783045784634,"version":"3.54.6"},"reference-count":45,"publisher":"Walter de Gruyter GmbH","issue":"2","license":[{"start":{"date-parts":[[2025,2,5]],"date-time":"2025-02-05T00:00:00Z","timestamp":1738713600000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>This paper introduces a significant advancement in neural network training algorithms through the development of a Fast Scaled Givens rotations in QR decomposition (FSGQR) method based on the recursive least squares (RLS) method. The algorithm represents an optimized variant of existing rotation-based training approaches, distinguished by its complete elimination of scale factors from calculations while maintaining mathematical precision. Through extensive experimentation across multiple benchmarks, including complex tasks like the MNIST digit recognition and concrete strength prediction, FSGQR demonstrates superior performance compared to the widely-used ADAM optimizer and other conventional training methods. The algorithm achieves faster convergence with fewer training epochs while maintaining or improving accuracy.In some tasks, FSGQR completed training in up to five times fewer epochs compared to the ADAM algorithm, while it achieved higher recognition accuracy in the MNIST training set. The paper provides comprehensive mathematical foundations for the optimization, detailed implementation guidelines, and extensive empirical validation across various neural network architectures. The results conclusively demonstrate that FSGQR offers a compelling alternative to current deep learning optimization methods, particularly for applications requiring rapid training convergence without sacrificing accuracy. The algorithm\u2019s effectiveness is particularly noteworthy in feedforward neural networks with differentiable activation functions, making it a valuable tool for modern machine learning applications.<\/jats:p>","DOI":"10.2478\/jaiscr-2025-0006","type":"journal-article","created":{"date-parts":[[2025,2,5]],"date-time":"2025-02-05T18:38:28Z","timestamp":1738780708000},"page":"95-113","source":"Crossref","is-referenced-by-count":7,"title":["Accelerating Neural Network Training with FSGQR: A Scalable and High-Performance Alternative to Adam"],"prefix":"10.2478","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1769-3934","authenticated-orcid":false,"given":"Jaros\u0142aw","family":"Bilski","sequence":"first","affiliation":[{"name":"Department of Artificial Intelligence , Cz\u0119stochowa University of Technology , al. Armii Krajowej 36 , Cz\u0119stochowa , Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7683-9051","authenticated-orcid":false,"given":"Bartosz","family":"Kowalczyk","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence , Cz\u0119stochowa University of Technology , al. Armii Krajowej 36 , Cz\u0119stochowa , Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5387-9990","authenticated-orcid":false,"given":"Ludmila","family":"Dymova","sequence":"additional","affiliation":[{"name":"Information Technology Institute , SAN University , , \u0141\u00f3d\u017a , Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8992-153X","authenticated-orcid":false,"given":"Min","family":"Xiao","sequence":"additional","affiliation":[{"name":"College of Automation & College of Artificial Intelligence Nanjing University of Posts and Telecommunications Nanjing , China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"374","published-online":{"date-parts":[[2025,2,5]]},"reference":[{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_001","doi-asserted-by":"crossref","unstructured":"Oveis Abedinia, Nima Amjady, and Noradin Ghadimi. Solar energy forecasting based on hybrid neural network and improved meta-heuristic algorithm. Computational Intelligence, 34(1):241\u2013260, 2018.","DOI":"10.1111\/coin.12145"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_002","doi-asserted-by":"crossref","unstructured":"U. Rajendra Acharya, Shu Lih Oh, Yuki Hagiwara, Jen Hong Tan, and Hojjat Adeli. Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals. Computers in Biology and Medicine, 100:270\u2013278, 2018.","DOI":"10.1016\/j.compbiomed.2017.09.017"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_003","doi-asserted-by":"crossref","unstructured":"Igor Aizenberg, Dmitriy V. Paliy, Jacek M. Zurada, and Jaakko T. Astola. Blur identification by multilayer neural network based on multi-valued neurons. IEEE Transactions on Neural Networks, 19(5):883\u2013898, 2008.","DOI":"10.1109\/TNN.2007.914158"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_004","doi-asserted-by":"crossref","unstructured":"E. Angelini, G. di Tollo, and A. Roli. A neural network approach for credit risk evaluation. The Quarterly Review of Economics and Finance, 48(4):733\u2013755, 2008.","DOI":"10.1016\/j.qref.2007.04.001"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_005","unstructured":"Jaros\u0142aw Bilski. Struktury r\u00f3wnoleg\u0142e dla jednokierunkowych i dynamicznych sieci neuronowych. Akademicka Oficyna Wydawnicza EXIT, 2013."},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_006","doi-asserted-by":"crossref","unstructured":"Jaros\u0142aw Bilski and Alexander I. Galushkin. A new proposition of the activation function for significant improvement of neural networks performance. In Artificial Intelligence and Soft Computing, volume 9602 of Lecture Notes in Computer Science, pages 35\u201345. Springer-Verlag Berlin Heidelberg, 2016.","DOI":"10.1007\/978-3-319-39378-0_4"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_007","doi-asserted-by":"crossref","unstructured":"Jaros\u0142aw Bilski and Leszek Rutkowski. A fast training algorithm for neural networks. IEEE Transaction on Circuits and Systems Part II, 45(6):749\u2013753, 1998.","DOI":"10.1109\/82.686696"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_008","doi-asserted-by":"crossref","unstructured":"Jaros\u0142aw Bilski and Jacek Smol\u0105g. Parallel realisation of the recurrent multi layer perceptron learning. Artificial Intelligence and Soft Computing, Springer-Verlag Berlin Heidelberg, (LNAI 7267):12\u201320, 2012.","DOI":"10.1007\/978-3-642-29347-4_2"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_009","doi-asserted-by":"crossref","unstructured":"Jaros\u0142aw Bilski and Jacek Smol\u0105g. Parallel approach to learning of the recurrent Jordan neural network. Artificial Intelligence and Soft Computing, Springer-Verlag Berlin Heidelberg, (LNAI 7895):32\u201340, 2013.","DOI":"10.1007\/978-3-642-38658-9_3"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_010","doi-asserted-by":"crossref","unstructured":"Jaros\u0142aw Bilski and Jacek Smol\u0105g. Parallel architectures for learning the RTRN and Elman dynamic neural network. IEEE Transactions on Parallel and Distributed Systems, 26(9):2561\u20132570, 2015.","DOI":"10.1109\/TPDS.2014.2357019"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_011","doi-asserted-by":"crossref","unstructured":"Jaros\u0142aw Bilski, Jacek Smol\u0105g, and Alexander I. Galushkin. The parallel approach to the conjugate gradient learning algorithm for the feed-forward neural networks. In Artificial Intelligence and Soft Computing, volume 8467 of Lecture Notes in Computer Science, pages 12\u201321. Springer-Verlag Berlin Heidelberg, 2014.","DOI":"10.1007\/978-3-319-07173-2_2"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_012","doi-asserted-by":"crossref","unstructured":"Jaros\u0142aw Bilski, Jacek Smol\u0105g, and Jacek M. Zurada. Parallel approach to the Levenberg-Marquardt learning algorithm for feedforward neural networks. In Artificial Intelligence and Soft Computing, volume 9119 of Lecture Notes in Computer Science, pages 3\u201314. Springer-Verlag Berlin Heidelberg, 2015.","DOI":"10.1007\/978-3-319-19324-3_1"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_013","doi-asserted-by":"crossref","unstructured":"Jaros\u0142aw Bilski, Bartosz Kowalczyk, and Andrzej Cader. Modifications of the Givens training algorithm for artificial neural networks. In Leszek Rutkowski, Rafa\u0142 Scherer, Marcin Korytkowski, Witold Pedrycz, Ryszard Tadeusiewicz, and Jacek M. Zurada, editors, Artificial Intelligence and Soft Computing, pages 14\u201328, Cham, 2019. Springer International Publishing.","DOI":"10.1007\/978-3-030-20912-4_2"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_014","doi-asserted-by":"crossref","unstructured":"Jaros\u0142aw Bilski, Bartosz Kowalczyk, Marek Kisiel-Dorohinicki, Agnieszka Siwocha, and Jacek \u017burada. Towards a very fast feedforward multilayer neural networks training algorithm. Journal of Artificial Intelligence and Soft Computing Research, 12(3):181\u2013195, 2022.","DOI":"10.2478\/jaiscr-2022-0012"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_015","doi-asserted-by":"crossref","unstructured":"Jaros\u0142aw Bilski, Bartosz Kowalczyk, Andrzej Marja\u0144ski, Micha\u0142 Gandor, and Jacek Zurada. A novel fast feedforward neural networks training algorithm. Journal of Artificial Intelligence and Soft Computing Research, 11(4):287\u2013306, 2021.","DOI":"10.2478\/jaiscr-2021-0017"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_016","doi-asserted-by":"crossref","unstructured":"Jaros\u0142aw Bilski, Jacek Smol\u0105g, Bartosz Kowalczyk, Konrad Grzanek, and Ivan Izonin. Fast computational approach to the Levenberg-Marquardt algorithm for training feedforward neural networks. Journal of Artificial Intelligence and Soft Computing Research, 12(2):45\u201361, 2023.","DOI":"10.2478\/jaiscr-2023-0006"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_017","doi-asserted-by":"crossref","unstructured":"W. Duch, K. Swaminathan, and J. Meller. Artificial intelligence approaches for rational drug design and discovery. Current Pharmaceutical Design, 13(14):1497\u20131508, 2007.","DOI":"10.2174\/138161207780765954"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_018","unstructured":"John Duchi, Elad Hazan, and Yoram Singer. Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research, 12:2121\u20132159, 07 2011."},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_019","doi-asserted-by":"crossref","unstructured":"Marcin Gabryel, Eliza Koci\u0107, Milan Koci\u0107, Zofia Patora-Wysocka, Min Xiao, and Miros\u0142aw Pawlak. Accelerating user profiling in e-commerce using conditional GAN networks for synthetic data generation. Journal of Artificial Intelligence and Soft Computing Research, 14(4):309\u2013319, 2024.","DOI":"10.2478\/jaiscr-2024-0017"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_020","doi-asserted-by":"crossref","unstructured":"Morven W. Gentleman. Least Squares Computations by Givens Transformations Without Square Roots. IMA Journal of Applied Mathematics, 12(3):329\u2013336, 12 1973.","DOI":"10.1093\/imamat\/12.3.329"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_021","doi-asserted-by":"crossref","unstructured":"Ghosh and Reilly. Credit card fraud detection with a neural-network. In 1994 Proceedings of the Twenty-Seventh Hawaii International Conference on System Sciences, volume 3, pages 621\u2013630, Jan 1994.","DOI":"10.1109\/HICSS.1994.323314"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_022","doi-asserted-by":"crossref","unstructured":"Wallace Givens. Computation of plain unitary rotations transforming a general matrix to triangular form. Journal of The Society for Industrial and Applied Mathematics, 6:26\u201350, 1958.","DOI":"10.1137\/0106004"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_023","doi-asserted-by":"crossref","unstructured":"J. Gu, Z. Wang, J. Kuen, L. Ma, A. Shahroudy, B. Shuai, T. Liu, X. Wang, G. Wang, J. Cai, and T. Chen. Recent advances in convolutional neural networks. Pattern Recognition, 77:354\u2013377, 2018.","DOI":"10.1016\/j.patcog.2017.10.013"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_024","doi-asserted-by":"crossref","unstructured":"Martin T. Hagan and Mohammad B. Menhaj. Training feedforward networks with the Marquardt algorithm. IEEE Transactions on Neuralnetworks, 5:989\u2013993, 1994.","DOI":"10.1109\/72.329697"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_025","doi-asserted-by":"crossref","unstructured":"A. Horzyk and R. Tadeusiewicz. Self-optimizing neural networks. In Fu-Liang Yin, Jun Wang, and Chengan Guo, editors, Advances in Neural Networks \u2013 ISNN 2004, pages 150\u2013155, Berlin, Heidelberg, 2004. Springer Berlin Heidelberg.","DOI":"10.1007\/978-3-540-28647-9_26"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_026","unstructured":"Andrzej Kie\u0142basi\u0144ski and Hubert Schwetlick. Numeryczna Algebra Liniowa: Wprowadzenie do Oblicze\u0144 Zautomatyzowanych. Wydawnictwa Naukowo-Techniczne, Warszawa, 1992."},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_027","unstructured":"Diederik P. Kingma and Jimmy Ba. Adam: A method for stochastic optimization, 2014."},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_028","doi-asserted-by":"crossref","unstructured":"Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278\u20132324, 1998.","DOI":"10.1109\/5.726791"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_029","doi-asserted-by":"crossref","unstructured":"Dominik Lewy and Jacek Ma\u0144dziuk. Training CNN classifiers solely on webly data. Journal of Artificial Intelligence and Soft Computing Research, 13(1):75\u201392, 2023.","DOI":"10.2478\/jaiscr-2023-0005"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_030","doi-asserted-by":"crossref","unstructured":"Y. Li, R. Cui, Z. Li, and D. Xu. Neural network approximation based near-optimal motion planning with kinodynamic constraints using RRT. IEEE Transactions on Industrial Electronics, 65(11):8718\u20138729, Nov 2018.","DOI":"10.1109\/TIE.2018.2816000"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_031","doi-asserted-by":"crossref","unstructured":"H. Liu, X. Mi, and Y. Li. Wind speed forecasting method based on deep learning strategy using empirical wavelet transform, long short term memory neural network and Elman neural network. Energy Conversion and Management, 156:498\u2013514, 2018.","DOI":"10.1016\/j.enconman.2017.11.053"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_032","doi-asserted-by":"crossref","unstructured":"M. Mazurowski, P. Habas, J. Zurada, J. Lo, J. Baker, and G. Tourassi. Training neural network classifiers for medical decision making: The effects of imbalanced datasets on classification performance. Neural networks : the official journal of the International Neural Network Society, 21:427\u201336, 03 2008.","DOI":"10.1016\/j.neunet.2007.12.031"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_033","unstructured":"Warwick Nash, Tracy Sellers, Simon Talbot, Andrew Cawthorn, and Wes Ford. Abalone. UCI Machine Learning Repository, 1995. DOI: https:\/\/doi.org\/10.24432\/C55C7W."},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_034","doi-asserted-by":"crossref","unstructured":"Tacjana Niksa-Rynkiewicz, Piotr Stomma, Anna Witkowska, Danuta Rutkowska, Adam S\u0142owik, Krzysztof Cpa\u0142ka, Joanna Jaworek-Korjakowska, and Piotr Kolendo. An intelligent approach to short-term wind power prediction using deep neural networks. Journal of Artificial Intelligence and Soft Computing Research, 13(3):197\u2013210, 2023.","DOI":"10.2478\/jaiscr-2023-0015"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_035","doi-asserted-by":"crossref","unstructured":"B.T. Polyak. Some methods of speeding up the convergence of iteration methods. USSR Computational Mathematics and Mathematical Physics, 4(5):1\u201317, 1964.","DOI":"10.1016\/0041-5553(64)90137-5"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_036","doi-asserted-by":"crossref","unstructured":"Nataliya Shakhovska, Andrii Shebeko, and Yarema Prykarpatskyy. A novel explainable AI model for medical data analysis. Journal of Artificial Intelligence and Soft Computing Research, 14(2):121\u2013137, 2024.","DOI":"10.2478\/jaiscr-2024-0007"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_037","doi-asserted-by":"crossref","unstructured":"R. Shirin. A neural network approach for retailer risk assessment in the aftermarket industry. Benchmarking: An International Journal, 26(5):1631\u20131647, Jan 2019.","DOI":"10.1108\/BIJ-06-2018-0162"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_038","doi-asserted-by":"crossref","unstructured":"A.K. Singh, S.K. Jha, and A.V. Muley. Candidates selection using artificial neural network technique in a pharmaceutical industry. In Siddhartha Bhattacharyya, Aboul Ella Hassanien, Deepak Gupta, Ashish Khanna, and Indrajit Pan, editors, International Conference on Innovative Computing and Communications, pages 359\u2013366, Singapore, 2019. Springer Singapore.","DOI":"10.1007\/978-981-13-2354-6_38"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_039","doi-asserted-by":"crossref","unstructured":"R. Tadeusiewicz, L. Ogiela, and M.R. Ogiela. Cognitive analysis techniques in business planning and decision support systems. In L. Rutkowski, R. Tadeusiewicz, L.A. Zadeh, and J.M. Zurada, editors, Artificial Intelligence and Soft Computing \u2013 ICAISC 2006, pages 1027\u20131039, Berlin, Heidelberg, 2006. Springer Berlin Heidelberg.","DOI":"10.1007\/11785231_108"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_040","doi-asserted-by":"crossref","unstructured":"K.Y. Tam and M. Kiang. Predicting bank failures: A neural network approach. Applied Artificial Intelligence, 4(4):265\u2013282, 1990.","DOI":"10.1080\/08839519008927951"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_041","unstructured":"Paul Werbos. Beyond Regression: New Tools for Prediction and Analysis in the Behavioral Sciences. Harvard University, 1974."},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_042","doi-asserted-by":"crossref","unstructured":"B.M. Wilamowski. Neural network architectures and learning algorithms. IEEE Industrial Electronics Magazine, 3(4):56\u201363, 2009.","DOI":"10.1109\/MIE.2009.934790"},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_043","unstructured":"I-Cheng Yeh. Concrete Compressive Strength. UCI Machine Learning Repository, 2007. DOI: https:\/\/doi.org\/10.24432\/C5PK67."},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_044","unstructured":"Matthew D. Zeiler. Adadelta: An adaptive learning rate method, 2012."},{"key":"2026042812103992225_j_jaiscr-2025-0006_ref_045","doi-asserted-by":"crossref","unstructured":"Junming Zhang, Hao Dong, Jinfeng Gao, Ruxian Yao, Gangqiang Li, and Haitao Wu. Self-organized operational neural networks for the detection of atrial fibrillation. Journal of Artificial Intelligence and Soft Computing Research, 14(1):63\u201375, 2024.","DOI":"10.2478\/jaiscr-2024-0004"}],"container-title":["Journal of Artificial Intelligence and Soft Computing Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/reference-global.com\/pdf\/10.2478\/jaiscr-2025-0006","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T19:20:20Z","timestamp":1777404020000},"score":1,"resource":{"primary":{"URL":"https:\/\/reference-global.com\/article\/10.2478\/jaiscr-2025-0006"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,5]]},"references-count":45,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,2,5]]},"published-print":{"date-parts":[[2025,3,1]]}},"alternative-id":["10.2478\/jaiscr-2025-0006"],"URL":"https:\/\/doi.org\/10.2478\/jaiscr-2025-0006","relation":{},"ISSN":["2449-6499"],"issn-type":[{"value":"2449-6499","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,5]]}}}