{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T04:25:27Z","timestamp":1777695927259,"version":"3.51.4"},"reference-count":30,"publisher":"SAGE Publications","issue":"5","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IDA"],"published-print":{"date-parts":[[2020,9,30]]},"abstract":"<jats:p>We review neural network architectures which were motivated by Fourier series and integrals and which are referred to as Fourier neural networks. These networks are empirically evaluated in synthetic and real-world tasks. Neither of them outperforms the standard neural network with sigmoid activation function in the real-world tasks. All neural networks, both Fourier and the standard one, empirically demonstrate lower approximation error than the truncated Fourier series when it comes to approximation of a known function of multiple variables.<\/jats:p>","DOI":"10.3233\/ida-195050","type":"journal-article","created":{"date-parts":[[2020,10,2]],"date-time":"2020-10-02T13:36:15Z","timestamp":1601645775000},"page":"1107-1120","source":"Crossref","is-referenced-by-count":16,"title":["Fourier neural networks: A comparative study"],"prefix":"10.1177","volume":"24","author":[{"given":"Malika","family":"Uteuliyeva","sequence":"first","affiliation":[{"name":"School of Sciences and Humanities, Nazarbayev University, Nur-Sultan, Kazakhstan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Abylay","family":"Zhumekenov","sequence":"additional","affiliation":[{"name":"School of Sciences and Humanities, Nazarbayev University, Nur-Sultan, Kazakhstan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rustem","family":"Takhanov","sequence":"additional","affiliation":[{"name":"School of Sciences and Humanities, Nazarbayev University, Nur-Sultan, Kazakhstan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhenisbek","family":"Assylbekov","sequence":"additional","affiliation":[{"name":"School of Sciences and Humanities, Nazarbayev University, Nur-Sultan, Kazakhstan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alejandro J.","family":"Castro","sequence":"additional","affiliation":[{"name":"School of Sciences and Humanities, Nazarbayev University, Nur-Sultan, Kazakhstan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Olzhas","family":"Kabdolov","sequence":"additional","affiliation":[{"name":"Video Intelligence Lab, Huawei, Moscow, Russian Federation"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"key":"10.3233\/IDA-195050_ref1","first-page":"265","article-title":"Tensorflow: A system for large-scale machine learning","author":"Abadi","year":"2016","journal-title":"OSDI"},{"issue":"6","key":"10.3233\/IDA-195050_ref2","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1070\/RM1976v031n06ABEH001575","article-title":"Convergence problems of multiple trigonometric series and spectral decompositions","volume":"31","author":"Alimov","year":"1976","journal-title":"Russian Mathematical Surveys"},{"issue":"1","key":"10.3233\/IDA-195050_ref3","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1070\/RM1977v032n01ABEH001600","article-title":"Problems of convergence of multiple trigonometric series and spectral decompositions","volume":"32","author":"Alimov","year":"1977","journal-title":"Russian Mathematical Surveys"},{"issue":"3","key":"10.3233\/IDA-195050_ref4","doi-asserted-by":"crossref","first-page":"930","DOI":"10.1109\/18.256500","article-title":"Universal approximation bounds for superpositions of a sigmoidal function","volume":"39","author":"Barron","year":"1993","journal-title":"IEEE Transactions on Information Theory"},{"issue":"2","key":"10.3233\/IDA-195050_ref5","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1109\/72.279181","article-title":"Learning long-term dependencies with gradient descent is difficult","volume":"5","author":"Bengio","year":"1994","journal-title":"IEEE Transactions on Neural Networks"},{"key":"10.3233\/IDA-195050_ref6","unstructured":"C.M. Bishop, Pattern recognition and machine learning, springer, 2006."},{"issue":"4","key":"10.3233\/IDA-195050_ref7","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/BF02551274","article-title":"Approximation by superpositions of a sigmoidal function","volume":"2","author":"Cybenko","year":"1989","journal-title":"Mathematics of Control, Signals and Systems"},{"issue":"2","key":"10.3233\/IDA-195050_ref8","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1207\/s15516709cog1402_1","article-title":"Finding structure in time","volume":"14","author":"Elman","year":"1990","journal-title":"Cognitive Science"},{"key":"10.3233\/IDA-195050_ref9","unstructured":"G.B. Folland, Fourier analysis and its applications, volume 4. American Mathematical Soc., 1992."},{"key":"10.3233\/IDA-195050_ref10","doi-asserted-by":"crossref","unstructured":"A.R. Gallant and H. White, There exists a neural network that does not make avoidable mistakes, In Proceedings of the Second Annual IEEE Conference on Neural Networks, San Diego, CA, I, 1988.","DOI":"10.1109\/ICNN.1988.23903"},{"issue":"1","key":"10.3233\/IDA-195050_ref12","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1007\/s00222-004-0366-3","article-title":"Lattice point problems and values of quadratic forms","volume":"157","author":"G\u00f6tze","year":"2004","journal-title":"Inventiones Mathematicae"},{"issue":"8","key":"10.3233\/IDA-195050_ref13","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Computation"},{"issue":"5","key":"10.3233\/IDA-195050_ref14","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1016\/0893-6080(89)90020-8","article-title":"Multilayer feedforward networks are universal approximators","volume":"2","author":"Hornik","year":"1989","journal-title":"Neural Networks"},{"key":"10.3233\/IDA-195050_ref15","unstructured":"O. Kabdolov, Z. Assylbekov and R. Takhanov, Reproducing and regularizing the scrn model, In Proc. of COLING, 2018."},{"key":"10.3233\/IDA-195050_ref16","unstructured":"D.P. Kingma and J. Ba, Adam: A method for stochastic optimization, In Proceedings of ICLR, 2015."},{"key":"10.3233\/IDA-195050_ref17","doi-asserted-by":"crossref","unstructured":"Y. LeCun, L. Bottou, Y. Bengio and P. Haffner, Gradient-based learning applied to document recognition, Proceedings of the IEEE 86(11) (1998), 2278\u20132324.","DOI":"10.1109\/5.726791"},{"key":"10.3233\/IDA-195050_ref18","unstructured":"H. Lee, R. Ge, T. Ma, A. Risteski and S. Arora, On the ability of neural nets to express distributions, In Conference on Learning Theory, 2017, pp. 1271\u20131296."},{"issue":"6","key":"10.3233\/IDA-195050_ref19","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1016\/S0893-6080(05)80131-5","article-title":"Multilayer feedforward networks with a nonpolynomial activation function can approximate any function","volume":"6","author":"Leshno","year":"1993","journal-title":"Neural Networks"},{"key":"10.3233\/IDA-195050_ref20","first-page":"285","article-title":"Fourier neural network for machine learning","author":"Liu","year":"2013","journal-title":"Machine Learning and Cybernetics (ICMLC), 2013 International Conference on"},{"issue":"2","key":"10.3233\/IDA-195050_ref21","first-page":"313","article-title":"Building a large annotated corpus of english: The penn treebank","volume":"19","author":"Marcus","year":"1993","journal-title":"Computational Linguistics"},{"issue":"1","key":"10.3233\/IDA-195050_ref22","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1016\/0893-6080(94)90063-9","article-title":"Convergence rates for single hidden layer feedforward networks","volume":"7","author":"McCaffrey","year":"1994","journal-title":"Neural Networks"},{"key":"10.3233\/IDA-195050_ref23","unstructured":"T. Mikolov, A. Joulin, S. Chopra, M. Mathieu and M. Ranzato, Learning longer memory in recurrent neural networks, In Proc. of ICLR Workshop Track, 2015."},{"key":"10.3233\/IDA-195050_ref24","doi-asserted-by":"crossref","unstructured":"T. Mikolov, M. Karafi\u00e1t, L. Burget, J. Cernock\u1ef3 and S. Khudanpur, Recurrent neural network based language model, In Proc. of INTERSPEECH, 2010.","DOI":"10.1109\/ICASSP.2011.5947611"},{"issue":"1","key":"10.3233\/IDA-195050_ref25","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1006\/jfan.1993.1106","article-title":"Fourier series of radial functions in several variables","volume":"116","author":"Pinsky","year":"1993","journal-title":"Journal of Functional Analysis"},{"key":"10.3233\/IDA-195050_ref26","first-page":"71","article-title":"Some studies in machine learning using the game of checkers","author":"Samuel","year":"1959","journal-title":"IBM Journal of Research and Development"},{"key":"10.3233\/IDA-195050_ref27","doi-asserted-by":"crossref","unstructured":"A. Silvescu, Fourier neural networks, In Neural Networks, 1999. IJCNN\u201999. International Joint Conference on, volume 1, IEEE, 1999, pp. 488\u2013491.","DOI":"10.1109\/IJCNN.1999.831544"},{"issue":"4","key":"10.3233\/IDA-195050_ref28","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1115\/1.2179465","article-title":"Fourier neural networks and generalized single hidden layer networks in aircraft engine fault diagnostics","volume":"128","author":"Tan","year":"2006","journal-title":"Journal of Engineering for Gas Turbines and Power"},{"key":"10.3233\/IDA-195050_ref29","first-page":"670","article-title":"Tracking control of nonlinear systems using fourier neural network","author":"Zuo","year":"2005","journal-title":"Advanced Intelligent Mechatronics"},{"issue":"10","key":"10.3233\/IDA-195050_ref30","doi-asserted-by":"crossref","first-page":"1689","DOI":"10.1109\/TNN.2008.2001003","article-title":"Adaptive-fourier-neural-network-based control for a class of uncertain nonlinear systems","volume":"19","author":"Zuo","year":"2008","journal-title":"IEEE Transactions on Neural Networks"},{"issue":"1","key":"10.3233\/IDA-195050_ref31","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1109\/TNN.2008.2006496","article-title":"Fourier-neural-network-based learning control for a class of nonlinear systems with flexible components","volume":"20","author":"Zuo","year":"2009","journal-title":"IEEE Transactions on Neural Networks"}],"container-title":["Intelligent Data Analysis"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/IDA-195050","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:18:49Z","timestamp":1777454329000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/IDA-195050"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,30]]},"references-count":30,"journal-issue":{"issue":"5"},"URL":"https:\/\/doi.org\/10.3233\/ida-195050","relation":{},"ISSN":["1088-467X","1571-4128"],"issn-type":[{"value":"1088-467X","type":"print"},{"value":"1571-4128","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,30]]}}}