{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T07:13:28Z","timestamp":1758266008700},"reference-count":19,"publisher":"World Scientific Pub Co Pte Lt","issue":"06","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Neur. Syst."],"published-print":{"date-parts":[[2009,12]]},"abstract":"<jats:p> Multilayer feed-forward neural networks are widely used based on minimization of an error function. Back propagation (BP) is a famous training method used in the multilayer networks but it often suffers from the drawback of slow convergence. To make the learning faster, we propose 'Fusion of Activation Functions' (FAF) in which different conventional activation functions (AFs) are combined to compute final activation. This has not been studied extensively yet. One of the sub goals of the paper is to check the role of linear AFs in combination. We investigate whether FAF can enable the learning to be faster. Validity of the proposed method is examined by performing simulations on challenging nine real benchmark classification and time series prediction problems. The FAF has been applied to 2-bit, 3-bit and 4-bit parity, the breast cancer, Diabetes, Heart disease, Iris, wine, Glass and Soybean classification problems. The algorithm is also tested with Mackey-Glass chaotic time series prediction problem. The algorithm is shown to work better than other AFs used independently in BP such as sigmoid (SIG), arctangent (ATAN), logarithmic (LOG). <\/jats:p>","DOI":"10.1142\/s0129065709002130","type":"journal-article","created":{"date-parts":[[2009,12,28]],"date-time":"2009-12-28T20:14:03Z","timestamp":1262031243000},"page":"437-448","source":"Crossref","is-referenced-by-count":25,"title":["FASTER TRAINING USING FUSION OF ACTIVATION FUNCTIONS FOR FEED FORWARD NEURAL NETWORKS"],"prefix":"10.1142","volume":"19","author":[{"given":"MD.","family":"ASADUZZAMAN","sequence":"first","affiliation":[{"name":"Khulna University of Engineering &amp; Technology (KUET), Department of Electrical &amp; Electronic Engineering, Khulna-9203, Bangladesh"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"MD.","family":"SHAHJAHAN","sequence":"additional","affiliation":[{"name":"Khulna University of Engineering &amp; Technology (KUET), Department of Electrical &amp; Electronic Engineering, Khulna-9203, Bangladesh"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"KAZUYUKI","family":"MURASE","sequence":"additional","affiliation":[{"name":"University of Fukui, Department of Human &amp; Artificial Intelligence Systems, Bunkyo 3-9-1, Fukui-910-8705, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2011,11,21]]},"reference":[{"key":"rf1","doi-asserted-by":"publisher","DOI":"10.1016\/0925-2312(93)90042-2"},{"key":"rf2","doi-asserted-by":"publisher","DOI":"10.1016\/0925-2312(94)90033-7"},{"key":"rf3","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2003.09.011"},{"key":"rf4","doi-asserted-by":"publisher","DOI":"10.1061\/(ASCE)0733-947X(2004)130:1(83)"},{"key":"rf5","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(96)00102-5"},{"key":"rf6","first-page":"669","author":"Yu X. H.","journal-title":"IEEE Transactions on Neural Networks"},{"key":"rf7","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2004.836237"},{"key":"rf8","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065707001275"},{"key":"rf9","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065709001793"},{"key":"rf10","first-page":"1218","author":"Yu C. C.","journal-title":"IEEE"},{"key":"rf11","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2002.1000148"},{"key":"rf12","doi-asserted-by":"publisher","DOI":"10.1016\/S0925-2312(02)00569-6"},{"key":"rf13","first-page":"359","volume":"3","author":"Abid S.","journal-title":"Int. J. Soft Computing"},{"key":"rf14","doi-asserted-by":"publisher","DOI":"10.1541\/ieejeiss.123.999"},{"key":"rf15","unstructured":"R.\u00a0Tawel, Advance in Neural Information Processing System\u00a01, ed. D.\u00a0Touretzy (Morgan Kaufmann, 1989)\u00a0pp. 169\u2013176."},{"key":"rf16","first-page":"2373","author":"Kamruzzaman J.","journal-title":"IEICE Transactions of Fundamentals of Electronics"},{"key":"rf18","unstructured":"S. E.\u00a0Fahlman and C.\u00a0Lebiere, Advances in Neural Information Processing Systems\u00a02, ed. D. S.\u00a0Touretzky (Morgan Kaufmann, San Mateo, CA, 1990)\u00a0pp. 524\u2013532."},{"key":"rf22","doi-asserted-by":"publisher","DOI":"10.1109\/72.701179"},{"key":"rf23","doi-asserted-by":"publisher","DOI":"10.1109\/72.329697"}],"container-title":["International Journal of Neural Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0129065709002130","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,8,6]],"date-time":"2019-08-06T22:05:53Z","timestamp":1565129153000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S0129065709002130"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,12]]},"references-count":19,"journal-issue":{"issue":"06","published-online":{"date-parts":[[2011,11,21]]},"published-print":{"date-parts":[[2009,12]]}},"alternative-id":["10.1142\/S0129065709002130"],"URL":"https:\/\/doi.org\/10.1142\/s0129065709002130","relation":{},"ISSN":["0129-0657","1793-6462"],"issn-type":[{"value":"0129-0657","type":"print"},{"value":"1793-6462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,12]]}}}