{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,10,28]],"date-time":"2023-10-28T15:40:50Z","timestamp":1698507650033},"reference-count":32,"publisher":"Wiley","issue":"11","license":[{"start":{"date-parts":[[2007,3,21]],"date-time":"2007-03-21T00:00:00Z","timestamp":1174435200000},"content-version":"vor","delay-in-days":4097,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems &amp; Computers in Japan"],"published-print":{"date-parts":[[1996,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper investigates the influence of noises added to hidden units of multilayer perceptrons. It is shown that a skeletal structure of the network emerges when independent Gaussian noises are added to inputs of hidden units during the error back\u2010propagation learning. By analyzing the average behavior of the backp\u2010ropagation learning to such noises, it is shown that the weights from hidden units to output units tend to be small and outputs of hidden units tend to be 0 or 1. This means that the network is automatically structurized by adding the noises. As the result, it is expected that the generalization ability of the network is improved. This network structurization was confirmed by experiments of pattern classification and logic Boolean function learning.<\/jats:p>","DOI":"10.1002\/scj.4690271106","type":"journal-article","created":{"date-parts":[[2007,7,8]],"date-time":"2007-07-08T09:54:18Z","timestamp":1183888458000},"page":"64-73","source":"Crossref","is-referenced-by-count":1,"title":["Influence of noises added to hidden units on learning of multilayer perceptrons and structurization of networks"],"prefix":"10.1002","volume":"27","author":[{"given":"Takio","family":"Kurita","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hideki","family":"Asoh","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shinji","family":"Umeyama","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shotaro","family":"Akaho","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Akitaka","family":"Hosomi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2007,3,21]]},"reference":[{"key":"e_1_2_1_2_2","doi-asserted-by":"publisher","DOI":"10.1038\/323533a0"},{"key":"e_1_2_1_3_2","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/5236.001.0001","volume-title":"Parallel Distributed Processing","author":"Rumelhart D. E.","year":"1986"},{"key":"e_1_2_1_4_2","volume-title":"Perceptrons","author":"Minsky M.","year":"1969"},{"key":"e_1_2_1_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF02551274"},{"key":"e_1_2_1_6_2","unstructured":"S. E.Fahlman.An empirical study of learning speed in back\u2010propagation networks.Tech. ReportCMU\u2010CS\u201088\u2010162(1988)."},{"key":"e_1_2_1_7_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1992.4.2.141"},{"key":"e_1_2_1_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF03037353"},{"key":"e_1_2_1_9_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1989.1.1.151"},{"issue":"11","key":"e_1_2_1_10_2","first-page":"1872","article-title":"A method to determine the number of hidden units of three layered neural networks by information criteria","volume":"73","author":"Kurita T.","year":"1991","journal-title":"I.E.I.C.E. Trans, on Information and Communication Engineers"},{"issue":"7","key":"e_1_2_1_11_2","first-page":"955","article-title":"Estimation of generalization capability by combination of new information criterion and cross validation","volume":"74","author":"Wata Y.","year":"1991","journal-title":"I.E.I.C.E. Trans. on Information and Communication Engineers"},{"key":"e_1_2_1_12_2","unstructured":"S.Watanabe.An optimization method of artificial neural networks based on a modified information criterion.Tech. Report of I.E.I.C.E. NC\u201093\u201352(1993)."},{"key":"e_1_2_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.1989.118275"},{"key":"e_1_2_1_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.1990.137847"},{"key":"e_1_2_1_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/0893-6080(90)90019-H"},{"key":"e_1_2_1_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/34.88570"},{"key":"e_1_2_1_17_2","first-page":"713","article-title":"An approximation of nonlinear canonical correlation analysis by multilayer perceptrons","volume":"1","author":"Asoh H.","year":"1994","journal-title":"Proc. of Inter. Conf. on Artificial Neural Networks"},{"key":"e_1_2_1_18_2","first-page":"177","volume-title":"Advances in Neural Information Processing Systems","author":"Hanson S. J.","year":"1989"},{"issue":"5","key":"e_1_2_1_19_2","first-page":"71","article-title":"A structural connectionist learning algorithm with forgetting","volume":"5","author":"Ishikawa M.","year":"1990","journal-title":"Journal of Japanese Society for Artificial Intelligence"},{"key":"e_1_2_1_20_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1992.4.3.448"},{"key":"e_1_2_1_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICNN.1988.23864"},{"key":"e_1_2_1_22_2","unstructured":"Y. L.Cun J. S.DenkerandS. A.Solla.Optimal brain damage. In:Advances in Neural Information Processing System 2 ed. D. Touretzky pp.598\u2013605(1990)."},{"key":"e_1_2_1_23_2","unstructured":"B.HassibiandD. G.Stork.Second order derivatives for network pruning: optimal brain surgeon. In:Advances in Neural Information Processing Systems 5 ed. S. J. Handon J. D. Cowan and C. L. Giles pp.164\u2013171(1993)."},{"issue":"4","key":"e_1_2_1_24_2","first-page":"443","article-title":"A method to reduce redundant hidden nodes","volume":"77","author":"Sekita I.","year":"1994","journal-title":"I.E.I.C.E. Trans. Inf. and Syst."},{"key":"e_1_2_1_25_2","doi-asserted-by":"crossref","unstructured":"S.Akaho.Regularization learning of neural networks for generalization. Proc. of the Workshop on Algorithmic Learning Theory pp.99\u2013110(1992).","DOI":"10.1007\/3-540-57369-0_31"},{"key":"e_1_2_1_26_2","doi-asserted-by":"publisher","DOI":"10.1049\/el:19910970"},{"key":"e_1_2_1_27_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1992.4.3.366"},{"key":"e_1_2_1_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/72.238328"},{"key":"e_1_2_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/72.286908"},{"key":"e_1_2_1_30_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1995.7.1.108"},{"key":"e_1_2_1_31_2","unstructured":"T.Kurita H.Asoh S.Umeyama S.AkahoandA.Hosomi.A structural learning for multilayered perceptrons by adding independent noises.Tech. Report of I.E.I.C.E. NC93\u201021(1993)."},{"key":"e_1_2_1_32_2","doi-asserted-by":"crossref","unstructured":"T.Kurita H.Asoh S.Umeyama S.AkahoandA.Hosomi.A structural learning by adding independent noises to hidden units. Proc. of IEEE Inter. Conf. on Neural Networks pp.275\u2013278(1994).","DOI":"10.1109\/ICNN.1994.374174"},{"key":"e_1_2_1_33_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-1809.1936.tb02137.x"}],"container-title":["Systems and Computers in Japan"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1002%2Fscj.4690271106","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/scj.4690271106","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,27]],"date-time":"2023-10-27T02:55:16Z","timestamp":1698375316000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/scj.4690271106"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1996,1]]},"references-count":32,"journal-issue":{"issue":"11","published-print":{"date-parts":[[1996,1]]}},"alternative-id":["10.1002\/scj.4690271106"],"URL":"https:\/\/doi.org\/10.1002\/scj.4690271106","archive":["Portico"],"relation":{},"ISSN":["0882-1666","1520-684X"],"issn-type":[{"value":"0882-1666","type":"print"},{"value":"1520-684X","type":"electronic"}],"subject":[],"published":{"date-parts":[[1996,1]]}}}