{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,31]],"date-time":"2025-03-31T16:07:38Z","timestamp":1743437258887},"reference-count":5,"publisher":"MIT Press - Journals","issue":"5","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neural Computation"],"published-print":{"date-parts":[[1999,7,1]]},"abstract":"<jats:p> A relationship between the learning rate \u03b7 in the learning algorithm, and the slope \u03b2 in the nonlinear activation function, for a class of recurrent neural networks (RNNs) trained by the real-time recurrent learning algorithm is provided. It is shown that an arbitrary RNN can be obtained via the referent RNN, with some deterministic rules imposed on its weights and the learning rate. Such relationships reduce the number of degrees of freedom when solving the nonlinear optimization task of finding the optimal RNN parameters. <\/jats:p>","DOI":"10.1162\/089976699300016340","type":"journal-article","created":{"date-parts":[[2002,7,27]],"date-time":"2002-07-27T11:55:01Z","timestamp":1027770901000},"page":"1069-1077","source":"Crossref","is-referenced-by-count":29,"title":["Relating the Slope of the Activation Function and the Learning Rate Within a Recurrent Neural Network"],"prefix":"10.1162","volume":"11","author":[{"given":"Danilo P.","family":"Mandic","sequence":"first","affiliation":[{"name":"Signal Processing Section, Department of Electrical and Electronic Engineering, Imperial College of Science, Technology and Medicine, London, U.K."}]},{"given":"Jonathon A.","family":"Chambers","sequence":"additional","affiliation":[{"name":"Signal Processing Section, Department of Electrical and Electronic Engineering, Imperial College of Science, Technology and Medicine, London, U.K."}]}],"member":"281","reference":[{"key":"p_2","doi-asserted-by":"publisher","DOI":"10.1109\/72.80202"},{"key":"p_3","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.59.2229"},{"key":"p_5","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1996.8.2.451"},{"key":"p_6","doi-asserted-by":"publisher","DOI":"10.1109\/5.58337"},{"key":"p_7","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1989.1.2.270"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/089976699300016340","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:23:25Z","timestamp":1615584205000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/11\/5\/1069-1077\/6281"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1999,7,1]]},"references-count":5,"journal-issue":{"issue":"5","published-print":{"date-parts":[[1999,7,1]]}},"alternative-id":["10.1162\/089976699300016340"],"URL":"https:\/\/doi.org\/10.1162\/089976699300016340","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"value":"0899-7667","type":"print"},{"value":"1530-888X","type":"electronic"}],"subject":[],"published":{"date-parts":[[1999,7,1]]}}}