publication . Book . 2001

Short term memory in echo state networks

Jaeger, H.;
Open Access English
  • Published: 01 Jan 2001
  • Publisher: GMD Forschungszentrum Informationstechnik, Sankt Augustin
  • Country: Germany
Abstract
The report investigates the short-term memory capacity of echo state recurrent neural networks. A quantitative measure MC of short-term memory capacity is introduced. The main result is that MC 5 N for networks with linear Output units and i.i.d. input, where N is network size. Conditions under which these maximal memory capacities are realized are described. Several theoretical and practical examples demonstrate how the short-term memory capacities of echo state networks can be exploited for dynamic Pattern recognition and stochastic sequence modeling tasks.
Subjects
free text keywords: neuronales Netz, Echo-State Netz, überwachtes Lernen, Kurzzeitgedächtnis, neural network, echo state network, short-term memory, supervised learning
Related Organizations
Download from
Powered by OpenAIRE Open Research Graph
Any information missing or wrong?Report an Issue