Deep Echo State Network (DeepESN): A Brief Survey

Preprint English OPEN
Gallicchio, Claudio; Micheli, Alessio;
(2017)
  • Subject: Statistics - Machine Learning | Computer Science - Machine Learning | Computer Science - Artificial Intelligence

The study of deep recurrent neural networks (RNNs) and, in particular, of deep Reservoir Computing (RC) is gaining an increasing research attention in the neural networks community. The recently introduced Deep Echo State Network (DeepESN) model opened the way to an ext... View more
  • References (37)
    37 references, page 1 of 4

    [1] D. Verstraeten, B. Schrauwen, M. d'Haene, D. Stroobandt, An experimental unification of reservoir computing methods, Neural networks 20 (3) (2007) 391-403.

    [2] M. Lukoˇseviˇcius, H. Jaeger, Reservoir computing approaches to recurrent neural network training, Computer Science Review 3 (3) (2009) 127-149.

    [3] W. Maass, T. Natschl¨ager, H. Markram, Real-time computing without stable states: A new framework for neural computation based on perturbations, Neural computation 14 (11) (2002) 2531-2560.

    [4] P. Tinˇo, G. Dorffner, Predicting the future of discrete sequences from fractal representations of the past, Machine Learning 45 (2) (2001) 187-217.

    [6] H. Jaeger, The ”echo state” approach to analysing and training recurrent neural networks - with an erratum note, Tech. rep., GMD - German National Research Institute for Computer Science, Tech. Rep. (2001).

    [7] P. Tinˇo, B. Hammer, M. Bod´en, Markovian bias of neural-based architectures with feedback connections, in: Perspectives of neural-symbolic integration, Springer, 2007, pp. 95-133.

    [8] C. Gallicchio, A. Micheli, Architectural and markovian factors of echo state networks, Neural Networks 24 (5) (2011) 440-456.

    [9] I. B. Yildiz, H. Jaeger, S. J. Kiebel, Re-visiting the echo state property, Neural networks 35 (2012) 1-9.

    [10] G. Manjunath, H. Jaeger, Echo state property linked to an input: Exploring a fundamental characteristic of recurrent neural networks, Neural computation 25 (3) (2013) 671-696.

    [11] M. Massar, S. Massar, Mean-field theory of echo state networks, Physical Review E 87 (4) (2013) 042809.

  • Related Organizations (1)
  • Metrics
Share - Bookmark