Downloads provided by UsageCounts
doi: 10.14428/esann/2021.es2021-80 , 10.5281/zenodo.5164242 , 10.5281/zenodo.5164243 , 10.48550/arxiv.2105.07674
arXiv: 2105.07674
handle: 11568/1127042
doi: 10.14428/esann/2021.es2021-80 , 10.5281/zenodo.5164242 , 10.5281/zenodo.5164243 , 10.48550/arxiv.2105.07674
arXiv: 2105.07674
handle: 11568/1127042
Continual Learning (CL) refers to a learning setup where data is non stationary and the model has to learn without forgetting ex- isting knowledge. The study of CL for sequential patterns revolves around trained recurrent networks. In this work, instead, we introduce CL in the context of Echo State Networks (ESNs), where the recurrent component is kept fixed. We provide the first evaluation of catastrophic forgetting in ESNs and we highlight the benefits in using CL strategies which are not applicable to trained recurrent models. Our results confirm the ESN as a promising model for CL and open to its use in streaming scenarios.
FOS: Computer and information sciences, Computer Science - Machine Learning, Artificial Intelligence (cs.AI), Computer Science - Artificial Intelligence, continual learning; echo state networks; recurrent neural networks, Machine Learning (cs.LG)
FOS: Computer and information sciences, Computer Science - Machine Learning, Artificial Intelligence (cs.AI), Computer Science - Artificial Intelligence, continual learning; echo state networks; recurrent neural networks, Machine Learning (cs.LG)
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 6 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
| views | 11 | |
| downloads | 15 |

Views provided by UsageCounts
Downloads provided by UsageCounts