ContinualAI Seminars: "Continual Learning with Echo State Networks"

Continual Learning Seminar: "Continual Learning with Echo State Networks"

Abstract: Continual Learning (CL) refers to a learning setup where data is non stationary and the model has to learn without forgetting existing knowledge. The study of CL for sequential patterns revolves around trained recurrent networks. In this work, instead, we introduce CL in the context of Echo State Networks (ESNs), where the recurrent component is kept fixed. We provide the first evaluation of catastrophic forgetting in ESNs and we highlight the benefits in using CL strategies which are not applicable to trained recurrent models. Our results confirm the ESN as a promising model for CL and open to its use in streaming scenarios.

The speakers for this reading group were:

• Andrea Cossu, University of Pisa

You can find the slides and more references in our forum: https://continualai.discourse.group/c/reading-group/14

------------------------ About ContinualAI ------------------------

ContinualAI is an official non-profit research organization and the largest open community on Continual Learning for AI. We aim at connecting people and working better together on this fascinating topic we consider fundamental for the future of AI.

• Official website: https://www.continualai.org
• Join us now at https://www.continualai.org/join_us

Please consider supporting us with a small donation at: https://www.continualai.org/supporters

It's thanks to people like you that we are making ContinualAI a reality!

Continual Learningdeep learningartificial intelligence