Can sleep protect memories from catastrophic forgetting?

Continual learning remains an unsolved problem in artificial neural networks. The brain has evolved mechanisms to prevent catastrophic forgetting of old knowledge during new training. Building upon data suggesting the importance of sleep in learning and memory, we tested a hypothesis that sleep prot...

Full description

Bibliographic Details
Published in:eLife
Main Authors: Oscar C González, Yury Sokolov, Giri P Krishnan, Jean Erik Delanois, Maxim Bazhenov
Format: Article
Language:English
Published: eLife Sciences Publications Ltd 2020-08-01
Subjects:
Online Access:https://elifesciences.org/articles/51005
Description
Summary:Continual learning remains an unsolved problem in artificial neural networks. The brain has evolved mechanisms to prevent catastrophic forgetting of old knowledge during new training. Building upon data suggesting the importance of sleep in learning and memory, we tested a hypothesis that sleep protects old memories from being forgotten after new learning. In the thalamocortical model, training a new memory interfered with previously learned old memories leading to degradation and forgetting of the old memory traces. Simulating sleep after new learning reversed the damage and enhanced old and new memories. We found that when a new memory competed for previously allocated neuronal/synaptic resources, sleep replay changed the synaptic footprint of the old memory to allow overlapping neuronal populations to store multiple memories. Our study predicts that memory storage is dynamic, and sleep enables continual learning by combining consolidation of new memory traces with reconsolidation of old memory traces to minimize interference.
ISSN:2050-084X