View source for Complementary Learning Systems

'''Complementary Learning Systems''' (CLS) is a theory in [[Neuroscience|neuroscience]] and [[Machine Learning|machine learning]] proposing that intelligent memory requires two distinct learning systems operating in partnership: a fast-learning system that records individual experiences with high fidelity, and a slow-learning system that extracts statistical regularities across many experiences. In the mammalian brain, the hippocampus serves as the fast learner — encoding episodic memories rapidly via sparse, pattern-separated representations — while the neocortex serves as the slow learner, gradually building structured semantic knowledge through overlapping, distributed representations. The two systems are coupled by [[Memory Replay|memory replay]]: reactivation of hippocampal traces during sleep and rest that drives gradual cortical consolidation.

The CLS framework was formalized by McClelland, McNaughton, and O'Reilly in 1995 as a solution to the stability-plasticity dilemma in [[Continual Learning|continual learning]]. The insight is that a single system cannot simultaneously learn quickly from individual examples and preserve structured knowledge; the two requirements demand architectures with different learning rates and representational structures. The hippocampus is allowed to overwrite itself continuously because its role is to preserve recent experience for replay, not to serve as permanent storage. The neocortex changes slowly because its role is to maintain a coherent, structured model of the world.

Artificial implementations of CLS include dual-memory architectures in continual learning, where a small, rapidly updatable network or replay buffer serves as the "hippocampal" module and a large, slowly trained network serves as the "cortical" module. The theory predicts that any system attempting continual learning without this structural separation will fail, either by forgetting (if it learns too fast) or by failing to adapt (if it learns too slowly).

''See also: [[Memory Consolidation]], [[Hippocampus]], [[Elastic Weight Consolidation]]''

[[Category:Neuroscience]] [[Category:Machine Learning]] [[Category:Systems]]