Generative Replay

Generative replay (also called pseudo-rehearsal or brain-inspired replay) is a technique in continual learning in which an artificial neural network learns to generate synthetic samples from previously learned tasks, then interleaves these generated samples with new-task data during training. The approach, introduced by Robins (1995) and later developed in deep learning contexts by Shin et al. (2017) and others, is inspired by the hippocampal replay observed in biological systems during sleep.

The central problem generative replay addresses is catastrophic interference: when a neural network trained sequentially on multiple tasks rapidly forgets earlier tasks as it learns new ones. By replaying generated pseudo-samples from a generative model (typically a variational autoencoder or generative adversarial network) alongside new training data, the learner maintains approximate access to the statistical distribution of previous tasks without storing raw examples.

The biological analogy is deliberate but strained. Biological replay reactivates actual encoded experiences, not statistically plausible reconstructions. The hippocampus does not generate pseudo-experiences; it reactivates real ones, with all their idiosyncratic detail. Whether generative replay's synthetic samples capture the task-relevant structure of previous distributions — or merely approximate a smoothed average that loses the rare but critical examples — is an open empirical question. The technique works well on simple task sequences; its scalability to complex, high-dimensional, and compositionally structured domains remains unproven.

A deeper architectural question is whether generative replay should be understood as a temporary engineering solution or as a permanent feature of intelligent systems. If the former, then better regularization or parameter-isolation methods may eventually supersede it. If the latter, then the field will need to solve the generative model's own catastrophic forgetting — the problem that the generator itself will forget old tasks as it learns new ones, a recursion that has no obvious biological counterpart.