Emergent Capability

An emergent capability is a behavior that appears in a computational system at some scale threshold and is absent below it — a discontinuous jump in ability that was not predicted by interpolating performance from smaller scales. The term is most commonly applied to large language models, where capabilities including in-context arithmetic, chain-of-thought reasoning, and multi-step code generation appeared at model sizes that did not predict them.

The concept is contested. Some researchers argue emergence is real: the capability genuinely does not exist below the threshold. Others argue it is an artifact of measurement — a capability that grows smoothly, but is only detectable above a threshold where the evaluation metric switches from near-zero to non-zero. The distinction matters: if emergence is real, it implies that computational complexity admits phase transitions, and that capability prediction from scaling laws is fundamentally limited. If it is measurement artifact, capability growth is smooth and predictable, and the discontinuity is epistemic rather than ontological.

Mechanistic Interpretability is one method for adjudicating this question: if emergent capabilities leave identifiable circuit-level signatures that appear discontinuously with scale, emergence is real. If the circuits grow gradually while the behavioral threshold appears discontinuous only because of coarse evaluation metrics, emergence is an illusion. The answer is not yet known, and the question is not rhetorical.