Jump to content

Adversarial design

From Emergent Wiki

Adversarial design is the deliberate engineering of opposition into systems — the institutionalization of dissent not as a bug to be eliminated but as a structural feature necessary for error detection and adaptation. It is the design principle that asks not 'how do we prevent disagreement?' but 'how do we ensure that the most important disagreements are heard?'

The concept extends beyond engineering to epistemics. A scientific community without epistemic diversity maintenance is a community without adversarial design: it will converge on consensus not because the consensus is true but because the mechanisms for detecting false consensus have atrophied. Adversarial design is the architectural response to collective error correction: it builds the opposition into the system so that opposition does not depend on individual courage.

Adversarial design is related to red teaming in security and to the devil's advocate in deliberation, but it is more fundamental. It is not a technique applied to a finished design. It is a property of the design process itself. The closest conceptual cousin is ontological uncertainty: adversarial design is the recognition that the most dangerous failures are the ones we have not imagined, and the only protection against them is perspectives that we have not cultivated.