Prisoner's Dilemma
The Prisoner's Dilemma is the foundational game in game theory, and it is the simplest model that captures the structural logic of why individually rational behavior produces collectively suboptimal outcomes. Two players, each with two strategies — cooperate or defect — face a payoff matrix in which defection is the dominant strategy for each player, but mutual cooperation yields a higher payoff than mutual defection. The result is a Nash equilibrium that is Pareto inefficient: both players would be better off if they cooperated, but neither can safely cooperate because the other has an incentive to defect.
The Prisoner's Dilemma is not a curiosity of formal game theory. It is a template for understanding a vast class of social and institutional problems: arms races, pollution, tax evasion, price wars, and the erosion of public goods. The dilemma arises whenever the private returns to defection exceed the private returns to cooperation, even though the social returns to cooperation exceed the social returns to defection. It is the mathematical signature of Moloch — the systems-level failure mode in which rational individual choice produces collective ruin.
The Formal Structure
The canonical Prisoner's Dilemma has the following payoff structure, with the first number in each cell representing Player A's payoff and the second representing Player B's:
|| || B cooperates || B defects || || A cooperates || R, R || S, T || || A defects || T, S || P, P ||
where T > R > P > S (Temptation > Reward > Punishment > Sucker). The inequalities ensure that:
- Defection is a dominant strategy: regardless of what the other player does, defection yields a higher payoff.
- Mutual cooperation is Pareto superior to mutual defection: both players prefer (R, R) to (P, P).
- Mutual defection is the unique Nash equilibrium: neither player can improve their payoff by unilaterally changing strategy.
The formal structure is elegant, but the real insight is in the gap between individual rationality and collective optimality. The Nash equilibrium is not a prediction of what players should do; it is a prediction of what they will do given the incentive structure. And the prediction is: they will defect, and they will be worse off than if they had cooperated.
The Iterated Dilemma and the Shadow of the Future
The one-shot Prisoner's Dilemma is analytically tractable but empirically rare. Most real social dilemmas are iterated: the same players interact repeatedly, and today's cooperation can be rewarded with tomorrow's cooperation, while today's defection can be punished with tomorrow's defection. In the iterated prisoner's dilemma, the logic changes because the shadow of the future alters the payoff calculus.
Robert Axelrod's famous tournaments, in which strategies competed in iterated dilemmas, showed that simple reciprocity strategies — most notably Tit for Tat, which cooperates on the first move and then mirrors the opponent's previous move — outperformed more sophisticated strategies. The result was surprising: Tit for Tat is not strategically complex, it does not model the opponent's mental state, and it does not optimize against any specific strategy. It succeeds because it is nice (cooperates first), provocable (punishes defection immediately), forgiving (returns to cooperation after punishing), and clear (its behavior is predictable).
The iterated dilemma is more hopeful than the one-shot version, but the hope is conditional. Cooperation emerges only when:
- The probability of future interaction is high enough that the long-term gains from cooperation exceed the short-term gains from defection.
- The number of players is small enough that defection can be detected and punished.
- The payoff structure is stable enough that players can learn which strategies work.
- The communication channels are clear enough that cooperative intentions can be signaled and understood.
When these conditions fail — when interaction is anonymous, when the number of players is large, when payoffs are opaque, or when communication is noisy — the iterated dilemma collapses back into the one-shot dilemma, and defection prevails.
The Generalization: Social Dilemmas
The Prisoner's Dilemma is the simplest case of a broader class of social dilemmas — situations in which individual rationality conflicts with collective welfare. The tragedy of the commons is a multi-player Prisoner's Dilemma: each herder has an incentive to add more cattle to the common pasture, but the collective outcome is overgrazing and ruin. The arms race is a Prisoner's Dilemma between nations: each has an incentive to build more weapons, but the collective outcome is mutual insecurity and wasted resources. Rent-seeking is a Prisoner's Dilemma between firms: each has an incentive to lobby for regulatory advantages, but the collective outcome is a misallocation of resources that benefits no one.
The generalization reveals that the Prisoner's Dilemma is not a pathology of particular individuals or institutions. It is a structural feature of any system in which private returns and social returns diverge. The question is not why