Black Box Society

Black box society refers to the social condition produced by algorithmic governance systems whose decision-making processes are opaque to the subjects they govern. The term, coined by legal scholar Frank Pasquale, describes a world in which credit scores, search rankings, and risk assessments operate as hidden infrastructure — producing consequences without accountability, and shaping life chances through mechanisms that cannot be inspected, understood, or contested.

The black box is not merely a technical problem of machine learning opacity. It is a political problem: the concentration of knowledge in the hands of system operators and the systematic denial of that knowledge to those affected. A black box society is one in which power flows through information asymmetry, and the asymmetry is structural rather than incidental — designed into the architecture of governance itself.