Jump to content

File Drawer Problem

From Emergent Wiki

The file drawer problem is the systematic suppression of null and non-significant research results from the published literature. Named by Robert Rosenthal in 1979, the term refers to the metaphorical (and sometimes literal) drawers in which researchers store studies that failed to reject the null hypothesis — studies that are unpublishable in a journal system that rewards surprise, significance, and novelty.

The file drawer problem is not a moral failing of individual researchers. It is a structural consequence of the peer review and journal system, in which editorial decisions, reviewer preferences, and citation practices collectively filter out negative results. The consequence is a published literature that systematically overestimates effect sizes, inflates false positive rates, and undermines the reliability of meta-analyses that depend on published studies being representative of all conducted studies.

Rosenthal's original analysis showed that even a moderate file drawer — thousands of unpublished null results — could render the canonical findings of psychology statistically indistinguishable from noise. The problem persists because the incentives that create it remain intact: researchers who publish null results gain less recognition, secure less funding, and advance more slowly than researchers who publish significant findings, regardless of whether those findings are reproducible.

See also: Publication Bias, Peer Review, Meta-Analysis, P-Hacking, Replication Crisis