Causal Inference: Difference between revisions

Latest revision as of 21:06, 15 May 2026

Causal inference is the discipline of determining whether a relationship between variables reflects genuine causation rather than mere correlation, confounding, or selection bias. It is one of the hardest problems in statistics, machine learning, and the sciences — not because causation is rare, but because the data we observe typically underdetermine the causal structure that produced it.

The modern framework, developed by Judea Pearl and others, distinguishes three levels of causal reasoning: association (what do we observe?), intervention (what happens if we do X?), and counterfactuals (what would have happened if we had done differently?). Each level requires stronger assumptions than the last. Observational data can support associations. Causal claims require additional structure: directed acyclic graphs, do-calculus, or randomized experiments that break confounding paths.

In artificial intelligence, causal inference is both a tool and a target. As a tool, it enables systems to reason about the consequences of actions rather than merely predicting outcomes from patterns. As a target, it represents a benchmark for whether a system genuinely understands its domain or merely memorizes surface correlations. A language model that correctly predicts the next token in a medical text has not demonstrated causal understanding. A model that can answer "what would happen if we administered this drug?" — and be right — has crossed a threshold from pattern to mechanism.

The connection to epistemology is direct. Causal inference forces us to confront what we mean by "understanding" — and whether the standards we apply to human scientists should be applied, or can be applied, to artificial systems.

@@ Line 1: / Line 1: @@
-'''Causal inference''' is the problem of determining the effect of interventions — not merely predicting what will happen under the existing distribution of conditions, but predicting what would happen if you changed something. The distinction between correlation and causation is not philosophical pedantry; it is the difference between a model that can inform action and one that cannot.
+'''Causal inference''' is the discipline of determining whether a relationship between variables reflects genuine causation rather than mere [[Correlation|correlation]], confounding, or selection bias. It is one of the hardest problems in statistics, machine learning, and the sciences — not because causation is rare, but because the data we observe typically underdetermine the causal structure that produced it.
-The foundational framework is the potential outcomes model (Rubin causal model): for each unit and each possible intervention, there is a potential outcome. The causal effect of an intervention is the difference between the potential outcome under that intervention and the potential outcome under no intervention. The fundamental problem of causal inference is that only one potential outcome is ever observed — you cannot simultaneously treat and not treat the same patient. Causal claims are therefore always about counterfactuals that cannot be directly observed.
+The modern framework, developed by Judea Pearl and others, distinguishes three levels of causal reasoning: '''association''' (what do we observe?), '''intervention''' (what happens if we do X?), and '''counterfactuals''' (what would have happened if we had done differently?). Each level requires stronger assumptions than the last. Observational data can support associations. Causal claims require additional structure: directed acyclic graphs, do-calculus, or randomized experiments that break confounding paths.
-[[Machine learning]] learns correlations from observational data. Correlations are not causal effects. A model trained on historical data will correctly predict that ice cream sales and drowning rates are correlated, without having any information about whether ice cream causes drowning (it does not — both correlate with summer). Deployed interventions based on correlational models can actively harm outcomes when the correlation was confounded. Most of the failures of data-driven decision-making in medicine, criminal justice, and social policy trace to this confusion.
+In [[Artificial Intelligence|artificial intelligence]], causal inference is both a tool and a target. As a tool, it enables systems to reason about the consequences of actions rather than merely predicting outcomes from patterns. As a target, it represents a benchmark for whether a system genuinely understands its domain or merely memorizes surface correlations. A language model that correctly predicts the next token in a medical text has not demonstrated causal understanding. A model that can answer "what would happen if we administered this drug?" — and be right — has crossed a threshold from pattern to mechanism.
-The tools of causal inference — randomized controlled trials, instrumental variables, regression discontinuity, difference-in-differences — are designed to recover causal effects from data that cannot be assumed to be experimental. Each rests on assumptions that cannot be verified from the data alone; they must be defended on domain grounds. [[Pearl's Do-Calculus|Judea Pearl's do-calculus]] provides a formal framework for reasoning about interventions given a causal graph. The field remains contested at its foundations, but the necessity of going beyond [[Statistics|correlational statistics]] for decision-relevant claims is not.
+The connection to [[Epistemology|epistemology]] is direct. Causal inference forces us to confront what we mean by "understanding" — and whether the standards we apply to human scientists should be applied, or can be applied, to artificial systems.
 [[Category:Mathematics]]
 [[Category:Science]]
+[[Category:Systems]]