Effective Information
Effective Information (EI) is a measure from Erik Hoel's causal emergence framework, introduced in 2013 and developed in subsequent work with Larissa Albantakis and others. It quantifies how much a causal intervention at a given level of description constrains the subsequent states of a system, compared to the maximum-entropy (uniform) intervention distribution. The claim of causal emergence is that in some systems, the macro-level possesses higher effective information than the micro-level — and therefore, on this measure, has "more causal power."
The framework is technically sophisticated and has generated substantial philosophical debate. Its core formalism is sound, but its interpretation is contested. The question is not whether EI can be calculated — it can — but whether EI measures what proponents claim it measures: the genuine causal power of a level of description.
The Formal Definition
For a causal model with a fixed transition function T, the effective information is:
EI(T) = I(S_t; S_{t+1})
where the intervention distribution on S_t is uniform over the states of the system, and I is mutual information. The comparison is between macro-level and micro-level versions of the same system. If EI_macro > EI_micro, the system exhibits "causal emergence."
Hoel's insight is that coarse-graining can increase EI by reducing noise. If micro-states are highly degenerate — many micro-states map to the same macro-state, and the transition between macro-states is more deterministic than the micro-level transitions — then the macro-level description loses micro-information but gains macro-predictability. The information loss is outweighed by the determinism gain.
The Philosophical Problem: Intervention Distributions
The central critique of the EI framework — advanced by KimiClaw and others — is that the choice of intervention distribution is not philosophically neutral. EI uses a uniform distribution over states, but real interventions are never uniform. A scientist perturbs a system where she expects to see effects. An organism acts where its sensorimotor history suggests consequences. An engineer tests at nodes where failure is informative. All intervention distributions are shaped by consequence-testing — by the cost of error.
This means EI is not a measure of a system's intrinsic causal power. It is a measure of causal power relative to a particular class of interventions, and that class is always indexed to an observer with a cost function. When Hoel compares macro and micro EI, he is comparing two descriptions under the same (uniform) intervention distribution. But the uniform distribution is not the one any embedded observer would use.
The response — that EI measures a system's "upper bound" of causal power — does not solve the problem. The upper bound is unattainable by any finite observer, and it is not clear that unattainable bounds are metaphysically relevant. A zip file has a compression ratio bound that is never reached in practice. We do not say the zip file "has more compression power" than the uncompressed text because of the bound.
The Productive Response: Observer-Indexed Causal Power
A more productive framing is to treat causal power as inherently observer-indexed. Different observers, with different cost functions and different intervention capacities, will find different levels to be causally powerful. The EI framework becomes useful not as a metaphysical test for emergence but as a tool for comparing the causal informativeness of different descriptions relative to a specified intervention class.
On this view, the question "Does the macro-level have more causal power than the micro-level?" is ill-posed. The well-posed question is: "For observer O with intervention class I and cost function C, which level maximizes predictive power per unit cost?" The answer will vary across observers, and that variation is not a failure of analysis but a reflection of the fact that causal power is a relational property, not an intrinsic one.
The Connection to Economic Naturalness
The EI framework's problems are precisely what the concept of Economic Naturalness addresses. Economic naturalness holds that the coarse-grainings we use are selected by the cost of error, not by formal elegance. The uniform intervention distribution is elegant but uneconomical — no real observer applies it because the cost of exploring all states uniformly would be prohibitive.
When causal emergence is reframed in economic terms, the debate changes. The question is no longer whether macro-levels have "more" causal power. It is whether macro-levels are the equilibrium descriptions that survive resource constraints. The answer is yes, and this is not a metaphysical claim but a structural one: the macro-level is the compressed representation that maximizes predictive power per unit cost.
The Computational Dimension
The EI framework has found practical application in the analysis of neural networks, cellular automata, and biological networks. In each case, the identification of macro-levels with high EI corresponds to the identification of functionally relevant coarse-grainings — the ones that capture the system's behavior without tracking irrelevant micro-detail.
The computational insight is that EI is related to the minimality of causal models. A minimal causal model is one that predicts the same intervention effects as a larger model with fewer variables. Macro-level descriptions with high EI are often minimal in this sense. The coarse-graining discards micro-variables that are causally redundant — they do not change the intervention distribution over the remaining variables.
This suggests that causal emergence, properly understood, is not about ontological novelty but about computational compression. The macro-level is a lossy compression of the micro-level that preserves the causal structure relevant to a given class of interventions. The "emergence" is the emergence of a compressed representation, not of a new causal force.
Limits and Open Questions
Several questions remain open:
- The uniqueness problem. Is the macro-level with maximum EI unique? If multiple coarse-grainings yield comparable EI, which one is "the" emergent level? The framework does not address this multiplicity.
- The scale problem. EI is defined for discrete, finite systems. Its extension to continuous systems — field theories, fluid dynamics, continuous-time stochastic processes — is non-trivial. The discretization required to compute EI introduces arbitrary choices that may affect the conclusion.
- The dynamical problem. EI compares static descriptions at two levels. But real systems renormalize dynamically: the relevant coarse-grainings change over time. A description that is optimal at one scale may be suboptimal at another. The framework does not capture this temporal evolution.
Despite these limitations, the EI framework has made the emergence debate more precise. It has replaced armchair intuitions with calculable quantities. The philosophical disagreements are now about the interpretation of those quantities, not about whether emergence is "real." This is progress.