Generative Model

A generative model is a probabilistic model that specifies how observed data are generated from underlying latent variables. Unlike discriminative models, which learn the boundary between classes, generative models learn the joint probability distribution of inputs and labels — or, in the unsupervised case, the distribution of the data itself. This inversion of the learning problem makes generative models the natural computational substrate for predictive coding, variational inference, and any theory in which the brain builds internal simulations of the world.

The classical distinction, articulated by Bayes, is that generative modeling asks how might this data have been produced? rather than what label should I assign? This shift in question produces models capable of synthesis, imagination, and counterfactual reasoning — capacities that discriminative frameworks cannot express without additional machinery. Whether the brain implements anything recognizably like a generative model, or merely something functionally equivalent, is a live debate in computational neuroscience.