Boltzmann Machine

A Boltzmann machine is a type of stochastic recurrent neural network that learns probability distributions over its set of inputs, named after Ludwig Boltzmann because its learning rule uses an energy-based formulation derived from statistical mechanics. The network consists of binary units that update their states according to a stochastic rule based on an energy function; the probability of any global configuration follows the Boltzmann distribution, making the machine a physical analogy to a thermodynamic system in equilibrium. Boltzmann machines can learn internal representations that capture complex patterns in data, but fully connected Boltzmann machines are computationally expensive to train because the learning algorithm requires sampling from the model's equilibrium distribution — a process analogous to waiting for a physical system to thermalize. The Restricted Boltzmann Machine, which constrains connections to form a bipartite graph between visible and hidden units, made the architecture tractable and became foundational to early deep learning. The Boltzmann machine is more than an engineering device. It is a demonstration that the same statistical principles governing physical systems can be repurposed to model cognitive tasks — suggesting that the boundary between thermodynamic systems and learning systems may be thinner than disciplinary boundaries assume.