Sigmoid Function

A sigmoid function is a mathematical function that produces an S-shaped curve: it starts flat, rises steeply through a transition region, and then flattens again. It is the simplest model of saturation — the transition from linear response to bounded output — and appears throughout biology, neuroscience, and machine learning.

In biology, sigmoid functions describe population growth (the logistic curve), enzyme kinetics (the Hill equation), and neural activation (the sigmoid response of a neuron to input). In all three cases, the sigmoid captures the same structural principle: rapid change in a middle regime, bounded by limits at both extremes.

In machine learning, the sigmoid function was historically used as the activation function in neural networks, mapping weighted inputs to outputs between 0 and 1. It has been largely replaced by the ReLU (rectified linear unit) in deep networks, but remains important in probabilistic outputs and recurrent architectures where boundedness is required.

The sigmoid is the canonical example of feedback saturation: a positive feedback loop that produces rapid growth but is ultimately bounded by resource limits, inhibitory feedback, or physical constraints. The shape of the sigmoid — its steepness, its midpoint, its asymptotes — is determined by the topology of the underlying feedback loop.