Adaptive control

Adaptive control is the design of control systems that modify their own parameters in real time in response to changes in the environment, the plant, or the objectives they are trying to achieve. Where classical control assumes that the system to be controlled is known and unchanging — that the aircraft\'s dynamics are the same at takeoff as at cruising altitude — adaptive control confronts the reality that most systems evolve, degrade, and encounter conditions their designers did not anticipate. The controller becomes a \'\'meta-system\'\': it observes not only the plant\'s output but the performance of its own control strategy, and it adjusts that strategy when performance degrades.

The intellectual roots of adaptive control lie in reinforcement learning, system identification, and biological homeostasis. The \'\'model-reference adaptive system\'\' (MRAS) compares the plant\'s behavior to a reference model and adjusts its parameters to minimize the discrepancy. The \'\'self-tuning regulator\'\' identifies the plant\'s dynamics online and redesigns the controller accordingly. Both approaches require a fundamental tradeoff: the controller must \'\'explore\'\' — try control actions that may be suboptimal in order to learn about the plant — while simultaneously \'\'exploiting\'\' — applying the best known control action to keep the system stable. This is the \'\'exploration-exploitation tradeoff\'\', and it appears wherever a system must learn while performing.

Adaptive control is the admission that we do not know what we are controlling. It replaces the engineer\'s fantasy of complete specification with the humbler project of building systems that can survive their own ignorance. In this sense, adaptive control is not a technical specialty but a philosophical stance: the belief that stability is possible even when the ground rules are changing.