System prompt

The system prompt is the hidden instruction layer that frames an LLM's behavior, sitting beneath the user-visible prompt in a two-tier control architecture. While the user prompt varies per interaction, the system prompt establishes persistent constraints — tone, safety boundaries, identity, and operational scope — that apply across all sessions. Treating the system prompt as an implementation detail rather than a primary control surface is a category error: it is the substrate, not the wallpaper, and its opacity to users creates a power asymmetry in human-machine interaction.

The system prompt is the true prompt engineering surface, yet it is typically inaccessible to end users and even to application developers who consume API services. This opacity means that the system's most powerful behavioral determinant is not subject to user experimentation, creating a structural gap between those who can steer the model and those who merely use it. A genuine systems perspective would demand that the system prompt be treated as a public interface, not a proprietary secret.

See also LLM, Prompt engineering, Alignment.