Why AI needs a control layer, not another dashboard

Enterprises don't have an AI observability problem. They have a runtime enforcement problem. Here's what changes when governance becomes infrastructure.

Why AI needs a control layer, not another dashboard

Every regulated enterprise we talk to has the same artifact pinned in Confluence: an AI policy. It is thoughtful, it is signed by someone senior, and it is entirely unenforced. Models still call tools they were never meant to touch. Pipelines still pull data the requester isn't entitled to. And when an auditor asks what actually happened on a specific request, the answer is reassembled by hand from three different logging systems, days after the fact.

The reflexive fix is a dashboard. Surface the violations, chart them, promise to act on the worst ones next quarter. We think that instinct is backwards, and not by a little. A dashboard is a record of things that already happened. By the time a leaked record or an unauthorized action shows up on a chart, the event is over. You have visibility into the failure, not control over it.

This is the distinction the market keeps blurring: observability is not enforcement. Observability tells you that a model returned a customer's Social Security number in a response. Enforcement is the layer that redacts it before it ever leaves the boundary. Both are useful. Only one of them prevents the incident. An enterprise that buys observability and calls it governance has bought a smoke detector and called it a sprinkler.

Consider a customer support assistant with access to an internal order-history API. Nothing in that setup is misbehaving. The API returns what it was asked for. The model formats it helpfully. The chat surface displays it. And somewhere in that chain, raw email addresses and phone numbers end up in a response they should never have reached, because no component in the path was responsible for saying no. A dashboard catches this on Thursday. A control layer catches it on the request.

A control layer sits in the request path, between models, data, and the actions they can take. It evaluates three things on every request, inline, against the current policy. First, the prompt and its retrieved context: is the requester entitled to the data being pulled, and for this purpose? Second, the tool call: is this agent scoped to invoke this tool, with these arguments, right now? Third, the output: does the response contain anything - PII, secrets, a prohibited category of content - that policy says must be redacted or blocked before it crosses the boundary?

The point is that the policy is not a document that describes the intended behavior. The policy is the runtime that produces the behavior. The same artifact an engineer reviews in a pull request is the artifact that decides, in microseconds, whether a request is allowed. There is no gap between what the policy says and what the system does, because they are the same thing.

The urgency is rising because the blast radius is rising. When a model could only emit text, an ungoverned mistake was an embarrassing answer. When that same model can invoke a payment API, modify a customer record, or schedule a transfer, an ungoverned mistake becomes a regulatory event. Autonomy raises the cost of every gap between the written policy and the running system - which is exactly the gap a control layer is built to close.

Every important control in the modern stack made this same journey. Access control started as a document about who should read what, and became identity and RBAC - evaluated on every call, not reviewed once a quarter. Encryption started as a policy about protecting data in transit, and became TLS: on by default, invisible until it fails. Change management started as a binder of approvals and became CI/CD. The pattern is consistent. Once a control matters enough, it stops being a promise humans make and becomes something the system does automatically, every time, whether anyone is watching or not.

Putting enforcement in the request path fixes the evidence problem almost for free. When every decision is made in one place, every decision can be recorded in one place, at the moment it is made: the rule that fired, the policy version that decided it, the principal, the finding. Evidence stops being a forensic reconstruction you dread and becomes a byproduct of the system running normally. The worst time to discover your logging was insufficient is during an incident review with a regulator on the call.

We are building this layer, and we are building it with design partners rather than claiming a finished product we haven't shipped. But the thesis does not depend on us. In a few years, 'do you govern your AI at runtime?' will be answered the way 'do you encrypt in transit?' is answered today: of course we do, it's infrastructure. The only open question is whether your governance is a document that describes that world, or a control layer that enforces it.

Share

Further reading