Agents and the blast radius problem

Autonomous agents make the cost of an unbounded action much higher. Here's how we think about scoping permissions for tool-using systems.

Agents and the blast radius problem

When a single LLM call could only generate text, the worst case was a bad answer. When that call can invoke a payment API, schedule a transfer, or modify a customer record, the worst case is a regulatory event.

This is the blast radius problem. Most agent frameworks ship with a tool registry that grants every tool to every agent by default. We argue this is the AI equivalent of running everything as root.

The correct primitive is purpose-scoped, identity-bound tool grants - evaluated at runtime, expressed as policy, and revocable in real time. We'll publish the interface design we've converged on with our enterprise design partners next month.

Share

Further reading