AI agents
What makes an AI agent safe enough to run unattended
Four controls that separate a demo agent from one you can leave running.
An agent is a loop: decide, call a tool, observe, repeat. The risk comes from what the tools can do and how long the loop may run. Before an agent runs unattended, give it scoped credentials, so it can only touch what its task needs.
Add hard limits on steps, time and spend, and treat everything a tool returns as untrusted input, since text retrieved from the web or a ticket can contain instructions aimed at the model. Finally, require human approval for irreversible actions such as payments or deletions.
Log every step. A trace lets you debug a bad run, prove what happened and build an evaluation set from real cases.
Related service: AI Engineering
Reference project: AI Agent Platform