Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

The permission you can't prompt away

Описание и применение

<p><strong>Enforcing agent safety in the tool layer, not the system prompt.</strong></p> <p><em>Drawn from a personal agentic system ("Vantage") I built and run daily.</em></p> <p>Most agent "guardrails" are sentences. Somewhere in a system prompt there is a line like <em>"Never delete files without asking"</em> or <em>"Do not send email on the user's behalf."</em> The line is polite, it is well-intentioned, and it is not a control. It is a request addressed to a probabilistic text generator, evaluated anew on every turn, competing with everything else in the context window. The day it loses t

Задача

<p><strong>Enforcing agent safety in the tool layer, not the system prompt.</strong></p> <p><em>Drawn from a personal agentic system ("Vantage") I built and run daily.</em></p> <p>Most agent "guardrails" are sentences. Somewhere in a system prompt there is a line like <em>"Never delete files without asking"</em> or <em>"Do not send email on the user's behalf."</em> The line is polite, it is well-intentioned, and it is not a control. It is a request addressed to a probabilistic text generator, evaluated anew on every turn, competing with everything else in the context window. The day it loses t

Результат

<p><strong>Enforcing agent safety in the tool layer, not the system prompt.</strong></p> <p><em>Drawn from a personal agentic system ("Vantage") I built and run daily.</em></p> <p>Most agent "guardrails" are sentences. Somewhere in a system prompt there is a line like <em>"Never delete files without asking"</em> or <em>"Do not send email on the user's behalf."</em> The line is polite, it is well-intentioned, and it is not a control. It is a request addressed to a probabilistic text generator, evaluated anew on every turn, competing with everything else in the context window. The day it loses t

Доказательства

The permission you can't prompt away

Источник

  • Дата записи: 2026-10-16T08:41:18.376Z