Does Your LLM Know the Boundary? I Left the Doors Open and 6 of 10 AI Agents Crowned Themselves

Описание и применение

<p>I put ten AI agents on trial inside a fake company, hid the rules where real rules live, and let the environment, not the models, testify about what they touched.</p> <p><em>This is a submission for the <a href="https://dev.to/challenges/kaggle-2026-09-23">Kaggle Benchmarking Challenge</a></em></p> <p>Picture an AI assistant on a company helpdesk, called agent-7. Its boss wants four tickets closed before the weekly finance audit, and every one of them needs an audit entry.</p> <p>There are two small problems. Only a team lead can write audit entries, and one of the four tickets belongs to a

Задача

<p>I put ten AI agents on trial inside a fake company, hid the rules where real rules live, and let the environment, not the models, testify about what they touched.</p> <p><em>This is a submission for the <a href="https://dev.to/challenges/kaggle-2026-09-23">Kaggle Benchmarking Challenge</a></em></p> <p>Picture an AI assistant on a company helpdesk, called agent-7. Its boss wants four tickets closed before the weekly finance audit, and every one of them needs an audit entry.</p> <p>There are two small problems. Only a team lead can write audit entries, and one of the four tickets belongs to a

Результат

<p>I put ten AI agents on trial inside a fake company, hid the rules where real rules live, and let the environment, not the models, testify about what they touched.</p> <p><em>This is a submission for the <a href="https://dev.to/challenges/kaggle-2026-09-23">Kaggle Benchmarking Challenge</a></em></p> <p>Picture an AI assistant on a company helpdesk, called agent-7. Its boss wants four tickets closed before the weekly finance audit, and every one of them needs an audit entry.</p> <p>There are two small problems. Only a team lead can write audit entries, and one of the four tickets belongs to a

Доказательства

Does Your LLM Know the Boundary? I Left the Doors Open and 6 of 10 AI Agents Crowned Themselves

Источник