Why We Treat the LLM as an Untrusted Planner

Description and use

<p><em>Giving AI access to your business software is easy. Making sure it uses that access responsibly is the real challenge.</em></p> <p>Imagine giving a new employee access to your company's database on their first day.</p> <p>They don't know your internal policies. They don't understand which customers are sensitive, which records should never be deleted, or which actions require a manager's approval.</p> <p>Would you give them unrestricted access to everything and simply tell them, "Please be careful"?</p> <p>Probably not.</p> <p>Yet, that's surprisingly close to how some people approach A

Problem

<p><em>Giving AI access to your business software is easy. Making sure it uses that access responsibly is the real challenge.</em></p> <p>Imagine giving a new employee access to your company's database on their first day.</p> <p>They don't know your internal policies. They don't understand which customers are sensitive, which records should never be deleted, or which actions require a manager's approval.</p> <p>Would you give them unrestricted access to everything and simply tell them, "Please be careful"?</p> <p>Probably not.</p> <p>Yet, that's surprisingly close to how some people approach A

Outcome

<p><em>Giving AI access to your business software is easy. Making sure it uses that access responsibly is the real challenge.</em></p> <p>Imagine giving a new employee access to your company's database on their first day.</p> <p>They don't know your internal policies. They don't understand which customers are sensitive, which records should never be deleted, or which actions require a manager's approval.</p> <p>Would you give them unrestricted access to everything and simply tell them, "Please be careful"?</p> <p>Probably not.</p> <p>Yet, that's surprisingly close to how some people approach A

Evidence

Why We Treat the LLM as an Untrusted Planner

Source