Your AI support agent will invent a price it was never told — here's the 3-section fix

Description and use

<p>A friend runs a 40-seat restaurant. Last month he wired an AI agent into his booking inbox. Within 4 days it had quoted a customer "$45 per person, all-in, drinks included" for a set menu that costs $68. It also promised a same-day refund policy his restaurant has never had.</p> <p>The agent didn't hallucinate because it was dumb. It hallucinated because <strong>nothing in its context told it where "the truth" ended and "what a helpful assistant would say" began</strong>. Ask an LLM for a price it has never seen and it will produce the most plausible-sounding number. Plausible is the proble

Problem

<p>A friend runs a 40-seat restaurant. Last month he wired an AI agent into his booking inbox. Within 4 days it had quoted a customer "$45 per person, all-in, drinks included" for a set menu that costs $68. It also promised a same-day refund policy his restaurant has never had.</p> <p>The agent didn't hallucinate because it was dumb. It hallucinated because <strong>nothing in its context told it where "the truth" ended and "what a helpful assistant would say" began</strong>. Ask an LLM for a price it has never seen and it will produce the most plausible-sounding number. Plausible is the proble

Outcome

<p>A friend runs a 40-seat restaurant. Last month he wired an AI agent into his booking inbox. Within 4 days it had quoted a customer "$45 per person, all-in, drinks included" for a set menu that costs $68. It also promised a same-day refund policy his restaurant has never had.</p> <p>The agent didn't hallucinate because it was dumb. It hallucinated because <strong>nothing in its context told it where "the truth" ended and "what a helpful assistant would say" began</strong>. Ask an LLM for a price it has never seen and it will produce the most plausible-sounding number. Plausible is the proble

Evidence

Your AI support agent will invent a price it was never told — here's the 3-section fix

Source