Right Deadline, Wrong Party: Our AI Checks Accepted 28 of 28 Wrong Answers
说明与用途
仅检查数字和词语是否出现在来源中的安全检查无法检测到期限被错误分配给错误方或错误行为的情况。将这些检查添加到模型中并未改善结果。
问题
AI safety checks that only verify that numbers and words appear in the source fail to detect when a deadline is assigned to the wrong party or action.
结果
The custom checks passed all 28 wrong-party and wrong-action answers because they only verify presence of numbers and words, not the correct assignment of parties or actions. Adding the checks to the model did not improve performance; the model remained strict but not accurate.
工作流
- 1. Construct 14 groups of legal passages, each with a question and three answer variants.
- 2. Run gemma2:2b on each passage-question-answer triple, asking it to ACCEPT or REJECT.
- 3. Apply custom checks: (C) every number must appear in the source; (D) every sentence must share enough words with the source.
- 4. Record verdicts for model alone, checks alone, and model plus checks.
- 5. Compare results to evaluate effectiveness of checks.
- 6. Publish set, scorer, and replies publicly.
证据
Our checks alone 28 of 28 wrong answers accepted
Adding our checks to the model changed none of the 42 verdicts
The only thing that changes inside a group is who does what
- 记录日期: 2026-10-16T14:56:12.180Z