I Built an Agent Skill to Stop AI From Answering the Wrong Question Beautifully

说明与用途

Judgment Loop 是一个防止 AI 回答错误问题的代理技能。它作为重要决策的路由和推理护栏，在采取行动之前要求进行假设测试和证伪检查。

问题

AI systems produce coherent, detailed, and persuasive answers that can be misleading. The model may optimize a proxy while the underlying reality stays unchanged, or turn an attractive plan into a commitment before testing its weakest assumption.

结果

The skill routes between five modes (Quick, Decision, Research, Learning, Review) to ensure answers are falsifiable and actions remain under user ownership. It prevents premature commitment to uncertain claims by requiring isolated falsification tests.

工作流

• Identify the core question and the reality supposed to change.
• Check if the chosen metric could improve while that reality remains the same.
• Classify claims as verified facts, reasonable inferences, or untested hypotheses.
• Identify the strongest reason the current judgment could fail.
• Determine the cheapest test that separates competing explanations.
• Decide what action should close now and what belief should remain open to revision.

证据

The model may optimize a proxy while the underlying reality stays unchanged. It may turn an attractive plan into a commitment before testing its weakest assumption.

来源

The skill routes between five modes: Quick, Decision, Research, Learning, Review.

来源

The repository is available at: https://github.com/sirsws/judgment-loop

来源