A model selector that can abstain: a contributor walkthrough of Koto

说明与用途

Koto 在编码客户端中添加了本地优先模型选择器，支持在没有合适本地模型时进行放弃。示例演示了分类器行为和放弃逻辑。

问题

Determine whether a local model can be selected for a coding task and abstain when no suitable local model exists.

结果

The synthetic example demonstrates that Koto can correctly select a local model when evidence exists, abstain when evidence is insufficient, and refuse an ineligible model. It does not execute the model or perform any network calls.

工作流

• Collect prompt history and optional feedback
• Score the prompt against retained examples
• Classify using a nearest‑neighbor model
• If a local model is eligible and matches the prompt, route to it
• If no eligible local model matches, abstain and keep the commercial baseline

证据

The question is small enough to test: when checked examples support a local model for a familiar task, can the selector recommend it—and otherwise leave the permitted commercial baseline in place?

来源

The first query matches an eligible example. The second lacks enough matching evidence. The third matches a model that is not eligible. None is the selector abstaining; it does not itself execute a model or authorize a fallback.

来源