I run a 'radar' that finds free LLM endpoints and auto-adopts the good ones — behind a five-part gate so it can't adopt junk

说明与用途

雷达自动发现免费 LLM 端点，按五项严格标准（响应、工具调用、上下文完整性、稳定性、性能）进行测试，只有通过全部测试的模型才被自动采用，避免手动追踪和隐藏故障。

问题

Free LLM endpoints appear and vanish constantly; manually chasing them is inefficient and risky because many free models fail silently in agent pipelines.

结果

The radar keeps most agent work on free or cheap models, automatically adopting better free options while preventing silent failures, and frees the author from manual monitoring.

工作流

• 1. Scan public LLM endpoints for free tiers.
• 2. For each candidate, send a simple request to confirm responsiveness within a timeout.
• 3. Run a concrete tool‑calling test: the model must emit a correct call and incorporate the result in the next turn.
• 4. Test context handling by feeding a long prompt and verifying the full response is returned.
• 5. Perform repeated calls to assess stability and ensure consistent behavior.
• 6. Compare performance against the currently used model for the specific job; adopt only if better.
• 7. Record all metrics and audit logs; blocklist known dud models by name.

证据

Only a model that clears all five gets adopted. Everything is measured on real tasks and written down, so adoption is a reproducible decision I can audit later, not a vibe.

来源

Most of my agent work runs on free or cheap models, adopted automatically as better free options appear, with the expensive frontier models reserved for the genuinely hard slice.

来源