Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

Measure Your Free AI Tier Before You Trust It: Three Numbers in 20 Minutes

说明与用途

一个60行脚本测量免费AI层的warm p95延迟、令牌计数漂移和突发失败率。

问题

Free AI tiers lack reliable performance and billing metrics, leading to uncertain latency, token accounting drift, and burst failure rates.

结果

The probe provides three actionable metrics—warm p95 latency, token accounting drift, and burst failure rate—allowing teams to validate free tier performance before scaling.

工作流

  • Set environment variables BASE_URL, MODEL, API_KEY, and PROMPT.
  • Define call() to send a single /chat/completions request and record time and usage.
  • Discard one cold-ish call, then perform 15 warm calls to collect latency data.
  • Compute p95 latency from warm call durations.
  • Sum reported total_tokens from warm responses and compare to local token count for accounting drift.
  • Launch five concurrent requests to measure burst failure rate (429, 5xx, timeout).

证据

So I wrote a 60‑line probe. It runs in about twenty minutes on a free tier and it tells you three numbers nobody publishes.

来源

The three numbers

  1. Warm p95 latency.
  2. Token accounting drift.
  3. Burst failure rate.

来源

  • 记录日期: 2026-10-27T13:11:18.266Z