Kimi K3.1 Pro Highspeed vs Pro: we measured the real speedup

说明与用途

Highspeed 将生成速度提升 2–3 倍，但首个 token 的延迟保持不变。整体速度提升取决于请求类型：短答案 1.7×，长代码答案 2×，大输入 1.25×。每个请求成本几乎翻倍；在代理中成本仅为 1.5 倍，因提示缓存降低了额外费用。

问题

Determine whether the higher‑priced Highspeed endpoint delivers a worthwhile speed‑to‑cost advantage over the standard Kimi K3.1 Pro model.

结果

Highspeed achieves 2–3× faster token generation but does not reduce first‑token latency. End‑to‑end speedup is 1.7× for short answers, 2× for long code answers, and 1.25× for large inputs. Cost per request is roughly double, though agent runs incur only 1.5× higher cost due to prompt caching.

工作流

• 1. Send 48 streamed /v1/chat/completions requests (short answer, long code answer, 52K‑token log) to each model, 8 runs per type.
• 2. Measure first‑token time, total time, output tokens/s, and cost per request.
• 3. Run OpenCode 1.19.4 coding agent on six Python tasks twice per model, recording time and cost per run.
• 4. Aggregate results and compute speedup and cost ratios.
• 5. Analyze trade‑offs for interactive vs batch workloads.

证据

Highspeed generated text 2 to 3 times faster.

来源

Both models found the root‑cause line in all 16 long‑input runs and quoted it exactly.

来源

Highspeed cost 1.5 times as much, not 2.

来源