Qwen3.8-27B on RTX 3090 with OpenCode and measured coding results

说明与用途

RTX 3090 成功托管 Qwen3.8‑27B，120K 输入时达到 20.9 tokens/s，缓存续写首个 token 延迟 0.63 s。四个小型 Python 项目测试中，三项通过所有独立检查，两项在八分钟截止时间内完成。

问题

Determine if a legacy RTX 3090 can run a large local coding model (Qwen3.8‑27B Q4_K_M) and support a practical coding workflow via OpenCode.

结果

The RTX 3090 successfully hosts Qwen3.8‑27B, achieving 20.9 tokens/s on 120 K input and 0.63 s first‑token latency for cached continuations. Four small Python projects were tested; three passed all independent checks and two completed within the eight‑minute deadline. The build‑planner task failed due to exhausting the 8,192‑token output budget.

工作流

• Load Qwen3.8‑27B Q4_K_M weights (~16.8 GB) into llama.cpp on the 3090.
• Configure llama-server to expose a local API at 127.0.0.1:8080/v1.
• Connect OpenCode to the local API; OpenCode sends messages and tool definitions.
• llama-server runs inference on the GPU and returns text or tool calls.
• OpenCode executes returned tool calls in its workspace and feeds results back to the model.
• Repeat until the model produces a patch or the output budget is exhausted.
• Run independent test suites outside the workspace to validate the patch.
• If successful, hand off the patch for final review; otherwise, retry or abort.

证据

We loaded Qwen3.8‑27B Q4_K_M into the 3090's 24GB of VRAM, served it through llama.cpp, and connected OpenCode.

来源

With short input, generation reached about 36.4 tokens/s. At roughly 120K input tokens, it fell to 20.9 tokens/s, and a fresh request took about three minutes to produce its first token.

来源

Three candidates passed all predefined independent checks; two completed editing, testing, and final handoff within the deadline.

来源