Migrating 35KB Prompts from Opus to Ollama: Key Gotchas

说明与用途

将35 KB提示从Opus迁移到Ollama时，由于令牌限制导致截断，并且系统消息处理方式不同导致输出质量变化。解决方案包括重写提示、调整请求、添加缓存和错误处理。

问题

A 35 KB pre‑prompt from Opus exceeded Ollama’s default token limit, causing truncation and unpredictable model behavior, and Ollama’s different handling of system messages altered output quality.

结果

Prompt successfully migrated to Ollama with token limits respected, output quality restored, and latency reduced through caching.

工作流

• Audit prompt length with a matching tokenizer
• Rewrite prompt to stay within Ollama’s token limit
• Adjust request payload format for Ollama’s system message handling
• Add a caching layer (e.g., Redis) to store the prompt payload
• Wrap LLM call in try‑catch to handle truncation errors
• Implement graceful fallback or logging for token limit errors

证据

The prompt was larger than Ollama’s default token limit, so the request was truncated and the model behaved unpredictably.

来源

Ollama treats system messages and prompt formatting differently, which altered output quality.

来源