Free LLM Server Memory, Measured: A 20-Run Context-Bleed Probe

说明与用途

免费 LLM 服务器的内存探测：20 次运行测试确认无上下文保留，可安全地将服务器视为无状态代理。

问题

Determine whether a free LLM server retains context between independent requests, to inform secure integration design.

结果

The 20‑run probe consistently showed isolated responses, indicating the free server does not retain context between calls. This informed a stateless integration strategy.

工作流

• Send a request asking the server to remember a unique marker.
• Send a second request immediately afterward asking for that marker, with no history or reference to the first.
• Check if the marker appears in the second response.
• Repeat the pair 20 times with fresh markers and a short delay.
• Record and analyze the pattern of leaks.
• Decide on trust posture based on the pattern.
• Apply safe usage rules: treat server as stateless, include all context in each request, avoid secrets in prompts, and verify outputs with assertions.

证据

The twenty runs produce one of three patterns, and each pattern implies a different trust posture: All runs isolated → Stateless endpoint.

来源

The harness measures one endpoint, over one network path, on one day, and it says nothing about output quality or speed.

来源