AgentCgroup: What Happens When AI Agents Meet OS Resources?

说明与用途

为使用OS工具的AI代理实现动态内存管理，降低资源浪费并防止OOM杀死，提高可靠性和效率。

问题

AI agents experience unpredictable, short‑lived memory spikes when invoking OS tools, causing static container limits to either waste capacity or kill the agent during critical phases.

结果

Dynamic, command‑level memory limits reduce wasted capacity from 93 % to near zero while preventing OOM kills during test bursts, improving agent reliability and resource efficiency.

工作流

• 1. Instrument agent traces to capture tool‑call start/end and 1‑s CPU/memory samples.
• 2. Aggregate memory traces by execution progress to identify the two‑layer memory structure.
• 3. Classify Bash commands into categories (test execution, package install, git, file exploration).
• 4. Measure P95 memory spikes per category to set per‑command budgets.
• 5. Deploy AgentCgroup eBPF controller to enforce dynamic limits per command, protecting the stable baseline while allowing transient bursts.
• 6. Monitor container metrics to validate that peak memory no longer triggers OOMs and that overall capacity usage improves.

证据

OS work such as container setup and tool execution consumes 55% to 60% of end‑to‑end latency, and memory reaches 15.4 times its average level with sub‑second changes up to 3 GB/s.

来源

Static allocation reacts badly to this combination. Reserving the observed peak wastes up to 93% of provisioned capacity during quiet phases, while killing the container at the peak discards minutes of accumulated, non‑reproducible agent state.

来源

The tool‑call owns the spike: Test execution overwhelmingly dominates, and it is also the most resource‑intensive category.

来源