AgentCgroup: What Happens When AI Agents Meet OS Resources?

Описание и применение

Динамическое управление памятью для AI‑агентов, использующих ОС‑инструменты, снижает неэффективное выделение ресурсов и предотвращает OOM‑убийства, улучшая надёжность и эффективность.

Задача

AI agents experience unpredictable, short‑lived memory spikes when invoking OS tools, causing static container limits to either waste capacity or kill the agent during critical phases.

Результат

Dynamic, command‑level memory limits reduce wasted capacity from 93 % to near zero while preventing OOM kills during test bursts, improving agent reliability and resource efficiency.

Рабочий процесс

• 1. Instrument agent traces to capture tool‑call start/end and 1‑s CPU/memory samples.
• 2. Aggregate memory traces by execution progress to identify the two‑layer memory structure.
• 3. Classify Bash commands into categories (test execution, package install, git, file exploration).
• 4. Measure P95 memory spikes per category to set per‑command budgets.
• 5. Deploy AgentCgroup eBPF controller to enforce dynamic limits per command, protecting the stable baseline while allowing transient bursts.
• 6. Monitor container metrics to validate that peak memory no longer triggers OOMs and that overall capacity usage improves.

Доказательства

OS work such as container setup and tool execution consumes 55% to 60% of end‑to‑end latency, and memory reaches 15.4 times its average level with sub‑second changes up to 3 GB/s.

Источник

Static allocation reacts badly to this combination. Reserving the observed peak wastes up to 93% of provisioned capacity during quiet phases, while killing the container at the peak discards minutes of accumulated, non‑reproducible agent state.

Источник

The tool‑call owns the spike: Test execution overwhelmingly dominates, and it is also the most resource‑intensive category.

Источник