Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

Your SKILL.md is production config. Test it like one.

Описание и применение

skilldiff позволяет тестировать изменения в файлах SKILL.md, выявляя регрессии поведения агентов, которые не видны обычными diff‑проверками.

Задача

Edits to SKILL.md files can silently change agent behavior, causing regressions that are hard to detect until weeks later.

Результат

skilldiff enables deterministic, reproducible detection of behavioral regressions in agent skills, reducing late-stage bugs and improving PR quality.

Рабочий процесс

  • 1. Run npx skilldiff init to discover skills and generate starter scenarios.
  • 2. Define assertions in a YAML scenario file (e.g., files_changed, tool_calls, must_not).
  • 3. Execute npx skilldiff run <scenario> --live --base origin/main for live testing or CI mode for deterministic runs.
  • 4. Review the behavior report in the PR comment; failures block the merge.

Доказательства

A text diff would never have caught that. That's behavioral regression.

Источник

For CI it replays recorded traces, so it's deterministic and needs no API key or credits.

Источник

  • Дата записи: 2026-09-21T19:15:14.311Z