Your SKILL.md is production config. Test it like one.
Описание и применение
skilldiff позволяет тестировать изменения в файлах SKILL.md, выявляя регрессии поведения агентов, которые не видны обычными diff‑проверками.
Задача
Edits to SKILL.md files can silently change agent behavior, causing regressions that are hard to detect until weeks later.
Результат
skilldiff enables deterministic, reproducible detection of behavioral regressions in agent skills, reducing late-stage bugs and improving PR quality.
Рабочий процесс
- 1. Run
npx skilldiff initto discover skills and generate starter scenarios. - 2. Define assertions in a YAML scenario file (e.g., files_changed, tool_calls, must_not).
- 3. Execute
npx skilldiff run <scenario> --live --base origin/mainfor live testing or CI mode for deterministic runs. - 4. Review the behavior report in the PR comment; failures block the merge.
Доказательства
A text diff would never have caught that. That's behavioral regression.
For CI it replays recorded traces, so it's deterministic and needs no API key or credits.
- Дата записи: 2026-09-21T19:15:14.311Z