I Built a Bot That Reproduces GitHub Bugs Automatically — Here's What Broke (and What I Learned)

说明与用途

Ghost Hunter 自动从 GitHub issue 描述中重现错误，消除了手动设置环境的需求，加速调试，并及时发现和修复安全风险。

问题

Maintainers spend excessive time reproducing bugs from vague issue reports, delaying debugging and fixes.

结果

Automated bug reproduction reduced manual effort, improved issue triage, and surfaced security concerns early, leading to prompt fixes.

工作流

• Comment bot/reproduce on an issue
• Ghost Hunter parses the issue with an LLM to extract environment and steps
• Ghost Hunter spins up an isolated Docker container matching the environment
• Ghost Hunter runs the reproduction steps inside the sandbox
• Ghost Hunter posts crash logs back to the issue

证据

Within the first day, two commenters independently flagged real security concerns I hadn't fully thought through: Prompt injection risk and Network isolation.

来源

Metabase's own internal bug-reproduction tool deliberately requires a human-in-the-loop trigger specifically to prevent this exact class of attack on public repos.

来源