Score Incoming OSS PRs Against the Issue Contract

Description and use

The workflow enforces a contract‑based review of incoming PRs, bounding diffs and automating initial scoring to focus on the intended fix.

Problem

Maintainers struggle to evaluate OSS PRs that ignore the original issue, leading to debates about narrative rather than the actual contract.

Outcome

The workflow enforces a strict contract‑based review, reduces scope creep, and automates initial scoring, leading to faster, more focused merges.

Workflow

• Freeze the issue text and save as JSON
• Convert frozen issue to a short YAML contract
• Fetch PR and bound diff against allowed paths
• Run a free model to score the PR against the contract
• Apply decision table to decide merge, request‑changes, or needs‑repro

Evidence

Pull request descriptions usually sell intent, not failure.

Source

Freeze the issue text and save as JSON

Source

MonkeyCode offers free model access and a free server option

Source