Konsil: An Adversarial AI Medical Case-Review Board

Description and use

Konsil is an open‑source adversarial multi‑agent medical case‑review board that preserves disagreement, verifies evidence, and audits outputs to prevent hallucinations and omissions.

Problem

Multi‑agent systems often converge too quickly, reinforcing shared assumptions and producing overconfident answers.

Outcome

Konsil’s architecture prevented hallucinated author names, silent removal of disagreements, and composite quotations during blind development runs, demonstrating that a system can self‑audit its correction process.

Workflow

• 1. Blind specialist agents independently review the case.
• 2. Challenger agent questions assumptions and seeks alternative explanations.
• 3. Checklist Officer verifies that all findings are addressed and evidence is cited.
• 4. Steward evaluates cost‑aware sequencing and value of additional information.
• 5. Dissent Ledger records all disagreements with reasoning and confidence.
• 6. Reviewer Gate audits citation integrity, dissent integrity, safety language, and completeness; failures trigger corrections and re‑audit.

Evidence

Agents can converge too quickly, reinforce shared assumptions, overlook alternative explanations, and produce an answer that sounds more confident than the available evidence justifies.

Source

After the initial assessments, a dedicated Challenger agent reviews the emerging positions. Its job is to question assumptions, explore alternative explanations, identify missing evidence, and challenge premature conclusions.

Source

The Reviewer Gate caught: Hallucinated author names in otherwise valid references. A disagreement that had been silently removed from the final minutes. A composite quotation incorrectly presented as verbatim.

Source