WeirdClauses: Skimming the Boring 90% of Contracts with Open-Weight Surprisal
说明与用途
WeirdClauses 通过本地惊奇度计算和标准条款对比,快速识别合同中的异常条款,将审阅时间缩短至 3–4 分钟。
问题
Reading long contracts is mentally exhausting; most clauses are boilerplate, but the few anomalous clauses can hide significant risks.
结果
On a benchmark of 100 synthetic leases, WeirdClauses achieved Recall@10% of 0.517, Mean Percentile Rank of 0.820, and MRR of 0.916, demonstrating that reviewing the top 10% of flagged clauses captures the majority of anomalous terms.
工作流
- Ingest contract file (.txt, .md, .docx, .pdf)
- Segment into clauses with exact character spans
- Compute per-token linguistic surprisal using Qwen/Qwen2.5-0.5B
- Retrieve nearest standard clauses via sentence-transformers/all-MiniLM-L6-v2
- Condition surprisal on standard clauses
- Aggregate token surprisals (top-quartile mean, Z-score)
- Rank clauses by unusualness
- Apply rule-based regex to extract key facts
- Generate standalone HTML heat-map report
- Present interactive web explorer or CLI ranking table
证据
By reading just the top 10% highest-ranked clauses, you capture over 51.7% of all anomalous terms.
Zero document text, tokens, or metadata ever leave your machine. No API keys, no telemetry, no recurring SaaS subscriptions.
The very first unusual clause in the document appears at rank 1.09 on average—meaning the top-ranked clause is almost guaranteed to be an anomaly.
- 记录日期: 2026-10-25T12:11:15.336Z