Which phrases make a paragraph read like AI? I built a heatmap and measured it on HC3

说明与用途

AiSniff 通过规则高亮 AI 写作模式的短语，并提供重写提示，但整体检测效果有限。

问题

Identify specific phrases that make a paragraph appear AI‑generated rather than relying on a single opaque score.

结果

AiSniff provides phrase‑level AI‑writing pattern detection with rule explanations and rewrite hints, but its overall detection performance is weak (AUROC 0.63 English, 0.59 Chinese).

工作流

• Paste text into the web interface or run the CLI tool.
• AiSniff scans the text against 61 versioned JSON rules for English and Traditional Chinese.
• Underlined phrases are displayed with rule details and rewrite suggestions.
• A side panel groups hits by type, shows density per 1,000 words or characters, and offers a before/after compare view.
• Export the marked text as PNG if needed.
• In CI, run npx github:Arthur031221/AiSniff lint draft.md to fail a build when density is too high.

证据

I built AiSniff.

来源

It runs fully in the browser. There is no server and no model call, so nothing you paste leaves the page.

来源

There are 61 rules in versioned JSON packs for English and Traditional Chinese.

来源

At least one English rule fires on 28% of ChatGPT answers and 2% of human answers.

来源

The AUROC is 0.63 for English and 0.59 for Chinese, and 72% of the English ChatGPT answers have no hit at all.

来源