I Built a 32,000-Word Uzbek Dictionary and Never Checked If It Was Actually What I Claimed It Was

说明与用途

作者构建了一个32,000词的乌兹别克语词典，错误地声称仅包含名词。经过审核后，词典被纠正并用于创建一个快速拼写检查器，单词匹配准确率为87.5%。

问题

The author claimed a 32,000-word Uzbek list contained only nouns, but it actually included verbs, leading to inaccurate downstream usage.

结果

An audited Uzbek word list enabled a fast, accurate spell-checker, demonstrating the value of verifying data claims before building tools.

工作流

• Collect community word lists
• Filter to nouns only (initially)
• Commit to repo without verification
• Audit list: count suffixes, identify verbs, remove duplicates
• Build fuzzy-matching spell-checker using string similarity
• Generate synthetic test set of 200 words with random typos
• Evaluate top‑1 and top‑5 accuracy
• Analyze shortcomings (synthetic typos, mislabeling, no frequency weighting)
• Publish code and results on GitHub
• Invite community feedback

证据

12.1% of a list I documented as “nouns only” are verb infinitives, not nouns.

来源

87.5% of the time, the single top suggestion is the exact word the person meant to type. 99% of the time, it’s somewhere in the top 5.

来源