We Scored 17 Real Playwright Test Suites: The State of Playwright Quality in 2026

说明与用途

该研究对17个公开的Playwright测试套件进行评分，发现5,467条违规记录，其中大部分是原始定位器反模式。即使评分高的套件也可能隐藏密集的反模式。

问题

Managed QA vendors claim to write good Playwright tests, but claims are not measurable and many real-world suites contain anti‑patterns that reduce reliability.

结果

The study quantified 5,467 rule violations across 1,214 spec files, highlighting raw locators and missing assertions as the most common issues. Scores ranged from 77/100 to 98/100, showing that high grades can mask dense anti‑pattern clusters.

工作流

• 1. Install playwright‑score via npm. 2. Clone each target repo’s Playwright subdirectory with a shallow, sparse git clone. 3. Run playwright-score with the standard profile and threshold 80. 4. Collect the JSON findings and aggregate by rule. 5. Analyze the results to identify high‑impact anti‑patterns.
• 6. Prioritize fixes for raw locators, hard‑coded waits, and missing assertions.
• 7. Re‑run the scorer to verify improvements.
• 8. Repeat periodically to track quality over time.

证据

5,467 individual rule violations found

来源

30.1% of all locators are raw CSS/XPath

来源

12 / 17 repos have a test with zero assertions

来源