Who Holds #1 on Every Hugging Face Official Benchmark? A Live Index
Description and use
A live index aggregates all Hugging Face official benchmark leaderboards, revealing which organization holds the most #1 positions across fields.
Problem
Hugging Face official benchmark leaderboards are spread across dozens of dataset pages, making it hard to identify which organization holds the most first-place spots across all benchmarks.
Outcome
The index tracks ~49 official benchmarks with ~1,000 leaderboard entries, showing that FINAL‑Bench holds the most first‑place spots (eleven) across various fields.
Workflow
- 1. Query Hugging Face API for list of datasets tagged as official benchmarks.
- 2. For each dataset, pull the ranked entries from the public API.
- 3. Aggregate results: count #1 positions per organization, per country, per field, compute gap to #2, and list top two models per benchmark.
- 4. Render a live view with charts, heatmaps, and tables.
- 5. Update automatically on each page visit.
- 6. Handle ties by counting each tied organization.
- 7. Derive country from publishing organization, not model name.
- 8. Measure #1‑to‑#2 gap relative to #2 score and direction‑aware for lower‑is‑better metrics.
Evidence
Hugging Face marks certain datasets as official benchmarks. Each one carries a leaderboard on its dataset page, built automatically from the .eval_results files that model repositories publish.
The problem: these leaderboards live on dozens of separate dataset pages. There is no single place that answers a simple question.
So we built one.
It is a live, read-only view that recomputes from the Hugging Face API on every visit.
Nothing is hand-entered. The page reads the list of datasets that Hugging Face tags as official benchmarks, pulls each board's ranked entries from the public API, and aggregates.
As of early October 2026 the index tracked around 49 official benchmarks with roughly a thousand leaderboard entries in total, and the single organization holding the most first-place spots was FINAL-Bench with eleven...
- Record date: 2026-10-15T14:41:13.725Z