Loading page...Загружаем страницу...正在加载页面...
AtlasRepo

Who Holds #1 on Every Hugging Face Official Benchmark? A Live Index

Description and use

A live index aggregates all Hugging Face official benchmark leaderboards, revealing which organization holds the most #1 positions across fields.

Problem

Hugging Face official benchmark leaderboards are spread across dozens of dataset pages, making it hard to identify which organization holds the most first-place spots across all benchmarks.

Outcome

The index tracks ~49 official benchmarks with ~1,000 leaderboard entries, showing that FINAL‑Bench holds the most first‑place spots (eleven) across various fields.

Workflow

  • 1. Query Hugging Face API for list of datasets tagged as official benchmarks.
  • 2. For each dataset, pull the ranked entries from the public API.
  • 3. Aggregate results: count #1 positions per organization, per country, per field, compute gap to #2, and list top two models per benchmark.
  • 4. Render a live view with charts, heatmaps, and tables.
  • 5. Update automatically on each page visit.
  • 6. Handle ties by counting each tied organization.
  • 7. Derive country from publishing organization, not model name.
  • 8. Measure #1‑to‑#2 gap relative to #2 score and direction‑aware for lower‑is‑better metrics.

Evidence

Hugging Face marks certain datasets as official benchmarks. Each one carries a leaderboard on its dataset page, built automatically from the .eval_results files that model repositories publish.

Source

The problem: these leaderboards live on dozens of separate dataset pages. There is no single place that answers a simple question.

Source

So we built one.

Source

It is a live, read-only view that recomputes from the Hugging Face API on every visit.

Source

Nothing is hand-entered. The page reads the list of datasets that Hugging Face tags as official benchmarks, pulls each board's ranked entries from the public API, and aggregates.

Source

As of early October 2026 the index tracked around 49 official benchmarks with roughly a thousand leaderboard entries in total, and the single organization holding the most first-place spots was FINAL-Bench with eleven...

Source

  • Record date: 2026-10-15T14:41:13.725Z