Claude Fable 5.1 Benchmark Results: The Gains Are Mostly in Execution

Описание и применение

<p>Claude Fable 5.1 looks less like a general reasoning leap and more like a substantial upgrade for agents that have to keep working.</p> <p>Its biggest reported improvements are in scientific research, business automation, terminal coding, and other tasks that require planning, tool calls, verification, and recovery over multiple steps. The gains are much smaller on closed-ended reasoning and shorter IDE coding tasks.</p> <p>That distinction matters more than any single leaderboard number.</p> <h2> The short version </h2> <ul> <li>Fable 5.1 scored <strong>52.6%</strong> on Terminal-Bench-Sci

Задача

<p>Claude Fable 5.1 looks less like a general reasoning leap and more like a substantial upgrade for agents that have to keep working.</p> <p>Its biggest reported improvements are in scientific research, business automation, terminal coding, and other tasks that require planning, tool calls, verification, and recovery over multiple steps. The gains are much smaller on closed-ended reasoning and shorter IDE coding tasks.</p> <p>That distinction matters more than any single leaderboard number.</p> <h2> The short version </h2> <ul> <li>Fable 5.1 scored <strong>52.6%</strong> on Terminal-Bench-Sci

Результат

<p>Claude Fable 5.1 looks less like a general reasoning leap and more like a substantial upgrade for agents that have to keep working.</p> <p>Its biggest reported improvements are in scientific research, business automation, terminal coding, and other tasks that require planning, tool calls, verification, and recovery over multiple steps. The gains are much smaller on closed-ended reasoning and shorter IDE coding tasks.</p> <p>That distinction matters more than any single leaderboard number.</p> <h2> The short version </h2> <ul> <li>Fable 5.1 scored <strong>52.6%</strong> on Terminal-Bench-Sci

Доказательства

Claude Fable 5.1 Benchmark Results: The Gains Are Mostly in Execution

Источник