Claude Sonnet 4

Anthropic · anthropic/claude-sonnet-4-20250514

ProviderAnthropic
Familyclaude-sonnet
Typellm-reasoning
Statusactive
Released2025-05-22
Updated2025-05-22

Reported benchmark scores

These scores carry one collection date for the whole card (2026-04) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
Aider Polyglot Benchmarkunassessed75.5
AlpacaEvalunassessed50.8
Arena Elo — Codingunassessed1390.0
Arena Elo — Hard Promptsunassessed1430.5
Arena Elo — Mathunassessed1370.0
Arena Elo — Overall (Text)unassessed1380.0
Arena Elo — Style Controlunassessed1398.5
Arena Elo — Visionunassessed1207.0
Artificial Analysis Intelligence Indexunassessed85.0
Artificial Analysis Output Speedunassessed73.0
BBQ (Bias Benchmark for QA)unassessed87.5
ChartQAunassessed84.2
DocVQAunassessed91.5
GPQA Diamondunassessed74.1
HELM Safetyunassessed91.8
HumanEvalunassessed91.5
IFEvalunassessed90.4
LiveCodeBenchunassessed59.0
MATH-500unassessed93.8
MathVistaunassessed62.1
MMLU: Astronomyunassessed77.8
MMLU: Biology (subcategory)unassessed85.5
MMLU: Business Ethicsunassessed79.5
MMLU: Chemistry (subcategory)unassessed79.8
MMLU: Clinical Knowledgeunassessed84.2
MMLU: Computer Science (subcategory)unassessed86.2
MMLU: Jurisprudenceunassessed77.8
MMLU: Physics (unresolved key)unassessed82.5
MMLU-Prounassessed83.0
MMLU: Professional Accountingunassessed69.8
MMLU: Professional Lawunassessed75.5
MMMUunassessed68.2
MT-Benchunassessed9.2
MultiPL-Eunassessed86.7
MultiPL-E: C++unassessed85.8
MultiPL-E: C#unassessed85.5
MultiPL-E: Gounassessed82.8
MultiPL-E: Javaunassessed89.1
MultiPL-E: JavaScriptunassessed89.5
MultiPL-E: Juliaunassessed67.5
MultiPL-E: Kotlin (unconfirmed)unassessed79.8
MultiPL-E: Luaunassessed62.1
MultiPL-E: Perlunassessed58.8
MultiPL-E: PHPunassessed82.2
MultiPL-E: Pythonunassessed93.2
MultiPL-E: Runassessed65.2
MultiPL-E: Rubyunassessed75.2
MultiPL-E: Rustunassessed78.5
MultiPL-E: Scalaunassessed68.5
MultiPL-E: Swiftunassessed73.5
MultiPL-E: TypeScriptunassessed88.2
SWE-bench Agentunassessed55.8
SWE-bench Verifiedunassessed65.3
τ-benchunassessed61.5
Terminal-Benchunassessed48.2
Terminal-Bench 2.0unassessed59.1
ToxiGenunassessed94.5
WildBenchunassessed78.2

Data

This card as JSON · Edit on GitHub