Llama-4-Maverick-17B-128E-Instruct-FP8

Meta · meta/llama-4-maverick-17b-128e-instruct-fp8

ProviderMeta
Familyllama
Typevlm
Statusactive
Released2025-04-05
Updated2025-04-05

Reported benchmark scores

These scores carry one collection date for the whole card (2026-04) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
Aider Polyglot Benchmarkunassessed15.6
Arena Elo — Codingunassessed1320.0
Arena Elo — Mathunassessed1300.0
Arena Elo — Overall (Text)unassessed1310.0
BBQ (Bias Benchmark for QA)unassessed81.8
ChartQAunassessed90.0
DocVQAunassessed94.4
GPQA Diamondunassessed62.5
HELM Safetyunassessed86.5
HumanEvalunassessed85.5
IFEvalunassessed83.0
LiveCodeBenchunassessed39.7
MATH-500unassessed82.2
MathVistaunassessed73.7
MGSM (Multilingual Grade School Math)unassessed92.3
MMLU-Prounassessed73.5
MMMUunassessed73.4
MultiPL-E: C#unassessed75.5
MultiPL-E: Juliaunassessed55.8
MultiPL-E: Kotlin (unconfirmed)unassessed66.8
MultiPL-E: Luaunassessed49.8
MultiPL-E: Perlunassessed44.5
MultiPL-E: PHPunassessed73.2
MultiPL-E: Runassessed52.2
MultiPL-E: Rubyunassessed60.2
MultiPL-E: Scalaunassessed54.5
MultiPL-E: Swiftunassessed59.8
ToxiGenunassessed89.8

Data

This card as JSON · Edit on GitHub