Gemma 3 27B

Google DeepMind · google/gemma-3-27b-it

ProviderGoogle DeepMind
Familygemma
Typevlm
Statusactive
Released2025-03-12
Updated2025-03-12

Reported benchmark scores

These scores carry one collection date for the whole card (2026-04) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
AI2D (AI2 Diagrams)unassessed84.5
Aider Polyglot Benchmarkunassessed4.9
Arena Elo — Codingunassessed1270.0
Arena Elo — Hard Promptsunassessed1364.9
Arena Elo — Mathunassessed1250.0
Arena Elo — Overall (Text)unassessed1260.0
Arena Elo — Style Controlunassessed1365.1
Arena Elo — Visionunassessed1157.3
Artificial Analysis Intelligence Indexunassessed70.0
Artificial Analysis Output Speedunassessed82.0
BIG-Bench Hardunassessed56.2
ChartQAunassessed72.5
DocVQAunassessed82.1
GPQA Diamondunassessed58.2
GSM8Kunassessed95.9
HumanEvalunassessed79.5
IFEvalunassessed79.0
LiveCodeBenchunassessed29.7
MATH-500unassessed77.8
MathVistaunassessed48.5
MedMCQAunassessed62.6
MedQAunassessed74.9
MMLU-Prounassessed67.5
MMMUunassessed55.2
MuSRunassessed25.2
PubMedQAunassessed73.4

Data

This card as JSON · Edit on GitHub