o1-preview

OpenAI · openai/o1-preview

ProviderOpenAI
Familyo
Typellm-reasoning
Statuspreview
Released2024-09-12
Updated2024-09-12

Reported benchmark scores

These scores carry one collection date for the whole card (2026-04) and a source list rather than a source per score, so they cannot be attributed individually. They are shown as reported and are not verified evidence. Benchmark pages carry the reviewed, dated evidence where it exists.
BenchmarkCatalogue standingScore
Aider Polyglot Benchmarkunassessed61.7
Arena Elo — Codingunassessed1320.0
Arena Elo — Hard Promptsunassessed1396.1
Arena Elo — Mathunassessed1360.0
Arena Elo — Overall (Text)unassessed1330.0
Arena Elo — Style Controlunassessed1387.6
GPQA Diamondunassessed73.3
HumanEvalunassessed88.5
IFEvalunassessed86.0
LiveCodeBenchunassessed67.9
MATH-500unassessed92.5
MGSM (Multilingual Grade School Math)unassessed90.8
MMLU-Prounassessed78.0
SWE-bench Verifiedunassessed41.3

Data

This card as JSON · Edit on GitHub