ModelSpec is an analysis of alternatives for AI models: it decides which models fit a job from your requirements, sourced benchmarks and real cost, and shows its work.

GPT-6 Astra vs GPT-6 Sol for Maths and proofs, as of 2026-09-23

Find a text model with the strongest evidence on mathematical problems and proofs.

Worked example as of 2026-09-23, from the public data image.

What the evidence says

The evidence can't separate them for this job.

GPT-6 Sol has a 31% chance of matching or beating GPT-6 Astra on this job's objective.

probability bands: a model joins the leader when P(its score >= the leader's) >= 0.25 under the score posteriors; a weighted capability with an 80% interval wider than 2.8 is not enough evidence

Decision status: partial. P(best) and score intervals retain the full ranked lineup for this job, including models beyond this pair and models with thin evidence. Models with unknown objective values remain unranked and are outside this probability. P(best) is not a head-to-head probability.

Scores and score intervals use the objective's dimensionless normalised units. Cost per task is in USD for the selected offering and the applied spec's task size. When task size is omitted, the engine uses its documented default. Unavailable means the engine returned no value.

ModelScoreScore intervalP(best), ranked job lineupCost per task, USDSelected offering: provider / region / tierCapability estimates and intervals
GPT-6 Astra1.0[0.747794, 1.252206]25%0.6azure-ai-foundry / global-short-context / standard
  • maths: 1.561674136; interval [0.843459177, 2.279889095]; benchmarks 4; direct benchmarks 2
GPT-6 Sol0.836582[0.496071, 1.177094]11%0.12azure-ai-foundry / global-short-context / standard
  • maths: 1.096304173; interval [0.126618298, 2.065990048]; benchmarks 2; direct benchmarks 1

Strongest maths evidence, cost no object.

Requirements

Preferences

Applied template spec
spec_version
1
where
  • model.class = text-generator
optimize
weights
maths
1.0

Evidence for GPT-6 Astra

BenchmarkVersionMeasurementUnitPublished intervalEvidence dateMeasurement conditionsProvenance
arxivmathArXivMath, MathArena Overall table92.68percentUnavailable2026-09-30
  • Effort: max
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: benchmark_author
  • Sample size: Unavailable
Source
brokenarxivBrokenArXiv, MathArena Overall table90.67percentUnavailable2026-09-30
  • Effort: max
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: benchmark_author
  • Sample size: Unavailable
Source
frontiermath_tiers_1_3_v2FrontierMath-Tiers-1-3-v2-Private (Epoch AI run)93.68percentUnavailable2026-08-30
  • Effort: max
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
hleHumanity's Last Exam, Scale Labs leaderboard54.8percentUnavailable2026-09-30
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
hle_toolsHumanity's Last Exam (w/ tools)57.2percentUnavailable2026-09-03
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: provider_self_report
  • Sample size: Unavailable
Source

Missing facts for GPT-6 Astra

Evidence for GPT-6 Sol

BenchmarkVersionMeasurementUnitPublished intervalEvidence dateMeasurement conditionsProvenance
arxivmathArXivMath, MathArena Overall table91.32percentUnavailable2026-09-30
  • Effort: max
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: benchmark_author
  • Sample size: Unavailable
Source
brokenarxivBrokenArXiv, MathArena Overall table86.98percentUnavailable2026-09-30
  • Effort: max
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: benchmark_author
  • Sample size: Unavailable
Source

Missing facts for GPT-6 Sol

What this template teaches

Use one Must to select the right model class and one Prefer to state what best means.

Decision dec_25456c28ff3379f3b08db308 on public snapshot snap_05a963d2477ac2fb.

Read the full dated job answer.

The live board uses current data. This link applies the template to its full lineup.

Apply this template on Decide

Human lookup is free on Decide. CLI, API, and MCP access requires a key. Access and pricing.

Use-case examples · Model comparisons · How we decide

Feedback