ModelSpec is an analysis of alternatives for AI models: it decides which models fit a job from your requirements, sourced benchmarks and real cost, and shows its work.

Claude Opus 5.5 vs Grok 4.7 for General assistant (balanced), as of 2026-09-23

Find an active assistant that balances how people rate its responses against task cost.

Worked example as of 2026-09-23, from the public data image.

What the evidence says

The evidence can't separate them for this job.

Grok 4.7 has a 26% chance of matching or beating Claude Opus 5.5 on this job's objective.

probability bands: a model joins the leader when P(its score >= the leader's) >= 0.25 under the score posteriors; a weighted capability with an 80% interval wider than 2.8 is not enough evidence

Decision status: partial. P(best) and score intervals retain the full ranked lineup for this job, including models beyond this pair and models with thin evidence. Models with unknown objective values remain unranked and are outside this probability. P(best) is not a head-to-head probability.

Scores and score intervals use the objective's dimensionless normalised units. Cost per task is in USD for the selected offering and the applied spec's task size. When task size is omitted, the engine uses its documented default. Unavailable means the engine returned no value.

ModelScoreScore intervalP(best), ranked job lineupCost per task, USDSelected offering: provider / region / tierCapability estimates and intervals
Claude Opus 5.50.846914[0.703041, 0.990787]41%0.24anthropic / global / standard
  • chat_preference: 1.584232494; interval [0.565758585, 2.602706403]; benchmarks 1; direct benchmarks 1
Grok 4.70.745338[0.601465, 0.889211]7%0.104xai / global / standard
  • chat_preference: 0.204866691; interval [-0.813607219, 1.2233406]; benchmarks 1; direct benchmarks 1

Response quality first, cost as a real second term.

Requirements

Preferences

Applied template spec
spec_version
1
where
  • model.class = text-generator
  • model.lifecycle = active
optimize
weights
chat_preference
0.6
-offering.cost_per_task
0.4

Evidence for Claude Opus 5.5

BenchmarkVersionMeasurementUnitPublished intervalEvidence dateMeasurement conditionsProvenance
arena_webdevwebdev / overall, latest split, revision 1880dbebff5b1818.41Arena score (Elo scale)Unavailable2026-09-23
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source

Missing facts for Claude Opus 5.5

Evidence for Grok 4.7

BenchmarkVersionMeasurementUnitPublished intervalEvidence dateMeasurement conditionsProvenance
arena_webdevwebdev / overall, latest split, revision 1880dbebff5b1632.3Arena score (Elo scale)Unavailable2026-09-23
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source

Missing facts for Grok 4.7

What this template teaches

A 60/40 blend lets a large price gap overturn a small quality lead.

Decision dec_a6d258fd73f7d9848e50fa39 on public snapshot snap_05a963d2477ac2fb.

Read the full dated job answer.

The live board uses current data. This link applies the template to its full lineup.

Apply this template on Decide

Human lookup is free on Decide. CLI, API, and MCP access requires a key. Access and pricing.

Use-case examples · Model comparisons · How we decide

Feedback