ModelSpec is an analysis of alternatives for AI models: it decides which models fit a job from your requirements, sourced benchmarks and real cost, and shows its work.

Claude Opus 5.5 vs Gemini 3.7 Flash for General assistant (balanced), as of 2026-09-23

Find an active assistant that balances how people rate its responses against task cost.

Worked example as of 2026-09-23, from the public data image.

What the evidence says

The evidence can't separate them for this job.

Gemini 3.7 Flash has a 39% chance of matching or beating Claude Opus 5.5 on this job's objective.

probability bands: a model joins the leader when P(its score >= the leader's) >= 0.25 under the score posteriors; a weighted capability with an 80% interval wider than 2.8 is not enough evidence

Decision status: partial. P(best) and score intervals retain the full ranked lineup for this job, including models beyond this pair and models with thin evidence. Models with unknown objective values remain unranked and are outside this probability. P(best) is not a head-to-head probability.

Scores and score intervals use the objective's dimensionless normalised units. Cost per task is in USD for the selected offering and the applied spec's task size. When task size is omitted, the engine uses its documented default. Unavailable means the engine returned no value.

ModelScoreScore intervalP(best), ranked job lineupCost per task, USDSelected offering: provider / region / tierCapability estimates and intervals
Claude Opus 5.50.846914[0.703041, 0.990787]41%0.24anthropic / global / standard
  • chat_preference: 1.584232494; interval [0.565758585, 2.602706403]; benchmarks 1; direct benchmarks 1
Gemini 3.7 Flash0.813658[0.788701, 0.838614]4%0.045google-gemini-api / global / standard
  • chat_preference: 0.402038706; interval [0.225372725, 0.578704687]; benchmarks 24; direct benchmarks 24

Response quality first, cost as a real second term.

Requirements

Preferences

Applied template spec
spec_version
1
where
  • model.class = text-generator
  • model.lifecycle = active
optimize
weights
chat_preference
0.6
-offering.cost_per_task
0.4

Evidence for Claude Opus 5.5

BenchmarkVersionMeasurementUnitPublished intervalEvidence dateMeasurement conditionsProvenance
arena_webdevwebdev / overall, latest split, revision 1880dbebff5b1818.41Arena score (Elo scale)Unavailable2026-09-23
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source

Missing facts for Claude Opus 5.5

Evidence for Gemini 3.7 Flash

BenchmarkVersionMeasurementUnitPublished intervalEvidence dateMeasurement conditionsProvenance
arena_elo_style_controltext_style_control / overall, latest split, revision 1880dbebff5b1489.82Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_businesstext_style_control / industry_business_and_management_and_financial_operations, latest split, revision 1880dbebff5b1474.41Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_chinesetext_style_control / chinese, latest split, revision 1880dbebff5b1555.76Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_codingtext_style_control / coding, latest split, revision 1880dbebff5b1520.59Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_creative_writingtext_style_control / creative_writing, latest split, revision 1880dbebff5b1494.76Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_englishtext_style_control / english, latest split, revision 1880dbebff5b1487.54Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_experttext_style_control / expert, latest split, revision 1880dbebff5b1515.38Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_factualitytext_factuality / overall, latest split, revision 1880dbebff5b1485.68Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_frenchtext_style_control / french, latest split, revision 1880dbebff5b1509.07Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_hard_promptstext_style_control / hard_prompts, latest split, revision 1880dbebff5b1506.7Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_entertainment_sports_mediatext_style_control / industry_entertainment_and_sports_and_media, latest split, revision 1880dbebff5b1476.55Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_mathematicaltext_style_control / industry_mathematical, latest split, revision 1880dbebff5b1510.79Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_software_it_servicestext_style_control / industry_software_and_it_services, latest split, revision 1880dbebff5b1511.67Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_instruction_followingtext_style_control / instruction_following, latest split, revision 1880dbebff5b1484.41Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_legaltext_style_control / industry_legal_and_government, latest split, revision 1880dbebff5b1496.89Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_longer_querytext_style_control / longer_query, latest split, revision 1880dbebff5b1498.07Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_mathtext_style_control / math, latest split, revision 1880dbebff5b1521.51Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_medicinetext_style_control / industry_medicine_and_healthcare, latest split, revision 1880dbebff5b1493.05Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_multi_turntext_style_control / multi_turn, latest split, revision 1880dbebff5b1498.23Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_non_englishtext_style_control / non_english, latest split, revision 1880dbebff5b1483.76Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_russiantext_style_control / russian, latest split, revision 1880dbebff5b1513.63Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_sciencetext_style_control / industry_life_and_physical_and_social_science, latest split, revision 1880dbebff5b1510.95Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_writingtext_style_control / industry_writing_and_literature_and_language, latest split, revision 1880dbebff5b1488.65Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_webdevwebdev / overall, latest split, revision 1880dbebff5b1594.56Arena score (Elo scale)Unavailable2026-09-23
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source

Missing facts for Gemini 3.7 Flash

What this template teaches

A 60/40 blend lets a large price gap overturn a small quality lead.

Decision dec_a6d258fd73f7d9848e50fa39 on public snapshot snap_05a963d2477ac2fb.

Read the full dated job answer.

The live board uses current data. This link applies the template to its full lineup.

Apply this template on Decide

Human lookup is free on Decide. CLI, API, and MCP access requires a key. Access and pricing.

Use-case examples · Model comparisons · How we decide

Feedback