ModelSpec is an analysis of alternatives for AI models: it decides which models fit a job from your requirements, sourced benchmarks and real cost, and shows its work.

Claude Opus 5.5 vs Gemini 3.8 Flash for General assistant (balanced), as of 2026-09-23

Find an active assistant that balances how people rate its responses against task cost.

Worked example as of 2026-09-23, from the public data image.

What the evidence says

The evidence can't separate them for this job.

Gemini 3.8 Flash has a 42% chance of matching or beating Claude Opus 5.5 on this job's objective.

probability bands: a model joins the leader when P(its score >= the leader's) >= 0.25 under the score posteriors; a weighted capability with an 80% interval wider than 2.8 is not enough evidence

Decision status: partial. P(best) and score intervals retain the full ranked lineup for this job, including models beyond this pair and models with thin evidence. Models with unknown objective values remain unranked and are outside this probability. P(best) is not a head-to-head probability.

Scores and score intervals use the objective's dimensionless normalised units. Cost per task is in USD for the selected offering and the applied spec's task size. When task size is omitted, the engine uses its documented default. Unavailable means the engine returned no value.

ModelScoreScore intervalP(best), ranked job lineupCost per task, USDSelected offering: provider / region / tierCapability estimates and intervals
Claude Opus 5.50.846914[0.703041, 0.990787]41%0.24anthropic / global / standard
  • chat_preference: 1.584232494; interval [0.565758585, 2.602706403]; benchmarks 1; direct benchmarks 1
Gemini 3.8 Flash0.822556[0.7976, 0.847512]7%0.045google-gemini-api / global / standard
  • chat_preference: 0.465029132; interval [0.288363151, 0.641695113]; benchmarks 24; direct benchmarks 24

Response quality first, cost as a real second term.

Requirements

Preferences

Applied template spec
spec_version
1
where
  • model.class = text-generator
  • model.lifecycle = active
optimize
weights
chat_preference
0.6
-offering.cost_per_task
0.4

Evidence for Claude Opus 5.5

BenchmarkVersionMeasurementUnitPublished intervalEvidence dateMeasurement conditionsProvenance
arena_webdevwebdev / overall, latest split, revision 1880dbebff5b1818.41Arena score (Elo scale)Unavailable2026-09-23
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source

Missing facts for Claude Opus 5.5

Evidence for Gemini 3.8 Flash

BenchmarkVersionMeasurementUnitPublished intervalEvidence dateMeasurement conditionsProvenance
arena_elo_codingText Arena coding category, raw (not style-controlled)1513.97Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_elo_overallText Arena overall, raw (not style-controlled)1494.67Arena score (Elo scale)[1486.14, 1503.21]2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: 5076
Source
arena_elo_style_controltext_style_control / overall, latest split, revision 1880dbebff5b1493.01Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_businesstext_style_control / industry_business_and_management_and_financial_operations, latest split, revision 1880dbebff5b1495.21Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_chinesetext_style_control / chinese, latest split, revision 1880dbebff5b1543.31Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_codingtext_style_control / coding, latest split, revision 1880dbebff5b1534.96Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_creative_writingtext_style_control / creative_writing, latest split, revision 1880dbebff5b1495.85Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_englishtext_style_control / english, latest split, revision 1880dbebff5b1502.66Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_experttext_style_control / expert, latest split, revision 1880dbebff5b1502.04Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_factualitytext_factuality / overall, latest split, revision 1880dbebff5b1489.99Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_hard_promptstext_style_control / hard_prompts, latest split, revision 1880dbebff5b1517.19Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_entertainment_sports_mediatext_style_control / industry_entertainment_and_sports_and_media, latest split, revision 1880dbebff5b1465.53Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_mathematicaltext_style_control / industry_mathematical, latest split, revision 1880dbebff5b1519.73Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_software_it_servicestext_style_control / industry_software_and_it_services, latest split, revision 1880dbebff5b1518.01Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_instruction_followingtext_style_control / instruction_following, latest split, revision 1880dbebff5b1491.7Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_legaltext_style_control / industry_legal_and_government, latest split, revision 1880dbebff5b1482.91Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_longer_querytext_style_control / longer_query, latest split, revision 1880dbebff5b1508.86Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_medicinetext_style_control / industry_medicine_and_healthcare, latest split, revision 1880dbebff5b1498.96Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_multi_turntext_style_control / multi_turn, latest split, revision 1880dbebff5b1513.3Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_non_englishtext_style_control / non_english, latest split, revision 1880dbebff5b1478.34Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_russiantext_style_control / russian, latest split, revision 1880dbebff5b1494.62Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_sciencetext_style_control / industry_life_and_physical_and_social_science, latest split, revision 1880dbebff5b1506.01Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_writingtext_style_control / industry_writing_and_literature_and_language, latest split, revision 1880dbebff5b1499.8Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_webdevwebdev / overall, latest split, revision 1880dbebff5b1583.75Arena score (Elo scale)Unavailable2026-09-23
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source

Missing facts for Gemini 3.8 Flash

What this template teaches

A 60/40 blend lets a large price gap overturn a small quality lead.

Decision dec_a6d258fd73f7d9848e50fa39 on public snapshot snap_05a963d2477ac2fb.

Read the full dated job answer.

The live board uses current data. This link applies the template to its full lineup.

Apply this template on Decide

Human lookup is free on Decide. CLI, API, and MCP access requires a key. Access and pricing.

Use-case examples · Model comparisons · How we decide

Feedback