ModelSpec is an analysis of alternatives for AI models: it decides which models fit a job from your requirements, sourced benchmarks and real cost, and shows its work.

Claude Opus 5.5 vs Gemini 3.8 Flash for Regulated data on a budget, as of 2026-09-23

Find the cheapest offering with the data-handling commitments regulated workloads need.

Worked example as of 2026-09-23, from the public data image.

What the evidence says

The evidence can't separate them for this job.

Claude Opus 5.5 has a 31% chance of matching or beating Gemini 3.8 Flash on this job's objective.

probability bands: a model joins the leader when P(its score >= the leader's) >= 0.25 under the score posteriors; a weighted capability with an 80% interval wider than 2.8 is not enough evidence

Decision status: answered. P(best) and score intervals retain the full ranked lineup for this job, including models beyond this pair and models with thin evidence. Models with unknown objective values remain unranked and are outside this probability. P(best) is not a head-to-head probability.

Scores and score intervals use the objective's dimensionless normalised units. Cost per task is in USD for the selected offering and the applied spec's task size. When task size is omitted, the engine uses its documented default. Unavailable means the engine returned no value.

ModelScoreScore intervalP(best), ranked job lineupCost per task, USDSelected offering: provider / region / tierCapability estimates and intervals
Claude Opus 5.50.754054[0.589399, 0.918709]29%0.24google-vertex-ai / global / standard
  • chat_preference: 1.584232494; interval [0.565758585, 2.602706403]; benchmarks 1; direct benchmarks 1
Gemini 3.8 Flash0.819061[0.790499, 0.847622]43%0.045google-vertex-ai / global / standard
  • chat_preference: 0.465029132; interval [0.288363151, 0.641695113]; benchmarks 24; direct benchmarks 24

HIPAA-ready offerings; cheapest first, quality kept.

Requirements

Preferences

Applied template spec
spec_version
1
where
  • offering.data.trains_on_customer_data = No
  • offering.data.zero_retention = Yes
  • offering.attestation.baa = Yes
optimize
weights
-offering.cost_per_task
0.7
chat_preference
0.3

Evidence for Claude Opus 5.5

BenchmarkVersionMeasurementUnitPublished intervalEvidence dateMeasurement conditionsProvenance
arena_webdevwebdev / overall, latest split, revision 1880dbebff5b1818.41Arena score (Elo scale)Unavailable2026-09-23
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source

Missing facts for Claude Opus 5.5

Evidence for Gemini 3.8 Flash

BenchmarkVersionMeasurementUnitPublished intervalEvidence dateMeasurement conditionsProvenance
arena_elo_codingText Arena coding category, raw (not style-controlled)1513.97Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_elo_overallText Arena overall, raw (not style-controlled)1494.67Arena score (Elo scale)[1486.14, 1503.21]2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: 5076
Source
arena_elo_style_controltext_style_control / overall, latest split, revision 1880dbebff5b1493.01Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_businesstext_style_control / industry_business_and_management_and_financial_operations, latest split, revision 1880dbebff5b1495.21Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_chinesetext_style_control / chinese, latest split, revision 1880dbebff5b1543.31Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_codingtext_style_control / coding, latest split, revision 1880dbebff5b1534.96Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_creative_writingtext_style_control / creative_writing, latest split, revision 1880dbebff5b1495.85Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_englishtext_style_control / english, latest split, revision 1880dbebff5b1502.66Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_experttext_style_control / expert, latest split, revision 1880dbebff5b1502.04Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_factualitytext_factuality / overall, latest split, revision 1880dbebff5b1489.99Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_hard_promptstext_style_control / hard_prompts, latest split, revision 1880dbebff5b1517.19Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_entertainment_sports_mediatext_style_control / industry_entertainment_and_sports_and_media, latest split, revision 1880dbebff5b1465.53Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_mathematicaltext_style_control / industry_mathematical, latest split, revision 1880dbebff5b1519.73Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_software_it_servicestext_style_control / industry_software_and_it_services, latest split, revision 1880dbebff5b1518.01Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_instruction_followingtext_style_control / instruction_following, latest split, revision 1880dbebff5b1491.7Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_legaltext_style_control / industry_legal_and_government, latest split, revision 1880dbebff5b1482.91Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_longer_querytext_style_control / longer_query, latest split, revision 1880dbebff5b1508.86Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_medicinetext_style_control / industry_medicine_and_healthcare, latest split, revision 1880dbebff5b1498.96Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_multi_turntext_style_control / multi_turn, latest split, revision 1880dbebff5b1513.3Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_non_englishtext_style_control / non_english, latest split, revision 1880dbebff5b1478.34Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_russiantext_style_control / russian, latest split, revision 1880dbebff5b1494.62Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_sciencetext_style_control / industry_life_and_physical_and_social_science, latest split, revision 1880dbebff5b1506.01Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_writingtext_style_control / industry_writing_and_literature_and_language, latest split, revision 1880dbebff5b1499.8Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_webdevwebdev / overall, latest split, revision 1880dbebff5b1583.75Arena score (Elo scale)Unavailable2026-09-23
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source

Missing facts for Gemini 3.8 Flash

What this template teaches

The gates are the same as the other tiers; only the ranking moves toward cost.

Decision dec_dec45b7d93983dd1d411f74a on public snapshot snap_05a963d2477ac2fb.

Read the full dated job answer.

The live board uses current data. This link applies the template to its full lineup.

Apply this template on Decide

Human lookup is free on Decide. CLI, API, and MCP access requires a key. Access and pricing.

Use-case examples · Model comparisons · How we decide

Feedback