ModelSpec is an analysis of alternatives for AI models: it decides which models fit a job from your requirements, sourced benchmarks and real cost, and shows its work.

Gemini 3.1 Pro Preview vs Gemini 3.8 Flash for Regulated data on a budget, as of 2026-09-23

Find the cheapest offering with the data-handling commitments regulated workloads need.

Worked example as of 2026-09-23, from the public data image.

What the evidence says

The evidence separates them: Gemini 3.8 Flash leads for Regulated data on a budget, with a 43% chance of being the best model in the full lineup for this job, as of 2026-09-23.

Gemini 3.1 Pro Preview has an under 1% chance of matching or beating Gemini 3.8 Flash on this job's objective.

probability bands: a model joins the leader when P(its score >= the leader's) >= 0.25 under the score posteriors; a weighted capability with an 80% interval wider than 2.8 is not enough evidence

Decision status: answered. P(best) and score intervals retain the full ranked lineup for this job, including models beyond this pair and models with thin evidence. Models with unknown objective values remain unranked and are outside this probability. P(best) is not a head-to-head probability. Separation from this challenger need not mean a unique best model across that lineup.

Scores and score intervals use the objective's dimensionless normalised units. Cost per task is in USD for the selected offering and the applied spec's task size. When task size is omitted, the engine uses its documented default. Unavailable means the engine returned no value.

ModelScoreScore intervalP(best), ranked job lineupCost per task, USDSelected offering: provider / region / tierCapability estimates and intervals
Gemini 3.1 Pro Preview0.640982[0.616966, 0.664998]under 1%0.128google-vertex-ai / global / standard
  • chat_preference: 0.01105026; interval [-0.137500042, 0.159600562]; benchmarks 34; direct benchmarks 34
Gemini 3.8 Flash0.819061[0.790499, 0.847622]43%0.045google-vertex-ai / global / standard
  • chat_preference: 0.465029132; interval [0.288363151, 0.641695113]; benchmarks 24; direct benchmarks 24

HIPAA-ready offerings; cheapest first, quality kept.

Requirements

Preferences

Applied template spec
spec_version
1
where
  • offering.data.trains_on_customer_data = No
  • offering.data.zero_retention = Yes
  • offering.attestation.baa = Yes
optimize
weights
-offering.cost_per_task
0.7
chat_preference
0.3

Evidence for Gemini 3.1 Pro Preview

BenchmarkVersionMeasurementUnitPublished intervalEvidence dateMeasurement conditionsProvenance
arena_elo_style_controltext_style_control / overall, latest split, revision 1880dbebff5b1486.81Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_businesstext_style_control / industry_business_and_management_and_financial_operations, latest split, revision 1880dbebff5b1477.34Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_chinesetext_style_control / chinese, latest split, revision 1880dbebff5b1530.02Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_codingtext_style_control / coding, latest split, revision 1880dbebff5b1520.16Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_creative_writingtext_style_control / creative_writing, latest split, revision 1880dbebff5b1480.3Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_documentdocument / overall, latest split, revision 1880dbebff5b1443.92Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_englishtext_style_control / english, latest split, revision 1880dbebff5b1489.13Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_experttext_style_control / expert, latest split, revision 1880dbebff5b1509.05Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_factualitytext_factuality / overall, latest split, revision 1880dbebff5b1471.8Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_frenchtext_style_control / french, latest split, revision 1880dbebff5b1501.84Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_germantext_style_control / german, latest split, revision 1880dbebff5b1493.58Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_hard_promptstext_style_control / hard_prompts, latest split, revision 1880dbebff5b1507.49Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_entertainment_sports_mediatext_style_control / industry_entertainment_and_sports_and_media, latest split, revision 1880dbebff5b1467.54Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_mathematicaltext_style_control / industry_mathematical, latest split, revision 1880dbebff5b1485.24Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_software_it_servicestext_style_control / industry_software_and_it_services, latest split, revision 1880dbebff5b1511.95Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_instruction_followingtext_style_control / instruction_following, latest split, revision 1880dbebff5b1481.01Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_japanesetext_style_control / japanese, latest split, revision 1880dbebff5b1494.05Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_koreantext_style_control / korean, latest split, revision 1880dbebff5b1458.5Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_legaltext_style_control / industry_legal_and_government, latest split, revision 1880dbebff5b1497.14Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_longer_querytext_style_control / longer_query, latest split, revision 1880dbebff5b1499.93Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_mathtext_style_control / math, latest split, revision 1880dbebff5b1489.37Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_medicinetext_style_control / industry_medicine_and_healthcare, latest split, revision 1880dbebff5b1502.96Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_multi_turntext_style_control / multi_turn, latest split, revision 1880dbebff5b1494.74Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_non_englishtext_style_control / non_english, latest split, revision 1880dbebff5b1479.67Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_polishtext_style_control / polish, latest split, revision 1880dbebff5b1495.98Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_russiantext_style_control / russian, latest split, revision 1880dbebff5b1500.29Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_sciencetext_style_control / industry_life_and_physical_and_social_science, latest split, revision 1880dbebff5b1512.17Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_spanishtext_style_control / spanish, latest split, revision 1880dbebff5b1480.32Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_visionvision_style_control / overall, latest split, revision 1880dbebff5b1278.69Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_vision_diagramvision_style_control / diagram, latest split, revision 1880dbebff5b1308.97Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_vision_homeworkvision_style_control / homework, latest split, revision 1880dbebff5b1311.09Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_vision_ocrvision_style_control / ocr, latest split, revision 1880dbebff5b1292.97Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_writingtext_style_control / industry_writing_and_literature_and_language, latest split, revision 1880dbebff5b1480.94Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_webdevwebdev / overall, latest split, revision 1880dbebff5b1446.69Arena score (Elo scale)Unavailable2026-09-23
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source

Missing facts for Gemini 3.1 Pro Preview

Evidence for Gemini 3.8 Flash

BenchmarkVersionMeasurementUnitPublished intervalEvidence dateMeasurement conditionsProvenance
arena_elo_codingText Arena coding category, raw (not style-controlled)1513.97Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_elo_overallText Arena overall, raw (not style-controlled)1494.67Arena score (Elo scale)[1486.14, 1503.21]2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: 5076
Source
arena_elo_style_controltext_style_control / overall, latest split, revision 1880dbebff5b1493.01Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_businesstext_style_control / industry_business_and_management_and_financial_operations, latest split, revision 1880dbebff5b1495.21Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_chinesetext_style_control / chinese, latest split, revision 1880dbebff5b1543.31Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_codingtext_style_control / coding, latest split, revision 1880dbebff5b1534.96Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_creative_writingtext_style_control / creative_writing, latest split, revision 1880dbebff5b1495.85Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_englishtext_style_control / english, latest split, revision 1880dbebff5b1502.66Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_experttext_style_control / expert, latest split, revision 1880dbebff5b1502.04Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_factualitytext_factuality / overall, latest split, revision 1880dbebff5b1489.99Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_hard_promptstext_style_control / hard_prompts, latest split, revision 1880dbebff5b1517.19Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_entertainment_sports_mediatext_style_control / industry_entertainment_and_sports_and_media, latest split, revision 1880dbebff5b1465.53Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_mathematicaltext_style_control / industry_mathematical, latest split, revision 1880dbebff5b1519.73Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_software_it_servicestext_style_control / industry_software_and_it_services, latest split, revision 1880dbebff5b1518.01Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_instruction_followingtext_style_control / instruction_following, latest split, revision 1880dbebff5b1491.7Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_legaltext_style_control / industry_legal_and_government, latest split, revision 1880dbebff5b1482.91Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_longer_querytext_style_control / longer_query, latest split, revision 1880dbebff5b1508.86Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_medicinetext_style_control / industry_medicine_and_healthcare, latest split, revision 1880dbebff5b1498.96Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_multi_turntext_style_control / multi_turn, latest split, revision 1880dbebff5b1513.3Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_non_englishtext_style_control / non_english, latest split, revision 1880dbebff5b1478.34Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_russiantext_style_control / russian, latest split, revision 1880dbebff5b1494.62Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_sciencetext_style_control / industry_life_and_physical_and_social_science, latest split, revision 1880dbebff5b1506.01Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_writingtext_style_control / industry_writing_and_literature_and_language, latest split, revision 1880dbebff5b1499.8Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_webdevwebdev / overall, latest split, revision 1880dbebff5b1583.75Arena score (Elo scale)Unavailable2026-09-23
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source

Missing facts for Gemini 3.8 Flash

What this template teaches

The gates are the same as the other tiers; only the ranking moves toward cost.

Decision dec_dec45b7d93983dd1d411f74a on public snapshot snap_05a963d2477ac2fb.

Read the full dated job answer.

The live board uses current data. This link applies the template to its full lineup.

Apply this template on Decide

Human lookup is free on Decide. CLI, API, and MCP access requires a key. Access and pricing.

Use-case examples · Model comparisons · How we decide

Feedback