ModelSpec is an analysis of alternatives for AI models: it decides which models fit a job from your requirements, sourced benchmarks and real cost, and shows its work.

Gemini 2.5 Flash vs Gemini 3.8 Flash for General assistant on a budget, as of 2026-09-23

Find an active assistant that keeps one task at or under $0.05 without ignoring response quality.

Worked example as of 2026-09-23, from the public data image.

What the evidence says

The evidence separates them: Gemini 3.8 Flash leads for General assistant on a budget, with a 58% chance of being the best model in the full lineup for this job, as of 2026-09-23.

Gemini 2.5 Flash has a 15% chance of matching or beating Gemini 3.8 Flash on this job's objective.

probability bands: a model joins the leader when P(its score >= the leader's) >= 0.25 under the score posteriors; a weighted capability with an 80% interval wider than 2.8 is not enough evidence

Decision status: partial. P(best) and score intervals retain the full ranked lineup for this job, including models beyond this pair and models with thin evidence. Models with unknown objective values remain unranked and are outside this probability. P(best) is not a head-to-head probability. Separation from this challenger need not mean a unique best model across that lineup.

Scores and score intervals use the objective's dimensionless normalised units. Cost per task is in USD for the selected offering and the applied spec's task size. When task size is omitted, the engine uses its documented default. Unavailable means the engine returned no value.

ModelScoreScore intervalP(best), ranked job lineupCost per task, USDSelected offering: provider / region / tierCapability estimates and intervals
Gemini 2.5 Flash0.407801[0.331894, 0.483709]8%0.022google-gemini-api / global / standard
  • chat_preference: -0.576719849; interval [-0.734872721, -0.418566977]; benchmarks 34; direct benchmarks 34
Gemini 3.8 Flash0.5[0.415207, 0.584793]58%0.045google-gemini-api / global / standard
  • chat_preference: 0.465029132; interval [0.288363151, 0.641695113]; benchmarks 24; direct benchmarks 24

At most $0.05 a task; quality still ranked.

Requirements

Preferences

Applied template spec
spec_version
1
where
  • model.class = text-generator
  • model.lifecycle = active
  • offering.cost_per_task <= 0.05
optimize
weights
chat_preference
0.5
-offering.cost_per_task
0.5

Evidence for Gemini 2.5 Flash

BenchmarkVersionMeasurementUnitPublished intervalEvidence dateMeasurement conditionsProvenance
arena_elo_codingText Arena coding category, raw (not style-controlled)1423.43Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_elo_overallText Arena overall, raw (not style-controlled)1417.27Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_elo_style_controltext_style_control / overall, latest split, revision 1880dbebff5b1409.69Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_businesstext_style_control / industry_business_and_management_and_financial_operations, latest split, revision 1880dbebff5b1399.28Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_chineseUnavailable1438.551159423747Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_codingtext_style_control / coding, latest split, revision 1880dbebff5b1423.54Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_creative_writingtext_style_control / creative_writing, latest split, revision 1880dbebff5b1395.92Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_englishUnavailable1413.1526534766867Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_experttext_style_control / expert, latest split, revision 1880dbebff5b1423.28Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_factualityUnavailable1436.5672969425964Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_frenchUnavailable1424.79612570021Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_germanUnavailable1406.7010285918066Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_hard_promptstext_style_control / hard_prompts, latest split, revision 1880dbebff5b1419.52Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_entertainment_sports_mediaUnavailable1386.9174855746019Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_mathematicalUnavailable1416.2080990590348Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_software_it_servicesUnavailable1420.9827682508285Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_instruction_followingtext_style_control / instruction_following, latest split, revision 1880dbebff5b1400.34Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_japaneseUnavailable1391.9533422126951Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_koreanUnavailable1372.0849796785787Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_legaltext_style_control / industry_legal_and_government, latest split, revision 1880dbebff5b1426.59Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_longer_querytext_style_control / longer_query, latest split, revision 1880dbebff5b1417.79Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_mathtext_style_control / math, latest split, revision 1880dbebff5b1405.78Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_medicinetext_style_control / industry_medicine_and_healthcare, latest split, revision 1880dbebff5b1426.64Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_multi_turntext_style_control / multi_turn, latest split, revision 1880dbebff5b1403.26Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_non_englishtext_style_control / non_english, latest split, revision 1880dbebff5b1400.17Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_polishUnavailable1399.161677862202Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_russianUnavailable1409.692764828731Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_sciencetext_style_control / industry_life_and_physical_and_social_science, latest split, revision 1880dbebff5b1430.49Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_spanishUnavailable1405.8987859835715Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_visionvision_style_control / overall, latest split, revision 1880dbebff5b1215.04Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_vision_diagramUnavailable1234.017225440668Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_vision_homeworkUnavailable1239.0784738969742Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_vision_ocrUnavailable1222.7386908468304Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_writingtext_style_control / industry_writing_and_literature_and_language, latest split, revision 1880dbebff5b1402.96Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source

Missing facts for Gemini 2.5 Flash

Evidence for Gemini 3.8 Flash

BenchmarkVersionMeasurementUnitPublished intervalEvidence dateMeasurement conditionsProvenance
arena_elo_codingText Arena coding category, raw (not style-controlled)1513.97Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_elo_overallText Arena overall, raw (not style-controlled)1494.67Arena score (Elo scale)[1486.14, 1503.21]2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: 5076
Source
arena_elo_style_controltext_style_control / overall, latest split, revision 1880dbebff5b1493.01Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_businesstext_style_control / industry_business_and_management_and_financial_operations, latest split, revision 1880dbebff5b1495.21Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_chinesetext_style_control / chinese, latest split, revision 1880dbebff5b1543.31Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_codingtext_style_control / coding, latest split, revision 1880dbebff5b1534.96Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_creative_writingtext_style_control / creative_writing, latest split, revision 1880dbebff5b1495.85Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_englishtext_style_control / english, latest split, revision 1880dbebff5b1502.66Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_experttext_style_control / expert, latest split, revision 1880dbebff5b1502.04Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_factualitytext_factuality / overall, latest split, revision 1880dbebff5b1489.99Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_hard_promptstext_style_control / hard_prompts, latest split, revision 1880dbebff5b1517.19Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_entertainment_sports_mediatext_style_control / industry_entertainment_and_sports_and_media, latest split, revision 1880dbebff5b1465.53Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_mathematicaltext_style_control / industry_mathematical, latest split, revision 1880dbebff5b1519.73Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_industry_software_it_servicestext_style_control / industry_software_and_it_services, latest split, revision 1880dbebff5b1518.01Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_instruction_followingtext_style_control / instruction_following, latest split, revision 1880dbebff5b1491.7Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_legaltext_style_control / industry_legal_and_government, latest split, revision 1880dbebff5b1482.91Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_longer_querytext_style_control / longer_query, latest split, revision 1880dbebff5b1508.86Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_medicinetext_style_control / industry_medicine_and_healthcare, latest split, revision 1880dbebff5b1498.96Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_multi_turntext_style_control / multi_turn, latest split, revision 1880dbebff5b1513.3Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_non_englishtext_style_control / non_english, latest split, revision 1880dbebff5b1478.34Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_russiantext_style_control / russian, latest split, revision 1880dbebff5b1494.62Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_sciencetext_style_control / industry_life_and_physical_and_social_science, latest split, revision 1880dbebff5b1506.01Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_sc_writingtext_style_control / industry_writing_and_literature_and_language, latest split, revision 1880dbebff5b1499.8Arena score (Elo scale)Unavailable2026-09-13
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source
arena_webdevwebdev / overall, latest split, revision 1880dbebff5b1583.75Arena score (Elo scale)Unavailable2026-09-23
  • Effort: Unavailable
  • Subcategory: Unavailable
  • Harness: Unavailable
  • Measured by: independent_evaluator
  • Sample size: Unavailable
Source

Missing facts for Gemini 3.8 Flash

What this template teaches

The budget is a Must; inside it, cost and quality share the ranking equally.

Decision dec_31e56e608d050b9f9287f060 on public snapshot snap_05a963d2477ac2fb.

Read the full dated job answer.

The live board uses current data. This link applies the template to its full lineup.

Apply this template on Decide

Human lookup is free on Decide. CLI, API, and MCP access requires a key. Access and pricing.

Use-case examples · Model comparisons · How we decide

Feedback