ModelSpec is an analysis of alternatives for AI models: it decides which models fit a job from your requirements, sourced benchmarks and real cost, and shows its work.
Gemini 2.5 Flash vs Gemini 3.8 Flash for General assistant on a budget, as of 2026-09-23
Find an active assistant that keeps one task at or under $0.05 without ignoring response quality.
Worked example as of 2026-09-23, from the public data image.
What the evidence says
The evidence separates them: Gemini 3.8 Flash leads for General assistant on a budget, with a 58% chance of being the best model in the full lineup for this job, as of 2026-09-23.
Gemini 2.5 Flash has a 15% chance of matching or beating Gemini 3.8 Flash on this job's objective.
probability bands: a model joins the leader when P(its score >= the leader's) >= 0.25 under the score posteriors; a weighted capability with an 80% interval wider than 2.8 is not enough evidence
Decision status: partial. P(best) and score intervals retain the full ranked lineup for this job, including models beyond this pair and models with thin evidence. Models with unknown objective values remain unranked and are outside this probability. P(best) is not a head-to-head probability. Separation from this challenger need not mean a unique best model across that lineup.
Scores and score intervals use the objective's dimensionless normalised units. Cost per task is in USD for the selected offering and the applied spec's task size. When task size is omitted, the engine uses its documented default. Unavailable means the engine returned no value.
| Model | Score | Score interval | P(best), ranked job lineup | Cost per task, USD | Selected offering: provider / region / tier | Capability estimates and intervals |
|---|---|---|---|---|---|---|
| Gemini 2.5 Flash | 0.407801 | [0.331894, 0.483709] | 8% | 0.022 | google-gemini-api / global / standard |
|
| Gemini 3.8 Flash | 0.5 | [0.415207, 0.584793] | 58% | 0.045 | google-gemini-api / global / standard |
|
At most $0.05 a task; quality still ranked.
Requirements
model.class = text-generator: A conversational assistant needs a text-generating model.model.lifecycle = active: An active model is still supported by its lab or provider.offering.cost_per_task <= 0.05: The offering must stay within the per-task budget.
Preferences
chat_preference: Prefer stronger assistants among offerings inside the budget.-offering.cost_per_task: Prefer the cheaper task among offerings inside the budget.
Applied template spec
spec_version- 1
where- model.class = text-generator
- model.lifecycle = active
- offering.cost_per_task <= 0.05
optimizeweightschat_preference- 0.5
-offering.cost_per_task- 0.5
Evidence for Gemini 2.5 Flash
| Benchmark | Version | Measurement | Unit | Published interval | Evidence date | Measurement conditions | Provenance |
|---|---|---|---|---|---|---|---|
| arena_elo_coding | Text Arena coding category, raw (not style-controlled) | 1423.43 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_elo_overall | Text Arena overall, raw (not style-controlled) | 1417.27 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_elo_style_control | text_style_control / overall, latest split, revision 1880dbebff5b | 1409.69 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_business | text_style_control / industry_business_and_management_and_financial_operations, latest split, revision 1880dbebff5b | 1399.28 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_chinese | Unavailable | 1438.551159423747 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_coding | text_style_control / coding, latest split, revision 1880dbebff5b | 1423.54 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_creative_writing | text_style_control / creative_writing, latest split, revision 1880dbebff5b | 1395.92 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_english | Unavailable | 1413.1526534766867 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_expert | text_style_control / expert, latest split, revision 1880dbebff5b | 1423.28 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_factuality | Unavailable | 1436.5672969425964 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_french | Unavailable | 1424.79612570021 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_german | Unavailable | 1406.7010285918066 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_hard_prompts | text_style_control / hard_prompts, latest split, revision 1880dbebff5b | 1419.52 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_industry_entertainment_sports_media | Unavailable | 1386.9174855746019 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_industry_mathematical | Unavailable | 1416.2080990590348 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_industry_software_it_services | Unavailable | 1420.9827682508285 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_instruction_following | text_style_control / instruction_following, latest split, revision 1880dbebff5b | 1400.34 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_japanese | Unavailable | 1391.9533422126951 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_korean | Unavailable | 1372.0849796785787 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_legal | text_style_control / industry_legal_and_government, latest split, revision 1880dbebff5b | 1426.59 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_longer_query | text_style_control / longer_query, latest split, revision 1880dbebff5b | 1417.79 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_math | text_style_control / math, latest split, revision 1880dbebff5b | 1405.78 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_medicine | text_style_control / industry_medicine_and_healthcare, latest split, revision 1880dbebff5b | 1426.64 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_multi_turn | text_style_control / multi_turn, latest split, revision 1880dbebff5b | 1403.26 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_non_english | text_style_control / non_english, latest split, revision 1880dbebff5b | 1400.17 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_polish | Unavailable | 1399.161677862202 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_russian | Unavailable | 1409.692764828731 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_science | text_style_control / industry_life_and_physical_and_social_science, latest split, revision 1880dbebff5b | 1430.49 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_spanish | Unavailable | 1405.8987859835715 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_vision | vision_style_control / overall, latest split, revision 1880dbebff5b | 1215.04 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_vision_diagram | Unavailable | 1234.017225440668 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_vision_homework | Unavailable | 1239.0784738969742 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_vision_ocr | Unavailable | 1222.7386908468304 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_writing | text_style_control / industry_writing_and_literature_and_language, latest split, revision 1880dbebff5b | 1402.96 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
Missing facts for Gemini 2.5 Flash
feature.streaming: not_disclosedlicence.commercial_use: not_disclosedlicence.fine_tuning: not_disclosedlicence.output_training: not_disclosedlicence.user_cap: not_disclosedmodel.context_window: not_disclosedmodel.fits_hardware: unknownmodel.hardware_fit_indeterminate: unknownmodel.input_modalities: not_disclosedmodel.languages: unknownmodel.max_output_tokens: not_disclosedmodel.output_modalities: not_disclosedmodel.parameters_total: unknownmodel.release_date: not_disclosedmodel.weights_openness: not_disclosedorigin.base_lineage: not_disclosedorigin.lab_jurisdiction: not_disclosedorigin.weights_hosting: not_disclosedoffering.api_model_id: unknownoffering.attestation.baa: not_disclosedoffering.attestation.soc2: not_disclosedoffering.data.retention: not_disclosedoffering.data.trains_on_customer_data: not_disclosedoffering.data.zero_retention: not_disclosedoffering.private_deployment: unknownoffering.router_slug: unknownoffering.speed.throughput: unknownoffering.speed.time_to_first_token: unknown
Evidence for Gemini 3.8 Flash
| Benchmark | Version | Measurement | Unit | Published interval | Evidence date | Measurement conditions | Provenance |
|---|---|---|---|---|---|---|---|
| arena_elo_coding | Text Arena coding category, raw (not style-controlled) | 1513.97 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_elo_overall | Text Arena overall, raw (not style-controlled) | 1494.67 | Arena score (Elo scale) | [1486.14, 1503.21] | 2026-09-13 |
| Source |
| arena_elo_style_control | text_style_control / overall, latest split, revision 1880dbebff5b | 1493.01 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_business | text_style_control / industry_business_and_management_and_financial_operations, latest split, revision 1880dbebff5b | 1495.21 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_chinese | text_style_control / chinese, latest split, revision 1880dbebff5b | 1543.31 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_coding | text_style_control / coding, latest split, revision 1880dbebff5b | 1534.96 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_creative_writing | text_style_control / creative_writing, latest split, revision 1880dbebff5b | 1495.85 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_english | text_style_control / english, latest split, revision 1880dbebff5b | 1502.66 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_expert | text_style_control / expert, latest split, revision 1880dbebff5b | 1502.04 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_factuality | text_factuality / overall, latest split, revision 1880dbebff5b | 1489.99 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_hard_prompts | text_style_control / hard_prompts, latest split, revision 1880dbebff5b | 1517.19 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_industry_entertainment_sports_media | text_style_control / industry_entertainment_and_sports_and_media, latest split, revision 1880dbebff5b | 1465.53 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_industry_mathematical | text_style_control / industry_mathematical, latest split, revision 1880dbebff5b | 1519.73 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_industry_software_it_services | text_style_control / industry_software_and_it_services, latest split, revision 1880dbebff5b | 1518.01 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_instruction_following | text_style_control / instruction_following, latest split, revision 1880dbebff5b | 1491.7 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_legal | text_style_control / industry_legal_and_government, latest split, revision 1880dbebff5b | 1482.91 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_longer_query | text_style_control / longer_query, latest split, revision 1880dbebff5b | 1508.86 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_medicine | text_style_control / industry_medicine_and_healthcare, latest split, revision 1880dbebff5b | 1498.96 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_multi_turn | text_style_control / multi_turn, latest split, revision 1880dbebff5b | 1513.3 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_non_english | text_style_control / non_english, latest split, revision 1880dbebff5b | 1478.34 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_russian | text_style_control / russian, latest split, revision 1880dbebff5b | 1494.62 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_science | text_style_control / industry_life_and_physical_and_social_science, latest split, revision 1880dbebff5b | 1506.01 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_sc_writing | text_style_control / industry_writing_and_literature_and_language, latest split, revision 1880dbebff5b | 1499.8 | Arena score (Elo scale) | Unavailable | 2026-09-13 |
| Source |
| arena_webdev | webdev / overall, latest split, revision 1880dbebff5b | 1583.75 | Arena score (Elo scale) | Unavailable | 2026-09-23 |
| Source |
Missing facts for Gemini 3.8 Flash
model.hardware_fit_indeterminate: unknownmodel.languages: unknownmodel.parameters_total: unknownorigin.base_lineage: not_disclosedorigin.weights_hosting: not_disclosedoffering.api_model_id: unknownoffering.attestation.baa: not_disclosedoffering.attestation.soc2: not_disclosedoffering.private_deployment: unknownoffering.router_slug: unknownoffering.speed.throughput: unknownoffering.speed.time_to_first_token: unknown
What this template teaches
The budget is a Must; inside it, cost and quality share the ranking equally.
Decision dec_31e56e608d050b9f9287f060 on public snapshot snap_05a963d2477ac2fb.
Read the full dated job answer.
The live board uses current data. This link applies the template to its full lineup.
Human lookup is free on Decide. CLI, API, and MCP access requires a key. Access and pricing.