ModelSpec is an analysis of alternatives for AI models: it decides which models fit a job from your requirements, sourced benchmarks and real cost, and shows its work.

Coding, balanced

Find an active coding model with room for a repository that balances coding strength against task cost.

Worked example as of 2026-09-23, from the public data image.

Coding strength first, cost as a real second term.

Requirements

Preferences

Applied template spec
spec_version
1
where
  • model.class = text-generator
  • model.lifecycle = active
  • model.context_window >= 200000
optimize
weights
software_engineering
0.7
-offering.cost_per_task
0.3

Worked answer

Decision status: partial.

Tied on the evidence

probability bands: a model joins the leader when P(its score >= the leader's) >= 0.25 under the score posteriors; a weighted capability with an 80% interval wider than 2.8 is not enough evidence

Tie-breakers describe members of the tie. They do not establish a winner.

This is a partial answer. Unknown facts or missing objective evidence can leave eligible candidates unranked.

probability bands: a model joins the leader when P(its score >= the leader's) >= 0.25 under the score posteriors; a weighted capability with an 80% interval wider than 2.8 is not enough evidence

Score and score interval use the objective's dimensionless normalised units. Cost per task is for the engine-selected offering and the applied spec's task size. When task size is omitted, the engine uses its documented default. P(best) is the engine probability. Unavailable means the engine did not return a value. Thin evidence is undetermined and is not a recommendation.

Best band

ModelScoreScore intervalP(best)Cost per task, USDCapability estimates and intervals
anthropic/claude-sonnet-5-50.884067[0.636213, 1.131921]0.269531250.12
  • software_engineering: 1.005798442; interval [0.036112567, 1.975484317]; benchmarks 3; direct benchmarks 2
anthropic/claude-opus-5-50.894595[0.657556, 1.131633]0.218750.24
  • software_engineering: 1.300758259; interval [0.373384859, 2.22813166]; benchmarks 4; direct benchmarks 2

Rest band

ModelScoreScore intervalP(best)Cost per task, USDCapability estimates and intervals
anthropic/claude-opus-4-70.711629[0.52433, 0.898928]0.019531250.3
  • software_engineering: 0.711822213; interval [-0.020952777, 1.444597204]; benchmarks 5; direct benchmarks 2
zhipu/glm-5-30.699362[0.525553, 0.87317]0.00781250.0736
  • software_engineering: 0.185044748; interval [-0.494949533, 0.86503903]; benchmarks 6; direct benchmarks 2
google/gemini-3-7-flash0.693025[0.51921, 0.86684]0.0156250.045
  • software_engineering: 0.099771765; interval [-0.580250011, 0.779793541]; benchmarks 6; direct benchmarks 2
anthropic/claude-opus-50.649174[0.50088, 0.797467]0.011718750.3
  • software_engineering: 0.467477024; interval [-0.11269439, 1.047648438]; benchmarks 7; direct benchmarks 3
google/gemini-3-8-flash0.636603[0.490853, 0.782354]0.00.045
  • software_engineering: -0.120968438; interval [-0.69119135, 0.449254473]; benchmarks 8; direct benchmarks 3
xai/grok-4-70.601089[0.364031, 0.838147]0.0156250.104
  • software_engineering: -0.135139749; interval [-1.062588258, 0.792308759]; benchmarks 3; direct benchmarks 1
openai/gpt-5-6-sol0.587669[0.436709, 0.738628]0.003906250.24
  • software_engineering: 0.099962916; interval [-0.490641673, 0.690567505]; benchmarks 6; direct benchmarks 3
openai/gpt-5-40.563049[0.407479, 0.71862]0.003906250.16
  • software_engineering: -0.165538069; interval [-0.774180651, 0.443104514]; benchmarks 9; direct benchmarks 3
openai/gpt-6-astra0.552087[0.382206, 0.721968]0.003906250.6
  • software_engineering: 0.722074908; interval [0.05744525, 1.386704566]; benchmarks 7; direct benchmarks 2
meta/muse-spark-1-30.547031[0.31937, 0.774692]0.00781250.067
  • software_engineering: -0.424879214; interval [-1.31556301, 0.465804581]; benchmarks 3; direct benchmarks 1
anthropic/claude-fable-50.542591[0.368345, 0.716837]0.00.6
  • software_engineering: 0.68492301; interval [0.003215236, 1.366630785]; benchmarks 6; direct benchmarks 2
anthropic/claude-fable-5-10.533154[0.363259, 0.703048]0.00781250.6
  • software_engineering: 0.648000878; interval [-0.016682066, 1.312683821]; benchmarks 7; direct benchmarks 2
google/gemini-3-5-flash0.517769[0.332941, 0.702597]0.00.096
  • software_engineering: -0.478034522; interval [-1.201143536, 0.245074492]; benchmarks 5; direct benchmarks 2
zhipu/glm-5-20.483142[0.329142, 0.637142]0.00.0736
  • software_engineering: -0.660878011; interval [-1.26337721, -0.058378812]; benchmarks 6; direct benchmarks 3
anthropic/claude-opus-4-60.461412[0.305361, 0.617462]0.00.3
  • software_engineering: -0.267108807; interval [-0.877629968, 0.343412354]; benchmarks 9; direct benchmarks 3
deepseek/deepseek-v4-pro0.333848[0.150048, 0.517649]0.00.06864
  • software_engineering: -1.255451879; interval [-1.974539251, -0.536364507]; benchmarks 5; direct benchmarks 2
google/gemini-3-1-pro-preview0.255135[0.076512, 0.433759]0.00.128
  • software_engineering: -1.437870949; interval [-2.136704195, -0.739037704]; benchmarks 7; direct benchmarks 2

Thin evidence: undetermined

ModelScoreScore intervalP(best)Cost per task, USDCapability estimates and intervals
qwen/qwen3-8-max-09020.706443[0.196935, 1.21595]0.160156250.104
  • software_engineering: 0.277037196; interval [-1.716323405, 2.270397798]; benchmarks 1; direct benchmarks 0
openai/gpt-6-sol0.699203[0.189696, 1.208711]0.18750.12
  • software_engineering: 0.282550248; interval [-1.710810354, 2.275910849]; benchmarks 1; direct benchmarks 0
meta/muse-spark-1-10.585104[0.152591, 1.017616]0.066406250.067
  • software_engineering: -0.275927718; interval [-1.968057691, 1.416202254]; benchmarks 3; direct benchmarks 1

Unknown requirements

Some candidates may qualify. Missing facts:

Engine warnings

Omitted result rows: models 11; offerings 20. The bands above include all ranked models.

Decision dec_522f407374f23603bb2a189d on public snapshot snap_05a963d2477ac2fb.

What this template teaches

A 70/30 blend keeps capability in charge while letting a large price gap decide close calls.

The live board uses current data. Its answer can change as evidence changes.

Apply this template on Decide

Human lookup is free on Decide. CLI, API, and MCP access requires a key. Access and pricing.

Use-case examples · How we decide

Feedback