ModelSpec is an analysis of alternatives for AI models: it decides which models fit a job from your requirements, sourced benchmarks and real cost, and shows its work.

Regulated data on a budget

Find the cheapest offering with the data-handling commitments regulated workloads need.

Worked example as of 2026-09-23, from the public data image.

HIPAA-ready offerings; cheapest first, quality kept.

Requirements

Preferences

Applied template spec
spec_version
1
where
  • offering.data.trains_on_customer_data = No
  • offering.data.zero_retention = Yes
  • offering.attestation.baa = Yes
optimize
weights
-offering.cost_per_task
0.7
chat_preference
0.3

Worked answer

Decision status: answered.

Tied on the evidence

probability bands: a model joins the leader when P(its score >= the leader's) >= 0.25 under the score posteriors; a weighted capability with an 80% interval wider than 2.8 is not enough evidence

Tie-breakers describe members of the tie. They do not establish a winner.

probability bands: a model joins the leader when P(its score >= the leader's) >= 0.25 under the score posteriors; a weighted capability with an 80% interval wider than 2.8 is not enough evidence

Score and score interval use the objective's dimensionless normalised units. Cost per task is for the engine-selected offering and the applied spec's task size. When task size is omitted, the engine uses its documented default. P(best) is the engine probability. Unavailable means the engine did not return a value. Thin evidence is undetermined and is not a recommendation.

Best band

ModelScoreScore intervalP(best)Cost per task, USDCapability estimates and intervals
google/gemini-3-8-flash0.819061[0.790499, 0.847622]0.433593750.045
  • chat_preference: 0.465029132; interval [0.288363151, 0.641695113]; benchmarks 24; direct benchmarks 24
anthropic/claude-opus-5-50.754054[0.589399, 0.918709]0.28906250.24
  • chat_preference: 1.584232494; interval [0.565758585, 2.602706403]; benchmarks 1; direct benchmarks 1
google/gemini-3-7-flash0.808877[0.780316, 0.837438]0.277343750.045
  • chat_preference: 0.402038706; interval [0.225372725, 0.578704687]; benchmarks 24; direct benchmarks 24

Rest band

ModelScoreScore intervalP(best)Cost per task, USDCapability estimates and intervals
google/gemini-3-1-pro-preview0.640982[0.616966, 0.664998]0.00.128
  • chat_preference: 0.01105026; interval [-0.137500042, 0.159600562]; benchmarks 34; direct benchmarks 34
google/gemini-3-5-flash0.635676[0.61166, 0.659691]0.00.096
  • chat_preference: -0.271422803; interval [-0.419973105, -0.122872501]; benchmarks 34; direct benchmarks 34
anthropic/claude-opus-4-60.547603[0.524261, 0.570944]0.00.3
  • chat_preference: 0.775317472; interval [0.630936802, 0.919698141]; benchmarks 36; direct benchmarks 36
anthropic/claude-opus-4-70.530151[0.506135, 0.554167]0.00.3
  • chat_preference: 0.667370368; interval [0.518820066, 0.81592067]; benchmarks 34; direct benchmarks 34
anthropic/claude-opus-50.506722[0.482706, 0.530738]0.00.3
  • chat_preference: 0.522450073; interval [0.373899771, 0.671000375]; benchmarks 34; direct benchmarks 34
anthropic/claude-fable-50.211316[0.1873, 0.235332]0.00.6
  • chat_preference: 1.035674964; interval [0.887124662, 1.184225266]; benchmarks 34; direct benchmarks 34
anthropic/claude-fable-5-10.169138[0.143991, 0.194284]0.00.6
  • chat_preference: 0.774780684; interval [0.619237933, 0.930323435]; benchmarks 31; direct benchmarks 31

Engine warnings

Decision dec_dec45b7d93983dd1d411f74a on public snapshot snap_05a963d2477ac2fb.

What this template teaches

The gates are the same as the other tiers; only the ranking moves toward cost.

The live board uses current data. Its answer can change as evidence changes.

Apply this template on Decide

Human lookup is free on Decide. CLI, API, and MCP access requires a key. Access and pricing.

Use-case examples · How we decide

Feedback