K2 Think V2

Institute of Foundation Models · ifm/k2-think-v2

ProviderInstitute of Foundation Models
Familyk2-think
Typellm-reasoning
Statusactive
Released2026-01-08
Updated2026-08-05
Parameters72.6B
Open weightsyes

Lineage

RelationshipModel
Is a finetune ofIFM/K2-V2-Instruct

What it fits on

Ordered by predicted speed. Bandwidth sets decode rate; memory decides whether it runs at all.

Every figure here is computed, not measured. Fit is weights at each quantisation against device memory, with a 25% allowance for the KV cache, activations and the OS. Decode rate is the memory-bandwidth roofline at 70% efficiency. Nobody has run this model on these devices.
DeviceMemoryBandwidthBest qualityWeightstok/sFastest
NVIDIA GB200 Grace Blackwell Superchip372.0 GB16000.0 GB/sbf16145.1 GB~77.2~308.8 q4
AMD Instinct MI355X288.0 GB8000.0 GB/sbf16145.1 GB~38.6~154.4 q4
NVIDIA B200180.0 GB7700.0 GB/sfp872.55 GB~74.3~148.6 q4
Google TPU7x (Ironwood)192.0 GB7380.0 GB/sfp872.55 GB~71.2~142.4 q4
AMD Instinct MI325X256.0 GB6000.0 GB/sbf16145.1 GB~28.9~115.8 q4
AMD Instinct MI300X192.0 GB5300.0 GB/sfp872.55 GB~51.1~102.3 q4
NVIDIA H200 SXM141.0 GB4800.0 GB/sfp872.55 GB~46.3~92.6 q4
NVIDIA H100 NVL94.0 GB3900.0 GB/sq654.41 GB~50.2~75.3 q4
NVIDIA H100 SXM80.0 GB3350.0 GB/sq654.41 GB~43.1~64.6 q4
AMD Instinct MI250X128.0 GB3200.0 GB/sfp872.55 GB~30.9~61.8 q4
Google TPU v5p95.0 GB2765.0 GB/sq654.41 GB~35.6~53.4 q4
NVIDIA A100 80GB SXM80.0 GB2039.0 GB/sq654.41 GB~26.2~39.3 q4
NVIDIA H100 PCIe80.0 GB2000.0 GB/sq654.41 GB~25.7~38.6 q4
AMD Instinct MI21064.0 GB1600.0 GB/sq545.34 GB~24.7~30.9 q4
Apple M3 Ultra512.0 GB819.0 GB/sbf16145.1 GB~4.0~15.8 q4
Apple M2 Ultra192.0 GB800.0 GB/sfp872.55 GB~7.7~15.4 q4
Apple M4 Max128.0 GB546.0 GB/sfp872.55 GB~5.3~10.5 q4
Apple M1 Max64.0 GB400.0 GB/sq545.34 GB~6.2~7.7 q4
Apple M2 Max96.0 GB400.0 GB/sq654.41 GB~5.1~7.7 q4
Apple M3 Max128.0 GB400.0 GB/sfp872.55 GB~3.9~7.7 q4
Apple M4 Pro64.0 GB273.0 GB/sq545.34 GB~4.2~5.3 q4

Where it runs

Taken from the card's availability section.

PlatformId on that platform
Hugging FaceIFM/K2-Think-V2

Verified benchmark evidence

Each row was checked against its source by a reviewer, and carries the model identifier as actually evaluated — which is not always the same as this card's.
BenchmarkEvaluated asScoreEvidence dateSource kind
aa_lcrK2 Think V257.0%2026-09-10 evaluatedindependent evaluatorsource
critptK2 Think V20.0%2026-09-10 evaluatedindependent evaluatorsource
gdpval_aaK2 Think V20.0%2026-09-10 evaluatedindependent evaluatorsource
gpqa_diamondK2 Think V271.31%2026-09-10 evaluatedindependent evaluatorsource

Reported benchmark scores

This card reports no benchmark scores yet.

BenchmarkCatalogue standingScore

Data

This card as JSON · See it in the graph · Edit on GitHub