IBM · ibm/granite-4-2-3b
| Provider | IBM |
|---|---|
| Family | granite |
| Type | llm-chat |
| Status | active |
| Released | 2026-08-07 |
| Updated | 2026-09-02 |
| Parameters | 3.7B |
| Open weights | yes |
| Relationship | Model |
|---|---|
| Is a finetune of | ibm-granite/granite-4.1-3b-base |
Ordered by predicted speed. Bandwidth sets decode rate; memory decides whether it runs at all.
| Device | Memory | Bandwidth | Best quality | Weights | tok/s | Fastest |
|---|---|---|---|---|---|---|
| Cerebras WSE-3 | 44.0 GB | 21000000.0 GB/s | bf16 | 7.32 GB | ~2008340.7 | ~8033362.8 q4 |
| NVIDIA GB200 Grace Blackwell Superchip | 372.0 GB | 16000.0 GB/s | bf16 | 7.32 GB | ~1530.2 | ~6120.7 q4 |
| AMD Instinct MI355X | 288.0 GB | 8000.0 GB/s | bf16 | 7.32 GB | ~765.1 | ~3060.3 q4 |
| NVIDIA B200 | 180.0 GB | 7700.0 GB/s | bf16 | 7.32 GB | ~736.4 | ~2945.6 q4 |
| Google TPU7x (Ironwood) | 192.0 GB | 7380.0 GB/s | bf16 | 7.32 GB | ~705.8 | ~2823.2 q4 |
| AMD Instinct MI325X | 256.0 GB | 6000.0 GB/s | bf16 | 7.32 GB | ~573.8 | ~2295.2 q4 |
| AMD Instinct MI300X | 192.0 GB | 5300.0 GB/s | bf16 | 7.32 GB | ~506.9 | ~2027.5 q4 |
| NVIDIA H200 SXM | 141.0 GB | 4800.0 GB/s | bf16 | 7.32 GB | ~459.0 | ~1836.2 q4 |
| NVIDIA H100 NVL | 94.0 GB | 3900.0 GB/s | bf16 | 7.32 GB | ~373.0 | ~1491.9 q4 |
| NVIDIA H100 SXM | 80.0 GB | 3350.0 GB/s | bf16 | 7.32 GB | ~320.4 | ~1281.5 q4 |
| AMD Instinct MI250X | 128.0 GB | 3200.0 GB/s | bf16 | 7.32 GB | ~306.0 | ~1224.1 q4 |
| Google TPU v5p | 95.0 GB | 2765.0 GB/s | bf16 | 7.32 GB | ~264.4 | ~1057.7 q4 |
| NVIDIA A100 80GB SXM | 80.0 GB | 2039.0 GB/s | bf16 | 7.32 GB | ~195.0 | ~780.0 q4 |
| NVIDIA H100 PCIe | 80.0 GB | 2000.0 GB/s | bf16 | 7.32 GB | ~191.3 | ~765.1 q4 |
| NVIDIA GeForce RTX 5090 | 32.0 GB | 1792.0 GB/s | bf16 | 7.32 GB | ~171.4 | ~685.5 q4 |
| Google TPU v6e (Trillium) | 32.0 GB | 1638.0 GB/s | bf16 | 7.32 GB | ~156.7 | ~626.6 q4 |
| AMD Instinct MI210 | 64.0 GB | 1600.0 GB/s | bf16 | 7.32 GB | ~153.0 | ~612.1 q4 |
| NVIDIA A100 40GB SXM | 40.0 GB | 1555.0 GB/s | bf16 | 7.32 GB | ~148.7 | ~594.9 q4 |
| Google TPU v4 | 32.0 GB | 1200.0 GB/s | bf16 | 7.32 GB | ~114.8 | ~459.0 q4 |
| NVIDIA GeForce RTX 4090 | 24.0 GB | 1008.0 GB/s | bf16 | 7.32 GB | ~96.4 | ~385.6 q4 |
| AMD Radeon RX 7900 XTX | 24.0 GB | 960.0 GB/s | bf16 | 7.32 GB | ~91.8 | ~367.2 q4 |
| NVIDIA GeForce RTX 5080 | 16.0 GB | 960.0 GB/s | bf16 | 7.32 GB | ~91.8 | ~367.2 q4 |
| NVIDIA GeForce RTX 3090 | 24.0 GB | 936.0 GB/s | bf16 | 7.32 GB | ~89.5 | ~358.1 q4 |
| NVIDIA L40S | 48.0 GB | 864.0 GB/s | bf16 | 7.32 GB | ~82.6 | ~330.5 q4 |
| Apple M3 Ultra | 512.0 GB | 819.0 GB/s | bf16 | 7.32 GB | ~78.3 | ~313.3 q4 |
| AMD Radeon RX 7900 XT | 20.0 GB | 800.0 GB/s | bf16 | 7.32 GB | ~76.5 | ~306.0 q4 |
| Apple M2 Ultra | 192.0 GB | 800.0 GB/s | bf16 | 7.32 GB | ~76.5 | ~306.0 q4 |
| Google TPU v5e | 16.0 GB | 800.0 GB/s | bf16 | 7.32 GB | ~76.5 | ~306.0 q4 |
| NVIDIA GeForce RTX 4080 SUPER | 16.0 GB | 736.0 GB/s | bf16 | 7.32 GB | ~70.4 | ~281.6 q4 |
| NVIDIA GeForce RTX 4070 Ti SUPER | 16.0 GB | 672.0 GB/s | bf16 | 7.32 GB | ~64.3 | ~257.1 q4 |
| AMD Radeon RX 9070 XT | 16.0 GB | 640.0 GB/s | bf16 | 7.32 GB | ~61.2 | ~244.8 q4 |
| Apple M4 Max | 128.0 GB | 546.0 GB/s | bf16 | 7.32 GB | ~52.2 | ~208.9 q4 |
| Apple M1 Max | 64.0 GB | 400.0 GB/s | bf16 | 7.32 GB | ~38.3 | ~153.0 q4 |
| Apple M2 Max | 96.0 GB | 400.0 GB/s | bf16 | 7.32 GB | ~38.3 | ~153.0 q4 |
| Apple M3 Max | 128.0 GB | 400.0 GB/s | bf16 | 7.32 GB | ~38.3 | ~153.0 q4 |
| NVIDIA GeForce RTX 3060 12GB | 12.0 GB | 360.0 GB/s | bf16 | 7.32 GB | ~34.4 | ~137.7 q4 |
| NVIDIA L4 | 24.0 GB | 300.0 GB/s | bf16 | 7.32 GB | ~28.7 | ~114.8 q4 |
| NVIDIA GeForce RTX 4060 Ti 16GB | 16.0 GB | 288.0 GB/s | bf16 | 7.32 GB | ~27.5 | ~110.2 q4 |
| Apple M4 Pro | 64.0 GB | 273.0 GB/s | bf16 | 7.32 GB | ~26.1 | ~104.4 q4 |
| Apple M4 | 32.0 GB | 120.0 GB/s | bf16 | 7.32 GB | ~11.5 | ~45.9 q4 |
Taken from the card's availability section.
| Platform | Id on that platform |
|---|---|
| Hugging Face | ibm-granite/granite-4.2-3b |
| Benchmark | Evaluated as | Score | Evidence date | Source kind | |
|---|---|---|---|---|---|
| aa_lcr | Granite 4.2 3B | 24.33% | 2026-09-10 evaluated | independent evaluator | source |
| critpt | Granite 4.2 3B | 0.0% | 2026-09-10 evaluated | independent evaluator | source |
| gdpval_aa | Granite 4.2 3B | 0.0% | 2026-09-10 evaluated | independent evaluator | source |
| gpqa_diamond | Granite 4.2 3B | 55.86% | 2026-09-10 evaluated | independent evaluator | source |
| scicode | Granite 4.2 3B | 25.35% | 2026-09-10 evaluated | independent evaluator | source |
This card reports no benchmark scores yet.
| Benchmark | Catalogue standing | Score |
|---|