NVIDIA · nvidia/nvidia-nemotron-3-5-lightning-30b-a3b
| Provider | NVIDIA |
|---|---|
| Family | nemotron |
| Type | llm-reasoning |
| Status | active |
| Released | 2026-08-11 |
| Updated | 2026-08-24 |
| Parameters | 31.6B |
| Open weights | yes |
Chain Of Thought · tier-2 Function Calling · tier-2 Multilingual · tier-2 Think Budget Control · tier-2
Ordered by predicted speed. Bandwidth sets decode rate; memory decides whether it runs at all.
| Device | Memory | Bandwidth | Best quality | Weights | tok/s | Fastest |
|---|---|---|---|---|---|---|
| Cerebras WSE-3 | 44.0 GB | 21000000.0 GB/s | fp8 | 31.58 GB | ~4900000.0 | ~9800000.0 q4 |
| NVIDIA GB200 Grace Blackwell Superchip | 372.0 GB | 16000.0 GB/s | bf16 | 63.16 GB | ~1866.7 | ~7466.7 q4 |
| AMD Instinct MI355X | 288.0 GB | 8000.0 GB/s | bf16 | 63.16 GB | ~933.3 | ~3733.3 q4 |
| NVIDIA B200 | 180.0 GB | 7700.0 GB/s | bf16 | 63.16 GB | ~898.3 | ~3593.3 q4 |
| Google TPU7x (Ironwood) | 192.0 GB | 7380.0 GB/s | bf16 | 63.16 GB | ~861.0 | ~3444.0 q4 |
| AMD Instinct MI325X | 256.0 GB | 6000.0 GB/s | bf16 | 63.16 GB | ~700.0 | ~2800.0 q4 |
| AMD Instinct MI300X | 192.0 GB | 5300.0 GB/s | bf16 | 63.16 GB | ~618.3 | ~2473.3 q4 |
| NVIDIA H200 SXM | 141.0 GB | 4800.0 GB/s | bf16 | 63.16 GB | ~560.0 | ~2240.0 q4 |
| NVIDIA H100 NVL | 94.0 GB | 3900.0 GB/s | bf16 | 63.16 GB | ~455.0 | ~1820.0 q4 |
| NVIDIA H100 SXM | 80.0 GB | 3350.0 GB/s | fp8 | 31.58 GB | ~781.7 | ~1563.3 q4 |
| AMD Instinct MI250X | 128.0 GB | 3200.0 GB/s | bf16 | 63.16 GB | ~373.3 | ~1493.3 q4 |
| Google TPU v5p | 95.0 GB | 2765.0 GB/s | bf16 | 63.16 GB | ~322.6 | ~1290.3 q4 |
| NVIDIA A100 80GB SXM | 80.0 GB | 2039.0 GB/s | fp8 | 31.58 GB | ~475.8 | ~951.5 q4 |
| NVIDIA H100 PCIe | 80.0 GB | 2000.0 GB/s | fp8 | 31.58 GB | ~466.7 | ~933.3 q4 |
| NVIDIA GeForce RTX 5090 | 32.0 GB | 1792.0 GB/s | q6 | 23.68 GB | ~557.5 | ~836.3 q4 |
| Google TPU v6e (Trillium) | 32.0 GB | 1638.0 GB/s | q6 | 23.68 GB | ~509.6 | ~764.4 q4 |
| AMD Instinct MI210 | 64.0 GB | 1600.0 GB/s | fp8 | 31.58 GB | ~373.3 | ~746.7 q4 |
| NVIDIA A100 40GB SXM | 40.0 GB | 1555.0 GB/s | q6 | 23.68 GB | ~483.8 | ~725.7 q4 |
| Google TPU v4 | 32.0 GB | 1200.0 GB/s | q6 | 23.68 GB | ~373.3 | ~560.0 q4 |
| NVIDIA GeForce RTX 4090 | 24.0 GB | 1008.0 GB/s | q4 | 15.79 GB | ~470.4 | ~470.4 q4 |
| AMD Radeon RX 7900 XTX | 24.0 GB | 960.0 GB/s | q4 | 15.79 GB | ~448.0 | ~448.0 q4 |
| NVIDIA GeForce RTX 3090 | 24.0 GB | 936.0 GB/s | q4 | 15.79 GB | ~436.8 | ~436.8 q4 |
| NVIDIA L40S | 48.0 GB | 864.0 GB/s | fp8 | 31.58 GB | ~201.6 | ~403.2 q4 |
| Apple M3 Ultra | 512.0 GB | 819.0 GB/s | bf16 | 63.16 GB | ~95.5 | ~382.2 q4 |
| Apple M2 Ultra | 192.0 GB | 800.0 GB/s | bf16 | 63.16 GB | ~93.3 | ~373.3 q4 |
| Apple M4 Max | 128.0 GB | 546.0 GB/s | bf16 | 63.16 GB | ~63.7 | ~254.8 q4 |
| Apple M1 Max | 64.0 GB | 400.0 GB/s | fp8 | 31.58 GB | ~93.3 | ~186.7 q4 |
| Apple M2 Max | 96.0 GB | 400.0 GB/s | bf16 | 63.16 GB | ~46.7 | ~186.7 q4 |
| Apple M3 Max | 128.0 GB | 400.0 GB/s | bf16 | 63.16 GB | ~46.7 | ~186.7 q4 |
| NVIDIA L4 | 24.0 GB | 300.0 GB/s | q4 | 15.79 GB | ~140.0 | ~140.0 q4 |
| Apple M4 Pro | 64.0 GB | 273.0 GB/s | fp8 | 31.58 GB | ~63.7 | ~127.4 q4 |
| Apple M4 | 32.0 GB | 120.0 GB/s | q6 | 23.68 GB | ~37.3 | ~56.0 q4 |
Taken from the card's availability section.
| Platform | Id on that platform |
|---|---|
| Fireworks AI | |
| Hugging Face | nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 |
| NVIDIA NIM | nvidia/nemotron-3.5-lightning-30b-a3b |
| OpenRouter | nvidia/nemotron-3.5-lightning |
| Benchmark | Evaluated as | Score | Evidence date | Source kind | |
|---|---|---|---|---|---|
| aa_lcr | Nemotron 3.5 Lightning | 60.33% | 2026-09-10 evaluated | independent evaluator | source |
| critpt | Nemotron 3.5 Lightning | 0.0% | 2026-09-10 evaluated | independent evaluator | source |
| gdpval_aa | Nemotron 3.5 Lightning | 13.34% | 2026-09-10 evaluated | independent evaluator | source |
| gpqa_diamond | Nemotron 3.5 Lightning | 74.34% | 2026-09-10 evaluated | independent evaluator | source |
| scicode | Nemotron 3.5 Lightning | 32.06% | 2026-09-10 evaluated | independent evaluator | source |
This card reports no benchmark scores yet.
| Benchmark | Catalogue standing | Score |
|---|