Apertus 70B Instruct

Swiss AI · swiss-ai/apertus-70b-instruct-2509

Provider	Swiss AI
Family	apertus
Type	llm-chat
Status	active
Released	2025-09-01
Updated	2026-07-17
Parameters	70.6B
Open weights	yes

Lineage

Relationship	Model
Is a finetune of	swiss-ai/Apertus-70B-2509

What it fits on

Ordered by predicted speed. Bandwidth sets decode rate; memory decides whether it runs at all.

Every figure here is computed, not measured. Fit is weights at each quantisation against device memory, with a 25% allowance for the KV cache, activations and the OS. Decode rate is the memory-bandwidth roofline at 70% efficiency. Nobody has run this model on these devices.

Device	Memory	Bandwidth	Best quality	Weights	tok/s	Fastest
NVIDIA GB200 Grace Blackwell Superchip	372.0 GB	16000.0 GB/s	bf16	141.2 GB	~79.3	~317.3 q4
AMD Instinct MI355X	288.0 GB	8000.0 GB/s	bf16	141.2 GB	~39.7	~158.6 q4
NVIDIA B200	180.0 GB	7700.0 GB/s	fp8	70.6 GB	~76.3	~152.7 q4
Google TPU7x (Ironwood)	192.0 GB	7380.0 GB/s	bf16	141.2 GB	~36.6	~146.3 q4
AMD Instinct MI325X	256.0 GB	6000.0 GB/s	bf16	141.2 GB	~29.7	~119.0 q4
AMD Instinct MI300X	192.0 GB	5300.0 GB/s	bf16	141.2 GB	~26.3	~105.1 q4
NVIDIA H200 SXM	141.0 GB	4800.0 GB/s	fp8	70.6 GB	~47.6	~95.2 q4
NVIDIA H100 NVL	94.0 GB	3900.0 GB/s	q6	52.95 GB	~51.6	~77.3 q4
NVIDIA H100 SXM	80.0 GB	3350.0 GB/s	q6	52.95 GB	~44.3	~66.4 q4
AMD Instinct MI250X	128.0 GB	3200.0 GB/s	fp8	70.6 GB	~31.7	~63.5 q4
Google TPU v5p	95.0 GB	2765.0 GB/s	fp8	70.6 GB	~27.4	~54.8 q4
NVIDIA A100 80GB SXM	80.0 GB	2039.0 GB/s	q6	52.95 GB	~27.0	~40.4 q4
NVIDIA H100 PCIe	80.0 GB	2000.0 GB/s	q6	52.95 GB	~26.4	~39.7 q4
AMD Instinct MI210	64.0 GB	1600.0 GB/s	q5	44.12 GB	~25.4	~31.7 q4
NVIDIA L40S	48.0 GB	864.0 GB/s	q4	35.3 GB	~17.1	~17.1 q4
Apple M3 Ultra	512.0 GB	819.0 GB/s	bf16	141.2 GB	~4.1	~16.2 q4
Apple M2 Ultra	192.0 GB	800.0 GB/s	bf16	141.2 GB	~4.0	~15.9 q4
Apple M4 Max	128.0 GB	546.0 GB/s	fp8	70.6 GB	~5.4	~10.8 q4
Apple M1 Max	64.0 GB	400.0 GB/s	q5	44.12 GB	~6.3	~7.9 q4
Apple M2 Max	96.0 GB	400.0 GB/s	fp8	70.6 GB	~4.0	~7.9 q4
Apple M3 Max	128.0 GB	400.0 GB/s	fp8	70.6 GB	~4.0	~7.9 q4
Apple M4 Pro	64.0 GB	273.0 GB/s	q5	44.12 GB	~4.3	~5.4 q4

Where it runs

Taken from the card's availability section.

Platform	Id on that platform
Hugging Face	swiss-ai/Apertus-70B-Instruct-2509

Verified benchmark evidence

Each row was checked against its source by a reviewer, and carries the model identifier as actually evaluated — which is not always the same as this card's.

Benchmark	Evaluated as	Score	Evidence date	Source kind
aa_lcr	Apertus 70B Instruct	0.0%	2026-09-10 evaluated	independent evaluator	source
critpt	Apertus 70B Instruct	0.0%	2026-09-10 evaluated	independent evaluator	source
gpqa_diamond	Apertus 70B Instruct	27.17%	2026-09-10 evaluated	independent evaluator	source

Reported benchmark scores

This card reports no benchmark scores yet.

Benchmark	Catalogue standing	Score

Data

This card as JSON · See it in the graph · Edit on GitHub