Seed-OSS-36B-Instruct

ByteDance Seed · bytedance/seed-oss-36b-instruct

ProviderByteDance Seed
Familyseed
Typellm-chat
Statusactive
Released2025-08-20
Updated2025-08-26
Parameters36.2B
Open weightsyes

What it fits on

Ordered by predicted speed. Bandwidth sets decode rate; memory decides whether it runs at all.

Every figure here is computed, not measured. Fit is weights at each quantisation against device memory, with a 25% allowance for the KV cache, activations and the OS. Decode rate is the memory-bandwidth roofline at 70% efficiency. Nobody has run this model on these devices.
DeviceMemoryBandwidthBest qualityWeightstok/sFastest
Cerebras WSE-344.0 GB21000000.0 GB/sq627.11 GB~542168.8~813253.2 q4
NVIDIA GB200 Grace Blackwell Superchip372.0 GB16000.0 GB/sbf1672.3 GB~154.9~619.6 q4
AMD Instinct MI355X288.0 GB8000.0 GB/sbf1672.3 GB~77.5~309.8 q4
NVIDIA B200180.0 GB7700.0 GB/sbf1672.3 GB~74.5~298.2 q4
Google TPU7x (Ironwood)192.0 GB7380.0 GB/sbf1672.3 GB~71.5~285.8 q4
AMD Instinct MI325X256.0 GB6000.0 GB/sbf1672.3 GB~58.1~232.4 q4
AMD Instinct MI300X192.0 GB5300.0 GB/sbf1672.3 GB~51.3~205.2 q4
NVIDIA H200 SXM141.0 GB4800.0 GB/sbf1672.3 GB~46.5~185.9 q4
NVIDIA H100 NVL94.0 GB3900.0 GB/sfp836.15 GB~75.5~151.0 q4
NVIDIA H100 SXM80.0 GB3350.0 GB/sfp836.15 GB~64.9~129.7 q4
AMD Instinct MI250X128.0 GB3200.0 GB/sbf1672.3 GB~31.0~123.9 q4
Google TPU v5p95.0 GB2765.0 GB/sfp836.15 GB~53.5~107.1 q4
NVIDIA A100 80GB SXM80.0 GB2039.0 GB/sfp836.15 GB~39.5~79.0 q4
NVIDIA H100 PCIe80.0 GB2000.0 GB/sfp836.15 GB~38.7~77.5 q4
NVIDIA GeForce RTX 509032.0 GB1792.0 GB/sq522.59 GB~55.5~69.4 q4
Google TPU v6e (Trillium)32.0 GB1638.0 GB/sq522.59 GB~50.7~63.4 q4
AMD Instinct MI21064.0 GB1600.0 GB/sfp836.15 GB~31.0~62.0 q4
NVIDIA A100 40GB SXM40.0 GB1555.0 GB/sq627.11 GB~40.1~60.2 q4
Google TPU v432.0 GB1200.0 GB/sq522.59 GB~37.2~46.5 q4
NVIDIA L40S48.0 GB864.0 GB/sq627.11 GB~22.3~33.5 q4
Apple M3 Ultra512.0 GB819.0 GB/sbf1672.3 GB~7.9~31.7 q4
Apple M2 Ultra192.0 GB800.0 GB/sbf1672.3 GB~7.7~31.0 q4
Apple M4 Max128.0 GB546.0 GB/sbf1672.3 GB~5.3~21.1 q4
Apple M1 Max64.0 GB400.0 GB/sfp836.15 GB~7.7~15.5 q4
Apple M2 Max96.0 GB400.0 GB/sfp836.15 GB~7.7~15.5 q4
Apple M3 Max128.0 GB400.0 GB/sbf1672.3 GB~3.9~15.5 q4
Apple M4 Pro64.0 GB273.0 GB/sfp836.15 GB~5.3~10.6 q4
Apple M432.0 GB120.0 GB/sq522.59 GB~3.7~4.6 q4

Where it runs

Taken from the card's availability section.

PlatformId on that platform
Hugging FaceByteDance-Seed/Seed-OSS-36B-Instruct

Verified benchmark evidence

Each row was checked against its source by a reviewer, and carries the model identifier as actually evaluated — which is not always the same as this card's.
BenchmarkEvaluated asScoreEvidence dateSource kind
aa_lcrSeed-OSS-36B-Instruct61.33%2026-09-10 evaluatedindependent evaluatorsource
critptSeed-OSS-36B-Instruct0.0%2026-09-10 evaluatedindependent evaluatorsource
gpqa_diamondSeed-OSS-36B-Instruct72.63%2026-09-10 evaluatedindependent evaluatorsource

Reported benchmark scores

This card reports no benchmark scores yet.

BenchmarkCatalogue standingScore

Data

This card as JSON · See it in the graph · Edit on GitHub