Which GPU can run DeepSeek R1-Distill 32B?

Model-to-GPU finder — pick a model, get the VRAM math and every tracked card that fits. All numbers computed live from our sourced hardware database; nothing is estimated without a label.

Model
Quantization
Context length

DeepSeek R1-Distill 32B's verified context window is 131,072 tokens; larger selections are clamped to it.

The math for DeepSeek R1-Distill 32B at Q4_K_M

Weights: 32.8B params × 4.8 bits/weight ÷ 8 = 19.68 GB
+ loading overhead (10%): 1.97 GB
+ KV cache @ 4,096 ctx: 1.07 GB
= 22.72 GB VRAM required

Basis: calculated from verified architecture config (Params 32.8B (Qwen2.5-32B base), 64 layers, 8 KV heads, head dim 128 (5120/40 heads), 131072 context — HF config.json (deepseek-ai/DeepSeek-R1-Distill-Qwen-32B).). GPU VRAM/bandwidth figures are vendor specifications from our database. This tool never guesses throughput — see measured benchmarks for speed.

Disclosure: CompareAIHardware.com participates in the Amazon Associates program and earns from qualifying purchases made through “Check price” links below. Affiliate relationships do not influence fit rankings.

GPUs that can run DeepSeek R1-Distill 32B at Q4_K_M

Grouped by headroom over the 22.7 GB requirement. Every card links to full specs; “Check price” appears only where the product is verified available on Amazon.

Runs it comfortably (25%+ VRAM headroom)

GPUVRAMBandwidthType
AMD Radeon Pro W7800 32 GB 576 GB/s Pro GPU Check price
GeForce RTX 5090 32 GB 1792 GB/s Consumer GPU Check price
NVIDIA RTX 5000 Ada 32 GB 576 GB/s Pro GPU Check price
NVIDIA RTX PRO 4500 Blackwell 32 GB 896 GB/s Pro GPU Check price
NVIDIA A100 40GB SXMEOL 40 GB 1555 GB/s Data Center GPU
AMD Radeon Pro W7900 48 GB 864 GB/s Pro GPU Check price
NVIDIA RTX PRO 5000 Blackwell 48 GB 1344 GB/s Pro GPU
RTX 6000 Ada 48 GB 960 GB/s Pro GPU Check price
RTX A6000 48 GB 768 GB/s Pro GPU Check price
H100 SXM 80 GB 3350 GB/s Data Center GPU
NVIDIA A100 80GB SXM 80 GB 2039 GB/s Data Center GPU
NVIDIA H100 PCIe 80GB 80 GB 2039 GB/s Data Center GPU
NVIDIA RTX PRO 6000 Blackwell 96 GB 1792 GB/s Pro GPU Check price
H200 SXM 141 GB 4800 GB/s Data Center GPU
AMD Instinct MI300X 192 GB 5300 GB/s Data Center GPU
NVIDIA B200 192 GB 8000 GB/s Data Center GPU
AMD Instinct MI325X 256 GB 6000 GB/s Data Center GPU
AMD Instinct MI355X 288 GB 8000 GB/s Data Center GPU
NVIDIA B300 (Blackwell Ultra) 288 GB 8000 GB/s Data Center GPU

Minimum — fits with little headroom

These hold the model but leave little room; keep contexts short.

GPUVRAMBandwidthType
GeForce RTX 3090EOL 24 GB 936 GB/s Consumer GPU Check price
GeForce RTX 3090 TiEOL 24 GB 1008 GB/s Consumer GPU Check price
GeForce RTX 4090 24 GB 1008 GB/s Consumer GPU Check price
NVIDIA RTX PRO 4000 Blackwell 24 GB 672 GB/s Pro GPU Check price
Radeon RX 7900 XTX 24 GB 960 GB/s Consumer GPU Check price

Needs 2+ GPUs (tensor/pipeline parallel)

One card is too small, but a pair at ~90% parallel efficiency covers the requirement. Setup details: multi-GPU guide.

GPUPair VRAM (×2 @90%)Bandwidth eachType
Arc A770 16GB 16 GB ×2 ≈ 28.8 GB usable 560 GB/s Consumer GPU Check price
GeForce RTX 4060 Ti 16GB 16 GB ×2 ≈ 28.8 GB usable 288 GB/s Consumer GPU Check price
GeForce RTX 4070 Ti SUPEREOL 16 GB ×2 ≈ 28.8 GB usable 672 GB/s Consumer GPU Check price
GeForce RTX 4080EOL 16 GB ×2 ≈ 28.8 GB usable 716 GB/s Consumer GPU Check price
GeForce RTX 4080 SUPER 16 GB ×2 ≈ 28.8 GB usable 736 GB/s Consumer GPU Check price
GeForce RTX 5060 Ti 16GB 16 GB ×2 ≈ 28.8 GB usable 448 GB/s Consumer GPU Check price
GeForce RTX 5070 Ti 16 GB ×2 ≈ 28.8 GB usable 896 GB/s Consumer GPU Check price
GeForce RTX 5080 16 GB ×2 ≈ 28.8 GB usable 960 GB/s Consumer GPU Check price
NVIDIA RTX PRO 2000 Blackwell 16 GB ×2 ≈ 28.8 GB usable 288 GB/s Pro GPU Check price
Radeon RX 6800 XTEOL 16 GB ×2 ≈ 28.8 GB usable 512 GB/s Consumer GPU Check price
Radeon RX 7600 XT 16 GB ×2 ≈ 28.8 GB usable 288 GB/s Consumer GPU Check price
Radeon RX 7800 XT 16 GB ×2 ≈ 28.8 GB usable 624 GB/s Consumer GPU Check price
Radeon RX 9070 16 GB ×2 ≈ 28.8 GB usable 640 GB/s Consumer GPU Check price
Radeon RX 9070 XT 16 GB ×2 ≈ 28.8 GB usable 640 GB/s Consumer GPU Check price
Radeon RX 7900 XT 20 GB ×2 ≈ 36.0 GB usable 800 GB/s Consumer GPU Check price

Apple Silicon options for DeepSeek R1-Distill 32B

macOS lets Apple Silicon GPUs address about 75% of unified memory. Speed is bandwidth-bound — compare the GB/s column.

MacUnified memoryUsable by GPU (~75%)Bandwidth
Apple M4 32 GB 24 GB 120 GB/s
Apple M3 Pro 36 GB 27 GB 300 GB/s
Apple M4 Pro 64 GB 48 GB 273 GB/s
Apple M3 Max 128 GB 96 GB 400 GB/s
M4 Max (MacBook Pro) 128 GB 96 GB 546 GB/s
M3 Ultra (Mac Studio) 512 GB 384 GB 819 GB/s

Go deeper

Methodology: how we source and verify specs. Found a wrong number? File a correction.