Which GPU can run DeepSeek R1-Distill 32B?
Model-to-GPU finder — pick a model, get the VRAM math and every tracked card that fits. All numbers computed live from our sourced hardware database; nothing is estimated without a label.
The math for DeepSeek R1-Distill 32B at Q4_K_M
Weights: 32.8B params × 4.8 bits/weight ÷ 8 = 19.68 GB
+ loading overhead (10%): 1.97 GB
+ KV cache @ 4,096 ctx: 1.07 GB
= 22.72 GB VRAM required
Basis: calculated from verified architecture config (Params 32.8B (Qwen2.5-32B base), 64 layers, 8 KV heads, head dim 128 (5120/40 heads), 131072 context — HF config.json (deepseek-ai/DeepSeek-R1-Distill-Qwen-32B).). GPU VRAM/bandwidth figures are vendor specifications from our database. This tool never guesses throughput — see measured benchmarks for speed.
Disclosure: CompareAIHardware.com participates in the Amazon Associates program and earns from qualifying purchases made through “Check price” links below. Affiliate relationships do not influence fit rankings.
GPUs that can run DeepSeek R1-Distill 32B at Q4_K_M
Grouped by headroom over the 22.7 GB requirement. Every card links to full specs; “Check price” appears only where the product is verified available on Amazon.
Runs it comfortably (25%+ VRAM headroom)
| GPU | VRAM | Bandwidth | Type | |
|---|---|---|---|---|
| AMD Radeon Pro W7800 | 32 GB | 576 GB/s | Pro GPU | Check price |
| GeForce RTX 5090 | 32 GB | 1792 GB/s | Consumer GPU | Check price |
| NVIDIA RTX 5000 Ada | 32 GB | 576 GB/s | Pro GPU | Check price |
| NVIDIA RTX PRO 4500 Blackwell | 32 GB | 896 GB/s | Pro GPU | Check price |
| NVIDIA A100 40GB SXMEOL | 40 GB | 1555 GB/s | Data Center GPU | |
| AMD Radeon Pro W7900 | 48 GB | 864 GB/s | Pro GPU | Check price |
| NVIDIA RTX PRO 5000 Blackwell | 48 GB | 1344 GB/s | Pro GPU | |
| RTX 6000 Ada | 48 GB | 960 GB/s | Pro GPU | Check price |
| RTX A6000 | 48 GB | 768 GB/s | Pro GPU | Check price |
| H100 SXM | 80 GB | 3350 GB/s | Data Center GPU | |
| NVIDIA A100 80GB SXM | 80 GB | 2039 GB/s | Data Center GPU | |
| NVIDIA H100 PCIe 80GB | 80 GB | 2039 GB/s | Data Center GPU | |
| NVIDIA RTX PRO 6000 Blackwell | 96 GB | 1792 GB/s | Pro GPU | Check price |
| H200 SXM | 141 GB | 4800 GB/s | Data Center GPU | |
| AMD Instinct MI300X | 192 GB | 5300 GB/s | Data Center GPU | |
| NVIDIA B200 | 192 GB | 8000 GB/s | Data Center GPU | |
| AMD Instinct MI325X | 256 GB | 6000 GB/s | Data Center GPU | |
| AMD Instinct MI355X | 288 GB | 8000 GB/s | Data Center GPU | |
| NVIDIA B300 (Blackwell Ultra) | 288 GB | 8000 GB/s | Data Center GPU |
Minimum — fits with little headroom
These hold the model but leave little room; keep contexts short.
| GPU | VRAM | Bandwidth | Type | |
|---|---|---|---|---|
| GeForce RTX 3090EOL | 24 GB | 936 GB/s | Consumer GPU | Check price |
| GeForce RTX 3090 TiEOL | 24 GB | 1008 GB/s | Consumer GPU | Check price |
| GeForce RTX 4090 | 24 GB | 1008 GB/s | Consumer GPU | Check price |
| NVIDIA RTX PRO 4000 Blackwell | 24 GB | 672 GB/s | Pro GPU | Check price |
| Radeon RX 7900 XTX | 24 GB | 960 GB/s | Consumer GPU | Check price |
Needs 2+ GPUs (tensor/pipeline parallel)
One card is too small, but a pair at ~90% parallel efficiency covers the requirement. Setup details: multi-GPU guide.
| GPU | Pair VRAM (×2 @90%) | Bandwidth each | Type | |
|---|---|---|---|---|
| Arc A770 16GB | 16 GB ×2 ≈ 28.8 GB usable | 560 GB/s | Consumer GPU | Check price |
| GeForce RTX 4060 Ti 16GB | 16 GB ×2 ≈ 28.8 GB usable | 288 GB/s | Consumer GPU | Check price |
| GeForce RTX 4070 Ti SUPEREOL | 16 GB ×2 ≈ 28.8 GB usable | 672 GB/s | Consumer GPU | Check price |
| GeForce RTX 4080EOL | 16 GB ×2 ≈ 28.8 GB usable | 716 GB/s | Consumer GPU | Check price |
| GeForce RTX 4080 SUPER | 16 GB ×2 ≈ 28.8 GB usable | 736 GB/s | Consumer GPU | Check price |
| GeForce RTX 5060 Ti 16GB | 16 GB ×2 ≈ 28.8 GB usable | 448 GB/s | Consumer GPU | Check price |
| GeForce RTX 5070 Ti | 16 GB ×2 ≈ 28.8 GB usable | 896 GB/s | Consumer GPU | Check price |
| GeForce RTX 5080 | 16 GB ×2 ≈ 28.8 GB usable | 960 GB/s | Consumer GPU | Check price |
| NVIDIA RTX PRO 2000 Blackwell | 16 GB ×2 ≈ 28.8 GB usable | 288 GB/s | Pro GPU | Check price |
| Radeon RX 6800 XTEOL | 16 GB ×2 ≈ 28.8 GB usable | 512 GB/s | Consumer GPU | Check price |
| Radeon RX 7600 XT | 16 GB ×2 ≈ 28.8 GB usable | 288 GB/s | Consumer GPU | Check price |
| Radeon RX 7800 XT | 16 GB ×2 ≈ 28.8 GB usable | 624 GB/s | Consumer GPU | Check price |
| Radeon RX 9070 | 16 GB ×2 ≈ 28.8 GB usable | 640 GB/s | Consumer GPU | Check price |
| Radeon RX 9070 XT | 16 GB ×2 ≈ 28.8 GB usable | 640 GB/s | Consumer GPU | Check price |
| Radeon RX 7900 XT | 20 GB ×2 ≈ 36.0 GB usable | 800 GB/s | Consumer GPU | Check price |
Apple Silicon options for DeepSeek R1-Distill 32B
macOS lets Apple Silicon GPUs address about 75% of unified memory. Speed is bandwidth-bound — compare the GB/s column.
| Mac | Unified memory | Usable by GPU (~75%) | Bandwidth |
|---|---|---|---|
| Apple M4 | 32 GB | 24 GB | 120 GB/s |
| Apple M3 Pro | 36 GB | 27 GB | 300 GB/s |
| Apple M4 Pro | 64 GB | 48 GB | 273 GB/s |
| Apple M3 Max | 128 GB | 96 GB | 400 GB/s |
| M4 Max (MacBook Pro) | 128 GB | 96 GB | 546 GB/s |
| M3 Ultra (Mac Studio) | 512 GB | 384 GB | 819 GB/s |
Go deeper
- Full fit page for DeepSeek R1-Distill 32B — every quantization level, pre-built systems, FAQ.
- VRAM calculator — start from a parameter count instead of a named model.
- Best GPUs for LLM inference — tier-by-tier buying guide.
Methodology: how we source and verify specs. Found a wrong number? File a correction.