Can you run DeepSeek V4 Flash Vision-Exp locally?
DeepSeek family · Aug 2026 · 304.7B parameters · Hugging Face model card
DeepSeek V4 Flash Vision-Exp is an open-weight mixture-of-experts model (activating 6 of 256 experts per token, 304.65B total parameters, 1,048,576-token context, mit license). Running it locally needs roughly 192 GB of memory at Q4-class quantization (calculated) - multi-GPU server or large-unified-memory territory. Measured local speeds: not yet published here; we list unknowns as unknowns.
Minimum: 192 GB+ memory (Q4-class, calculated) · Recommended: 256 GB+ for comfortable context headroom (Q4-class, calculated)
How much VRAM does DeepSeek V4 Flash Vision-Exp need at each quantization?
DeepSeek V4 Flash Vision-Exp needs 201.1 GB of VRAM at Q4_K_M. The table below lists weights-only size and total VRAM including overhead for each common quantization level with 4k and 32k token contexts.
| Quantization | Bits / weight | Weights only | Total + KV @4k ctx | Total + KV @32k ctx |
|---|---|---|---|---|
| Q4_K_M | 4.8 | 182.8 GB | 201.1 GB | 201.1 GB |
| Q5_K_M | 5.7 | 217.1 GB | 238.8 GB | 238.8 GB |
| Q6_K | 6.6 | 251.3 GB | 276.5 GB | 276.5 GB |
| Q8_0 | 8.5 | 323.7 GB | 356.1 GB | 356.1 GB |
| FP16 | 16 | 609.3 GB | 670.2 GB | 670.2 GB |
Method: weights = parameters × bits-per-weight (Q4_K_M ≈ 4.8, Q5_K_M ≈ 5.7, Q6_K ≈ 6.6, Q8_0 ≈ 8.5, FP16 = 16), plus 10% loading overhead, plus KV cache from the verified architecture config (not applicable to this architecture). Source: HF-verified 2026-09-12 run2 via api (safetensors + config.json: MoE 256 experts, ctx 1M); VRAM figures are documented calculations, not measurements
Which GPUs can run DeepSeek V4 Flash Vision-Exp locally?
At Q4_K_M with a 4k context, DeepSeek V4 Flash Vision-Exp needs 201.1 GB of VRAM. The lists below are computed live from our GPU database and grouped by how much headroom the card has. Disclosure: CompareAIHardware.com participates in the Amazon Associates program and earns from qualifying purchases through links on this page. Affiliate relationships do not influence our recommendations.
Runs DeepSeek V4 Flash Vision-Exp comfortably (25%+ VRAM headroom)
| GPU | VRAM | Bandwidth | Type | |
|---|---|---|---|---|
| AMD Instinct MI325X | 256 GB | 6000 GB/s | Data Center GPU | |
| AMD Instinct MI355X | 288 GB | 8000 GB/s | Data Center GPU | |
| NVIDIA B300 (Blackwell Ultra) | 288 GB | 8000 GB/s | Data Center GPU |
Needs 2+ GPUs to run DeepSeek V4 Flash Vision-Exp
One of these cards is too small on its own, but a pair (tensor or pipeline parallel, ~90% efficiency) covers the 201.1 GB requirement. See our multi-GPU guide for setup.
| GPU | VRAM | Bandwidth | Type | |
|---|---|---|---|---|
| H200 SXM | 141 GB ×2 | 4800 GB/s | Data Center GPU | |
| AMD Instinct MI300X | 192 GB ×2 | 5300 GB/s | Data Center GPU | |
| NVIDIA B200 | 192 GB ×2 | 8000 GB/s | Data Center GPU |