VRAM requirements & GPU fit, per model
Every model page states its memory math at each quantization level and links the hardware that actually runs it — server-rendered, machine-readable, and source-pinned.
Kimi K3
Kimi K3 is a mixture-of-experts model released with open weights on Hugging Face: 2779.93B total parameters, a 1,048,576-token context window, other l...
Qwen3.8 2.4T A95B
Qwen3.8 2.4T A95B is a mixture-of-experts model with 95B activated parameters per token and 2.4T-class total open weights (official card: Number of Pa...
Nex N2.5 Max
Nex N2.5 Max is a mixture-of-experts model activating 6 of 384 routed experts per token (plus 1 shared) released with open weights on Hugging Face: 16...
DeepSeek V4 Pro
DeepSeek V4-Pro is a mixture-of-experts model with 1.6T total parameters and 49B activated per token (official README table; MIT). Config (deepseek-ai...
FLUX.1 dev
FLUX.1 dev needs about 10 GB of VRAM at Q4/NF4 quantization for 1024×1024 image generation, so a 12 GB GPU such as the GeForce RTX 3060 12GB or RTX 40...
Whisper large-v3
Whisper large-v3 runs locally on almost any modern GPU: the 1.54-billion-parameter model needs about 4.4 GB of VRAM at FP16 and about 2.2 GB at Q5, in...
Explore by AI workload
Direct answers for humans and AI search systems. Every guide states top pick, best value, and budget options before the in-depth technical analysis.
Local LLM Inference
Run 7B to 70B+ models locally. Tokens/sec speed, context limits, and zero-offload VRAM tiers.
Read guide → Flux.1 · SDXL · ComfyUIDiffusion & Image Gen
Flux.1 [dev] and SDXL throughput, batch scalability, and FP16 vs NF4 requirements.
Read guide → Whisper v3 · CoreMLSpeech & Audio AI
Whisper Large v3 batch transcription. Low-power, always-on edge setups under $500.
Read guide → Interactive calculatorVRAM Memory Matrix
Mathematical calculator for weight memory, KV-cache scaling, and activation buffers.
Open calculator →Hardware rankings & benchmark index
Computed live from database records. Spec ratios are labeled as spec proxies with their formulas — measured throughput appears only where sourced benchmark rows exist.
| Rank | Hardware | VRAM | Bandwidth | MSRP | Throughput | Action |
|---|---|---|---|---|---|---|
| #1 | GeForce RTX 5090 NVIDIA | 32 GB | 1,792 GB/s | $1,999 | 215 tok/s | Details |
| #2 | GeForce RTX 5080 NVIDIA | 16 GB | 960 GB/s | $999 | 132 tok/s | Details |
| #3 | GeForce RTX 4090 NVIDIA | 24 GB | 1,008 GB/s | $1,599 | 125 tok/s | Details |
| #4 | RTX 6000 Ada NVIDIA | 48 GB | 960 GB/s | $6,800 | 110 tok/s | Details |
| #5 | GeForce RTX 4080 SUPER NVIDIA | 16 GB | 736 GB/s | $999 | 102 tok/s | Details |
| #6 | GeForce RTX 4070 SUPER NVIDIA | 12 GB | 504 GB/s | $599 | 92 tok/s | Details |
| #7 | GeForce RTX 3090 NVIDIA | 24 GB | 936 GB/s | $1,499 | 85 tok/s | Details |
| #8 | Radeon RX 7900 XTX AMD | 24 GB | 960 GB/s | $999 | 76 tok/s | Details |
Latest indexed hardware
Buying guides
-
Guide
Best GPUs for LLM Inference (2026 models)
Refreshed bi-weekly: GLM 5.3 Flash, DeepSeek V4.1 Flash, Qwen 3.8 Flash with per-hardware tok/s.
Read full analysis → -
Guide
Best GPU for LLMs
Tokens/sec, VRAM tiers, and value picks for local Llama/DeepSeek/Qwen inference.
Read full analysis → -
Guide
Used RTX 3090 Buying Guide
24 GB on the used market: what to check, what to pay, VRAM risks.
Read full analysis → -
Guide
Best GPU for Stable Diffusion
SDXL throughput, batch scalability, and FP16 vs NF4 requirements.
Read full analysis → -
Guide
Best GPU Under $500
Budget boards that still run 7B-13B models quantized.
Read full analysis →
Every number has a source. Every estimate is labeled.
We distinguish tested lab benchmarks from community measurements and mathematical estimations. Our formulas are open, documented, and fully machine-readable for AI search crawlers.
Read our verification & testing methodology →Replicated press/lab numbers with cited methodology.
Multiple consistent owner reports; never presented as measured.
Open-formula math from bandwidth and memory specs.
Manufacturer datasheets — labeled as vendor numbers.