← All GPUs
NVIDIA RTX PRO 6000 Blackwell
NVIDIA · Pro GPU · 2025
Check Latest Price
Check Price on Amazon →
We earn a commission from qualifying purchases · Prices may vary
Performance Benchmarks
LLM Inference all sourced rows →
| Model | Metric | Value | Source |
|---|---|---|---|
|
Qwen3-8B
Q4_K_XL Token generation: 16K context, batch 1, Ubuntu 24.04, on-hardware lab measurement |
tokens per second |
140.6
tok/s
llama.cpp llama-bench, CUDA 12.8 · 2025-12-09
|
Estimate Hardware Corner LLM GPU Rankings ↗ |
Full Specifications
Vram gb
96 GB
Vram type
GDDR7 ECC
Memory bus
512 bit
Memory bandwidth gbps
1792 GB/s
Tdp watts
600 W
Cuda cores
24064
Pcie interface
PCIe 5.0 x16
Architecture
Blackwell
Related GPUs
Guides & Tools
CompareAIHardware.com participates in the Amazon Associates program. As an Amazon Associate, we earn from qualifying purchases.