← All GPUs
GeForce RTX 3090
NVIDIA · Consumer GPU · 2020
Check Latest Price
$1,499 MSRP
Check Price on Amazon →
We earn a commission from qualifying purchases · Prices may vary
Performance Benchmarks
Image Generation all sourced rows →
| Model | Metric | Value | Source |
|---|---|---|---|
| SDXL Turbo FP16 | images per minute |
45
img/min
ComfyUI · 2025-06-01
|
Independent benchmark Puget Systems Hardware Testing ↗ |
LLM Inference all sourced rows →
| Model | Metric | Value | Source |
|---|---|---|---|
|
Llama-3.1-8B
Q4_K_M Token generation: single user, batch 1, 4k context, mean of 3 runs |
tokens per second |
85
tok/s
llama.cpp b3500 (CUDA) · 2026-05-22
|
Unverified community MyAIHardware llama.cpp Benchmarks ↗ |
|
Llama-3.1-8B
Q4_K_M Prompt processing: 512-token prompt, batch 1, mean of 3 runs |
prompt tokens per second |
2,400
tok/s
llama.cpp b3500 (CUDA) · 2026-05-22
|
Unverified community MyAIHardware llama.cpp Benchmarks ↗ |
|
Qwen3-8B
Q4_K_XL Token generation: 16K context, batch 1, Ubuntu 24.04, on-hardware lab measurement |
tokens per second |
87.5
tok/s
llama.cpp llama-bench, CUDA 12.8 · 2025-12-09
|
Unverified community Hardware Corner LLM GPU Rankings ↗ |
Full Specifications
Vram gb
24 GB
Vram type
GDDR6X
Memory bus
384 bit
Memory bandwidth gbps
936 GB/s
Tdp watts
350 W
Cuda cores
10496
Pcie interface
PCIe 4.0 x16
Architecture
Ampere
Related GPUs
Guides & Tools
CompareAIHardware.com participates in the Amazon Associates program. As an Amazon Associate, we earn from qualifying purchases.