⌘K

AI GPU Benchmark Results

Every benchmark number in our database, with its source and evidence type. Filter by workload or evidence type; sort by any column. Independent benchmarks come from third-party reviews and standardized databases (MLPerf); community results are labeled reproducible when the run config is published, estimated when approximated.

100sourced results
27products covered
84GPUs in database
Honest coverage: our current benchmark set covers LLM inference (tokens/s) and Stable Diffusion image generation on flagship and mid-range cards. Gaming FPS and video-generation numbers are not yet sourced — they will appear here when we have verifiable sources. See the methodology and evidence-type definitions.

Filter results

All LLM inference (tokens/s) Image generation Video generation Speech & transcription Fine-tuning
All Manufacturer benchmark Independent benchmark Reproducible community benchmark Unverified community result Estimated

100 benchmark results

GPU Workload Model / config Result Evidence Source
RTX A6000 LLM inference (tokens/s) Llama-3-70B · Q4 · llama.cpp (48GB VRAM — editorial estimate pending article-level source verification) 22 tok/s EST Estimated0.40 Puget Systems Hardware Testing
RTX 6000 Ada LLM inference (tokens/s) Llama-3-70B · Q4 · llama.cpp (48GB VRAM — editorial estimate pending article-level source verification) 35 tok/s EST Estimated0.40 Puget Systems Hardware Testing
H200 SXM LLM inference (tokens/s) Llama-3-70B · Q4 · llama.cpp (141GB HBM3e — editorial estimate pending article-level source verification) 140 tok/s EST Estimated0.40 NVIDIA Official Specs
H100 SXM LLM inference (tokens/s) Llama-3-70B · Q4 · llama.cpp (80GB HBM3 — editorial estimate pending article-level source verification) 90 tok/s EST Estimated0.40 MLPerf Inference Results
H100 SXM LLM inference (tokens/s) Llama-3-8B · Q4 · llama.cpp (80GB HBM3 — editorial estimate pending article-level source verification) 500 tok/s EST Estimated0.40 NVIDIA Official Specs
GeForce RTX 5090 LLM inference (tokens/s) Llama-3-70B · Q4 · llama.cpp (32GB VRAM, tight fit — editorial estimate pending article-level source verification) 42 tok/s EST Estimated0.40 Tom's Hardware GPU Benchmarks 2025
GeForce RTX 5090 LLM inference (tokens/s) Llama-3.1-8B · FP16 · vLLM (Batch-serving throughput, ~18GB VRAM used; community + Spheron internal testing (approximate)) 3,500 tok/s EST Estimated0.40 Spheron GPU Benchmark Blog
GeForce RTX 4090 LLM inference (tokens/s) Llama-3-70B · Q4 · llama.cpp (24GB VRAM, very tight, heavy swapping — editorial estimate pending article-level source verification) 18 tok/s EST Estimated0.40 Tom's Hardware GPU Benchmarks 2025
GeForce RTX 4090 LLM inference (tokens/s) Llama-3.1-8B · FP16 · vLLM (Batch-serving throughput, ~18GB VRAM used; published llama.cpp/vLLM benchmarks (approximate)) 2,550 tok/s EST Estimated0.40 Spheron GPU Benchmark Blog
GeForce RTX 4060 Ti 16GB LLM inference (tokens/s) Llama-3-8B · Q4 · llama.cpp (16GB VRAM — EST pending article-level Llama-3.1-8B verification; verified Qwen3-8B @16K row exists (34.31 tok/s) — editorial estimate pending article-level source verification) 95 tok/s EST Estimated0.40 TechPowerUp GPU Reviews

How these numbers are sourced

Every row links to its original source and carries an evidence type plus a confidence score. Independent benchmarks come from third-party reviews (Tom's Hardware, TechPowerUp, Puget Systems) and standardized databases (MLPerf); manufacturer benchmarks are vendor-published figures; community results are reproducible when the run config is published, unverified otherwise — always labeled EST when estimated. Read the full benchmark methodology.

Compare any two GPUs head-to-head in the comparison tool, or browse value rankings.