AI GPU Benchmark Results
Every benchmark number in our database, with its source and evidence type. Filter by workload or evidence type; sort by any column. Independent benchmarks come from third-party reviews and standardized databases (MLPerf); community results are labeled reproducible when the run config is published, estimated when approximated.
Filter results
100 benchmark results
| GPU | Workload | Model / config | Result | Evidence | Source |
|---|---|---|---|---|---|
| RTX A6000 | LLM inference (tokens/s) | Llama-3-70B · Q4 · llama.cpp (48GB VRAM — editorial estimate pending article-level source verification) | 22 tok/s EST | Estimated0.40 | Puget Systems Hardware Testing |
| RTX 6000 Ada | LLM inference (tokens/s) | Llama-3-70B · Q4 · llama.cpp (48GB VRAM — editorial estimate pending article-level source verification) | 35 tok/s EST | Estimated0.40 | Puget Systems Hardware Testing |
| H200 SXM | LLM inference (tokens/s) | Llama-3-70B · Q4 · llama.cpp (141GB HBM3e — editorial estimate pending article-level source verification) | 140 tok/s EST | Estimated0.40 | NVIDIA Official Specs |
| H100 SXM | LLM inference (tokens/s) | Llama-3-70B · Q4 · llama.cpp (80GB HBM3 — editorial estimate pending article-level source verification) | 90 tok/s EST | Estimated0.40 | MLPerf Inference Results |
| H100 SXM | LLM inference (tokens/s) | Llama-3-8B · Q4 · llama.cpp (80GB HBM3 — editorial estimate pending article-level source verification) | 500 tok/s EST | Estimated0.40 | NVIDIA Official Specs |
| GeForce RTX 5090 | Image generation | FLUX.1-dev · BF16 · Diffusers (~26GB VRAM used; community + Spheron internal testing (approximate)) | 5.5 img/min EST | Estimated0.40 | Spheron GPU Benchmark Blog |
| GeForce RTX 5090 | LLM inference (tokens/s) | Llama-3-70B · Q4 · llama.cpp (32GB VRAM, tight fit — editorial estimate pending article-level source verification) | 42 tok/s EST | Estimated0.40 | Tom's Hardware GPU Benchmarks 2025 |
| GeForce RTX 5090 | LLM inference (tokens/s) | Llama-3.1-8B · FP16 · vLLM (Batch-serving throughput, ~18GB VRAM used; community + Spheron internal testing (approximate)) | 3,500 tok/s EST | Estimated0.40 | Spheron GPU Benchmark Blog |
| GeForce RTX 4090 | Image generation | FLUX.1-dev · BF16 · Diffusers (Requires memory-efficient attention (xFormers/SDPA) within 24GB; approximate) | 4 img/min EST | Estimated0.40 | Spheron GPU Benchmark Blog |
| GeForce RTX 4090 | LLM inference (tokens/s) | Llama-3-70B · Q4 · llama.cpp (24GB VRAM, very tight, heavy swapping — editorial estimate pending article-level source verification) | 18 tok/s EST | Estimated0.40 | Tom's Hardware GPU Benchmarks 2025 |
| GeForce RTX 4090 | LLM inference (tokens/s) | Llama-3.1-8B · FP16 · vLLM (Batch-serving throughput, ~18GB VRAM used; published llama.cpp/vLLM benchmarks (approximate)) | 2,550 tok/s EST | Estimated0.40 | Spheron GPU Benchmark Blog |
| GeForce RTX 4060 Ti 16GB | LLM inference (tokens/s) | Llama-3-8B · Q4 · llama.cpp (16GB VRAM — EST pending article-level Llama-3.1-8B verification; verified Qwen3-8B @16K row exists (34.31 tok/s) — editorial estimate pending article-level source verification) | 95 tok/s EST | Estimated0.40 | TechPowerUp GPU Reviews |
| Arc B580 | Image generation | SDXL Turbo · FP16 · ComfyUI | 18 img/min EST | Estimated0.40 | TechPowerUp GPU Reviews |
How these numbers are sourced
Every row links to its original source and carries an evidence type plus a confidence score. Independent benchmarks come from third-party reviews (Tom's Hardware, TechPowerUp, Puget Systems) and standardized databases (MLPerf); manufacturer benchmarks are vendor-published figures; community results are reproducible when the run config is published, unverified otherwise — always labeled EST when estimated. Read the full benchmark methodology.
Compare any two GPUs head-to-head in the comparison tool, or browse value rankings.