AI GPU Benchmark Results
Every benchmark number in our database, with its source and evidence type. Filter by workload or evidence type; sort by any column. Independent benchmarks come from third-party reviews and standardized databases (MLPerf); community results are labeled reproducible when the run config is published, estimated when approximated.
100sourced results
27products covered
84GPUs in database
Honest coverage: our current benchmark set covers LLM inference (tokens/s) and Stable Diffusion image generation on flagship and mid-range cards. Gaming FPS and video-generation numbers are not yet sourced — they will appear here when we have verifiable sources. See the methodology and evidence-type definitions.
Filter results
100 benchmark results
| GPU | Workload | Model / config | Result | Evidence | Source |
|---|---|---|---|---|---|
| RTX A6000 | Image generation | SDXL Turbo · FP16 · ComfyUI | 35 img/min | Independent benchmark0.85 | Puget Systems Hardware Testing |
| RTX 6000 Ada | LLM inference (tokens/s) | Llama-2-13B · UL Procyon AI Text Generation (TensorRT) (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); output rate 78.532 tok/s) | 3,957 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| RTX 6000 Ada | LLM inference (tokens/s) | Llama-3-8B · UL Procyon AI Text Generation (TensorRT) (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); output rate 138.62 tok/s) | 4,026 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| RTX 6000 Ada | LLM inference (tokens/s) | Mistral-7B · UL Procyon AI Text Generation (TensorRT) (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); output rate 166.633 tok/s) | 4,255 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| RTX 6000 Ada | LLM inference (tokens/s) | Phi-3.5-mini · UL Procyon AI Text Generation (TensorRT) (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); output rate 228.359 tok/s) | 4,508 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| RTX 6000 Ada | Image generation | SDXL Turbo · FP16 · ComfyUI | 75 img/min | Independent benchmark0.85 | Puget Systems Hardware Testing |
| RTX 6000 Ada | Image generation | Stable Diffusion 1.5 · FP16 · UL Procyon AI Image Generation (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); 1.477 s/image) | 4,230 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| RTX 6000 Ada | Image generation | Stable Diffusion 1.5 INT8 · INT8 · UL Procyon AI Image Generation (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); 0.559 s/image) | 55,901 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| RTX 6000 Ada | Image generation | Stable Diffusion XL · FP16 · UL Procyon AI Image Generation (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); 12.323 s/image) | 3,043 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| Radeon RX 7900 XTX | Image generation | SDXL Turbo · FP16 · ComfyUI (ROCm) | 40 img/min | Independent benchmark0.85 | Tom's Hardware GPU Benchmarks 2025 |
| NVIDIA B200 | LLM inference (tokens/s) | Llama-2-70B · FP8 · TensorRT-LLM (MLPerf v5.1) (MLPerf v5.1 server scenario, 8x B200 HGX host (throughput is per-host, not per-GPU)) | 101,611 tok/s | Independent benchmark0.85 | MLPerf Inference Results |
| NVIDIA B200 | LLM inference (tokens/s) | Llama-2-70B · FP8 · TensorRT-LLM (MLPerf v5.1) (MLPerf v5.1 offline scenario, 8x B200 HGX host (throughput is per-host, not per-GPU)) | 101,246 tok/s | Independent benchmark0.85 | MLPerf Inference Results |
| NVIDIA B200 | LLM inference (tokens/s) | Llama-3.1-405B · FP8 · TensorRT-LLM (MLPerf v5.1) (MLPerf v5.1 offline scenario, 8x B200 HGX host (throughput is per-host, not per-GPU)) | 1,660 tok/s | Independent benchmark0.85 | MLPerf Inference Results |
| NVIDIA B200 | LLM inference (tokens/s) | Llama-3.1-405B · FP8 · TensorRT-LLM (MLPerf v5.1) (MLPerf v5.1 server scenario, 8x B200 HGX host (throughput is per-host, not per-GPU)) | 1,280 tok/s | Independent benchmark0.85 | MLPerf Inference Results |
| GeForce RTX 5090 | LLM inference (tokens/s) | Llama-2-13B · UL Procyon AI Text Generation (TensorRT) (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); output rate 134.502 tok/s) | 6,591 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 5090 | LLM inference (tokens/s) | Llama-3-8B · UL Procyon AI Text Generation (TensorRT) (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); output rate 214.285 tok/s) | 6,104 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 5090 | LLM inference (tokens/s) | Mistral-7B · UL Procyon AI Text Generation (TensorRT) (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); output rate 255.945 tok/s) | 6,267 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 5090 | LLM inference (tokens/s) | Phi-3.5-mini · UL Procyon AI Text Generation (TensorRT) (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); output rate 314.435 tok/s) | 5,749 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 5090 | Image generation | SDXL Turbo · FP16 · ComfyUI | 120 img/min | Independent benchmark0.85 | Tom's Hardware GPU Benchmarks 2025 |
| GeForce RTX 5090 | Image generation | Stable Diffusion 1.5 · FP16 · UL Procyon AI Image Generation (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); 0.763 s/image) | 8,193 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 5090 | Image generation | Stable Diffusion 1.5 INT8 · INT8 · UL Procyon AI Image Generation (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); 0.394 s/image) | 79,272 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 5090 | Image generation | Stable Diffusion XL · FP16 · UL Procyon AI Image Generation (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); 5.223 s/image) | 7,179 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 5080 | LLM inference (tokens/s) | Llama-2-13B · UL Procyon AI Text Generation (TensorRT) (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); output rate 83.653 tok/s) | 4,790 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 5080 | LLM inference (tokens/s) | Llama-3-8B · UL Procyon AI Text Generation (TensorRT) (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); output rate 136.177 tok/s) | 4,424 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 5080 | LLM inference (tokens/s) | Mistral-7B · UL Procyon AI Text Generation (TensorRT) (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); output rate 163.598 tok/s) | 4,635 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 5080 | LLM inference (tokens/s) | Phi-3.5-mini · UL Procyon AI Text Generation (TensorRT) (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); output rate 209.459 tok/s) | 4,400 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 5080 | Image generation | SDXL Turbo · FP16 · ComfyUI | 65 img/min | Independent benchmark0.85 | TechPowerUp GPU Reviews |
| GeForce RTX 5080 | Image generation | Stable Diffusion 1.5 · FP16 · UL Procyon AI Image Generation (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); 1.344 s/image) | 4,650 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 5080 | Image generation | Stable Diffusion 1.5 INT8 · INT8 · UL Procyon AI Image Generation (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); 0.561 s/image) | 55,683 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 5080 | Image generation | Stable Diffusion XL · FP16 · UL Procyon AI Image Generation (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); 8.808 s/image) | 4,257 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 4090 | LLM inference (tokens/s) | Llama-2-13B · UL Procyon AI Text Generation (TensorRT) (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); output rate 92.853 tok/s) | 5,013 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 4090 | LLM inference (tokens/s) | Llama-3-8B · UL Procyon AI Text Generation (TensorRT) (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); output rate 150.039 tok/s) | 4,849 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 4090 | LLM inference (tokens/s) | Mistral-7B · UL Procyon AI Text Generation (TensorRT) (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); output rate 183.266 tok/s) | 5,094 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 4090 | LLM inference (tokens/s) | Phi-3.5-mini · UL Procyon AI Text Generation (TensorRT) (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); output rate 244.343 tok/s) | 4,958 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 4090 | Image generation | SDXL Turbo · FP16 · ComfyUI | 80 img/min | Independent benchmark0.85 | Tom's Hardware GPU Benchmarks 2025 |
| GeForce RTX 4090 | Image generation | Stable Diffusion 1.5 · FP16 · UL Procyon AI Image Generation (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); 1.188 s/image) | 5,260 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 4090 | Image generation | Stable Diffusion 1.5 INT8 · INT8 · UL Procyon AI Image Generation (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); 0.503 s/image) | 62,160 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 4090 | Image generation | Stable Diffusion XL · FP16 · UL Procyon AI Image Generation (Standardized UL Procyon suite; same lab platform (ThreadRipper 7980X, driver 571.86); 7.461 s/image) | 5,025 score | Independent benchmark0.85 | StorageReview GPU Reviews |
| GeForce RTX 4080 SUPER | Image generation | SDXL Turbo · FP16 · ComfyUI | 58 img/min | Independent benchmark0.85 | TechPowerUp GPU Reviews |
| GeForce RTX 4060 Ti 16GB | Image generation | SDXL Turbo · FP16 · ComfyUI | 28 img/min | Independent benchmark0.85 | TechPowerUp GPU Reviews |
| GeForce RTX 3090 | Image generation | SDXL Turbo · FP16 · ComfyUI | 45 img/min | Independent benchmark0.85 | Puget Systems Hardware Testing |
How these numbers are sourced
Every row links to its original source and carries an evidence type plus a confidence score. Independent benchmarks come from third-party reviews (Tom's Hardware, TechPowerUp, Puget Systems) and standardized databases (MLPerf); manufacturer benchmarks are vendor-published figures; community results are reproducible when the run config is published, unverified otherwise — always labeled EST when estimated. Read the full benchmark methodology.
Compare any two GPUs head-to-head in the comparison tool, or browse value rankings.