AI GPU Benchmark Results
Every benchmark number in our database, with its source and evidence type. Filter by workload or evidence type; sort by any column. Independent benchmarks come from third-party reviews and standardized databases (MLPerf); community results are labeled reproducible when the run config is published, estimated when approximated.
Filter results
100 benchmark results
| GPU | Workload | Model / config | Result | Evidence | Source |
|---|---|---|---|---|---|
| RTX 6000 Ada | LLM inference (tokens/s) | Llama-3.1-8B · Q4_K_M · llama.cpp b3500 (CUDA) (Token generation: single user, batch 1, 4k context, mean of 3 runs) | 110 tok/s | Unverified community result0.55 | MyAIHardware llama.cpp Benchmarks |
| RTX 6000 Ada | LLM inference (tokens/s) | Llama-3.1-8B · Q4_K_M · llama.cpp b3500 (CUDA) (Prompt processing: 512-token prompt, batch 1, mean of 3 runs) | 3,200 tok/s | Unverified community result0.55 | MyAIHardware llama.cpp Benchmarks |
| RTX 6000 Ada | LLM inference (tokens/s) | Qwen3-8B · Q4_K_XL · llama.cpp llama-bench, CUDA 12.8 (Token generation: 16K context, batch 1, Ubuntu 24.04, on-hardware lab measurement) | 98.7 tok/s | Unverified community result0.55 | Hardware Corner LLM GPU Rankings |
How these numbers are sourced
Every row links to its original source and carries an evidence type plus a confidence score. Independent benchmarks come from third-party reviews (Tom's Hardware, TechPowerUp, Puget Systems) and standardized databases (MLPerf); manufacturer benchmarks are vendor-published figures; community results are reproducible when the run config is published, unverified otherwise — always labeled EST when estimated. Read the full benchmark methodology.
Compare any two GPUs head-to-head in the comparison tool, or browse value rankings.