All AI GPUs — Specs, Benchmarks & Pricing
Browse every AI GPU in one filterable table. Sort by VRAM, bandwidth, LLM inference speed, power draw, and MSRP.
● Benchmark column shows tokens/second for Llama-3.1-8B (Q8) and Llama-3-70B (Q4_K_M)
| GPU | Mfr | VRAM | Type | BW (GB/s) | TDP | 8B (t/s) | 70B (t/s) | MSRP | Year | Status | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GeForce RTX 5090 | NVIDIA | 32 | GDDR7 | 1792 | 575W | 145.3 | 42.0 | $1,999 | Check Price | 2025 | available | |
| GeForce RTX 5080 | NVIDIA | 16 | GDDR7 | 960 | 360W | 94.1 | — | $999 | Check Price | 2025 | available | |
| GeForce RTX 5070 Ti | NVIDIA | 16 | GDDR7 | 896 | 300W | 87.5 | — | $749 | Check Price | 2025 | available | |
| GeForce RTX 5070 | NVIDIA | 12 | GDDR7 | 672 | 250W | 59.1 | — | $549 | Check Price | 2025 | available | |
| GeForce RTX 5060 Ti 16GB | NVIDIA | 16 | GDDR7 | 448 | 180W | 51.4 | — | $429 | Check Price | 2025 | available | |
| GeForce RTX 5060 | NVIDIA | 8 | GDDR7 | 448 | 145W | — | — | $299 | Check Price | 2025 | available | |
| GeForce RTX 5050 | NVIDIA | 8 | GDDR6 | 320 | 130W | — | — | $249 | Check Price | 2025 | available | |
| Radeon RX 9070 XT | AMD | 16 | GDDR6 | 640 | 304W | — | — | $599 | Check Price | 2025 | available | |
| Radeon RX 9070 | AMD | 16 | GDDR6 | 640 | 220W | — | — | $549 | Check Price | 2025 | available | |
| Arc B570 | Intel | 10 | GDDR6 | 380 | 150W | — | — | $219 | Check Price | 2025 | available | |
| NVIDIA RTX PRO 6000 Blackwell | NVIDIA | 96 | GDDR7 ECC | 1792 | 600W | 140.6 | — | — | Check Price | 2025 | available | |
| NVIDIA RTX PRO 5000 Blackwell | NVIDIA | 48 | GDDR7 with ECC | 1344 | 300W | — | — | — | 2025 | available | ||
| NVIDIA RTX PRO 4500 Blackwell | NVIDIA | 32 | GDDR7 with ECC | 896 | 200W | — | — | — | Check Price | 2025 | available | |
| NVIDIA RTX PRO 4000 Blackwell | NVIDIA | 24 | GDDR7 with ECC | 672 | 145W | — | — | — | Check Price | 2025 | available | |
| NVIDIA RTX PRO 2000 Blackwell | NVIDIA | 16 | GDDR7 with ECC | 288 | 70W | — | — | — | Check Price | 2025 | available | |
| GeForce RTX 4080 SUPER | NVIDIA | 16 | GDDR6X | 736 | 320W | 79.4 | — | $999 | Check Price | 2024 | available | |
| Radeon RX 7600 XT | AMD | 16 | GDDR6 | 288 | 190W | — | — | $329 | Check Price | 2024 | available | |
| Arc B580 | Intel | 12 | GDDR6 | 456 | 190W | 41.0 | — | $249 | Check Price | 2024 | available | |
| GeForce RTX 4070 Ti SUPER | NVIDIA | 16 | GDDR6X | 672 | 285W | 72.2 | — | $799 | Check Price | 2024 | eol | |
| GeForce RTX 4070 SUPER | NVIDIA | 12 | GDDR6X | 504 | 220W | 56.2 | — | $599 | Check Price | 2024 | eol | |
| GeForce RTX 4060 Ti 16GB | NVIDIA | 16 | GDDR6 | 288 | 160W | 34.3 | — | $499 | Check Price | 2023 | available | |
| GeForce RTX 4070 | NVIDIA | 12 | GDDR6X | 504 | 200W | 52.1 | — | $549 | Check Price | 2023 | eol | |
| GeForce RTX 4060 | NVIDIA | 8 | GDDR6 | 272 | 115W | — | — | $299 | Check Price | 2023 | available | |
| Radeon RX 7800 XT | AMD | 16 | GDDR6 | 624 | 263W | — | — | $499 | Check Price | 2023 | available | |
| Radeon RX 7700 XT | AMD | 12 | GDDR6 | 432 | 245W | — | — | $419 | Check Price | 2023 | available | |
| Radeon RX 7600 | AMD | 8 | GDDR6 | 288 | 165W | — | — | $269 | Check Price | 2023 | available | |
| Arc A580 | Intel | 8 | GDDR6 | 512 | 185W | — | — | $179 | Check Price | 2023 | available | |
| GeForce RTX 4060 Ti 8GB | NVIDIA | 8 | GDDR6 | 288 | 160W | — | — | $399 | Check Price | 2023 | available | |
| RTX 6000 Ada | NVIDIA | 48 | GDDR6 | 960 | 300W | 98.7 | 35.0 | $6,800 | Check Price | 2023 | available | |
| NVIDIA RTX 5000 Ada | NVIDIA | 32 | GDDR6 | 576 | 250W | — | — | $2,250 | Check Price | 2023 | available | |
| GeForce RTX 4090 | NVIDIA | 24 | GDDR6X | 1008 | 450W | 104.3 | 18.0 | $1,599 | Check Price | 2022 | available | |
| Radeon RX 7900 XTX | AMD | 24 | GDDR6 | 960 | 355W | 76.0 | — | $999 | Check Price | 2022 | available | |
| GeForce RTX 4080 | NVIDIA | 16 | GDDR6X | 716.8 | 320W | 77.9 | — | $1,199 | Check Price | 2022 | eol | |
| GeForce RTX 3090 Ti | NVIDIA | 24 | GDDR6X | 1008 | 450W | 93.6 | — | $1,999 | Check Price | 2022 | eol | |
| Radeon RX 7900 XT | AMD | 20 | GDDR6 | 800 | 315W | — | — | $649 | Check Price | 2022 | available | |
| Arc A770 16GB | Intel | 16 | GDDR6 | 560 | 225W | — | — | $349 | Check Price | 2022 | available | |
| Arc A750 | Intel | 8 | GDDR6 | 512 | 225W | — | — | $289 | Check Price | 2022 | available | |
| AMD Radeon Pro W7900 | AMD | 48 | GDDR6 with ECC | 864 | 295W | — | — | $3,999 | Check Price | 2022 | available | |
| AMD Radeon Pro W7800 | AMD | 32 | GDDR6 with ECC | 576 | 260W | — | — | $2,499 | Check Price | 2022 | available | |
| GeForce RTX 3080 Ti | NVIDIA | 12 | GDDR6X | 912 | 350W | 87.9 | — | $1,199 | Check Price | 2021 | eol | |
| GeForce RTX 3060 12GB | NVIDIA | 12 | GDDR6 | 360 | 170W | 42.0 | — | $329 | Check Price | 2021 | available | |
| RTX A6000 | NVIDIA | 48 | GDDR6 | 768 | 300W | 64.3 | 22.0 | $4,500 | Check Price | 2021 | available | |
| GeForce RTX 3090 | NVIDIA | 24 | GDDR6X | 936 | 350W | 87.5 | — | $1,499 | Check Price | 2020 | eol | |
| GeForce RTX 3080 10GB | NVIDIA | 10 | GDDR6X | 760 | 320W | 74.2 | — | $699 | Check Price | 2020 | eol | |
| GeForce RTX 3070 | NVIDIA | 8 | GDDR6 | 448 | 220W | — | — | $499 | Check Price | 2020 | eol | |
| Radeon RX 6800 XT | AMD | 16 | GDDR6 | 512 | 300W | — | — | $649 | Check Price | 2020 | eol | |
| GeForce RTX 2080 Ti | NVIDIA | 11 | GDDR6 | 616 | 250W | — | — | $999 | Check Price | 2018 | eol |
CompareAIHardware.com participates in the Amazon Associates program. Benchmark sources: MLPerf, llama.cpp repo, Tom's Hardware, Reddit r/LocalLLaMA. Estimates marked on detail pages.