All AI GPUs — Specs, Benchmarks & Pricing
Browse every AI GPU in one filterable table. Sort by VRAM, bandwidth, LLM inference speed, power draw, and MSRP.
● Benchmark column shows tokens/second for Llama-3.1-8B (Q8) and Llama-3-70B (Q4_K_M)
| GPU | Mfr | VRAM | Type | BW (GB/s) | TDP | 8B (t/s) | 70B (t/s) | MSRP | Year | Status | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Radeon RX 9050 | AMD | 8 | GDDR6 | 288 | 92W | — | — | $279 | 2026 | available | ||
| Radeon RX 9050 (4GB OEM) | AMD | 4 | GDDR6 | — | —W | — | — | — | 2026 | available | ||
| Radeon RX 9070 GRE | AMD | 12 | GDDR6 | 432 | 220W | — | — | $549 | 2026 | available | ||
| AMD Instinct MI430X | AMD | 432 | HBM4 | 23300 | —W | — | — | — | 2026 | announced | ||
| AMD Instinct MI455X | AMD | 432 | HBM4 | 23300 | —W | — | — | — | 2026 | announced | ||
| M6 (Mac mini) | Apple | — | — | 170 | —W | — | — | $899 | 2026 | available | ||
| M5 Pro (Mac mini) | Apple | — | — | 307 | —W | — | — | $1,699 | 2026 | available | ||
| M5 Max (Mac Studio) | Apple | — | — | — | —W | — | — | $2,499 | 2026 | available | ||
| M5 Ultra (Mac Studio) | Apple | — | — | 1200 | —W | — | — | $5,499 | 2026 | available | ||
| Apple M5 Max | Apple | — | unified | 614 | —W | — | — | — | 2026 | available | ||
| Apple M5 Pro | Apple | — | unified | 307 | —W | — | — | — | 2026 | available | ||
| Apple M5 Ultra | Apple | 512 | unified | 1200 | —W | — | — | — | 2026 | available | ||
| Apple M6 | Apple | — | unified | 170 | —W | — | — | — | 2026 | available | ||
| NVIDIA Jetson Orin Nano 2 | NVIDIA | 8 | — | — | 15W | — | — | — | 2026 | announced | ||
| Snapdragon X2 Elite Extreme (X2E-96-100) | Qualcomm | — | — | — | —W | — | — | — | 2026 | announced | ||
| Intel Arc G3 Extreme (Arc B390 iGPU) | Intel | — | — | — | —W | — | — | — | 2026 | available | ||
| NVIDIA RTX Spark (superchip) | NVIDIA | 128 | unified | — | —W | — | — | — | 2026 | announced | ||
| Minisforum N5 MAX AI NAS | MinisForum | — | LPDDR5x 8533MT/s (256-bit) | — | —W | — | — | $2,599 | Check Price | 2026 | available | |
| QNAP TVS-hx77AX series (AI NAS) | QNAP | — | DDR5 (ECC optional) | — | —W | — | — | — | 2026 | announced | ||
| UGREEN NASync DXP8800 Ultra | UGREEN | — | — | — | —W | — | — | $1,780 | 2026 | available | ||
| UGREEN NASync DXP6800 Ultra | UGREEN | — | — | — | —W | — | — | $1,450 | 2026 | available | ||
| QNAP QAI-h1290FX | QNAP | 128 | DDR4 ECC | — | —W | — | — | — | 2026 | available | ||
| UGREEN NASync iDX6011 Pro | UGREEN | — | LPDDR5x | — | —W | — | — | $6,000 | 2026 | available | ||
| GeForce RTX 5090 | NVIDIA | 32 | GDDR7 | 1792 | 575W | 145.3 | 42.0 | $1,999 | Check Price | 2025 | available | |
| GeForce RTX 5080 | NVIDIA | 16 | GDDR7 | 960 | 360W | 94.1 | — | $999 | Check Price | 2025 | available | |
| GeForce RTX 5070 Ti | NVIDIA | 16 | GDDR7 | 896 | 300W | 87.5 | — | $749 | Check Price | 2025 | available | |
| GeForce RTX 5070 | NVIDIA | 12 | GDDR7 | 672 | 250W | 59.1 | — | $549 | Check Price | 2025 | available | |
| GeForce RTX 5060 Ti 16GB | NVIDIA | 16 | GDDR7 | 448 | 180W | 51.4 | — | $429 | Check Price | 2025 | available | |
| GeForce RTX 5060 | NVIDIA | 8 | GDDR7 | 448 | 145W | — | — | $299 | Check Price | 2025 | available | |
| GeForce RTX 5050 | NVIDIA | 8 | GDDR6 | 320 | 130W | — | — | $249 | Check Price | 2025 | available | |
| Radeon RX 9070 XT | AMD | 16 | GDDR6 | 640 | 304W | — | — | $599 | Check Price | 2025 | available | |
| Radeon RX 9070 | AMD | 16 | GDDR6 | 640 | 220W | — | — | $549 | Check Price | 2025 | available | |
| Arc B570 | Intel | 10 | GDDR6 | 380 | 150W | — | — | $219 | Check Price | 2025 | available | |
| Radeon RX 9060 XT 16GB | AMD | 16 | GDDR6 | 320 | 160W | — | — | $349 | 2025 | available | ||
| Radeon RX 9060 XT 8GB | AMD | 8 | GDDR6 | 320 | 150W | — | — | $299 | 2025 | available | ||
| Radeon RX 9060 XT LP (16GB) | AMD | 16 | GDDR6 | 320 | 140W | — | — | — | 2025 | available | ||
| NVIDIA RTX PRO 6000 Blackwell | NVIDIA | 96 | GDDR7 ECC | 1792 | 600W | 140.6 | — | — | Check Price | 2025 | available | |
| NVIDIA RTX PRO 5000 Blackwell | NVIDIA | 48 | GDDR7 with ECC | 1344 | 300W | — | — | — | 2025 | available | ||
| NVIDIA RTX PRO 4500 Blackwell | NVIDIA | 32 | GDDR7 with ECC | 896 | 200W | — | — | — | Check Price | 2025 | available | |
| NVIDIA RTX PRO 4000 Blackwell | NVIDIA | 24 | GDDR7 with ECC | 672 | 145W | — | — | — | Check Price | 2025 | available | |
| NVIDIA RTX PRO 2000 Blackwell | NVIDIA | 16 | GDDR7 with ECC | 288 | 70W | — | — | — | Check Price | 2025 | available | |
| NVIDIA B200 | NVIDIA | 192 | HBM3e | 8000 | 1000W | — | — | — | 2025 | available | ||
| NVIDIA B300 (Blackwell Ultra) | NVIDIA | 288 | HBM3e | 8000 | 1400W | — | — | — | 2025 | available | ||
| AMD Instinct MI355X | AMD | 288 | HBM3E | 8000 | 1400W | — | — | — | 2025 | available | ||
| AMD Instinct MI350X | AMD | 288 | HBM3E | 8000 | 1000W | — | — | — | 2025 | available | ||
| M3 Ultra (Mac Studio) | Apple | — | — | 819 | 270W | — | — | $3,999 | Check Price | 2025 | discontinued | |
| M3 Ultra (Mac Studio, 256 GB) | Apple | — | — | 819 | 270W | — | — | $5,999 | 2025 | discontinued | ||
| M3 Ultra (Mac Studio, 96 GB) | Apple | — | — | 819 | 270W | — | — | $3,999 | 2025 | discontinued | ||
| Jetson Orin NX 16GB Super | NVIDIA | 16 | LPDDR5 | 102.4 | 25W | — | — | — | 2025 | available | ||
| QNAP TVS-AIh1688ATX | QNAP | — | — | — | —W | — | — | — | 2025 | available | ||
| GeForce RTX 4080 SUPER | NVIDIA | 16 | GDDR6X | 736 | 320W | 79.4 | — | $999 | Check Price | 2024 | available | |
| Radeon RX 7600 XT | AMD | 16 | GDDR6 | 288 | 190W | — | — | $329 | Check Price | 2024 | available | |
| Arc B580 | Intel | 12 | GDDR6 | 456 | 190W | 41.0 | — | $249 | Check Price | 2024 | available | |
| GeForce RTX 4070 Ti SUPER | NVIDIA | 16 | GDDR6X | 672 | 285W | 72.2 | — | $799 | Check Price | 2024 | eol | |
| GeForce RTX 4070 SUPER | NVIDIA | 12 | GDDR6X | 504 | 220W | 56.2 | — | $599 | Check Price | 2024 | eol | |
| H200 SXM | NVIDIA | 141 | HBM3e | 4800 | 700W | — | 140.0 | — | 2024 | available | ||
| AMD Instinct MI325X | AMD | 256 | HBM3e | 6000 | 1000W | — | — | — | 2024 | available | ||
| M4 Max (MacBook Pro) | Apple | — | — | 546 | —W | — | — | $3,199 | 2024 | available | ||
| Apple M4 | Apple | — | — | 120 | —W | — | — | — | 2024 | available | ||
| Apple M4 Pro | Apple | — | — | 273 | —W | — | — | — | 2024 | available | ||
| Jetson Orin Nano 8GB Super (Dev Kit) | NVIDIA | 8 | LPDDR5 | 102 | 25W | — | — | $249 | 2024 | available | ||
| Snapdragon X Elite (X1E-84-100) | Qualcomm | — | LPDDR5x | 135 | —W | — | — | — | 2024 | available | ||
| Intel Core Ultra 9 288V (Lunar Lake) | Intel | — | LPDDR5x (on-package) | 136.5 | 30W | — | — | — | 2024 | available | ||
| AMD Ryzen AI 9 HX 370 (Strix Point) | AMD | — | LPDDR5x | 120 | 28W | — | — | — | 2024 | available | ||
| Intel Core Ultra 9 285 (Arrow Lake) | Intel | — | — | — | 125W | — | — | — | 2024 | available | ||
| UGREEN NASync DXP8800 Plus | UGREEN | — | — | — | —W | — | — | $1,370 | 2024 | available | ||
| UGREEN NASync DXP4800 Plus | UGREEN | — | — | — | —W | — | — | $620 | 2024 | available | ||
| GeForce RTX 4060 Ti 16GB | NVIDIA | 16 | GDDR6 | 288 | 160W | 34.3 | — | $499 | Check Price | 2023 | available | |
| GeForce RTX 4070 | NVIDIA | 12 | GDDR6X | 504 | 200W | 52.1 | — | $549 | Check Price | 2023 | eol | |
| GeForce RTX 4060 | NVIDIA | 8 | GDDR6 | 272 | 115W | — | — | $299 | Check Price | 2023 | available | |
| Radeon RX 7800 XT | AMD | 16 | GDDR6 | 624 | 263W | — | — | $499 | Check Price | 2023 | available | |
| Radeon RX 7700 XT | AMD | 12 | GDDR6 | 432 | 245W | — | — | $419 | Check Price | 2023 | available | |
| Radeon RX 7600 | AMD | 8 | GDDR6 | 288 | 165W | — | — | $269 | Check Price | 2023 | available | |
| Arc A580 | Intel | 8 | GDDR6 | 512 | 185W | — | — | $179 | Check Price | 2023 | available | |
| GeForce RTX 4060 Ti 8GB | NVIDIA | 8 | GDDR6 | 288 | 160W | — | — | $399 | Check Price | 2023 | available | |
| Radeon RX 7900 GRE | AMD | — | — | — | —W | — | — | — | 2023 | eol | ||
| RTX 6000 Ada | NVIDIA | 48 | GDDR6 | 960 | 300W | 98.7 | 35.0 | $6,800 | Check Price | 2023 | available | |
| NVIDIA RTX 5000 Ada | NVIDIA | 32 | GDDR6 | 576 | 250W | — | — | $2,250 | Check Price | 2023 | available | |
| H100 SXM | NVIDIA | 80 | HBM3 | 3350 | 700W | 500.0 | 90.0 | — | 2023 | available | ||
| NVIDIA H100 PCIe 80GB | NVIDIA | 80 | HBM2e | 2039 | 350W | — | — | — | 2023 | available | ||
| AMD Instinct MI300X | AMD | 192 | HBM3 | 5300 | 750W | — | — | — | 2023 | available | ||
| Apple M3 | Apple | — | — | 150 | —W | — | — | — | 2023 | available | ||
| Apple M3 Pro | Apple | — | — | 300 | —W | — | — | — | 2023 | available | ||
| Apple M3 Max | Apple | — | — | 400 | —W | 55.0 | — | — | 2023 | available | ||
| QNAP TS-AI642 | QNAP | — | — | — | —W | — | — | — | 2023 | available | ||
| GeForce RTX 4090 | NVIDIA | 24 | GDDR6X | 1008 | 450W | 104.3 | 18.0 | $1,599 | Check Price | 2022 | available | |
| Radeon RX 7900 XTX | AMD | 24 | GDDR6 | 960 | 355W | 76.0 | — | $999 | Check Price | 2022 | available | |
| GeForce RTX 4080 | NVIDIA | 16 | GDDR6X | 716.8 | 320W | 77.9 | — | $1,199 | Check Price | 2022 | eol | |
| GeForce RTX 3090 Ti | NVIDIA | 24 | GDDR6X | 1008 | 450W | 93.6 | — | $1,999 | Check Price | 2022 | eol | |
| Radeon RX 7900 XT | AMD | 20 | GDDR6 | 800 | 315W | — | — | $649 | Check Price | 2022 | available | |
| Arc A770 16GB | Intel | 16 | GDDR6 | 560 | 225W | — | — | $349 | Check Price | 2022 | available | |
| Arc A750 | Intel | 8 | GDDR6 | 512 | 225W | — | — | $289 | Check Price | 2022 | available | |
| AMD Radeon Pro W7900 | AMD | 48 | GDDR6 with ECC | 864 | 295W | — | — | $3,999 | Check Price | 2022 | available | |
| AMD Radeon Pro W7800 | AMD | 32 | GDDR6 with ECC | 576 | 260W | — | — | $2,499 | Check Price | 2022 | available | |
| Jetson AGX Orin 64GB | NVIDIA | 64 | LPDDR5 | 204.8 | 60W | — | — | $1,999 | 2022 | available | ||
| Jetson AGX Orin 32GB | NVIDIA | 32 | LPDDR5 | 204.8 | 60W | — | — | — | 2022 | available | ||
| GeForce RTX 3080 Ti | NVIDIA | 12 | GDDR6X | 912 | 350W | 87.9 | — | $1,199 | Check Price | 2021 | eol | |
| GeForce RTX 3060 12GB | NVIDIA | 12 | GDDR6 | 360 | 170W | 42.0 | — | $329 | Check Price | 2021 | available | |
| RTX A6000 | NVIDIA | 48 | GDDR6 | 768 | 300W | 64.3 | 22.0 | $4,500 | Check Price | 2021 | available | |
| NVIDIA A100 80GB SXM | NVIDIA | 80 | HBM2e | 2039 | 400W | — | — | — | 2021 | available | ||
| GeForce RTX 3090 | NVIDIA | 24 | GDDR6X | 936 | 350W | 87.5 | — | $1,499 | Check Price | 2020 | eol | |
| GeForce RTX 3080 10GB | NVIDIA | 10 | GDDR6X | 760 | 320W | 74.2 | — | $699 | Check Price | 2020 | eol | |
| GeForce RTX 3070 | NVIDIA | 8 | GDDR6 | 448 | 220W | — | — | $499 | Check Price | 2020 | eol | |
| Radeon RX 6800 XT | AMD | 16 | GDDR6 | 512 | 300W | — | — | $649 | Check Price | 2020 | eol | |
| NVIDIA A100 40GB SXM | NVIDIA | 40 | HBM2 | 1555 | 400W | — | — | — | 2020 | eol | ||
| GeForce RTX 2080 Ti | NVIDIA | 11 | GDDR6 | 616 | 250W | — | — | $999 | Check Price | 2018 | eol |
CompareAIHardware.com participates in the Amazon Associates program. Benchmark sources: MLPerf, llama.cpp repo, Tom's Hardware, Reddit r/LocalLLaMA. Estimates marked on detail pages.