Datasets / Local AI GPU Value Index

Local AI GPU Value Index

The open dataset behind our value rankings: every discrete GPU we track with its launch MSRP, VRAM, memory bandwidth, and — where independent test data exists — measured llama.cpp generation tokens/s per $1000. Every number carries a source link. License: CC BY 4.0.

Download

Download CSV Download JSON Version v2026-09-04 · price basis: launch MSRP · license CC BY 4.0

Cite the versioned URL for stable references: https://compareaihardware.com/datasets/gpu-value-index/gpu-value-index-v2026-09-04.csv. See full methodology.

Headline: measured tokens/s per $1000

Ranked by measured generation throughput per $1000 of launch MSRP. Cohort: Qwen3-8B @ Q4_K_XL (19 GPUs measured). Switch cohort: Llama-3.1-8B @ Q4_K_M

#GPUtok/stok/s per $1000VRAMMSRP
1 GeForce RTX 3060 12GB 42.0 127.66 12 GB $329
2 GeForce RTX 5060 Ti 16GB 51.4 119.81 16 GB $429
3 GeForce RTX 5070 Ti 87.5 116.82 16 GB $749
4 GeForce RTX 5070 59.1 107.65 12 GB $549
5 GeForce RTX 3080 10GB 74.2 106.15 10 GB $699
6 GeForce RTX 4070 52.1 94.90 12 GB $549
7 GeForce RTX 5080 94.1 94.19 16 GB $999
8 GeForce RTX 4070 SUPER 56.2 93.82 12 GB $599
9 GeForce RTX 4070 Ti SUPER 72.2 90.36 16 GB $799
10 GeForce RTX 4080 SUPER 79.4 79.48 16 GB $999
11 GeForce RTX 3080 Ti 87.9 73.31 12 GB $1,199
12 GeForce RTX 5090 145.3 72.69 32 GB $1,999
13 GeForce RTX 4060 Ti 16GB 34.3 68.74 16 GB $499
14 GeForce RTX 4090 104.3 65.23 24 GB $1,599
15 GeForce RTX 4080 77.9 64.97 16 GB $1,199
16 GeForce RTX 3090 87.5 58.37 24 GB $1,499
17 GeForce RTX 3090 Ti 93.6 46.82 24 GB $1,999
18 RTX 6000 Ada 98.7 14.51 48 GB $6,800
19 RTX A6000 64.3 14.29 48 GB $4,500

Cohort shown: Qwen3-8B @ Q4_K_XL. The two cohorts use different models AND different quantizations — they are never averaged or normalized against each other.

Spec tier: bandwidth & VRAM per $1000 (all 57 GPUs)

A coverage metric computed from vendor specs ÷ launch MSRP — a proxy, not performance. Full column set lives in the download; top entries by bandwidth per $1000:

GPUGB/s per $1000GB per $1000BandwidthVRAMMSRP
Arc A580 2,860.34 44.69 512 GB/s 8 GB $179
Arc B580 1,831.33 48.19 456 GB/s 12 GB $249
Arc A750 1,771.63 27.68 512 GB/s 8 GB $289
Arc B570 1,735.16 45.66 380 GB/s 10 GB $219
Arc A770 16GB 1,604.58 45.85 560 GB/s 16 GB $349
GeForce RTX 5060 1,498.33 26.76 448 GB/s 8 GB $299
GeForce RTX 5050 1,285.14 32.13 320 GB/s 8 GB $249
Radeon RX 7800 XT 1,250.50 32.06 624 GB/s 16 GB $499
Radeon RX 7900 XT 1,232.67 30.82 800 GB/s 20 GB $649
GeForce RTX 5070 1,224.04 21.86 672 GB/s 12 GB $549
GeForce RTX 5070 Ti 1,196.26 21.36 896 GB/s 16 GB $749
Radeon RX 9070 1,165.76 29.14 640 GB/s 16 GB $549
GeForce RTX 3060 12GB 1,094.22 36.47 360 GB/s 12 GB $329
GeForce RTX 3080 10GB 1,087.27 14.31 760 GB/s 10 GB $699
Radeon RX 7600 1,070.63 29.74 288 GB/s 8 GB $269

Evidence legend

  • vendor_spec — manufacturer-published hardware specification (VRAM GB, memory bandwidth GB/s).
  • manufacturer_pricing — launch MSRP in USD at product introduction. Never street or used-market prices.
  • independent_benchmark — third-party measured llama.cpp generation throughput, non-estimate rows only, each with source URL and test date.

Coverage

57 GPUs total · 42 with sourced launch MSRP · measured cohorts: Qwen3-8B @ Q4_K_XL = 20 GPUs, Llama-3.1-8B @ Q4_K_M = 10 GPUs.

How to cite

CompareAIHardware, "Local AI GPU Value Index", dataset version v2026-09-04, September 2026. Licensed under CC BY 4.0. Available at: https://compareaihardware.com/datasets/gpu-value-index