← All GPUs
H200 SXM
NVIDIA · Data Center GPU · 2024
Performance Benchmarks
LLM Inference all sourced rows →
| Model | Metric | Value | Source |
|---|---|---|---|
|
Llama-3-70B
Q4 141GB HBM3e — editorial estimate pending article-level source verification |
tokens per second |
140
tok/s
est llama.cpp · 2025-06-01
|
Estimated NVIDIA Official Specs ↗ |
Full Specifications
Vram gb
141 GB
Vram type
HBM3e
Memory bandwidth gbps
4800 GB/s
Tdp watts
700 W
Cuda cores
16896
Architecture
Hopper
Related GPUs
Guides & Tools
CompareAIHardware.com participates in the Amazon Associates program. As an Amazon Associate, we earn from qualifying purchases.