Jetson AGX Orin 64GB
NVIDIA · Edge Compute Device · 2022
Full Specifications
Related GPUs
Common Questions
Can the Jetson AGX Orin 64GB run local LLMs?
Yes, if the model fits in its 64 GB of memory — VRAM capacity decides which models load at all, while its 204.8 GB/s of bandwidth decides how fast tokens generate. With 24 GB or more it can hold large quantized models such as 70B-class LLMs in reduced precision, and our model pages list exact VRAM fits per model.
How much VRAM does the Jetson AGX Orin 64GB have?
Jetson AGX Orin 64GB has 64 GB of video memory with 204.8 GB/s of memory bandwidth and a 60 W TDP , per the specification values in our hardware database.
Is the Jetson AGX Orin 64GB worth it for AI workloads?
At a $1,999 MSRP, its value depends on whether your models fit in 64 GB. Compare its VRAM and bandwidth against your target models with our VRAM calculator, or see how it stacks up in head-to-head comparisons.
Guides & Tools
CompareAIHardware.com participates in the Amazon Associates program. As an Amazon Associate, we earn from qualifying purchases.