Can you run AliceAI Foundation 80B A3B Base locally?

AliceAI family · 2026 · 81.3B parameters (3B activated per token) · Hugging Face model card

How much VRAM does AliceAI Foundation 80B A3B Base need at each quantization?

AliceAI Foundation 80B A3B Base needs 54.1 GB of VRAM at Q4_K_M. The table below lists weights-only size and total VRAM including overhead for each common quantization level with 4k and 32k token contexts.

hybrid KDA + gated attention; MoE 10/512 + 1 shared

Method: weights = parameters × bits-per-weight (Q4_K_M ≈ 4.8, Q5_K_M ≈ 5.7, Q6_K ≈ 6.6, Q8_0 ≈ 8.5, FP16 = 16), plus 10% loading overhead, plus KV cache from the verified architecture config (48 layers, 2 KV heads, 256 head dim). Source: HF-verified 2026-09-21 via api (gated=false params=81.29B safetensors.total=81286433408 ctx=262144 license=apache-2.0 repo=yandex/AliceAI-Foundation-80B-A3B-Base@641d8820dd13db8201b1d88e635c5b21ee247568 layers=48 kv_heads=2). MoE: num_experts=512 num_experts_per_tok=10 active_params_b=3.0 (official README (80B total, 3B active)). VRAM figures are documented calculations, not measurements. No tok/s invented.

Which GPUs can run AliceAI Foundation 80B A3B Base locally?

At Q4_K_M with a 4k context, AliceAI Foundation 80B A3B Base needs 54.1 GB of VRAM. The lists below are computed live from our GPU database and grouped by how much headroom the card has. Disclosure: CompareAIHardware.com participates in the Amazon Associates program and earns from qualifying purchases through links on this page. Affiliate relationships do not influence our recommendations.

Runs AliceAI Foundation 80B A3B Base comfortably (25%+ VRAM headroom)

Needs 2+ GPUs to run AliceAI Foundation 80B A3B Base

One of these cards is too small on its own, but a pair (tensor or pipeline parallel, ~90% efficiency) covers the 54.1 GB requirement. See our multi-GPU guide for setup.

Can a Mac run AliceAI Foundation 80B A3B Base?

Yes — these Apple Silicon machines fit AliceAI Foundation 80B A3B Base at Q4_K_M, since macOS lets the GPU use about 75% of unified memory. Generation speed is bound by memory bandwidth, so the GB/s column matters as much as capacity.

Can AliceAI Foundation 80B A3B Base run on mini PCs, Jetson, or NPU devices?

These edge and NPU devices from our database have enough memory for AliceAI Foundation 80B A3B Base at Q4_K_M. Their memory bandwidth is far below discrete GPUs, so expect a fraction of desktop generation speed.

Which pre-built systems can run AliceAI Foundation 80B A3B Base?

These mini PCs and workstations from our database fit AliceAI Foundation 80B A3B Base at Q4_K_M. Usable-memory figures are conservative: Windows shares about half of system RAM with the GPU by default (Linux can expose more), macOS lets Apple Silicon GPUs use about 75% of unified memory, and Linux unified-memory systems such as GB10 expose roughly 90%. Generation speed is bound by memory bandwidth, so compare the GB/s column before buying.

Frequently asked questions