Can my GPU run this model?
Weights
KV cache
Total VRAM needed (est.)
System RAM (CPU-only / full offload, est.)
Recommended GPUs by tier
Single-GPU fit. "Est. max tok/s" is a theoretical ceiling (bandwidth ÷ weight size), not a measurement. Real speed is usually much lower. Prices: Check price on Amazon Buy links are Amazon affiliate links; we may earn a commission at no extra cost to you.
| Tier | GPU | VRAM | Bandwidth | Fit | Est. max tok/s | Buy |
|---|