Can my GPU run this model?

Model

Quantization (GGUF)

Context length (tokens)

KV cache precision

Weights

KV cache

Total VRAM needed (est.)

System RAM (CPU-only / full offload, est.)

Recommended GPUs by tier

Single-GPU fit. "Est. max tok/s" is a theoretical ceiling (bandwidth ÷ weight size), not a measurement. Real speed is usually much lower. Prices: Check price on Amazon Buy links are Amazon affiliate links; we may earn a commission at no extra cost to you.

Tier	GPU	VRAM	Bandwidth	Fit	Est. max tok/s	Buy