What LLMs Fit in 8 GB of VRAM? (Oct 2026)
GeForce RTX 3060 8GB (desktop) is the catalog SKU in this 8 GB tier with the smallest net budget: 7.00 GiB after the sourced reserve. 32 catalog models fit at a file-backed artifact. The month follows dataset 2026-10-02.1 (Oct 2026), not the build clock.
Catalog dataset 2026-10-02.1 (Oct 2026).
Catalog SKUs in this tier
| SKU | Marketed capacity | Net budget |
|---|---|---|
| GeForce RTX 3060 8GB (desktop) Smallest net budget | 8 GB GDDR6 | 7.00 GiB |
| GeForce RTX 3070 8GB (desktop) | 8 GB GDDR6 | 7.00 GiB |
| GeForce RTX 4060 8GB (desktop) | 8 GB GDDR6 | 7.00 GiB |
| GeForce RTX 5060 Ti 8GB (desktop) | 8 GB GDDR7 | 7.00 GiB |
Catalog models that fit
Each row is one file-backed artifact on the representative SKU. A missing quantization is omitted, not replaced. Context search stops at the sourced cap. With no sourced cap, the only verdict shown is at 8192 tokens.
When catalog bandwidth is missing, the decode ceiling says not available. That is not a memory verdict.
| Model | Artifact | Max context that fits | Max context including tight | Verdict at 8192 tokens | Decode ceiling | Links |
|---|---|---|---|---|---|---|
| Qwen2.5-0.5B-Instruct | GGUF Q4_K_M (Qwen)gguf-q4_k_m · llama.cpp | 32,768 | 32,768 | 8192 Runs comfortably0.68 GiB–1.07 GiB | Not available | |
| Qwen3-0.6B | GGUF Q4_K_M (Unsloth)gguf-q4_k_m · llama.cpp | 40,960 | 40,960 | 8192 Runs comfortably1.37 GiB–1.81 GiB | Not available | |
| Gemma 3 1B IT | GGUF Q4_0 (Google QAT)gguf-q4_0 · llama.cpp | 32,768 | 32,768 | 8192 Runs comfortably1.10 GiB–1.50 GiB | Not available | |
| Llama 3.2 1B Instruct | Official BF16 safetensorsbf16 · vllm | 47,659 | 131,072 | 8192 Fits3.18 GiB–5.06 GiB | Not available | |
| Qwen2.5-1.5B-Instruct | GGUF Q4_K_M (Qwen)gguf-q4_k_m · llama.cpp | 32,768 | 32,768 | 8192 Runs comfortably1.38 GiB–1.80 GiB | Not available | |
| Qwen2.5-Coder-1.5B-Instruct | GGUF Q4_K_M (Qwen)gguf-q4_k_m · llama.cpp | 32,768 | 32,768 | 8192 Runs comfortably1.38 GiB–1.80 GiB | Not available | |
| SmolLM2-1.7B-Instruct | GGUF Q4_K_M (Hugging Face)gguf-q4_k_m · llama.cpp | 8,192 | 8,192 | 8192 Runs comfortably2.61 GiB–3.11 GiB | Not available | |
| Qwen3-1.7B-Base | GGUF Q4_K_M (mradermacher)gguf-q4_k_m · llama.cpp | 32,768 | 32,768 | 8192 Runs comfortably2.03 GiB–2.49 GiB | Not available | |
| Qwen3-1.7B | GGUF Q4_K_M (Unsloth)gguf-q4_k_m · llama.cpp | 40,960 | 40,960 | 8192 Runs comfortably2.03 GiB–2.49 GiB | Not available | |
| Qwen2.5-3B-Instruct | GGUF Q4_K_Mgguf-q4_k_m · llama.cpp | 32,768 | 32,768 | 8192 Runs comfortably2.37 GiB–2.80 GiB | Not available | |
| Qwen2.5-Coder-3B-Instruct | GGUF Q4_K_M (Qwen)gguf-q4_k_m · llama.cpp | 32,768 | 32,768 | 8192 Runs comfortably2.37 GiB–2.80 GiB | Not available | |
| Qwen2.5-VL-3B-Instruct | GGUF Q4_K_M (Unsloth)gguf-q4_k_m · llama.cpp | 107,979 | 128,000 | 8192 Runs comfortably2.20 GiB–2.63 GiB | Not available | |
| Phi-3.5-mini-instruct | GGUF Q4_K_M (bartowski)gguf-q4_k_m · llama.cpp | 8,999 | 12,687 | 8192 Fits5.35 GiB–5.98 GiB | Not available | |
| Phi-4-mini-instruct | GGUF Q4_K_M (Unsloth)gguf-q4_k_m · llama.cpp | 26,282 | 37,308 | 8192 Runs comfortably3.45 GiB–3.94 GiB | Not available | |
| Qwen3-4B | GGUF Q4_K_Mgguf-q4_k_m · llama.cpp | 23,326 | 33,126 | 8192 Runs comfortably3.58 GiB–4.08 GiB | Not available | |
| Qwen3-4B-Instruct-2507 | GGUF Q4_K_M (Unsloth)gguf-q4_k_m · llama.cpp | 23,326 | 33,126 | 8192 Runs comfortably3.58 GiB–4.08 GiB | Not available | |
| Gemma 3 4B IT | GGUF Q4_0 (Google QAT)gguf-q4_0 · llama.cpp | 131,072 | 131,072 | 8192 Runs comfortably3.33 GiB–3.79 GiB | Not available | |
| Qwen3-VL-4B-Instruct | GGUF Q4_K_M (Qwen)gguf-q4_k_m · llama.cpp | 23,326 | 33,126 | 8192 Runs comfortably3.58 GiB–4.08 GiB | Not available | |
| Mistral-7B-Instruct-v0.3 | GGUF Q4_K_M (bartowski)gguf-q4_k_m · llama.cpp | 12,602 | 22,958 | 8192 Fits5.20 GiB–5.72 GiB | Not available | |
| DeepSeek-R1-Distill-Qwen-7B | GGUF Q4_K_M (Unsloth)gguf-q4_k_m · llama.cpp | 23,647 | 47,065 | 8192 Fits4.92 GiB–5.42 GiB | Not available | |
| OpenMath-Nemotron-7B | GGUF Q4_K_M (mradermacher)gguf-q4_k_m · llama.cpp | 23,647 | 47,065 | 8192 Fits4.92 GiB–5.42 GiB | Not available | |
| Qwen2-7B-Instruct | GGUF Q4_K_M (Qwen)gguf-q4_k_m · llama.cpp | 23,647 | 32,768 | 8192 Fits4.92 GiB–5.42 GiB | Not available | |
| Qwen2.5-7B-Instruct | GGUF Q4_K_Mgguf-q4_k_m · llama.cpp | 23,647 | 32,768 | 8192 Fits4.92 GiB–5.42 GiB | Not available | |
| Qwen2.5-Coder-7B | GGUF Q4_K_M (mradermacher)gguf-q4_k_m · llama.cpp | 23,647 | 32,768 | 8192 Fits4.92 GiB–5.42 GiB | Not available | |
| Qwen2.5-Coder-7B-Instruct | GGUF Q4_K_M (Qwen)gguf-q4_k_m · llama.cpp | 23,647 | 32,768 | 8192 Fits4.92 GiB–5.42 GiB | Not available | |
| Qwen2.5-Math-7B-Instruct | GGUF Q4_K_M (bartowski)gguf-q4_k_m · llama.cpp | 4,096 | 4,096 | 8192 Fits · Rough estimate4.92 GiB–6.23 GiB | Not available | |
| DeepSeek-R1-Distill-Llama-8B | GGUF Q4_K_M (Unsloth)gguf-q4_k_m · llama.cpp | 8,617 | 18,777 | 8192 Fits5.71 GiB–6.24 GiB | Not available | |
| granite-3.3-8b-instruct | GGUF Q4_K_M (IBM)gguf-q4_k_m · llama.cpp | 7,096 | 14,887 | 8192 Tight fit5.98 GiB–6.53 GiB | Not available | |
| Qwen3-8B | GGUF Q4_K_Mgguf-q4_k_m · llama.cpp | 7,309 | 15,965 | 8192 Tight fit5.93 GiB–6.48 GiB | Not available | |
| Qwen3-8B-Base | GGUF Q4_K_M (mradermacher)gguf-q4_k_m · llama.cpp | 7,309 | 15,965 | 8192 Tight fit5.93 GiB–6.48 GiB | Not available | |
| Qwen2.5-VL-7B-Instruct | GGUF Q4_K_M (Unsloth)gguf-q4_k_m · llama.cpp | 23,647 | 47,065 | 8192 Fits4.92 GiB–5.42 GiB | Not available | |
| Qwen3-VL-8B-Instruct | GGUF Q4_K_M (Qwen)gguf-q4_k_m · llama.cpp | 7,309 | 15,965 | 8192 Tight fit5.93 GiB–6.48 GiB | Not available |