What LLM can a Mac with 32 GB unified memory run?
32 GB of unified memory is not 32 GB of VRAM. macOS lets the GPU wire about 67% by default, so this page budgets 21.3 GiB for weights, KV cache and runtime. The largest model in our list that fits is Qwen3-30B-A3B at Q4_K_M (18.2 GiB–18.9 GiB at 8,192 tokens). 13 of 22 models run, 3 are tight, 6 do not fit.
Model by model on 32 GB
| Model | Result | Quant to use | Estimated total | Max context |
|---|---|---|---|---|
| Phi-4-mini-instruct | Runs | Q8_0 | 4.9 GiB–5.5 GiB | 113,461 |
| Qwen3-4B | Runs | Q8_0 | 5.2 GiB–5.8 GiB | 40,960 |
| Mistral-7B-Instruct-v0.3 | Runs | Q8_0 | 8.3 GiB–8.9 GiB | 32,768 |
| Qwen2.5-7B-Instruct | Runs | Q8_0 | 8.1 GiB–8.7 GiB | 32,768 |
| DeepSeek-R1-Distill-Llama-8B | Runs | Q8_0 | 9.1 GiB–9.7 GiB | 81,052 |
| Qwen3-8B | Runs | Q8_0 | 9.4 GiB–10.0 GiB | 40,960 |
| GLM-4-9B-0414 | Runs | Q8_0 | 9.8 GiB–10.3 GiB | 32,768 |
| Mistral-Nemo-Instruct-2407 | Runs | Q8_0 | 13.5 GiB–14.2 GiB | 38,766 |
| phi-4 | Runs | Q8_0 | 16.2 GiB–17.0 GiB | 16,384 |
| Qwen3-14B | Runs | Q8_0 | 16.0 GiB–16.8 GiB | 23,196 |
| Qwen2.5-14B-Instruct | Runs | Q8_0 | 16.2 GiB–17.0 GiB | 19,315 |
| Mistral-Small-24B-Instruct-2501 | Runs | Q5_K_M | 17.0 GiB–17.8 GiB | 16,996 |
| Qwen3-30B-A3B | Runs | Q4_K_M | 18.2 GiB–18.9 GiB | 10,944 |
| Qwen3-32B | Tight | Q4_K_M | 20.5 GiB–21.4 GiB | 11,482 |
| Qwen2.5-32B-Instruct | Tight | Q4_K_M | 20.6 GiB–21.5 GiB | 11,142 |
| DeepSeek-R1-Distill-Qwen-32B | Tight | Q4_K_M | 20.6 GiB–21.5 GiB | 11,142 |
| Mixtral-8x7B-Instruct-v0.1 | No | Smallest file is 26.5 GiB | n/a | n/a |
| Llama-3.1-Nemotron-70B-Instruct-HF | No | Smallest file is 39.6 GiB | n/a | n/a |
| Qwen2.5-72B-Instruct | No | Smallest file is 41.0 GiB | n/a | n/a |
| Qwen3-Next-80B-A3B-Instruct | No | Smallest file is 45.1 GiB | n/a | n/a |
| GLM-4.5-Air | No | Smallest file is 68.0 GiB | n/a | n/a |
| Qwen3-235B-A22B | No | Smallest file is 132.4 GiB | n/a | n/a |
llama.cpp GGUF files, one sequence, fp16 KV cache, 8,192 tokens. Mixture-of-experts models keep all weights resident, so their file size sets the memory need, not their active parameters. Estimates, not measurements on a Mac.
Where the 21 GiB comes from
Apple does not publish a per-size rule. Its Metal talk gives 21 GB for the GPU on a 32 GB machine and 48 GB on a 64 GB one, which is two thirds and three quarters. This page uses two thirds up to 32 GB and three quarters above that. Some newer 128 GB machines report about 84%, so on those you get more than this page assumes. The limit can be raised with sudo sysctl iogpu.wired_limit_mb=… on recent macOS; raising it leaves less for the system.
The catalog's own Apple records use a different reserve: M2 Max 64GB reserves 10 GiB and M4 Max 128GB reserves 12 GiB, which assumes you have raised the limit. Their numbers will be higher than the 64 and 128 GB rows here.
Data sources
- Apple silicon unified memory and LLM sizing (LLMS-Explorer) — Quotes Apple's Metal Compute talk: 32 GB Mac gives the GPU 21 GB, 64 GB gives 48 GB. Newer 128 GB M4 Max logs show about 84%, so the share is not a constant.
- recommendedMaxWorkingSetSize (Apple Developer Forums) — Discussion of the default GPU working-set limit on Apple silicon.
- Model file sizes and architectures — catalog dataset 2026-10-02.1; GGUF bytes come from the Hugging Face repos listed on each model page