What LLM can a Mac with 64 GB unified memory run?

64 GB of unified memory is not 64 GB of VRAM. macOS lets the GPU wire about 75% by default, so this page budgets 48.0 GiB for weights, KV cache and runtime. The largest model in our list that fits is Mixtral-8x7B-Instruct-v0.1 at Q6_K (36.9 GiB–38.0 GiB at 8,192 tokens). 17 of 22 models run, 3 are tight, 2 do not fit.

Model by model on 64 GB

Recommended GGUF quant per model on a 64 GB Mac at 8,192 tokens
ModelResultQuant to useEstimated totalMax context
Phi-4-mini-instructRunsQ8_04.9 GiB–5.5 GiB131,072
Qwen3-4BRunsQ8_05.2 GiB–5.8 GiB40,960
Mistral-7B-Instruct-v0.3RunsQ8_08.3 GiB–8.9 GiB32,768
Qwen2.5-7B-InstructRunsQ8_08.1 GiB–8.7 GiB32,768
DeepSeek-R1-Distill-Llama-8BRunsQ8_09.1 GiB–9.7 GiB131,072
Qwen3-8BRunsQ8_09.4 GiB–10.0 GiB40,960
GLM-4-9B-0414RunsQ8_09.8 GiB–10.3 GiB32,768
Mistral-Nemo-Instruct-2407RunsQ8_013.5 GiB–14.2 GiB131,072
phi-4RunsQ8_016.2 GiB–17.0 GiB16,384
Qwen3-14BRunsQ8_016.0 GiB–16.8 GiB40,960
Qwen2.5-14B-InstructRunsQ8_016.2 GiB–17.0 GiB32,768
Mistral-Small-24B-Instruct-2501RunsQ8_024.7 GiB–25.6 GiB32,768
Qwen3-30B-A3BRunsQ8_031.1 GiB–32.2 GiB40,960
Qwen3-32BRunsQ8_034.6 GiB–35.7 GiB36,844
Qwen2.5-32B-InstructRunsQ8_034.6 GiB–35.7 GiB32,768
DeepSeek-R1-Distill-Qwen-32BRunsQ8_034.6 GiB–35.7 GiB36,833
Mixtral-8x7B-Instruct-v0.1RunsQ6_K36.9 GiB–38.0 GiB32,768
Llama-3.1-Nemotron-70B-Instruct-HFTightQ4_K_M42.2 GiB–43.6 GiB27,114
Qwen2.5-72B-InstructTightQ4_K_M43.6 GiB–45.0 GiB22,567
Qwen3-Next-80B-A3B-InstructTightQ4_K_M46.0 GiB–47.3 GiB30,460
GLM-4.5-AirNoSmallest file is 68.0 GiBn/an/a
Qwen3-235B-A22BNoSmallest file is 132.4 GiBn/an/a

llama.cpp GGUF files, one sequence, fp16 KV cache, 8,192 tokens. Mixture-of-experts models keep all weights resident, so their file size sets the memory need, not their active parameters. Estimates, not measurements on a Mac.

Where the 48 GiB comes from

Apple does not publish a per-size rule. Its Metal talk gives 21 GB for the GPU on a 32 GB machine and 48 GB on a 64 GB one, which is two thirds and three quarters. This page uses two thirds up to 32 GB and three quarters above that. Some newer 128 GB machines report about 84%, so on those you get more than this page assumes. The limit can be raised with sudo sysctl iogpu.wired_limit_mb=… on recent macOS; raising it leaves less for the system.

The catalog's own Apple records use a different reserve: M2 Max 64GB reserves 10 GiB and M4 Max 128GB reserves 12 GiB, which assumes you have raised the limit. Their numbers will be higher than the 64 GB rows here.

Data sources

Related pages