What LLM can my Mac run? Pick your memory size

Unified memory is shared with macOS, and the GPU gets about two thirds of it on 32 GB or less and three quarters above that. The table shows the quant each Mac memory tier can use for six benchmark models at 8,192 tokens.

Unified memoryGPU budgetQwen3-8BQwen3-14BQwen3-30B-A3BQwen3-32BQwen2.5-72B-InstructQwen3-235B-A22BPage
8 GB5 GiBNoNoNoNoNoNo8 GB Mac (2 of 22 models run)
16 GB11 GiBQ6_KQ4_K_M (tight)NoNoNoNo16 GB Mac (8 of 22 models run)
24 GB16 GiBQ8_0Q6_KNoNoNoNo24 GB Mac (11 of 22 models run)
32 GB21 GiBQ8_0Q8_0Q4_K_MQ4_K_M (tight)NoNo32 GB Mac (13 of 22 models run)
48 GB36 GiBQ8_0Q8_0Q8_0Q6_KNoNo48 GB Mac (17 of 22 models run)
64 GB48 GiBQ8_0Q8_0Q8_0Q8_0Q4_K_M (tight)No64 GB Mac (17 of 22 models run)
96 GB72 GiBQ8_0Q8_0Q8_0Q8_0Q6_KNo96 GB Mac (20 of 22 models run)
128 GB96 GiBQ8_0Q8_0Q8_0Q8_0Q8_0No128 GB Mac (21 of 22 models run)

llama.cpp GGUF files from the catalog, one sequence, fp16 KV cache. "No" means even Q4_K_M is over budget. The budget rule and its sources are on each tier page. These are memory estimates; speed depends on the chip's memory bandwidth, which this site does not model.

Related pages