GLM-4.5-Air on Apple M4 Max: Fits (Sep 2026)
Conditional memory judgement for one configuration. Change context, quant, or engine and the conclusion can change. Configuration used on this page: GGUF Q6_K (Unsloth), 8,192 cached tokens, 1 sequence, engine llama.cpp. Status: Likely fits. Software: Not verified..
Verdict on Apple M4 Max 128GB unified (MacBook Pro)
Yes, run Q6_K. The calculator puts it at 93.8 GiB–96.1 GiB at 8,192 tokens, inside 116.0 GiB of usable unified memory (after the OS reserve). Q8_0 is the next step up and does not clear the bar (111.0 GiB–113.6 GiB).
With Q6_K, the longest context that still counts as a fit is about 52,449 tokens of a 131,072-token native window, one sequence, fp16 KV cache.
| GGUF quant | File weights | KV cache | Estimated total | Verdict |
|---|---|---|---|---|
| Q8_0 | 109.4 GiB | 1.4 GiB | 111.0 GiB–113.6 GiB | Tight |
| Q6_K (recommended) | 92.2 GiB | 1.4 GiB | 93.8 GiB–96.1 GiB | Fits |
| Q5_K_M | 77.8 GiB | 1.4 GiB | 79.3 GiB–81.4 GiB | Fits |
| Q4_K_M | 68.0 GiB | 1.4 GiB | 69.5 GiB–71.4 GiB | Comfortable |
Engine llama.cpp, one sequence, fp16 KV. File weights are the published GGUF sizes in the catalog. Totals come from the same calculator that powers the tool below; they are estimates, not a measurement of this setup.
Fixed page configuration
GGUF Q6_K needs 93.8 GiB-96.1 GiB at 8,192 tokens against 116.00 GiB net on Apple M4 Max 128GB unified (MacBook Pro). Q8_0 is tight or over budget.
- ModelGLM-4.5-Air
- HardwareApple M4 Max 128GB unified (MacBook Pro)
- QuantizationGGUF Q6_K (Unsloth)
- Context length (cached tokens)8,192
- Engine
llama.cpp - Concurrent sequences1
- KV cache typefp16
Technical identifiers and share data
- Model
glm-4.5-air - Hardware
apple-m4-max-128gb-unified - Quantization
gguf-q6_k - Share fragment for this identity
v2.eyJzY2hlbWFWZXJzaW9uIjoyLCJjYWxjdWxhdG9yVmVyc2lvbiI6IjAuMy4wIiwiZGF0YXNldFZlcnNpb24iOiIyMDI2LTEwLTAyLjEiLCJjb25maWciOnsibW9kZWxJZCI6ImdsbS00LjUtYWlyIiwiaGFyZHdhcmVJZCI6ImFwcGxlLW00LW1heC0xMjhnYi11bmlmaWVkIiwiZGV2aWNlQ291bnQiOjEsInF1YW50aXphdGlvbklkIjoiZ2d1Zi1xNl9rIiwiY29udGV4dFRva2VucyI6ODE5MiwiY29uY3VycmVudFNlcXVlbmNlcyI6MSwiZW5naW5lIjoibGxhbWEuY3BwIiwia3ZUeXBlIjoiZnAxNiJ9fQ
Memory breakdown
- Weight artifact
- 92.21 GiB (99,007,528,192 bytes)
- Raw KV cache
- 1.44 GiB (1,543,503,872 bytes)
- Engine extras / workspace
- 0.13 GiB–2.44 GiB
- Total estimated demand
- 93.77 GiB–96.09 GiB
- Net calculator budget
- 116.00 GiB
- OS / display reserve
- 12.00 GiB
- Remaining vs net budget
- 19.91 GiB–22.23 GiB
96.09 GiB high estimate vs 116.00 GiB net
Enough memory does not mean this engine, quant, and OS will run. Support does not mean it will be fast.
Other published files on this device
Same model, device and context (8,192 tokens, 1 sequence, FP16 KV). Each row is one published weight-file set with its usual engine, sorted by memory.
| Quantization | Engine | Estimated memory | Fit |
|---|---|---|---|
| GGUF Q8_0 (Unsloth) | llama.cpp | 110.95 GiB–113.62 GiB | Tight fit |
| BF16 safetensors | vllm | 104.94 GiB–106.86 GiB | Tight fit |
| GGUF Q6_K (Unsloth) This page | llama.cpp | 93.77 GiB–96.09 GiB | Fits |
| GGUF Q5_K_M (Unsloth) | llama.cpp | 79.35 GiB–81.38 GiB | Fits |
| GGUF Q4_K_M (Unsloth) | llama.cpp | 69.53 GiB–71.36 GiB | Runs comfortably |
Assumptions that affect this result
- Requested context is within the recorded native window of 131072 tokens.
- Full-resident weight estimates use total parameters, including inactive MoE experts.
- Activated parameter count is unknown / not independently sourced. Active parameters describe routed compute, not the full resident model weight footprint.
- Weight bytes come from the selected weight files only, not from every file in the repository.
- Download file size is not peak GPU memory. Runtime layout, allocator padding, and KV are extra.
- Counted files: Q6_K/GLM-4.5-Air-Q6_K-00001-of-00002.gguf, Q6_K/GLM-4.5-Air-Q6_K-00002-of-00002.gguf.
- Multi-token prediction / draft weights exist and are not included unless enabled.
- Context budget is the number of cached tokens per sequence (prompt plus reserved generation).
Related pages
Sources
- GLM-4.5-Air model card
- config.json — revision a24ceef6ce4f3536971efe9b778bdaa1bab18daa
- safetensors index — metadata.total_size=110468824832
- Artifact repo unsloth/GLM-4.5-Air-GGUF
- MacBook Pro (14-inch, M4 Pro or M4 Max, 2024) tech specs — M4 Max with 16-core CPU configurable to 128GB unified memory.
Calculator
This combo page keeps the route model and device. Customize to change them on the main calculator; the share then keeps that identity.
Loading catalog snapshot…
Search or pick a catalog checkpoint to see memory demand.