MiniMax-M2 VRAM & Memory Requirements
Specific checkpoints with sourced architecture and weight files. GGUF Q4_K_M (Unsloth): 130.90 GiB–133.99 GiB at 8,192 tokens, 1 sequence, FP16 KV, llama.cpp.
Publisher and provenance
- PublisherMiniMax
- Hugging Face
MiniMaxAI/MiniMax-M2 - Revision
757303d492a50514c312788b5247a4f696a4c6a3 - Total parameters228,689,764,864
- Active parametersUnknown / not independently sourced
- Layers62
- Query heads48
- KV heads8 (gqa)
- Head dimension128
- Recorded context capability196,608
- Completenesscomplete · full
Active parameters describe tokens' routed compute, not the full resident model weight footprint. Full-resident weight estimates use total parameters.
Memory layers in this estimate
Artifact bytes, raw KV, engine extras, and total demand are separate. This is not a runtime trace.
- Weight artifact
- 128.84 GiB (138,342,385,120 bytes)
- Raw KV cache
- 1.94 GiB (2,080,374,784 bytes)
- Engine extras / workspace
- 0.13 GiB–3.21 GiB
- Total estimated demand
- 130.90 GiB–133.99 GiB
Published artifacts
| Quantization | Selected files | Bytes | Engine | Evidence |
|---|---|---|---|---|
| FP8 safetensors fp8 | 480,836,588,544 (447.81 GiB / 480.84 GB) | vllm, sglang, unspecified | file-metadata | |
| GGUF Q4_K_M (Unsloth) gguf-q4_k_m | Q4_K_M/MiniMax-M2-Q4_K_M-00001-of-00003.gguf, Q4_K_M/MiniMax-M2-Q4_K_M-00002-of-00003.gguf, Q4_K_M/MiniMax-M2-Q4_K_M-00003-of-00003.gguf | 138,342,385,120 (128.84 GiB / 138.34 GB) | llama.cpp, ollama, unspecified | file-metadata |
| GGUF Q5_K_M (Unsloth) gguf-q5_k_m | Q5_K_M/MiniMax-M2-Q5_K_M-00001-of-00004.gguf, Q5_K_M/MiniMax-M2-Q5_K_M-00002-of-00004.gguf, Q5_K_M/MiniMax-M2-Q5_K_M-00003-of-00004.gguf, Q5_K_M/MiniMax-M2-Q5_K_M-00004-of-00004.gguf | 162,303,936,128 (151.16 GiB / 162.30 GB) | llama.cpp, ollama, unspecified | file-metadata |
| GGUF Q6_K (Unsloth) gguf-q6_k | Q6_K/MiniMax-M2-Q6_K-00001-of-00004.gguf, Q6_K/MiniMax-M2-Q6_K-00002-of-00004.gguf, Q6_K/MiniMax-M2-Q6_K-00003-of-00004.gguf, Q6_K/MiniMax-M2-Q6_K-00004-of-00004.gguf | 187,763,083,904 (174.87 GiB / 187.76 GB) | llama.cpp, ollama, unspecified | file-metadata |
| GGUF Q8_0 (Unsloth) gguf-q8_0 | 243,136,873,184 (226.44 GiB / 243.14 GB) | llama.cpp, ollama, unspecified | file-metadata | |
| INT4 theoretical | No published file | 114,344,882,432 (theoretical) | — | theoretical |
Memory by quantization and context
Concurrent sequences = 1. KV defaults to FP16. The range includes documented runtime extras for the listed engine. These figures use the same core as the interactive calculator.
| Quantization | 2,048 tokens | 8,192 tokens | 32,768 tokens |
|---|---|---|---|
| FP8 safetensors | 448.92 GiB–450.81 GiB | 450.38 GiB–452.31 GiB | 456.19 GiB–458.30 GiB |
| GGUF Q4_K_M (Unsloth) | 129.45 GiB–132.41 GiB | 130.90 GiB–133.99 GiB | 136.72 GiB–140.21 GiB |
| GGUF Q5_K_M (Unsloth) | 151.77 GiB–155.17 GiB | 153.22 GiB–156.75 GiB | 159.03 GiB–162.97 GiB |
| GGUF Q6_K (Unsloth) | 175.48 GiB–179.36 GiB | 176.93 GiB–180.94 GiB | 182.74 GiB–187.16 GiB |
| GGUF Q8_0 (Unsloth) | 227.05 GiB–231.96 GiB | 228.50 GiB–233.54 GiB | 234.31 GiB–239.76 GiB |
| INT4 theoretical Theoretical rows are not downloadable artifacts. | 107.10 GiB–138.30 GiB | 108.55 GiB–140.12 GiB | 114.37 GiB–147.27 GiB |
Raw KV contribution
Standard GQA/MHA raw KV is 2 × layers × kvHeads × headDim × tokens × sequences × bytes per element. This page uses KV heads (8), not query heads (48). Using query heads would overstate this cache by 6×.
- 8,192 tokens, 1 sequence, FP16: 2,080,374,784 bytes (1.9375 GiB)
- 32,768 tokens: 8,321,499,136 bytes (7.7500 GiB)
Related pages
Sources
- MiniMax-M2 model card
- config.json — revision 757303d492a50514c312788b5247a4f696a4c6a3
- safetensors index — metadata.total_size=480836588544
- Artifact repo unsloth/MiniMax-M2-GGUF
Assumptions that affect this result
- Requested context is within the recorded native window of 196608 tokens.
- Full-resident weight estimates use total parameters, including inactive MoE experts.
- Activated parameter count is unknown / not independently sourced. Active parameters describe routed compute, not the full resident model weight footprint.
- Weight bytes come from the selected weight files only, not from every file in the repository.
- Download file size is not peak GPU memory. Runtime layout, allocator padding, and KV are extra.
- Counted files: Q4_K_M/MiniMax-M2-Q4_K_M-00001-of-00003.gguf, Q4_K_M/MiniMax-M2-Q4_K_M-00002-of-00003.gguf, Q4_K_M/MiniMax-M2-Q4_K_M-00003-of-00003.gguf.
- Multi-token prediction / draft weights exist and are not included unless enabled.
- Context budget is the number of cached tokens per sequence (prompt plus reserved generation).
Calculator
Loading catalog snapshot…
Search or pick a catalog checkpoint to see memory demand.