Can an RTX 4090 run Qwen3-30B-A3B?

Yes Qwen3-30B-A3B at Q4_K_M needs 18.16 GiB–18.93 GiB at 8,192 tokens of context. The RTX 4090 has about 22 GiB usable.

File: Qwen3-30B-A3B-Q4_K_M.gguf (18.6 GB).

These are estimates from the model's config and file sizes, not measurements. How we calculate

How much room is left

Other files on this GPU

QuantFile sizeEngineTotalFit
BF16 safetensors61.1 GBvllm58.2 GiB–60.1 GiBDoes not fit
GGUF Q8_032.5 GBllama.cpp31.1 GiB–32.2 GiBDoes not fit
GGUF Q6_K (Qwen)25.1 GBllama.cpp24.2 GiB–25.1 GiBDoes not fit
GGUF Q5_K_M (Qwen)21.7 GBllama.cpp21.1 GiB–21.9 GiBTight fit
GGUF Q4_K_M This page18.6 GBllama.cpp18.2 GiB–18.9 GiBFits

Same context (8,192 tokens), one chat at a time, each file with its usual engine.

Settings used

Technical identifiers and share data
  • Modelqwen3-30b-a3b
  • Hardwarenvidia-geforce-rtx-4090-24gb-desktop
  • Quantizationgguf-q4_k_m
  • Share fragment for this identityv2.eyJzY2hlbWFWZXJzaW9uIjoyLCJjYWxjdWxhdG9yVmVyc2lvbiI6IjAuMy4wIiwiZGF0YXNldFZlcnNpb24iOiIyMDI2LTEwLTAyLjEiLCJjb25maWciOnsibW9kZWxJZCI6InF3ZW4zLTMwYi1hM2IiLCJoYXJkd2FyZUlkIjoibnZpZGlhLWdlZm9yY2UtcnR4LTQwOTAtMjRnYi1kZXNrdG9wIiwiZGV2aWNlQ291bnQiOjEsInF1YW50aXphdGlvbklkIjoiZ2d1Zi1xNF9rX20iLCJjb250ZXh0VG9rZW5zIjo4MTkyLCJjb25jdXJyZW50U2VxdWVuY2VzIjoxLCJlbmdpbmUiOiJsbGFtYS5jcHAiLCJrdlR5cGUiOiJmcDE2In19
How this number is calculated

Total = weight file + KV cache + runtime buffers. The range spans low to high runtime overhead for the engine shown.

Weights (file)
17.28 GiB (18,556,685,824 bytes)
KV cache
0.75 GiB (805,306,368 bytes)
Runtime buffers
0.13 GiB–0.90 GiB
Total
18.16 GiB–18.93 GiB
Usable memory
22.00 GiB
OS / display reserve
2.00 GiB
Left over
3.07 GiB–3.84 GiB

18.93 GiB high estimate vs 22.00 GiB net

Enough memory does not mean this engine, quant, and OS will run. Support does not mean it will be fast.

  • Requested context is within the recorded native window of 40960 tokens.
  • Full-resident weight estimates use total parameters, including inactive MoE experts.
  • This MoE lists 30532122624 total parameters and 3300000000 active parameters. Active-parameter compute is not used as the weight-residency figure.
  • Weight bytes come from the selected weight files only, not from every file in the repository.
  • Download file size is not peak GPU memory. Runtime layout, allocator padding, and KV are extra.
  • Counted files: Qwen3-30B-A3B-Q4_K_M.gguf.
  • Context budget is the number of cached tokens per sequence (prompt plus reserved generation).
  • Concurrent sequences share one model replica; weights are not multiplied by sequence count.
Open this combo in the calculatorKV cache

Related pages

Sources

Calculator

This combo page keeps the route model and device. Customize to change them on the main calculator; the share then keeps that identity.

Loading catalog snapshot…

Context length

Longer context needs more memory for the KV cache, the model's working memory for the conversation.

More options
Quantization
Runtime

Engine and KV cache type for this estimate.

Workload

Overhead scenario and the prefill workspace.

Topology

How the model is split across devices. Memory is not added together.

Replica count is an advanced deployment option. Quantity is nodes or GPUs, not replicas.

Budget

System reserve and safety margin. An empty number keeps the previous value.

GiB (2^30 bytes)

%

Custom model

Import a config or type the architecture. Nothing is scanned until you import.

Parsed in the browser. The file is not uploaded.

Only huggingface.co, config.json, no token. Private repos are rejected.

Pick a model to see how much memory it needs.