Qwen3.8-Flash-Next: VRAM necessária 131,53 GiB

VRAM necessária 111,75 GiB–131,53 GiB. Qwen3.8-Flash-Next Q4_K_M em 8.192 tokens. Sem GPU, isto é demanda para rodar um LLM local, não se cabe. Estimativa grosseira Arquivo BF16: 359.999.963.128 bytes.

O checkpoint Qwen/Qwen3.8-Flash-Next traz neste catálogo BF16 safetensors de 359.999.963.128 bytes (335,28 GiB / 360,00 GB). Esse tamanho de download não é o pico de VRAM, e os números abaixo são estimativas.

Checkpoints específicos, com arquitetura e arquivos de peso rastreáveis. GGUF Q4_K_M (bartowski): 111,75 GiB–131,53 GiB em 8.192 tokens, 1 sequência, KV FP16, llama.cpp.

Este resultado é uma estimativa, não um rastreio medido.Não verificadoPesos com arquivo

Roda em

Publicador e procedência

A contagem de parâmetros ativos é desconhecida ou não tem fonte independente. Parâmetros ativos descrevem o compute roteado, não a pegada residente completa.

Camadas de memória desta estimativa

Bytes do arquivo, KV bruto, extras do engine e demanda total ficam separados. Isto não é um rastreio de execução.

Weight artifact
111,39 GiB (119.599.030.080 bytes)
Raw KV cache
0,19 GiB (201.326.592 bytes)
Engine extras / workspace
0,18 GiB–19,95 GiB
Total estimated demand
111,75 GiB–131,53 GiB

Arquivos contados

QuantizaçãoArquivos contadosBytesMotor de execuçãoEvidência
BF16 safetensors
bf16
131 shards safetensors
Total de bytes selecionados: 359.999.963.128 (335,28 GiB / 360,00 GB)
Primeiro shard: model-00001-of-00131.safetensors
Último shard: model-00131-of-00131.safetensors
Ver todos os 131 arquivos de shard
  • model-00001-of-00131.safetensors
  • model-00002-of-00131.safetensors
  • model-00003-of-00131.safetensors
  • model-00004-of-00131.safetensors
  • model-00005-of-00131.safetensors
  • model-00006-of-00131.safetensors
  • model-00007-of-00131.safetensors
  • model-00008-of-00131.safetensors
  • model-00009-of-00131.safetensors
  • model-00010-of-00131.safetensors
  • model-00011-of-00131.safetensors
  • model-00012-of-00131.safetensors
  • model-00013-of-00131.safetensors
  • model-00014-of-00131.safetensors
  • model-00015-of-00131.safetensors
  • model-00016-of-00131.safetensors
  • model-00017-of-00131.safetensors
  • model-00018-of-00131.safetensors
  • model-00019-of-00131.safetensors
  • model-00020-of-00131.safetensors
  • model-00021-of-00131.safetensors
  • model-00022-of-00131.safetensors
  • model-00023-of-00131.safetensors
  • model-00024-of-00131.safetensors
  • model-00025-of-00131.safetensors
  • model-00026-of-00131.safetensors
  • model-00027-of-00131.safetensors
  • model-00028-of-00131.safetensors
  • model-00029-of-00131.safetensors
  • model-00030-of-00131.safetensors
  • model-00031-of-00131.safetensors
  • model-00032-of-00131.safetensors
  • model-00033-of-00131.safetensors
  • model-00034-of-00131.safetensors
  • model-00035-of-00131.safetensors
  • model-00036-of-00131.safetensors
  • model-00037-of-00131.safetensors
  • model-00038-of-00131.safetensors
  • model-00039-of-00131.safetensors
  • model-00040-of-00131.safetensors
  • model-00041-of-00131.safetensors
  • model-00042-of-00131.safetensors
  • model-00043-of-00131.safetensors
  • model-00044-of-00131.safetensors
  • model-00045-of-00131.safetensors
  • model-00046-of-00131.safetensors
  • model-00047-of-00131.safetensors
  • model-00048-of-00131.safetensors
  • model-00049-of-00131.safetensors
  • model-00050-of-00131.safetensors
  • model-00051-of-00131.safetensors
  • model-00052-of-00131.safetensors
  • model-00053-of-00131.safetensors
  • model-00054-of-00131.safetensors
  • model-00055-of-00131.safetensors
  • model-00056-of-00131.safetensors
  • model-00057-of-00131.safetensors
  • model-00058-of-00131.safetensors
  • model-00059-of-00131.safetensors
  • model-00060-of-00131.safetensors
  • model-00061-of-00131.safetensors
  • model-00062-of-00131.safetensors
  • model-00063-of-00131.safetensors
  • model-00064-of-00131.safetensors
  • model-00065-of-00131.safetensors
  • model-00066-of-00131.safetensors
  • model-00067-of-00131.safetensors
  • model-00068-of-00131.safetensors
  • model-00069-of-00131.safetensors
  • model-00070-of-00131.safetensors
  • model-00071-of-00131.safetensors
  • model-00072-of-00131.safetensors
  • model-00073-of-00131.safetensors
  • model-00074-of-00131.safetensors
  • model-00075-of-00131.safetensors
  • model-00076-of-00131.safetensors
  • model-00077-of-00131.safetensors
  • model-00078-of-00131.safetensors
  • model-00079-of-00131.safetensors
  • model-00080-of-00131.safetensors
  • model-00081-of-00131.safetensors
  • model-00082-of-00131.safetensors
  • model-00083-of-00131.safetensors
  • model-00084-of-00131.safetensors
  • model-00085-of-00131.safetensors
  • model-00086-of-00131.safetensors
  • model-00087-of-00131.safetensors
  • model-00088-of-00131.safetensors
  • model-00089-of-00131.safetensors
  • model-00090-of-00131.safetensors
  • model-00091-of-00131.safetensors
  • model-00092-of-00131.safetensors
  • model-00093-of-00131.safetensors
  • model-00094-of-00131.safetensors
  • model-00095-of-00131.safetensors
  • model-00096-of-00131.safetensors
  • model-00097-of-00131.safetensors
  • model-00098-of-00131.safetensors
  • model-00099-of-00131.safetensors
  • model-00100-of-00131.safetensors
  • model-00101-of-00131.safetensors
  • model-00102-of-00131.safetensors
  • model-00103-of-00131.safetensors
  • model-00104-of-00131.safetensors
  • model-00105-of-00131.safetensors
  • model-00106-of-00131.safetensors
  • model-00107-of-00131.safetensors
  • model-00108-of-00131.safetensors
  • model-00109-of-00131.safetensors
  • model-00110-of-00131.safetensors
  • model-00111-of-00131.safetensors
  • model-00112-of-00131.safetensors
  • model-00113-of-00131.safetensors
  • model-00114-of-00131.safetensors
  • model-00115-of-00131.safetensors
  • model-00116-of-00131.safetensors
  • model-00117-of-00131.safetensors
  • model-00118-of-00131.safetensors
  • model-00119-of-00131.safetensors
  • model-00120-of-00131.safetensors
  • model-00121-of-00131.safetensors
  • model-00122-of-00131.safetensors
  • model-00123-of-00131.safetensors
  • model-00124-of-00131.safetensors
  • model-00125-of-00131.safetensors
  • model-00126-of-00131.safetensors
  • model-00127-of-00131.safetensors
  • model-00128-of-00131.safetensors
  • model-00129-of-00131.safetensors
  • model-00130-of-00131.safetensors
  • model-00131-of-00131.safetensors
359.999.963.128 (335,28 GiB / 360,00 GB)vllm, sglang, unspecifiedfile-metadata
GGUF Q8_0 (Unsloth)
gguf-q8_0
6 shards safetensors
Total de bytes selecionados: 188.225.033.248 (175,30 GiB / 188,23 GB)
Primeiro shard: Q8_0/Qwen3.8-Flash-Next-Q8_0-00001-of-00006.gguf
Último shard: Q8_0/Qwen3.8-Flash-Next-Q8_0-00006-of-00006.gguf
Ver todos os 6 arquivos de shard
  • Q8_0/Qwen3.8-Flash-Next-Q8_0-00001-of-00006.gguf
  • Q8_0/Qwen3.8-Flash-Next-Q8_0-00002-of-00006.gguf
  • Q8_0/Qwen3.8-Flash-Next-Q8_0-00003-of-00006.gguf
  • Q8_0/Qwen3.8-Flash-Next-Q8_0-00004-of-00006.gguf
  • Q8_0/Qwen3.8-Flash-Next-Q8_0-00005-of-00006.gguf
  • Q8_0/Qwen3.8-Flash-Next-Q8_0-00006-of-00006.gguf
188.225.033.248 (175,30 GiB / 188,23 GB)llama.cpp, ollama, unspecifiedfile-metadata
GGUF Q4_K_M (bartowski)
gguf-q4_k_m
Qwen3.8-Flash-Next-Q4_K_M/Qwen3.8-Flash-Next-Q4_K_M-00001-of-00004.gguf, Qwen3.8-Flash-Next-Q4_K_M/Qwen3.8-Flash-Next-Q4_K_M-00002-of-00004.gguf, Qwen3.8-Flash-Next-Q4_K_M/Qwen3.8-Flash-Next-Q4_K_M-00003-of-00004.gguf, Qwen3.8-Flash-Next-Q4_K_M/Qwen3.8-Flash-Next-Q4_K_M-00004-of-00004.gguf119.599.030.080 (111,39 GiB / 119,60 GB)llama.cpp, ollama, unspecifiedfile-metadata
GGUF Q5_K_M (bartowski)
gguf-q5_k_m
Qwen3.8-Flash-Next-Q5_K_M/Qwen3.8-Flash-Next-Q5_K_M-00001-of-00004.gguf, Qwen3.8-Flash-Next-Q5_K_M/Qwen3.8-Flash-Next-Q5_K_M-00002-of-00004.gguf, Qwen3.8-Flash-Next-Q5_K_M/Qwen3.8-Flash-Next-Q5_K_M-00003-of-00004.gguf, Qwen3.8-Flash-Next-Q5_K_M/Qwen3.8-Flash-Next-Q5_K_M-00004-of-00004.gguf134.668.639.040 (125,42 GiB / 134,67 GB)llama.cpp, ollama, unspecifiedfile-metadata
GGUF Q6_K (bartowski)
gguf-q6_k
5 shards safetensors
Total de bytes selecionados: 168.113.805.248 (156,57 GiB / 168,11 GB)
Primeiro shard: Qwen3.8-Flash-Next-Q6_K/Qwen3.8-Flash-Next-Q6_K-00001-of-00005.gguf
Último shard: Qwen3.8-Flash-Next-Q6_K/Qwen3.8-Flash-Next-Q6_K-00005-of-00005.gguf
Ver todos os 5 arquivos de shard
  • Qwen3.8-Flash-Next-Q6_K/Qwen3.8-Flash-Next-Q6_K-00001-of-00005.gguf
  • Qwen3.8-Flash-Next-Q6_K/Qwen3.8-Flash-Next-Q6_K-00002-of-00005.gguf
  • Qwen3.8-Flash-Next-Q6_K/Qwen3.8-Flash-Next-Q6_K-00003-of-00005.gguf
  • Qwen3.8-Flash-Next-Q6_K/Qwen3.8-Flash-Next-Q6_K-00004-of-00005.gguf
  • Qwen3.8-Flash-Next-Q6_K/Qwen3.8-Flash-Next-Q6_K-00005-of-00005.gguf
168.113.805.248 (156,57 GiB / 168,11 GB)llama.cpp, ollama, unspecifiedfile-metadata
INT4 theoreticalNenhum arquivo publicado89.999.990.730 (Linhas teóricas não são artefactos descarregáveis.)—theoretical

Memória por quantização e contexto

Sequências concorrentes = 1. O KV padrão é FP16. O intervalo inclui extras de runtime documentados para o engine indicado. Os números usam o mesmo núcleo da calculadora interativa.

Quantização2.048 tokens8.192 tokens32.768 tokens
BF16 safetensors336,00 GiB–388,56 GiB336,14 GiB–388,73 GiB336,70 GiB–389,39 GiB
GGUF Q8_0 (Unsloth)175,52 GiB–206,32 GiB175,66 GiB–206,50 GiB176,23 GiB–207,19 GiB
GGUF Q4_K_M (bartowski)111,61 GiB–131,35 GiB111,75 GiB–131,53 GiB112,31 GiB–132,22 GiB
GGUF Q5_K_M (bartowski)125,64 GiB–147,81 GiB125,79 GiB–147,99 GiB126,35 GiB–148,68 GiB
GGUF Q6_K (bartowski)156,79 GiB–184,35 GiB156,93 GiB–184,53 GiB157,50 GiB–185,22 GiB
INT4 theoretical
Linhas teóricas não são artefactos descarregáveis.
84,04 GiB–108,65 GiB84,18 GiB–108,83 GiB84,75 GiB–109,52 GiB

Cache KV (dados brutos)

Abrir a calculadora com este modelo

Páginas relacionadas

Fontes

Premissas que afetam o resultado

Calculadora

A carregar o snapshot do catálogo…

Escolha primeiro um modelo e depois confira o equipamento.

Quantização

Tipo de dispositivo

Carga

O comprimento de contexto afeta principalmente a memória do KV cache.

Configurações avançadas
Runtime

Engine e tipo de cache KV desta estimativa.

Carga

Cenário de overhead e o espaço de prefill.

Topologia

Como o modelo é dividido entre dispositivos. A memória não é somada.

O número de réplicas é avançado. A quantidade são nós ou GPUs, não réplicas.

Orçamento

Reserva do sistema e margem de segurança. Um número vazio mantém o valor anterior.

GiB (2^30 bytes)

%

Modelo personalizado

Importe uma config ou digite a arquitetura. Nada é varrido até você importar.

O arquivo é lido só no navegador e não é enviado.

Só huggingface.co, só config.json, sem token. Repositório privado é recusado.

Pesquise ou escolha um modelo do catálogo para ver a VRAM necessária e rodar um LLM local.

Pesquise ou escolha um modelo do catálogo para ver a VRAM necessária e rodar um LLM local.