DeepSeek-V4.1-Flash on RTX 5090: Does not fit, Rough estimate
DeepSeek-V4.1-Flash VRAM lists each catalog quant at 8,192 tokens.
Conditional memory judgement for one configuration. Change context, quant, or engine and the conclusion can change. Configuration used on this page: FP8 safetensors, 4,096 cached tokens, 1 sequence, engine vllm. Status: Insufficient memory. Software: Not verified..
Fixed page configuration
DeepSeek-V4.1-Flash official FP8 weights on one catalog RTX 5090 32 GB card, at the same context as the DGX Spark allowlisted combo. Coverage stays partial: this is not a full fit claim.
- ModelDeepSeek-V4.1-Flash
- HardwareGeForce RTX 5090 32GB (desktop)
- QuantizationFP8 safetensors
- Context length (cached tokens)4,096
- Engine
vllm - Concurrent sequences1
- KV cache typefp16
Technical identifiers and share data
- Model
deepseek-v4.1-flash - Hardware
nvidia-geforce-rtx-5090-32gb-desktop - Quantization
fp8 - Share fragment for this identity
v2.eyJzY2hlbWFWZXJzaW9uIjoyLCJjYWxjdWxhdG9yVmVyc2lvbiI6IjAuMy4wIiwiZGF0YXNldFZlcnNpb24iOiIyMDI2LTEwLTAyLjEiLCJjb25maWciOnsibW9kZWxJZCI6ImRlZXBzZWVrLXY0LjEtZmxhc2giLCJoYXJkd2FyZUlkIjoibnZpZGlhLWdlZm9yY2UtcnR4LTUwOTAtMzJnYi1kZXNrdG9wIiwiZGV2aWNlQ291bnQiOjEsInF1YW50aXphdGlvbklkIjoiZnA4IiwiY29udGV4dFRva2VucyI6NDA5NiwiY29uY3VycmVudFNlcXVlbmNlcyI6MSwiZW5naW5lIjoidmxsbSIsImt2VHlwZSI6ImZwMTYifX0
Memory breakdown
- Weight artifact
- 475.24 GiB (510,286,023,000 bytes)
- Raw KV cache
- 0.31 GiB (335,544,320 bytes)
- Engine extras / workspace
- 0.63 GiB–74.22 GiB
- Total estimated demand
- 476.18 GiB–549.77 GiB
- Net calculator budget
- 30.00 GiB
- OS / display reserve
- 2.00 GiB
- Remaining vs net budget
- -519.77 GiB–-446.18 GiB
549.77 GiB high estimate vs 30.00 GiB net
Enough memory does not mean this engine, quant, and OS will run. Support does not mean it will be fast.
Other published files on this device
Same model, device and context (4,096 tokens, 1 sequence, FP16 KV). Each row is one published weight-file set with its usual engine, sorted by memory.
| Quantization | Engine | Estimated memory | Fit |
|---|---|---|---|
| FP8 safetensors This page | vllm | 476.18 GiB–549.77 GiB | Does not fit · Rough estimate |
Assumptions that affect this result
- Requested context is within the recorded native window of 1048576 tokens.
- Full-resident weight estimates use total parameters, including inactive MoE experts.
- Activated parameter count is unknown / not independently sourced. Active parameters describe routed compute, not the full resident model weight footprint.
- Weight bytes come from the selected weight files only, not from every file in the repository.
- Download file size is not peak GPU memory. Runtime layout, allocator padding, and KV are extra.
- Weight bytes come from 48 published safetensors shards totaling 510286023000 bytes.
- This checkpoint has a vision component. Text-only inference does not include vision encoder or projector bytes.
- Multi-token prediction / draft weights exist and are not included unless enabled.
Related pages
Sources
- DeepSeek-V4.1-Flash model card
- config.json — revision dba1be0a40aa45a94ad051997016db3960a90277
- safetensors index — metadata.total_size=510286023000
- NVIDIA GeForce RTX 5090 product page — Standard Memory Config 32 GB GDDR7
Calculator
This combo page keeps the route model and device. Customize to change them on the main calculator; the share then keeps that identity.
Loading catalog snapshot…
Search or pick a catalog checkpoint to see memory demand.