DeepSeek V4 Flash
DeepSeek V4 Flash is a preview Mixture-of-Experts language model in the DeepSeek V4 series. It has 284B parameters with 13B activated and supports a context length of one million tokens. The model uses a hybrid attention architecture (Compressed Sparse Attention and Heavily Compressed Attention), Manifold-Constrained Hyper-Connections, and the Muon optimizer. It was pre-trained on over 32T tokens and post-trained with a two-stage paradigm. Its repository is deepseek-ai/DeepSeek-V4-Flash, it is licensed under MIT, and its pipeline is text-generation.
At a glance
- Parameters
- 290.94B
- Architecture
- deepseek_v4
- Context length
- 1,048,576
- License
- mit
- Disk space
- 148.7 GB
- Software
- Publisher PyTorch reference
Will it run on your machine?
Save your machine to see a personalized rating and its reasoning.
Add my hardwareBest for
- Long-context text generation and understanding up to one million tokens.
- Coding tasks.
- Reasoning tasks.
- Agentic tasks.
- Text generation via a text-generation pipeline.
Tradeoffs
- Preview version, not a final release.
- Smaller parameter scale than DeepSeek-V4-Pro, which may affect some capabilities.
- Detailed performance and compatibility requirements are not specified in the provided facts.
- No hardware requirements or tested configurations are provided.
- No information is provided about fine-tuning, quantization, or deployment constraints.
Ways to run it
Publisher PyTorch reference · Linux / rented GPU
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
torchrun --nproc-per-node ${MP} generate.py --ckpt-path ${SAVE_PATH} --config ${CONFIG} --interactiveExplore its uses
Keep exploring
Bonsai 2 · 27B
A compressed 27B-class reasoning model with publisher-provided GGUF packs and a dedicated llama.cpp fork for CUDA, Metal, and CPU.
DeepSeek V4.1 Flash
A multimodal reasoning model with a compressed key-value cache, published as open weights.
Qwen3.8
Explore 4 versions of Qwen3.8. Compare model sizes, packages, hardware requirements, and available setups.