MiniCPM5 1B Base
MiniCPM5 1B Base is the pre-training-only base checkpoint in the MiniCPM5 series, released under the apache-2.0 license. It is a dense causal language model using a standard LlamaForCausalLM architecture, with 1,080,632,832 total parameters and 679,552,512 non-embedding parameters. It has 24 layers, GQA with 16 query heads and 2 KV heads, and a context length of 131,072. The model targets English and Chinese, supports text-generation, and is associated with long-context, tool-calling, on-device, and edge-ai tags. Pretraining data includes openbmb/Ultra-FineWeb, Ultra-FineWeb-L3, UltraData-Math, and UltraData-SFT-2605. The official model card also notes a built-in think chat template switchable via enable_thinking for the released MiniCPM5-1B model, but this base checkpoint is pre-training only.
At a glance
- Parameters
- 1.08B
- Architecture
- llama
- Context length
- 131,072
- License
- apache-2.0
- Disk space
- 2 GB
- Software
- llama.cpp, SGLang, vLLM
Will it run on your machine?
Save your machine to see a personalized rating and its reasoning.
Add my hardwareBest for
- Base model for further fine-tuning or post-training
- English and Chinese text generation
- Long-context language modeling up to 131,072 tokens
- Research on compact causal language models
- On-device or edge-oriented local LLM experimentation
Tradeoffs
- It is a base checkpoint, not post-trained for chat or instruction following
- No performance, compatibility, or hardware requirements are specified in the source facts
- Only English and Chinese are listed as languages
- It is a text-generation model only; no multimodal capabilities are stated
- The model card describes features for MiniCPM5-1B, but this specific Base checkpoint is pre-training only
Ways to run it
llama.cpp · Windows, macOS, Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
llama-server -m MiniCPM5-2B-F16.gguf -a MiniCPM5-2B --port 8080 -ngl 99 -c 8192 --jinjaSGLang · Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
python -m sglang.launch_server --model-path openbmb/MiniCPM5-2B --port 30000vLLM · Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
vllm serve openbmb/MiniCPM5-2B --port 8000Explore its uses
Keep exploring
Bonsai 2 · 27B
A compressed 27B-class reasoning model with publisher-provided GGUF packs and a dedicated llama.cpp fork for CUDA, Metal, and CPU.
DeepSeek V4.1 Flash
A multimodal reasoning model with a compressed key-value cache, published as open weights.
Qwen3.8
Explore 4 versions of Qwen3.8. Compare model sizes, packages, hardware requirements, and available setups.