MiniCPM5 2B Base
MiniCPM5 2B Base is a dense 2B Transformer text-generation model from the MiniCPM5 series, released under the Apache-2.0 license by openbmb. It is positioned for on-device, local deployment, and resource-constrained scenarios, and its model card describes it as reaching 2B-class open-source SOTA within its stated comparison set. The model supports English and Chinese, uses the transformers library, and is associated with long-context, tool-calling, on-device, and edge-ai tags. It was trained on datasets including Ultra-FineWeb, UltraX-Preview, UltraData-Math, UltraData-Code, and several UltraData SFT/RL datasets.
At a glance
- Parameters
- 2.52B
- Architecture
- llama
- Context length
- 524,288
- License
- apache-2.0
- Disk space
- 4.7 GB
- Software
- llama.cpp, SGLang, vLLM
Will it run on your machine?
Save your machine to see a personalized rating and its reasoning.
Add my hardwareBest for
- On-device text generation
- Local deployment in resource-constrained environments
- English and Chinese language tasks
- Long-context understanding tasks
- Tool-calling and agentic tasks
Tradeoffs
- The supplied facts do not specify detailed context length limits.
- No specific hardware requirements are provided.
- No information is given about supported inference frameworks beyond the transformers library.
- Performance outside the stated comparison set is not described.
- No testing or benchmark results are provided beyond the claimed 2B-class open-source SOTA statement.
Ways to run it
llama.cpp · Windows, macOS, Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
llama-server -m MiniCPM5-2B-F16.gguf -a MiniCPM5-2B --port 8080 -ngl 99 -c 8192 --jinjaSGLang · Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
python -m sglang.launch_server --model-path openbmb/MiniCPM5-2B --port 30000vLLM · Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
vllm serve openbmb/MiniCPM5-2B --port 8000Explore its uses
Keep exploring
Bonsai 2 · 27B
A compressed 27B-class reasoning model with publisher-provided GGUF packs and a dedicated llama.cpp fork for CUDA, Metal, and CPU.
DeepSeek V4.1 Flash
A multimodal reasoning model with a compressed key-value cache, published as open weights.
Qwen3.8
Explore 4 versions of Qwen3.8. Compare model sizes, packages, hardware requirements, and available setups.