MiniCPM5 2B SFT
MiniCPM5 2B SFT is a dense 2B Transformer text-generation model in the MiniCPM5 series, released by OpenBMB under the apache-2.0 license. According to its official model card, it follows the training recipe of MiniCPM5-1B, supports English and Chinese, and is tagged for long-context, tool-calling, on-device, and edge-AI use. It uses the transformers library and safetensors format, with pipeline tag text-generation. The model card states it targets on-device, local deployment, and resource-constrained scenarios, and describes it as achieving SOTA performance among compared 2B-class open-source models while remaining competitive with 4B-class models in certain evaluated areas. Training data includes Ultra-FineWeb, UltraX-Preview, Ultra-FineWeb-L3, UltraData-Math, UltraData-Code, and several UltraData SFT/RL datasets. No specific context length, parameter count beyond '2B', hardware requirements, or benchmarking details are provided in the source facts.
What do you want to do?
Choose a task. Get the software, files, settings, and steps to run it.
Open a guide for its software, hardware requirements, and setup steps.
At a glance
- Parameters
- 2.52B
- Architecture
- llama
- Context length
- 131,072
- License
- apache-2.0
- Disk space
- 4.7 GB
- Software
- llama.cpp, SGLang, vLLM
Will it run on your machine?
Save your machine to see a personalized rating and its reasoning.
Add my hardwareBest for
- On-device text generation
- Local deployment in resource-constrained settings
- Long-context understanding
- Tool calling and agentic tasks
- Chinese and English text generation
Tradeoffs
- Only supports the English and Chinese languages according to the model card
- No specific context length or token limits are provided in the supplied facts
- No hardware requirements or compatibility details are supplied
- No benchmark numbers or comparison details are provided beyond general claims
- Only compares to models of similar size and 4B-class models as described in the model card; other comparisons are not supported
Ways to run it
llama.cpp · Windows, macOS, Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
llama-server -m MiniCPM5-2B-F16.gguf -a MiniCPM5-2B --port 8080 -ngl 99 -c 8192 --jinjaSGLang · Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
python -m sglang.launch_server --model-path openbmb/MiniCPM5-2B --port 30000vLLM · Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
vllm serve openbmb/MiniCPM5-2B --port 8000Explore its uses
Keep exploring
Bonsai 2 · 27B
A compressed 27B-class reasoning model with publisher-provided GGUF packs and a dedicated llama.cpp fork for CUDA, Metal, and CPU.
DeepSeek V4.1 Flash
A multimodal reasoning model with a compressed key-value cache, published as open weights.
Qwen3.8
Explore 4 versions of Qwen3.8. Compare model sizes, packages, hardware requirements, and available setups.