MiniCPM5 2B MLX
MiniCPM5 2B MLX is an Apache-2.0 licensed, text-generation model from OpenBMB, designed as a dense 2B Transformer for on-device, local deployment, and resource-constrained scenarios. According to the model card, it is the second model in the MiniCPM5 series and supports English and Chinese. Its stated focus areas include coding, mathematics, long-context understanding, tool use, and agentic tasks, and it is presented as achieving SOTA performance within a comparison set of similarly sized open-source models while remaining competitive with 4B-class models overall.
At a glance
- Parameters
- 2.52B
- Architecture
- llama
- Context length
- 131,072
- License
- apache-2.0
- Disk space
- 1.3 GB
- Software
- llama.cpp, SGLang, vLLM
Will it run on your machine?
Save your machine to see a personalized rating and its reasoning.
Add my hardwareBest for
- Local text generation
- On-device deployment in resource-constrained scenarios
- Coding tasks
- Mathematics tasks
- Long-context understanding and tool/agentic tasks
Tradeoffs
- The supplied facts do not specify supported languages beyond English and Chinese.
- No numerical hardware requirements are provided.
- No performance benchmarks or testing results are included in the supplied facts.
- No compatibility details beyond the MLX designation and transformers library are provided.
- No license limitations or deployment restrictions are stated beyond the Apache-2.0 identifier.
Ways to run it
llama.cpp · Windows, macOS, Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
llama-server -m MiniCPM5-2B-F16.gguf -a MiniCPM5-2B --port 8080 -ngl 99 -c 8192 --jinjaSGLang · Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
python -m sglang.launch_server --model-path openbmb/MiniCPM5-2B --port 30000vLLM · Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
vllm serve openbmb/MiniCPM5-2B --port 8000Explore its uses
Keep exploring
Bonsai 2 · 27B
A compressed 27B-class reasoning model with publisher-provided GGUF packs and a dedicated llama.cpp fork for CUDA, Metal, and CPU.
DeepSeek V4.1 Flash
A multimodal reasoning model with a compressed key-value cache, published as open weights.
Qwen3.8
Explore 4 versions of Qwen3.8. Compare model sizes, packages, hardware requirements, and available setups.