Mellum2.1 Thinking
A 12B-total, 2.5B-active open-weight thinking model for coding and tool use. Start with JetBrains’ official GGUF on a suitable desktop, or serve the BF16 checkpoint with vLLM on a larger GPU.
What do you want to do?
Choose a task. Get the software, files, settings, and steps to run it.
Open a guide for its software, hardware requirements, and setup steps.
At a glance
- Parameters
- 12B total · 2.5B active
- Architecture
- Mixture of experts
- Context length
- 131,072 architectural; usable context depends on memory
- License
- Apache 2.0
- Software
- Ollama, llama.cpp, VS Code + Cline, vLLM
Will it run on your machine?
Save your machine to see a personalized rating and its reasoning.
Add my hardwareBest for
- Private coding assistance in an editor with a self-hosted endpoint.
- Repository tasks that use tools and inspect file changes.
Tradeoffs
- The Q4 file needs additional runtime and context memory; validate Cline tool use on your exact package.
- The BF16 checkpoint needs substantially more GPU memory than its 2.5B active parameter count suggests.
Ways to run it
Ollama or llama.cpp · official Q4_K_M GGUF · Windows, macOS, or Linux; confirm tool support and context on your exact machine
JetBrains publishes an 8.1 GB Q4_K_M package. The file size alone is not a complete memory or coding-agent guarantee.
ollama run hf.co/JetBrains/Mellum2.1-12B-A2.5B-Thinking-GGUF:Q4_K_MvLLM · BF16 · Linux GPU server; Windows and macOS can connect as clients
Full-precision server route; account for roughly 24 GB weights plus KV cache and runtime memory.
vllm serve JetBrains/Mellum2.1-12B-A2.5B-Thinking --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser hermesExplore its uses
Sources and files
Primary sources and files behind this model page.
Keep exploring
Qwen2.5 Coder · 7B
Code generation, repair, and reasoning in a compact open-weight coding model.
Mistral Small 4 · 119B
Mistral Small 4 119B A6B is an Apache-2.0 licensed hybrid model from mistralai that combines general instruction, reasoning, and Devstral-style capabilities in one model. It uses a Mixture-of-Experts architecture with 119B total parameters, 6.5B activated per token, 128 experts with 4 active, and a 256k context length. It supports multimodal input (text and image) with text output, multilingual support across dozens of languages, system prompts, function calling, JSON output, and configurable reasoning effort. The model card also mentions optional efficiency resources: an eagle head for speculative decoding and an NVFP4 checkpoint. It is tagged for vLLM and offered in safetensors format.
Qwen3-Coder-Next · 80B A3B
Qwen3-Coder-Next is an open-weight text-generation model from Qwen/Qwen3-Coder-Next, licensed under apache-2.0. It is designed specifically for coding agents and local development. The model has 80B total parameters with 3B activated parameters, a 262,144-token native context length, and a hybrid architecture combining Gated DeltaNet, Gated Attention, and Mixture-of-Experts layers. It supports only non-thinking mode and does not generate thinking blocks.