LFM2.5 1.2B Instruct DSpark
LFM2.5 1.2B Instruct DSpark is a speculative-decoding draft model for LiquidAI/LFM2.5-1.2B-Instruct, using the DSpark method adapted to the LFM2.5 architecture. It has 295.7M draft parameters in BF16, a 5-layer full-attention backbone, a Markov head (rank 256), and a confidence head, with a block size of 9 and vocabulary of 65,536. The model is intended to accelerate text generation with the target LFM2.5-1.2B-Instruct model in SGLang and is also described as running on Apple silicon via the Metal backend. The official model card reports measured speedups and acceptance rates on H100 and M4 Max hardware.
At a glance
- Parameters
- 0.30B
- Architecture
- qwen3
- Context length
- 128,000
- License
- lfm1.0
- Disk space
- 0.6 GB
- Software
- SGLang
Will it run on your machine?
Save your machine to see a personalized rating and its reasoning.
Add my hardwareBest for
- Accelerating text generation with LiquidAI/LFM2.5-1.2B-Instruct using speculative decoding in SGLang.
- On-device inference on Apple silicon via the Metal backend as a draft model for the target LFM2.5-1.2B-Instruct model.
- MATH-500 and GSM8K style mathematical reasoning tasks when used with the compatible target model, based on reported acceptance benchmarks.
- HumanEval and MBPP style code generation tasks when used with the compatible target model, based on reported acceptance benchmarks.
- MT-Bench style multi-turn conversation when used with the compatible target model, based on reported acceptance benchmarks.
Tradeoffs
- Must be used with the specific target model LiquidAI/LFM2.5-1.2B-Instruct; it is a draft model and not a standalone generation model.
- Requires a build of SGLang with DSpark support; compatibility with other inference frameworks is not stated.
- The DSpark family includes separate drafters for different target models; this model is not interchangeable with other targets.
- License is lfm1.0 (other), and no additional permissions or restrictions beyond the license file are specified in the provided facts.
- The provided facts do not include quality benchmarks for the draft model itself; generated text is verified by the target model, so performance depends on the target.
Ways to run it
SGLang · Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
python -m sglang.launch_server --model-path LiquidAI/LFM2.5-1.2B-Instruct --speculative-algorithm DSPARK --speculative-draft-model-path LiquidAI/LFM2.5-1.2B-Instruct-DSpark --speculative-draft-attention-backend flashinfer --disable-radix-cache --mem-fraction-static 0.75 --port 30000Explore its uses
Keep exploring
Bonsai 2 · 27B
A compressed 27B-class reasoning model with publisher-provided GGUF packs and a dedicated llama.cpp fork for CUDA, Metal, and CPU.
DeepSeek V4.1 Flash
An open-weight model for reasoning, coding, agents, and image understanding. DeepSeek V4.1 Flash combines a 552B backbone with sparse activation and up to one million tokens of context. Choose the original checkpoint or a community uncensored variant below.
Qwen3.8
Explore 4 versions of Qwen3.8. Compare model sizes, packages, hardware requirements, and available setups.