granite embedding 97m multilingual r2
Granite-Embedding-97M-Multilingual-R2 is a 97M parameter dense embedding model from the Granite Embeddings collection, designed for multilingual text embeddings. It uses a ModernBERT-based bi-encoder architecture, produces 384-dimensional vectors, and supports context lengths up to 32,768 tokens. The model is released under the Apache-2.0 license and supports 200+ languages, with enhanced support for 52 languages and programming code. It is available with ONNX and OpenVINO formats and is compatible with sentence-transformers, vLLM, and llama.cpp (GGUF).
At a glance
- Parameters
- 0.10B
- Architecture
- modernbert
- Context length
- 32,768
- License
- apache-2.0
- Disk space
- 0.2 GB
- Software
- vLLM
Will it run on your machine?
Save your machine to see a personalized rating and its reasoning.
Add my hardwareBest for
- Multilingual text embedding generation
- Semantic search and information retrieval across languages
- Code retrieval involving languages such as Python, Go, Java, JavaScript, PHP, Ruby, SQL, C, and C++
- Long-document retrieval and multi-passage search
- Conversational multi-turn and reasoning retrieval tasks
Tradeoffs
- No specific hardware requirements or performance benchmarks are stated in the supplied facts.
- The model's compatibility is limited to the explicitly mentioned frameworks: sentence-transformers, vLLM, and llama.cpp (GGUF).
- No information is provided about fine-tuning or custom training capabilities.
- The model is not claimed to be tested by the summarizer, and no testing results are included.
- The model produces 384-dimensional vectors, which may be insufficient for tasks requiring higher-dimensional embeddings.
Ways to run it
vLLM · Linux
Repository-specific command in publisher documentation; confirm dependencies and hardware in the source.
vllm serve ibm-granite/granite-embedding-97m-multilingual-r2 --task embedExplore its uses
Keep exploring
Bonsai 2 · 27B
A compressed 27B-class reasoning model with publisher-provided GGUF packs and a dedicated llama.cpp fork for CUDA, Metal, and CPU.
DeepSeek V4.1 Flash
A multimodal reasoning model with a compressed key-value cache, published as open weights.
Qwen3.8
Explore 4 versions of Qwen3.8. Compare model sizes, packages, hardware requirements, and available setups.