Choose what you want to do.
Pick a task to see a recommendation and every relevant model already in the catalog.
Where will you run it?
Your task stays the same. The best model and exact package may change with your hardware.
Recommendations use task relevance and source evidence. Save a machine to see fit ratings. Save my machine
Private AI agents, from start to result.
Recommendations draw from the published catalog and editor-approved shortlist. Open the exact workflow for commands and files.
THE EXACT PACKAGE, SOFTWARE AND FIRST TEST LIVE IN THE GUIDE
Why this is hereAn editor-approved pick with a published task-specific workflow.
Check the exact package
The guide lists the supported files, software, and hardware for this model.
Compare setup optionsVerify a real result
Hermes connects to the local OpenAI-compatible endpoint, the model returns a tool call, the client sends the tool result back, and the final answer reflects that result. Check the llama-server log for the tool-call exchange.
Open the first-run checkAll models for private ai agents.
61 of 61 published models match these filters for this task. New catalog entries appear here automatically; featured picks require editorial approval.
These filters apply to the list below. Models missing the required source data are excluded when a filter is active.
Kolibri 1 · BF16
An open-weight English/German reasoning and tool-calling model with a publisher-maintained vLLM plugin and multi-GPU serving instructions.
GLM-5.3
Z.ai’s open-weight ~744B-total / ~40B-active reasoning model for long-running agents and coding. Its native FP8 checkpoint has a documented 8×H200 Linux vLLM path; a rented multi-GPU Pod is the practical alternative to owning that server.
GLM-5.3 Flash
Z.ai’s open-weight 321B-total / 18B-active multimodal agent model. Self-host the native FP8 checkpoint on a documented multi-GPU Linux server or rented GPU Pod; use Strix for an authorized repository review.
Bonsai 2 · 27B
A compressed 27B-class reasoning model with publisher-provided GGUF packs and a dedicated llama.cpp fork for CUDA, Metal, and CPU.
Qwen3.8-27B
A dense vision-language model for coding, reasoning, and agent tasks, with image and video understanding.
RavenX CyberAgent · 35B-A3B
A security-focused, open-weight 35B mixture-of-experts model (about 3B active parameters) distributed as GGUF. Run it locally with llama.cpp on Windows, macOS, or Linux, or use a rented RunPod GPU.
Qwen3-Coder-Next · 80B A3B
Qwen3-Coder-Next is an open-weight text-generation model from Qwen/Qwen3-Coder-Next, licensed under apache-2.0. It is designed specifically for coding agents and local development. The model has 80B total parameters with 3B activated parameters, a 262,144-token native context length, and a hybrid architecture combining Gated DeltaNet, Gated Attention, and Mixture-of-Experts layers. It supports only non-thinking mode and does not generate thinking blocks.
LFM2.5 2.6B
LFM2.5-2.6B is a text-generation model from LiquidAI with 2.69B parameters, a 131,072-token context window, and a 128,000-token vocabulary. It uses a hybrid architecture with 30 layers, including 22 double-gated short convolution blocks and 8 GQA layers, and was trained on 34 trillion tokens. The model is described as general-purpose, text-only, and post-trained for agentic workloads, with multilingual coverage across 16 languages. It is distributed under the lfm1.0 license and supports safetensors and text-generation tags.
Don’t stop at “installed.”
Make something.
A working setup produces an output you can inspect. Start with the guide’s small test, then increase quality, context, or duration once it is stable.
Hermes connects to the local OpenAI-compatible endpoint, the model returns a tool call, the client sends the tool result back, and the final answer reflects that result. Check the llama-server log for the tool-call exchange.
Make the setup yours.
Save your hardware, compare other models for the same task, or learn the ideas behind your first run.
Hardware fit is labeled by its evidence. Model and workflow pages contain the full sources, package requirements, and supported platform routes. RunPod links are affiliate links.