Install Ollama
Download and run OllamaSetup.exe from ollama.com/download, or paste this into PowerShell. Ollama starts in the background and adds an icon to the taskbar. Use version 0.40.16 or newer.
Download OllamaRun HauhauCS’s Gemma 4 12B Uncensored with Ollama on Windows, Mac or Linux, connect Hermes Agent, and have it read two files and write a checked review.
Estimated from the published file sizes plus runtime and context headroom at 65,536 tokens. Not measured by YouRunAI.
| Machine | Gemma 4 12B Uncensored · Q4_K_M · 6.9 GB |
|---|---|
| NVIDIA · 8 GB VRAM + 16 GB RAM | Partial offload: the weights nearly fill 8 GB, so Ollama keeps some layers in RAM; slower |
| NVIDIA · 12 GB VRAM | Recommended start; Ollama moves a few layers to RAM if it runs short |
| NVIDIA · 16 GB VRAM or more | Comfortable |
| AMD Radeon · 12 GB VRAM | Should fit; Ollama uses supported Radeon GPUs through ROCm on Windows and Linux |
| Intel Arc · 12 GB VRAM | Ollama’s Intel Arc acceleration is limited; if ollama ps shows 100% CPU, expect it to be slow |
| Apple Silicon · 8 GB unified memory | Too tight: the file alone is 6.9 GB |
| Apple Silicon · 16 GB unified memory | Recommended Mac start; close other apps |
| Apple Silicon · 24 GB unified memory or more | Comfortable |
| CPU only · 16 GB RAM | Loads, but agent turns are slow; short tasks only |
The repository also holds a 168 MB vision file and a 242 MB MTP speculative drafter. This guide leaves both out to keep the setup simple and save memory.
Pull HauhauCS’s 6.9 GB GGUF into Ollama, connect Hermes with Ollama’s launcher, and have the agent read two project files and write review.md. You approve each file action.
This setup uses the package documented for this task. Review its source and supported platforms before starting.
The publisher has not provided a complete memory target for this task. Check its hardware guidance before starting.
The 6.9 GB file is only the weights; the runtime and a 65,536-token agent context add memory. A 12 GB GPU or a 16 GB Apple Silicon Mac is the estimated starting point; an 8 GB GPU has to keep part of the model in system RAM. Not a YouRunAI measurement.
Choose where you want to run it. The instructions below update to match your selection.
Download and run OllamaSetup.exe from ollama.com/download, or paste this into PowerShell. Ollama starts in the background and adds an icon to the taskbar. Use version 0.40.16 or newer.
Download OllamaHermes needs a long context, and Ollama starts most models at 4,096 tokens on GPUs under 24 GB. Open Ollama’s Settings from its taskbar icon and move the Context length slider to 64k. That is the only setting you change.
Ollama context lengthIn PowerShell, run this to download HauhauCS’s 6.9 GB file straight from Hugging Face.
Exact file on Hugging FaceHermes Desktop is Nous Research’s free app for Hermes, with a chat window, file browser and tool output, so you do not need the terminal. Run this command: Ollama installs Hermes Desktop if you do not have it, connects it to Gemma 4 12B Uncensored and opens the app. You can also download the app first from the Hermes Desktop page (Windows 10 or 11). The app uses the model you launch it with: to switch to another model later, run the same command with that model’s name. If the model is not listed in the app, run ollama list to check that the download finished.
Download Hermes Desktop Ollama’s Hermes Desktop integration Hermes Desktop guidePrefer the terminal? Run this instead. It installs the Hermes command-line agent if needed and opens a Hermes chat in this window; it shares settings, sessions and memory with the desktop app. Skip the optional messaging setup. If you see “Hermes Gateway Starting…” instead of a chat, press Ctrl+C and run hermes.
Ollama’s Hermes integration Hermes Agent installation (manual option)In the Hermes chat (the desktop app or the terminal), paste the task below. It has Hermes create a notes file, read it back and write a review, so you can see it use real file tools. Hermes asks before each file action; read each request and approve it. A model with reduced refusals will not push back on risky actions, so keep these approvals on.
| Setting | Value |
|---|---|
| Task to paste into Hermes | Create a folder named agent-test. Inside it, write notes.md saying: launch day is Thursday 14 May, the owner is Priya, and the database migration runs at 09:00 before the app deploy. Then read notes.md and write review.md with a numbered launch checklist that adds a verified database backup before the migration, plus one sentence on the risk of skipping it. |
Open the agent-test folder. review.md should name Thursday 14 May and Priya and put a backup step before the migration. If both files exist, the agent is reading and writing files on your computer. Next time, open the Hermes Desktop app, or run hermes in a terminal (type /exit to leave).
review.md names the launch day and owner from notes.md, adds a verified backup before the migration, and Hermes’ activity shows the file reads and one approved write.
This guide uses Ollama’s official Hermes launcher, which writes the same custom-provider settings shown in the Hermes Agent section of HauhauCS’s Hugging Face page, pointed at Ollama. HauhauCS reports 0 refusals on 465 test prompts; that is the publisher’s number. YouRunAI has not run this exact task with this file, so inspect the output rather than trusting the chat summary. Sources checked November 17, 2026.
Run ollama ps while Hermes is working: the CONTEXT column should say 65536. If it says 4096, the context slider (or the Linux setting) did not apply; set it again and restart Ollama. If Hermes still answers only in chat, update Ollama and try the larger package if there is one.
Update Ollama to 0.40.16 or newer (re-run the installer, or Check for Updates from its icon), restart it, and run the command again. ollama pull resumes an interrupted download.
Choose a smaller package if there is one, or move Ollama’s context slider down to 32k. If it runs out of memory as soon as Hermes starts, run hermes config set model.context_length 65536 so Hermes does not ask for the model’s full maximum context.
Close and reopen the terminal. Follow any PATH or dependency message the installer printed.
Original instructions, model files, and compatibility notes behind this setup.
Source-backed package and platform-route plan for private local chat with Qwen3.5 · 9B. Preserves the official Ollama 9B package, a smaller 4B family fallback, and a clearly labeled community uncensored GGUF option.
Run Qwen3.8 27B with Ollama, connect it to Cline in VS Code, and make one reviewable code change in a tiny local project.
Generate images from text prompts in ComfyUI with the fast distilled or more adjustable base 4B model. Save your results and reuse the visual workflow.