Coding / WORKFLOW

Code locally with Muse Glimmer 30B in VS Code + Cline

Serve Meta’s Muse Glimmer 30B with llama.cpp, connect VS Code and Cline, and have it write a small module plus tests that you review and run yourself.

Verified sourceSource checked 11/17/2026
LOCAL
Freshness 67 out of 100. Release age: 103 days old, Aug 10, 2026. Measures age, not quality.
Popularity 72 out of 100. 149,325 downloads in 30 days; 2,168 lifetime likes. Checked Nov 21, 2026. Measures adoption, not quality.
What do these scores mean?

Two ways to compare models. Neither score measures answer quality, benchmark performance, or whether a model fits your machine.

Freshness · release age

A new release starts at 100. The score halves every 180 days: 100 × 2^(−age in days / 180). When the release date is unavailable, a repository date is a fallback—not proof of when the model was released. Missing dates stay unscored.

Check the date source
Popularity · adoption

Downloads over the past 30 days carry 80% of the score; lifetime likes carry 20%. Both use a logarithmic scale, capped at 10 million downloads and 100,000 likes. If likes are unavailable, downloads carry all the weight. Missing download statistics stay unscored.

round(80 × min(1, log10(1 + downloads) / 7) + 20 × min(1, log10(1 + likes) / 5))

Check the statistics source
Scores as of Nov 21, 2026. Statistics checked Nov 21, 2026. Statistics are marked for refresh after 72 hours.Full scoring method

Before you begin

Hardware

Estimated from Meta’s published file sizes and VRAM pairings plus runtime and context headroom. Muse Glimmer is a dense 30B model, so every parameter is used for every token: offloading layers to system RAM works but slows it down far more than it would a mixture-of-experts model. Not measured by YouRunAI.

MachineMuse Glimmer 30B · Q4_K_M GGUFMuse Glimmer 30B · Q4_K_XL GGUF
NVIDIA · 16 GB VRAM + 32 GB RAMRuns with several layers in RAM; noticeably slowHeavy offload; choose Q4_K_M instead
NVIDIA RTX 4090 · 24 GB VRAMRecommended start (Meta’s 24 GB pairing); keep the starting contextDoes not fit fully; offload a few layers or use Q4_K_M
NVIDIA RTX 5090 · 32 GB VRAMComfortable, with room for longer contextRecommended (Meta’s 32 GB pairing)
AMD Radeon · 24 GB VRAMFits; requires the HIP or Vulkan llama.cpp build on Windows (Linux tab here is NVIDIA only)Partial offload; requires the HIP or Vulkan build
Intel Arc · 16 GB VRAM + 32 GB RAMPartial offload through the Vulkan llama.cpp build; slowHeavy offload; choose Q4_K_M instead
Apple Silicon · 24 GB unified memoryToo tight for this guide: the file alone is 16.8 GBCannot fit
Apple Silicon · 32 GB unified memoryRecommended Mac start; close other appsTight; use Q4_K_M at the starting context
Apple Silicon · 64 GB unified memoryComfortableComfortable
CPU only · 32 GB RAMLoads, but a dense 30B model on CPU is very slow; short tasks onlyNeeds 48 GB RAM or more

Both packages are Meta’s own GGUF files from meta-models/Muse-Glimmer-30B-GGUF. Meta also publishes an optional 1.6 GB DFlash drafter for speculative decoding and full-precision weights (about 64 GB of VRAM) in the base repository; this guide leaves both out to keep the setup simple.

LOCAL CODING · VS CODE + CLINESOURCE-LINKED SETUP

Code locally with Muse Glimmer 30B in VS Code + Cline

Run Meta’s GGUF in llama.cpp, connect Cline through its OpenAI-compatible provider, and have it create a function with tests. You review every edit and run the test yourself.

Choose a package Run its commands Check the result
01
BEFORE YOU BEGIN

Choose your package

Select the weights you want. The instructions, downloads and settings change with your choice.

The publisher has not provided a complete memory target for this task. Check its hardware guidance before starting.

CURRENT SETUP

Muse Glimmer 30B · Q4_K_M GGUF · official

Start at 32,768 tokens for this Cline coding setup. The 16.8 GB file is only the weights; the runtime and context add more memory. Longer context needs more memory, so reduce it first if the server runs out. Estimate, not a YouRunAI measurement.

Freshness 67 out of 100. Release age: 103 days old, Aug 10, 2026. Measures age, not quality.
Popularity 72 out of 100. 149,325 downloads in 30 days; 2,168 lifetime likes. Checked Nov 21, 2026. Measures adoption, not quality.
What do these scores mean?

Two ways to compare models. Neither score measures answer quality, benchmark performance, or whether a model fits your machine.

Freshness · release age

A new release starts at 100. The score halves every 180 days: 100 × 2^(−age in days / 180). When the release date is unavailable, a repository date is a fallback—not proof of when the model was released. Missing dates stay unscored.

Check the date source
Popularity · adoption

Downloads over the past 30 days carry 80% of the score; lifetime likes carry 20%. Both use a logarithmic scale, capped at 10 million downloads and 100,000 likes. If likes are unavailable, downloads carry all the weight. Missing download statistics stay unscored.

round(80 × min(1, log10(1 + downloads) / 7) + 20 × min(1, log10(1 + likes) / 5))

Check the statistics source
Scores as of Nov 21, 2026. Statistics checked Nov 21, 2026. Statistics are marked for refresh after 72 hours.Full scoring method
View weight source
02
THE WORKFLOW

Set up Muse Glimmer 30B · Q4_K_M GGUF on your machine

Choose your computer first, then its GPU path. The instructions below update to match your selection.

CHOOSE YOUR SETUPWindows
01

Install llama.cpp with winget

Open PowerShell and install the official llama.cpp release with winget, then close and reopen PowerShell so llama-server is on your PATH. Meta’s card says Muse Glimmer needs llama.cpp build b10353 or newer; the second command prints your build number, and the third lists the GPUs llama.cpp can use. If only the CPU appears on an NVIDIA or AMD PC, download the CUDA or HIP Windows build from the official releases page instead and run the same commands from its folder.

Official llama.cpp releases (Windows builds) Meta’s Muse Glimmer GGUF files and minimum build
PowerShell
winget install llama.cpp
llama-server --version
llama-server --list-devices
02

Download Q4_K_M and start the local server

In PowerShell, run this command and leave the window open. The first run downloads Meta’s 16.8 GB Muse-Glimmer-30B-KQuant-17GB-Q4_K_M.gguf file; later runs reuse it. The --no-mmproj flag skips the vision encoder to save memory, because this guide only works with text and code. The server listens only on this computer at http://127.0.0.1:8080, names the model muse-glimmer-30b, and starts at 32,768 tokens of context with one request slot (-np 1), so the whole context goes to you. The sampling settings are Meta’s recommended temperature 1.0, top_p 0.95 and top_k 64, and --jinja is required for the chat template embedded in the file. Wait until the log says the server is listening.

Exact Q4_K_M file in Meta’s repository llama.cpp server options
PowerShell
llama-server -hf meta-models/Muse-Glimmer-30B-GGUF:Q4_K_M --no-mmproj --alias muse-glimmer-30b --jinja -c 32768 -np 1 -ngl 99 --temp 1.0 --top-p 0.95 --top-k 64 --host 127.0.0.1 --port 8080
04

Connect Cline to the local model

Open Cline's settings. Choose the OpenAI Compatible provider, set Base URL to http://127.0.0.1:8080/v1, enter any text such as local as the API key (llama.cpp does not check it), and set the model ID to muse-glimmer-30b. Set the context window to 32768 so it matches the server. Keep auto-approve off for file edits and terminal commands.

SettingValue
ProviderOpenAI Compatible
Base URLhttp://127.0.0.1:8080/v1
Model IDmuse-glimmer-30b
Context window32768
Cline OpenAI-compatible provider settings
05

Create a small project and give Cline a coding task

Create an empty folder named glimmer-coding-test, open it in VS Code with File → Open Folder, and paste the task below into Cline in Act mode. Approve each file write after reading it, and approve the single test command. Cline is the coding client; the model only proposes edits and commands.

Plain text
Create slugify.mjs that exports a function slugify(text) which lowercases text, trims it, replaces runs of non-alphanumeric characters with single hyphens and removes leading or trailing hyphens. Create slugify.test.mjs that uses node:test and node:assert to check at least four cases, including an empty string. Then run node --test and show me the result.
06

Review the diff and run the test yourself

Open both files and read the change. Then run the test from the VS Code terminal (PowerShell) to confirm it passes independently of Cline. A passing node --test run and code you have read is the result; a chat answer without saved files does not count.

PowerShell
node --test
03
SUCCESS CHECK · Muse Glimmer 30B · Q4_K_M GGUF

Reviewed code and a passing test

slugify.mjs and slugify.test.mjs exist in your project, you have read the diff, and node --test passes when you run it yourself.

Meta describes Muse Glimmer as built for local agentic and coding work and reports it ahead of Gemma4-31B and Qwen3.6-27B on its own benchmarks; those are publisher numbers. Cline tool reliability with this exact package has not been tested by YouRunAI; keep approvals on.

Back to setup steps

When it doesn’t go to plan

Cline says the model returned no tool call or an invalid response.

Confirm the server was started with --jinja and the model ID is exactly muse-glimmer-30b. Update llama.cpp, then retry. If it still fails, report the package and llama.cpp version rather than switching on auto-approve.

The server stops with an out-of-memory error.

Lower -c by half, close other GPU apps, or switch to Q4_K_M. On a 16 GB GPU replace -ngl 99 with -ngl 40 to keep part of the model in system RAM; it will be slower.

llama-server says it does not recognise the model architecture.

Meta’s card says builds b10344 and older cannot load Muse Glimmer. Update llama.cpp (winget upgrade llama.cpp, brew upgrade llama.cpp, or docker pull the server-cuda image), check llama-server --version shows b10353 or newer, and try again.

node is not recognised.

Install Node.js LTS from nodejs.org, then close and reopen VS Code so its terminal picks up the new PATH.

REFERENCE LIBRARY

Sources and files

Original instructions, model files, and compatibility notes behind this setup.

5 SOURCES

The model behind this workflow

Muse Glimmer 30B

Keep exploring

Text
SETUP GUIDE

Qwen3.5 · 9B private chat setup

Source-backed package and platform-route plan for private local chat with Qwen3.5 · 9B. Preserves the official Ollama 9B package, a smaller 4B family fallback, and a clearly labeled community uncensored GGUF option.

Freshness 36 out of 100. Release age: 267 days old, Feb 27, 2026. Measures age, not quality.
Popularity 91 out of 100. 6,163,654 downloads in 30 days; 2,432 lifetime likes. Checked Nov 21, 2026. Measures adoption, not quality.
SOFTWAREOllama
Coding
SETUP GUIDE

Build a private coding assistant with Qwen3.8 27B

Run Qwen3.8 27B with Ollama, connect it to Cline in VS Code, and make one reviewable code change in a tiny local project.

Freshness 66 out of 100. Repository age: 108 days old, Aug 5, 2026. Measures age, not quality.
Popularity 95 out of 100. 6,298,190 downloads in 30 days; 20,759 lifetime likes. Checked Nov 21, 2026. Measures adoption, not quality.
Arena Open Source Web coding: rank 13 of 63. Ranked model: Qwen3.8-27B. Original model ranking, not a benchmark of this package. Export dated Nov 20, 2026. Source checked Nov 21, 2026. Human preference ranking, not hardware suitability.+3
SOFTWAREOllama + Visual Studio Code + Cline + Python
Images
SETUP GUIDE

Create images locally with FLUX.2 Klein

Generate images from text prompts in ComfyUI with the fast distilled or more adjustable base 4B model. Save your results and reuse the visual workflow.

Freshness 30 out of 100. Release age: 310 days old, Jan 15, 2026. Measures age, not quality.
Popularity 77 out of 100. 440,359 downloads in 30 days; 1,140 lifetime likes. Checked Nov 21, 2026. Measures adoption, not quality.
SOFTWAREComfyUI