Install Ollama on Windows
Download the native Windows Ollama installer and start the tray app. Open a new PowerShell window after installation.
Download Ollama Ollama GPU and driver supportRun Qwen3.8 27B with Ollama, connect it to Cline in VS Code, and make one reviewable code change in a tiny local project.
Starting estimates for the exact 18 GB package with a small 16K-context Cline task. CPU offload can run on smaller GPUs with enough RAM, but tool iterations become slower.
| Machine | Qwen3.8 27B · 18 GB Ollama |
|---|---|
| NVIDIA GPU · 8 GB | CPU offload with 32 GB-plus RAM; slow for Cline. |
| NVIDIA GPU · 12 GB | CPU offload with 32 GB-plus RAM; slow for Cline. |
| NVIDIA GPU · 16 GB | CPU offload with 32 GB-plus RAM; slow for Cline. |
| NVIDIA GPU · 24 GB | Runs at 16K context with tight headroom; check offload. |
| NVIDIA GPU · 32 GB | Runs at 16K with headroom; check speed and backend. |
| AMD Radeon · 8 GB | CPU offload with 32 GB-plus RAM; slow for Cline. |
| AMD Radeon · 16 GB | CPU offload with 32 GB-plus RAM; slow for Cline. |
| AMD Radeon · 24 GB | Runs at 16K context with tight headroom; check offload. |
| AMD Radeon · 32 GB | Runs at 16K with headroom; check speed and backend. |
| Intel Arc · 8 GB | CPU offload with 32 GB-plus RAM; slow for Cline. |
| Intel Arc · 16 GB | CPU offload with 32 GB-plus RAM; slow for Cline. |
| Intel Arc · 24 GB | Runs at 16K context with tight headroom; check offload. |
| Intel Arc · 32 GB | Runs at 16K with headroom; check speed and backend. |
| Apple Silicon · 16 GB unified | Below the 32 GB unified-memory starting point for this coding task. |
| Apple Silicon · 24 GB unified | Below the 32 GB unified-memory starting point for this coding task. |
| Apple Silicon · 32 GB unified | Runs at 16K context; limited headroom. |
| Apple Silicon · 64 GB unified | Runs at 16K with headroom; try 32K only after checking memory. |
| CPU-only · 16 GB RAM | Not enough RAM for the 18 GB package plus a coding client. |
| CPU-only · 32 GB RAM | Can run in RAM at 16K; expect slow agent tool turns. |
| CPU-only · 64 GB RAM | Can run in RAM at 16K; expect slow agent tool turns. |
Memory fit is not a speed test. AMD and Intel require a working Ollama GPU backend; use ollama ps. If Cline slows or spills to RAM, reduce scope and context before changing models.
Install Ollama, VS Code and Cline. Pull the exact 27B package, prepare a two-file Python project, ask Cline to add subtraction, review its edits and run the tests yourself. Windows, Mac and Linux each have their own setup.
This setup uses the package documented for this task. Review its source and supported platforms before starting.
Save your machine in My Hardware to get an automatic starting choice. You can always choose any package yourself.
Start this small Cline project at 16,384 tokens on a 24 GB GPU or 32 GB Mac; memory headroom is tight at those tiers. Use a 32 GB GPU or 48 GB Mac before trying 32,768 tokens. Longer code files and tool output raise memory use; check ollama ps.
Choose where you want to run it. The instructions below update to match your selection.
Run Ollama on this machine and keep the model endpoint private. Check your GPU backend with ollama ps after a response.
Download the native Windows Ollama installer and start the tray app. Open a new PowerShell window after installation.
Download Ollama Ollama GPU and driver supportInstall Visual Studio Code and Python for Windows. In VS Code open Extensions, install Cline from the official listing and keep approval prompts enabled for the first task.
Visual Studio Code Cline extension Python downloadIn PowerShell, pull qwen3.8:27b. Ollama lists the package at about 18 GB. Confirm its tag appears locally before configuring Cline.
Qwen3.8 27B tag and sizeollama pull qwen3.8:27b
ollama listIn PowerShell, create the two small Python files below. The starting calculator only adds numbers, and the baseline test should exit without an error. Open qwen-coding-demo in VS Code with File → Open Folder.
New-Item -ItemType Directory -Force -Path "$HOME\qwen-coding-demo" | Out-Null
Set-Location "$HOME\qwen-coding-demo"
"def add(a, b):`n return a + b" | Set-Content calculator.py
"from calculator import add`nassert add(2, 3) == 5" | Set-Content test_calculator.py
python test_calculator.pyIn Cline Settings choose Ollama as provider, Base URL http://localhost:11434, exact Model ID qwen3.8:27b and context size 16384 for this small project. Enable Compact Prompt if available. Keep Auto Approve off; review requested file reads, edits and commands. On a 32 GB GPU or 48 GB Mac, consider 32768 only after the first run and a memory check.
Cline local model setup Ollama context and memoryIn Cline, paste: “Read calculator.py and test_calculator.py. Add subtract(a, b) to calculator.py, then add tests for subtract(7, 3) == 4 and subtract(3, 7) == -4. Do not change add(a, b) or add dependencies. Run the tests and show the diff.” Approve only edits to those two files and the requested test command.
In VS Code, review the two changed files before accepting them. In PowerShell from qwen-coding-demo, run the tests yourself. Check that the original add assertion and both subtract assertions pass, then run ollama ps to see whether the model stayed on GPU.
python test_calculator.py
ollama psCline adds subtract(a, b) and two tests without changing add(a, b). You inspect its edits and run the Python test file; the baseline assertion and new positive and negative checks all pass.
This is a source-backed setup and memory estimate, not a YouRunAI benchmark. Keep Cline approvals on. Start with one small project and 16K context; expand only after checking available memory and ollama ps.
Keep Ollama running, check ollama list for qwen3.8:27b, select Ollama as Cline provider and set http://localhost:11434 as the local base URL. Refresh the model list before retrying.
Close other GPU apps, keep Cline context at 16384 and limit the task to the two demo files. Check ollama ps for CPU offload. Use a 32 GB GPU or 48 GB Mac if it remains uncomfortable.
Reject unrelated edits, ask for the exact subtract function and two tests, review its diff, and run the local test file yourself. Do not accept a claimed pass without checking the actual output.
Original instructions, model files, and compatibility notes behind this setup.
Source-backed package and platform-route plan for private local chat with Qwen3.5 · 9B. Preserves the official Ollama 9B package, a smaller 4B family fallback, and a clearly labeled community uncensored GGUF option.
Generate images from text prompts in ComfyUI with the fast distilled or more adjustable base 4B model. Save your results and reuse the visual workflow.
Turn text prompts into local videos with the Wan2.1 T2V 1.3B model, complete pipeline files and a ready-to-load ComfyUI workflow.