Install Ollama for macOS
Download the Mac application from Ollama, move it to Applications, and open it so the local service starts.
Download Ollama for MacRun a private local chat using Ollama with Qwen3.8-27B, send a first prompt, and confirm the model responds.
Estimates for the 18.0 GB Ollama package at 4K text context. A full GPU load needs room beyond the weight download for runtime and KV cache; CPU offload can run on smaller GPUs with enough system RAM, but responds more slowly.
| Machine | Qwen3.8-27B |
|---|---|
| NVIDIA GPU · 8 GB | Use CPU offload with 32 GB RAM; slow. |
| NVIDIA GPU · 12 GB | Use CPU offload with 32 GB RAM; slow. |
| NVIDIA GPU · 16 GB | Use CPU offload with 32 GB RAM; slow. |
| NVIDIA GPU · 24 GB | Runs at 4K text context; limited headroom. |
| NVIDIA GPU · 32 GB | Runs at 4K with headroom; speed not tested. |
| AMD Radeon · 8 GB | Use CPU offload with 32 GB RAM; slow. Confirm the Ollama GPU backend with ollama ps. |
| AMD Radeon · 16 GB | Use CPU offload with 32 GB RAM; slow. Confirm the Ollama GPU backend with ollama ps. |
| AMD Radeon · 24 GB | Runs at 4K text context; limited headroom. Confirm the Ollama GPU backend with ollama ps. |
| AMD Radeon · 32 GB | Runs at 4K with headroom; speed not tested. Confirm the Ollama GPU backend with ollama ps. |
| Intel Arc · 8 GB | Use CPU offload with 32 GB RAM; slow. Confirm the Ollama GPU backend with ollama ps. |
| Intel Arc · 16 GB | Use CPU offload with 32 GB RAM; slow. Confirm the Ollama GPU backend with ollama ps. |
| Intel Arc · 24 GB | Runs at 4K text context; limited headroom. Confirm the Ollama GPU backend with ollama ps. |
| Intel Arc · 32 GB | Runs at 4K with headroom; speed not tested. Confirm the Ollama GPU backend with ollama ps. |
| Apple Silicon · 16 GB unified | Needs more unified memory at 4K; use a 32 GB Mac or lower-memory model. |
| Apple Silicon · 24 GB unified | Needs more unified memory at 4K; use a 32 GB Mac or lower-memory model. |
| Apple Silicon · 32 GB unified | Runs at 4K text context; limited memory headroom. |
| Apple Silicon · 64 GB unified | Runs at 4K text context with room to raise context; speed not tested. |
| CPU-only · 16 GB RAM | Below the 32 GB system-RAM starting point; choose a smaller model. |
| CPU-only · 32 GB RAM | Can run in system RAM at 4K; expect slower replies than GPU. |
| CPU-only · 64 GB RAM | Can run in system RAM at 4K; expect slower replies than GPU. |
These are memory-fit starting points, not performance tests. Check the exact AMD or Intel Ollama backend and use ollama ps to see the GPU/CPU split; longer context or image input needs more memory.
Run a private local chat using Ollama with Qwen3.8-27B, send a first prompt, and confirm the model responds.
This setup uses the package documented for this task. Review its source and supported platforms before starting.
Save your machine in My Hardware to get an automatic starting choice. You can always choose any package yourself.
The 18.0 GB published Ollama download is smaller than total runtime memory. Start with 4K text context. 24 GB GPU memory or 32 GB unified Mac memory is an estimated full-load starting point; 32 GB GPU or 48 GB Mac leaves more headroom. Longer context and other apps increase memory use; check ollama ps for actual offload.
Choose where you want to run it. The instructions below update to match your selection.
Use Terminal on Apple Silicon. Ollama for macOS is available from the official download page.
Download the Mac application from Ollama, move it to Applications, and open it so the local service starts.
Download Ollama for MacOpen a new Terminal window and confirm the command-line tool is available.
ollama --versionRun the publisher-listed command. The first launch downloads the selected weights; subsequent launches reuse the local copy.
ollama run qwen3.8:27bAt the Ollama chat prompt, paste: “Turn this local AI request into three requirements and one question: “I have a 32 GB GPU and 64 GB RAM. I need private chat with short context and cannot upload documents.”” The answer should preserve the hardware, privacy and short-context constraints and ask one useful clarifying question. This checks the actual selected model, not just that its download completed.
In a second Terminal window, verify that the selected package is installed locally.
ollama listRun the exact prompt in the operating-system instructions. The answer should preserve the hardware, privacy and short-context constraints and ask one useful clarifying question. Confirm that Ollama lists the selected package and use ollama ps to check whether it ran on GPU or fell back to CPU.
This is a source-linked setup, not a YouRunAI hardware test. Confirm your exact runtime version, package, and output before relying on it.
Check your internet connection and available disk space, then run the command again. The 18 GB model package must be downloaded completely before chat starts.
The 27B model requires substantial memory and compute. Close other heavy applications and ensure your GPU or CPU has enough available memory for the text-only workload.
Qwen3.8-27B operates in thinking mode by default and outputs ` thinking ... ` before the answer. This is expected behavior; read the content after the closing `` tag as the final response.
Original instructions, model files, and compatibility notes behind this setup.
Source-backed package and platform-route plan for private local chat with Qwen3.5 · 9B. Preserves the official Ollama 9B package, a smaller 4B family fallback, and a clearly labeled community uncensored GGUF option.
Run Qwen3.8 27B with Ollama, connect it to Cline in VS Code, and make one reviewable code change in a tiny local project.
Generate images from text prompts in ComfyUI with the fast distilled or more adjustable base 4B model. Save your results and reuse the visual workflow.