Install Ollama for macOS
Download the Mac application from Ollama, move it to Applications, and open it so the local service starts.
Download Ollama for MacInstall Ollama, pull the gpt-oss:20b model, launch a local private chat session, send a first prompt, and verify the model responds.
Estimates for the 14.0 GB Ollama package at 4K text context. A full GPU load needs room beyond the weight download for runtime and KV cache; CPU offload can run on smaller GPUs with enough system RAM, but responds more slowly.
| Machine | gpt-oss · 20B |
|---|---|
| NVIDIA GPU · 8 GB | Use CPU offload with 32 GB RAM; slow. |
| NVIDIA GPU · 12 GB | Use CPU offload with 32 GB RAM; slow. |
| NVIDIA GPU · 16 GB | Runs at 4K text context; limited headroom. |
| NVIDIA GPU · 24 GB | Runs at 4K with headroom; speed not tested. |
| NVIDIA GPU · 32 GB | Runs at 4K with headroom; speed not tested. |
| AMD Radeon · 8 GB | Use CPU offload with 32 GB RAM; slow. Confirm the Ollama GPU backend with ollama ps. |
| AMD Radeon · 16 GB | Runs at 4K text context; limited headroom. Confirm the Ollama GPU backend with ollama ps. |
| AMD Radeon · 24 GB | Runs at 4K with headroom; speed not tested. Confirm the Ollama GPU backend with ollama ps. |
| AMD Radeon · 32 GB | Runs at 4K with headroom; speed not tested. Confirm the Ollama GPU backend with ollama ps. |
| Intel Arc · 8 GB | Use CPU offload with 32 GB RAM; slow. Confirm the Ollama GPU backend with ollama ps. |
| Intel Arc · 16 GB | Runs at 4K text context; limited headroom. Confirm the Ollama GPU backend with ollama ps. |
| Intel Arc · 24 GB | Runs at 4K with headroom; speed not tested. Confirm the Ollama GPU backend with ollama ps. |
| Intel Arc · 32 GB | Runs at 4K with headroom; speed not tested. Confirm the Ollama GPU backend with ollama ps. |
| Apple Silicon · 16 GB unified | Needs more unified memory at 4K; use a 24 GB Mac or lower-memory model. |
| Apple Silicon · 24 GB unified | Runs at 4K text context; limited memory headroom. |
| Apple Silicon · 32 GB unified | Runs at 4K text context with room to raise context; speed not tested. |
| Apple Silicon · 64 GB unified | Runs at 4K text context with room to raise context; speed not tested. |
| CPU-only · 16 GB RAM | Below the 32 GB system-RAM starting point; choose a smaller model. |
| CPU-only · 32 GB RAM | Can run in system RAM at 4K; expect slower replies than GPU. |
| CPU-only · 64 GB RAM | Can run in system RAM at 4K; expect slower replies than GPU. |
These are memory-fit starting points, not performance tests. Check the exact AMD or Intel Ollama backend and use ollama ps to see the GPU/CPU split; longer context or image input needs more memory.
Install Ollama, pull the gpt-oss:20b model, launch a local private chat session, send a first prompt, and verify the model responds.
This setup uses the package documented for this task. Review its source and supported platforms before starting.
Save your machine in My Hardware to get an automatic starting choice. You can always choose any package yourself.
The 14.0 GB published Ollama download is smaller than total runtime memory. Start with 4K text context. 16 GB GPU memory or 24 GB unified Mac memory is an estimated full-load starting point; 24 GB GPU or 32 GB Mac leaves more headroom. Longer context and other apps increase memory use; check ollama ps for actual offload.
Choose where you want to run it. The instructions below update to match your selection.
Use Terminal on Apple Silicon. Ollama for macOS is available from the official download page.
Download the Mac application from Ollama, move it to Applications, and open it so the local service starts.
Download Ollama for MacOpen a new Terminal window and confirm the command-line tool is available.
ollama --versionRun the publisher-listed command. The first launch downloads the selected weights; subsequent launches reuse the local copy.
ollama run gpt-oss:20bAt the Ollama chat prompt, paste: “Draft a three-step plan to back up a local project folder to an external drive. Include a test that a file can be restored.” The plan should include copying, checking the copy and restoring one file; do not treat an untested backup as complete. This checks the actual selected model, not just that its download completed.
In a second Terminal window, verify that the selected package is installed locally.
ollama listRun the exact prompt in the operating-system instructions. The plan should include copying, checking the copy and restoring one file; do not treat an untested backup as complete. Confirm that Ollama lists the selected package and use ollama ps to check whether it ran on GPU or fell back to CPU.
This is a source-linked setup, not a YouRunAI hardware test. Confirm your exact runtime version, package, and output before relying on it.
Close and reopen your terminal so the updated PATH is loaded, then run the command again.
Run ollama pull gpt-oss:20b again; Ollama resumes from the downloaded portions.
Make sure you are running the model with Ollama, which applies the Harmony response format. The gpt-oss model must be used with the Harmony format to work correctly.
Try the lower reasoning effort setting by including “Reasoning: low” in the system prompt, or ensure your machine has enough free memory for the 20B model.
Original instructions, model files, and compatibility notes behind this setup.
Source-backed package and platform-route plan for private local chat with Qwen3.5 · 9B. Preserves the official Ollama 9B package, a smaller 4B family fallback, and a clearly labeled community uncensored GGUF option.
Run Qwen3.8 27B with Ollama, connect it to Cline in VS Code, and make one reviewable code change in a tiny local project.
Generate images from text prompts in ComfyUI with the fast distilled or more adjustable base 4B model. Save your results and reuse the visual workflow.