Install Ollama for macOS
Download the Mac application from Ollama, move it to Applications, and open it so the local service starts.
Download Ollama for MacRun the gpt-oss 120B model locally through Ollama, send a first chat prompt, and confirm the model returns a response. This setup is intended for machines with enough memory or GPU capacity to host the 65 GB package; the model is a text-generation model in the gpt-oss series.
Estimates for the 65.0 GB Ollama package at 4K text context. A full GPU load needs room beyond the weight download for runtime and KV cache; CPU offload can run on smaller GPUs with enough system RAM, but responds more slowly.
| Machine | gpt-oss · 120B |
|---|---|
| NVIDIA GPU · 16 GB | Use CPU offload with 96 GB RAM; slow. |
| NVIDIA GPU · 24 GB | Use CPU offload with 96 GB RAM; slow. |
| NVIDIA GPU · 32 GB | Use CPU offload with 96 GB RAM; slow. |
| NVIDIA GPU · 48 GB | Use CPU offload with 96 GB RAM; slow. |
| NVIDIA GPU · 80 GB | Runs at 4K text context; limited headroom. |
| AMD Radeon · 24 GB | Use CPU offload with 96 GB RAM; slow. Confirm the Ollama GPU backend with ollama ps. |
| AMD Radeon · 32 GB | Use CPU offload with 96 GB RAM; slow. Confirm the Ollama GPU backend with ollama ps. |
| Intel Arc · 24 GB | Use CPU offload with 96 GB RAM; slow. Confirm the Ollama GPU backend with ollama ps. |
| Intel Arc · 32 GB | Use CPU offload with 96 GB RAM; slow. Confirm the Ollama GPU backend with ollama ps. |
| Apple Silicon · 64 GB unified | Needs more unified memory at 4K; use a 96 GB Mac or lower-memory model. |
| Apple Silicon · 128 GB unified | Runs at 4K text context with room to raise context; speed not tested. |
| CPU-only · 64 GB RAM | Below the 96 GB system-RAM starting point; choose a smaller model. |
| DGX Spark · 128 GB unified memory | NVIDIA documents this exact Ollama 120B setup; start at short context. |
NVIDIA documents gpt-oss:120b on one 128 GB DGX Spark. This does not imply an 80 GB desktop GPU has the same memory architecture or speed; check free memory and offload on your own hardware.
Run the gpt-oss 120B model locally through Ollama, send a first chat prompt, and confirm the model returns a response. This setup is intended for machines with enough memory or GPU capacity to host the 65 GB package; the model is a text-generation model in the gpt-oss series.
This setup uses the package documented for this task. Review its source and supported platforms before starting.
Save your machine in My Hardware to get an automatic starting choice. You can always choose any package yourself.
The 65.0 GB published Ollama download is smaller than total runtime memory. Start with 4K text context. 80 GB GPU memory or 96 GB unified Mac memory is an estimated full-load starting point; 96 GB GPU or 128 GB Mac leaves more headroom. Longer context and other apps increase memory use; check ollama ps for actual offload.
Choose where you want to run it. The instructions below update to match your selection.
Use Terminal on Apple Silicon. Ollama for macOS is available from the official download page.
Download the Mac application from Ollama, move it to Applications, and open it so the local service starts.
Download Ollama for MacOpen a new Terminal window and confirm the command-line tool is available.
ollama --versionRun the publisher-listed command. The first launch downloads the selected weights; subsequent launches reuse the local copy.
ollama run gpt-oss:120bAt the Ollama chat prompt, paste: “Compare running a local 20B assistant with renting a GPU in four short bullets. Cover privacy, setup effort, recurring cost and performance.” Read all four tradeoffs and verify any performance or cost claims independently; the reply is a draft decision aid. This checks the actual selected model, not just that its download completed.
In a second Terminal window, verify that the selected package is installed locally.
ollama listRun the exact prompt in the operating-system instructions. Read all four tradeoffs and verify any performance or cost claims independently; the reply is a draft decision aid. Confirm that Ollama lists the selected package and use ollama ps to check whether it ran on GPU or fell back to CPU.
This is a source-linked setup, not a YouRunAI hardware test. Confirm your exact runtime version, package, and output before relying on it.
Check that you have enough free disk space (approximately 65 GB for the model) and a stable internet connection. If you are on a limited connection, consider using the smaller gpt-oss:20b variant instead by running `ollama run gpt-oss:20b`.
The 120B model is intended for a single 80 GB GPU or a machine with sufficient unified memory. If your hardware does not meet this, try the smaller `gpt-oss:20b` model or run the model on a machine with more memory.
Restart your terminal or command prompt so the PATH is updated. On Linux, you may need to log out and back in or source your shell profile. Confirm the installation completed successfully from the Ollama download page.
Original instructions, model files, and compatibility notes behind this setup.
Source-backed package and platform-route plan for private local chat with Qwen3.5 · 9B. Preserves the official Ollama 9B package, a smaller 4B family fallback, and a clearly labeled community uncensored GGUF option.
Run Qwen3.8 27B with Ollama, connect it to Cline in VS Code, and make one reviewable code change in a tiny local project.
Generate images from text prompts in ComfyUI with the fast distilled or more adjustable base 4B model. Save your results and reuse the visual workflow.