Install and start Ollama on Windows
Use the linked native installer, finish setup, and open the Ollama app. Keep it running.
Install Ollama GPU and driver supportSet up Qwen3.5 for local image understanding through a receipt-extraction example. Choose the lighter 2B or more capable 4B package, upload a receipt, and compare the extracted fields with the original. The supplied app is a dedicated receipt reader, not a general image-chat interface.
Starting estimates for one receipt at 4K context. Memory applies to the complete Ollama vision request, not weights alone.
| Machine | Qwen3.5 2B Q4 | Qwen3.5 4B Q4 |
|---|---|---|
| NVIDIA GPU · 4 GB VRAM + 16 GB RAM | Start here; limited GPU headroom | Use 2B first or allow CPU offload |
| NVIDIA GPU · 8 GB VRAM + 16 GB RAM | Comfortable starting estimate | Suitable starting estimate for one image |
| AMD GPU · 8 GB VRAM + 16 GB RAM | Use a supported Ollama GPU backend | Use a supported Ollama GPU backend |
| Intel GPU · 8 GB VRAM + 16 GB RAM | Vulkan when supported; CPU fallback otherwise | Vulkan when supported; CPU fallback otherwise |
| Apple Silicon · 8 GB unified memory | Smaller option; close memory-heavy apps | Possible but tight; 16 GB is preferable |
| Apple Silicon · 16 GB unified memory | Comfortable starting estimate | Recommended Mac starting point |
| CPU only · 16 GB RAM | Usable CPU route; wait longer per image | Usable CPU route; slower than accelerated inference |
No speed claims are implied. Check the exact GPU/OS against Ollama’s supported backends; insufficient VRAM may offload to system RAM.
| Machine | Qwen3.5 2B Q4 | Qwen3.5 4B Q4 |
|---|---|---|
| GPU · 8 GB / Mac · 16 GB unified | Start at 4,096 tokens; one receipt image | Start at 4,096 tokens; one receipt image |
The app bounds each request. Increasing context or the number/resolution of images raises memory use; single-page extraction rarely needs a very long conversation.
Explore local image understanding with Qwen3.5 using a receipt-extraction example. The supplied app reads a receipt image and saves its merchant, date, total and currency as JSON; it is a dedicated receipt reader. Choose the lighter 2B or more capable 4B package and check every extracted field against the original.
Select the weights you want. The instructions, downloads and settings change with your choice.
Save your machine in My Hardware to get an automatic starting choice. You can always choose any package yourself.
Estimated for one receipt image and a 4,096-token request. The app sets that limit explicitly; larger images need more working memory. Check Ollama GPU support for the exact card.
Choose where you want to run it. The instructions below update to match your selection.
NVIDIA uses CUDA; AMD/Intel acceleration depends on the exact card and supported ROCm/Vulkan driver. CPU fallback is available with sufficient RAM.
Use the linked native installer, finish setup, and open the Ollama app. Keep it running.
Install Ollama GPU and driver supportThis downloads the selected model to Ollama once. It does not start a terminal chat; the browser app will send the image and request the structured fields.
Exact packageollama pull qwen3.5:2bInstall uv from its official instructions, then open a new PowerShell window. The commands below create an isolated Python 3.11 environment; there is no need to change your system Python.
uv installationpowershell -ExecutionPolicy ByPass -c "irm https://astral.sh/uv/install.ps1 | iex"Use a new folder named yourunai-receipts in your home directory. These commands run in PowerShell. Leave this window in the project folder for the remaining commands.
uv virtual environmentsNew-Item -ItemType Directory -Force -Path "$env:USERPROFILE\yourunai-receipts" | Out-Null
Set-Location "$env:USERPROFILE\yourunai-receipts"
uv venv --python 3.11
uv pip install --python .\.venv\Scripts\python.exe ollama==0.6.2 gradio==6.28.0 pillow==12.3.0Right-click the download link below and choose Save Link As. Save the .py file directly in the project folder created above; keep its .py extension, not .txt. This complete YouRunAI starter creates the browser interface and output folders. You can inspect it in a text editor. Model weights download separately when the runtime needs them.
Download receipt-reader.pyRun this in PowerShell and keep the process open. Open http://127.0.0.1:7860. The app creates a readable sample-receipt.png and sends images only to Ollama at 127.0.0.1:11434. Each request uses 4,096 context tokens with a 1,024-token answer limit.
.\.venv\Scripts\python.exe receipt-reader.py --model qwen3.5:2bThe sample image is already selected. Click Extract receipt to run vision inference. Compare the JSON with the image: merchant CEDAR CAFE, date 2026-09-28, total 12, currency USD. A structurally valid JSON response can still contain a reading error, so check the actual fields.
Replace the image with a clear PNG or JPEG photo of your own receipt, then click Extract receipt. Keep the whole receipt legible and upright. Download the JSON using the file button; every result also gets a separate timestamped file under outputs/. PDF pages must first be exported as PNG/JPEG. Null means the field was not legible; compare it with the image before using the result.
Press Ctrl+C in the running PowerShell window to stop the app. Your files stay in yourunai-receipts. Next time run the commands below, then reopen http://127.0.0.1:7860. Dependencies and downloaded weights are reused. Keep this address local; there is no public sharing link.
Set-Location "$env:USERPROFILE\yourunai-receipts"
.\.venv\Scripts\python.exe receipt-reader.py --model qwen3.5:2bThe browser shows the original image and four extracted fields. The sample totals match the visible receipt, and a timestamped JSON file appears in outputs/. Your own receipt is checked the same way.
Keep the Python process open and wait until it prints the local URL. If another app uses that port, stop that app or run these examples one at a time.
The first run downloads the publisher model to the Hugging Face cache. Watch the Terminal/PowerShell progress and allow the download to finish; later starts reuse it.
Run the installation command from this guide again in the project folder. Launch with the .venv Python path shown here so you use the same environment.
Close memory-heavy apps and other models. Keep the supplied short input limits and batch size. The small-model CPU route needs system RAM, not GPU VRAM.
Open the Ollama app on Windows/Mac, or start its Linux service. Keep one server running on port 11434, then retry Extract receipt.
Pull the exact qwen3.5:2b or qwen3.5:4b tag shown here. Update Ollama and restart its server. A text-only substitute cannot read the image.
Use a sharp, upright, tightly cropped image and compare every field with the receipt. Try the 4B package if the smaller model misses clear text; do not treat valid JSON as proof of accuracy.
Original instructions, model files, and compatibility notes behind this setup.
Source-backed package and platform-route plan for private local chat with Qwen3.5 · 9B. Preserves the official Ollama 9B package, a smaller 4B family fallback, and a clearly labeled community uncensored GGUF option.
Run Qwen3.8 27B with Ollama, connect it to Cline in VS Code, and make one reviewable code change in a tiny local project.
Generate images from text prompts in ComfyUI with the fast distilled or more adjustable base 4B model. Save your results and reuse the visual workflow.