Text / Intermediate

Set up private chat with Ornith 1.5 35B A3B

Run Ornith-1.5-35B-A3B locally through Ollama, send it a first chat message, and verify that the model answers from your own machine.

EstimatedSource checked 9/24/2026
LOCALRENTED GPU

Before you begin

Difficulty
Intermediate
Software
Ollama, Ornith-1.5-35B-A3B-GGUF
Hardware
This setup uses Ollama. The exact checkpoint format, context, and runtime overhead determine its memory need; a weight-file size alone is not a GPU recommendation.
TEXT / OLLAMASOURCE-LINKED SETUP

Set up private chat with Ornith 1.5 35B A3B, step by step.

Run Ornith-1.5-35B-A3B locally through Ollama, send it a first chat message, and verify that the model answers from your own machine.

Choose a package Run its commands Check the result
01
BEFORE YOU BEGIN

The documented package

This setup uses the package documented for this task. Review its source and supported platforms before starting.

The publisher has not provided a complete memory target for this task. Check its hardware guidance before starting.

CURRENT SETUP

Ornith 1.5 35B A3B · official

This setup uses Ollama. The exact checkpoint format, context, and runtime overhead determine its memory need; a weight-file size alone is not a GPU recommendation.

View weight source
02
THE WORKFLOW

Set up Ornith 1.5 35B A3B on your machine

Pick your operating system. Every command below is for the selected package and runtime.

Install Ollama for this operating system before running the model command.

01

Install Ollama

Ollama must be installed and available on your PATH before you can pull the Ornith GGUF build. Install the Ollama desktop or command-line package for your operating system from the Ollama distribution page and confirm that the `ollama` command responds in a terminal.

02

Launch Ornith-1.5-35B-A3B

Run the published Ollama command. This downloads the Ornith-1.5-35B-A3B GGUF repository and starts an interactive chat session with the model.

ollama run hf.co/ornith-ai/Ornith-1.5-35B-A3B-GGUF
03

Send the first prompt

At the Ollama prompt, ask a short question that requires a generated answer, for example: `Write a one-line Python lambda that squares a number.` This gives the model a concrete prompt to respond to locally.

04

Read the model response

The model is a reasoning model, so the assistant turn may open with a ` thinking` block before the final answer. Check that the response includes the requested lambda, for example `lambda x: x * x`, confirming the selected model produced output on your machine.

05

Exit the chat

Type `/bye` to close the interactive session once you have confirmed the model responded.

03
SUCCESS CHECK · Ornith 1.5 35B A3B

Check the first local reply

Ask a short question with a known answer. Confirm the selected local model responds and verify the answer yourself before using it for private work.

This is a source-linked setup, not a YouRunAI hardware test. Confirm your exact runtime version, package, and output before relying on it.

Back to setup steps

When it doesn’t go to plan

The `ollama` command is not recognized.

Install the Ollama desktop or command-line package for your operating system and restart the terminal so the executable is on your PATH.

Ornith-1.5-35B-A3B fails to load due to insufficient memory.

Free memory on the machine or run the model on a system with enough capacity for a 35B mixture-of-experts GGUF build before rerunning the published Ollama command.

The model starts but takes a long time on the first prompt.

The first run downloads and loads the GGUF weights; wait for the download and model load to complete before sending the prompt.

REFERENCE LIBRARY

Sources and files

Original instructions, model files, and compatibility notes behind this setup.

4 SOURCES

The model behind this workflow

Ornith 1.5 35B A3B
MY HARDWARE

Will it run on your machine?

Save your machine to see a personalized rating and its reasoning.

Add my hardware

Keep exploring