WIDEAREAINTELLIGENCE
← model directory

huggingface

Ornith 1.5 35B A3B

hf/ornith-ai/Ornith-1.5-35B-A3B-GGUF

↓ runs free on your own hardware

Open-weight model — runs free on your own GPU via the node runtime (GGUF). 4,258,710 downloads and 424 likes on Hugging Face (ornith-ai/Ornith-1.5-35B-A3B-GGUF).

specs & pricing
Type
text
Provider
huggingface
Model ID
hf/ornith-ai/Ornith-1.5-35B-A3B-GGUF
Self-hostable
Yes — runs on your own GPU

Listed in the directory for discovery. textmodels aren't callable through the chat gateway yet — image and video models can run on your own nodes today.

Run it on your own hardware

Estimated GPU memory for Ornith 1.5 35B A3B (35B parameters), for the weights alone — add room for the context cache.

Q4_K_M
~20.6 GBfits a 24 GB card
Q8_0
~35.3 GBfits a 48 GB card
FP16 / BF16
~65.9 GBfits a 80 GB card

Install the agent on the machine and it dials out to the gateway over a single WebSocket — no port forwarding or inbound firewall rules. Requests for this model go to your node first and fail over to the cloud only when it can't serve.

VRAM calculator →Which GPU do I need? →

/// initialize

Call Ornith 1.5 35B A3B through one OpenAI-compatible endpoint.

Serve it from hardware you own, with cloud failover when your nodes are busy or offline.

Run it on your own hardware

no credit card · 2 nodes free · openai-compatible

Frequently asked questions

Can I run Ornith 1.5 35B A3B on my own hardware?
Yes — Ornith 1.5 35B A3B is an open-weight model you can run on a workstation or on-prem server you own. At Q4_K_M it needs roughly 20.6 GB of GPU memory, plus room for the context cache — it fits a single 24 GB card. Wide Area Intelligence routes requests to your own nodes first and fails over to the cloud only when they can't serve.

More from huggingface

← browse all models