← model directory

cloudflare

meta/llama-3.2-1b-instruct

cloudflare/meta/llama-3.2-1b-instruct

↓ runs free on your own hardware⚙ tool calling

The Llama 3.2 instruction-tuned text only models are optimized for multilingual dialogue use cases, including agentic retrieval and summarization tasks.

specs & pricing
Type
text
Provider
cloudflare
Model ID
cloudflare/meta/llama-3.2-1b-instruct
Capabilities
tools
Context window
60K tokens
Self-hostable
Yes — runs on your own GPU
Input price
$0.030 / 1M tokens
Output price
$0.22 / 1M tokens

Cloud price is billed from prepaid credits when a request fails over to the cloud. Open-weight models run free on GPUs you own — the gateway routes to your nodes first.

What it costs to run

cloud · 1M in + 1M out

$0.25

$0.030 for a million input tokens plus $0.22 for a million output tokens, billed from credits only when a request fails over to the cloud.

your hardware

$0 / token

Served from a workstation or on-prem server you own, there is no per-token fee — the marginal cost is power.

Run it on your own hardware

Estimated GPU memory for meta/llama-3.2-1b-instruct (1.2B parameters), including the KV cache for a 8,192-token context.

Q4_K_M
~1.7 GBfits a 8 GB card
Q8_0
~2.2 GBfits a 8 GB card
FP16 / BF16
~3.3 GBfits a 8 GB card

Install the agent on the machine and it dials out to the gateway over a single WebSocket — no port forwarding or inbound firewall rules. Requests for this model go to your node first and fail over to the cloud only when it can't serve.

/// initialize

Call meta/llama-3.2-1b-instruct through one OpenAI-compatible endpoint.

Serve it from hardware you own, with cloud failover when your nodes are busy or offline.

no credit card · 2 nodes free · openai-compatible

Frequently asked questions

What is the context window of meta/llama-3.2-1b-instruct?
meta/llama-3.2-1b-instruct accepts up to 60,000 tokens (60K) of context per request.
How much does meta/llama-3.2-1b-instruct cost per million tokens?
Through Wide Area Intelligence, meta/llama-3.2-1b-instruct costs $0.030 per 1M input tokens and $0.22 per 1M output tokens when served from the cloud, billed from prepaid credits. A workload of 1M input plus 1M output tokens costs $0.25.
Can I run meta/llama-3.2-1b-instruct on my own hardware?
Yes — meta/llama-3.2-1b-instruct is an open-weight model you can run on a workstation or on-prem server you own. At Q4_K_M it needs roughly 1.7 GB of GPU memory with an 8,192-token context — it fits a single 8 GB card. Wide Area Intelligence routes requests to your own nodes first and fails over to the cloud only when they can't serve.

More from cloudflare

← browse all models