cloudflare
meta/llama-3.2-1b-instruct
cloudflare/meta/llama-3.2-1b-instruct
The Llama 3.2 instruction-tuned text only models are optimized for multilingual dialogue use cases, including agentic retrieval and summarization tasks.
- Type
- text
- Provider
- cloudflare
- Model ID
- cloudflare/meta/llama-3.2-1b-instruct
- Capabilities
- tools
- Context window
- 60K tokens
- Self-hostable
- Yes — runs on your own GPU
- Input price
- $0.030 / 1M tokens
- Output price
- $0.22 / 1M tokens
Cloud price is billed from prepaid credits when a request fails over to the cloud. Open-weight models run free on GPUs you own — the gateway routes to your nodes first.
What it costs to run
cloud · 1M in + 1M out
$0.25
$0.030 for a million input tokens plus $0.22 for a million output tokens, billed from credits only when a request fails over to the cloud.
your hardware
$0 / token
Served from a workstation or on-prem server you own, there is no per-token fee — the marginal cost is power.
Run it on your own hardware
Estimated GPU memory for meta/llama-3.2-1b-instruct (1.2B parameters), including the KV cache for a 8,192-token context.
- Q4_K_M
- ~1.7 GBfits a 8 GB card
- Q8_0
- ~2.2 GBfits a 8 GB card
- FP16 / BF16
- ~3.3 GBfits a 8 GB card
Install the agent on the machine and it dials out to the gateway over a single WebSocket — no port forwarding or inbound firewall rules. Requests for this model go to your node first and fail over to the cloud only when it can't serve.
/// initialize
Call meta/llama-3.2-1b-instruct through one OpenAI-compatible endpoint.
Serve it from hardware you own, with cloud failover when your nodes are busy or offline.
no credit card · 2 nodes free · openai-compatible
Frequently asked questions
- What is the context window of meta/llama-3.2-1b-instruct?
- meta/llama-3.2-1b-instruct accepts up to 60,000 tokens (60K) of context per request.
- How much does meta/llama-3.2-1b-instruct cost per million tokens?
- Through Wide Area Intelligence, meta/llama-3.2-1b-instruct costs $0.030 per 1M input tokens and $0.22 per 1M output tokens when served from the cloud, billed from prepaid credits. A workload of 1M input plus 1M output tokens costs $0.25.
- Can I run meta/llama-3.2-1b-instruct on my own hardware?
- Yes — meta/llama-3.2-1b-instruct is an open-weight model you can run on a workstation or on-prem server you own. At Q4_K_M it needs roughly 1.7 GB of GPU memory with an 8,192-token context — it fits a single 8 GB card. Wide Area Intelligence routes requests to your own nodes first and fails over to the cloud only when they can't serve.
More from cloudflare
- ai4bharat/indictrans2-en-indic-1Bcloudflare/ai4bharat/indictrans2-en-indic-1B
- aisingapore/gemma-sea-lion-v4-27b-itcloudflare/aisingapore/gemma-sea-lion-v4-27b-it
- baai/bge-base-en-v1.5cloudflare/baai/bge-base-en-v1.5
- baai/bge-large-en-v1.5cloudflare/baai/bge-large-en-v1.5
- baai/bge-m3cloudflare/baai/bge-m3
- baai/bge-reranker-basecloudflare/baai/bge-reranker-base
- baai/bge-small-en-v1.5cloudflare/baai/bge-small-en-v1.5
- black-forest-labs/flux-1-schnellcloudflare/black-forest-labs/flux-1-schnell