WIDEAREAINTELLIGENCE
← model directory

qwen

Qwen: Qwen2.5 7B Instruct

qwen/qwen-2.5-7b-instruct

↓ runs free on your own hardware⚙ tool calling

Qwen2.5 7B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and...

specs & pricing
Type
text
Provider
qwen
Model ID
qwen/qwen-2.5-7b-instruct
Capabilities
tools
Context window
33K tokens
Self-hostable
Yes — runs on your own GPU
Input price
$0.11 / 1M tokens
Output price
$0.22 / 1M tokens

Cloud price is billed from prepaid credits when a request fails over to the cloud. Open-weight models run free on GPUs you own — the gateway routes to your nodes first.

What it costs to run

cloud · 1M in + 1M out

$0.33

$0.11 for a million input tokens plus $0.22 for a million output tokens, billed from credits only when a request fails over to the cloud.

your hardware

$0 / token

Served from a workstation or on-prem server you own, there is no per-token fee — the marginal cost is power.

AI cost calculator →GPU power cost →

Run it on your own hardware

Estimated GPU memory for Qwen: Qwen2.5 7B Instruct (7.6B parameters), including the KV cache for a 8,192-token context.

Q4_K_M
~5.5 GBfits a 8 GB card
Q8_0
~8.7 GBfits a 12 GB card
FP16 / BF16
~15.4 GBfits a 16 GB card

Install the agent on the machine and it dials out to the gateway over a single WebSocket — no port forwarding or inbound firewall rules. Requests for this model go to your node first and fail over to the cloud only when it can't serve.

VRAM calculator →Which GPU do I need? →

/// initialize

Call Qwen: Qwen2.5 7B Instruct through one OpenAI-compatible endpoint.

Serve it from hardware you own, with cloud failover when your nodes are busy or offline.

Run it on your own hardwareTry it in chat

no credit card · 2 nodes free · openai-compatible

Frequently asked questions

What is the context window of Qwen: Qwen2.5 7B Instruct?
Qwen: Qwen2.5 7B Instruct accepts up to 32,768 tokens (33K) of context per request.
How much does Qwen: Qwen2.5 7B Instruct cost per million tokens?
Through Wide Area Intelligence, Qwen: Qwen2.5 7B Instruct costs $0.11 per 1M input tokens and $0.22 per 1M output tokens when served from the cloud, billed from prepaid credits. A workload of 1M input plus 1M output tokens costs $0.33.
Can I run Qwen: Qwen2.5 7B Instruct on my own hardware?
Yes — Qwen: Qwen2.5 7B Instruct is an open-weight model you can run on a workstation or on-prem server you own. At Q4_K_M it needs roughly 5.5 GB of GPU memory with an 8,192-token context — it fits a single 8 GB card. Wide Area Intelligence routes requests to your own nodes first and fails over to the cloud only when they can't serve.

More from qwen

← browse all models