openai
OpenAI: GPT-3.5 Turbo Instruct
openai/gpt-3.5-turbo-instruct
This model is a variant of GPT-3.5 Turbo tuned for instructional prompts and omitting chat-related optimizations. Training data: up to Sep 2021.
- Type
- text
- Provider
- openai
- Model ID
- openai/gpt-3.5-turbo-instruct
- Context window
- 4K tokens
- Input price
- $1.65 / 1M tokens
- Output price
- $2.20 / 1M tokens
Cloud price is billed from prepaid credits when a request fails over to the cloud. Open-weight models run free on GPUs you own — the gateway routes to your nodes first.
What it costs to run
cloud · 1M in + 1M out
$3.85
$1.65 for a million input tokens plus $2.20 for a million output tokens, billed from credits only when a request fails over to the cloud.
your hardware
cloud only
OpenAI: GPT-3.5 Turbo Instruct is a hosted model, so it is always served from the cloud. Route easy traffic to an open model on your own hardware and keep this one for the requests that need it.
/// initialize
Call OpenAI: GPT-3.5 Turbo Instruct through one OpenAI-compatible endpoint.
Mix it with open models on your own hardware — the gateway routes each request to the cheapest place that can serve it.
no credit card · 2 nodes free · openai-compatible
Frequently asked questions
- What is the context window of OpenAI: GPT-3.5 Turbo Instruct?
- OpenAI: GPT-3.5 Turbo Instruct accepts up to 4,095 tokens (4K) of context per request.
- How much does OpenAI: GPT-3.5 Turbo Instruct cost per million tokens?
- Through Wide Area Intelligence, OpenAI: GPT-3.5 Turbo Instruct costs $1.65 per 1M input tokens and $2.20 per 1M output tokens when served from the cloud, billed from prepaid credits. A workload of 1M input plus 1M output tokens costs $3.85.