Llama 3.1 8B pricing, context window and limits
Llama 3.1 8B costs $0.05 per million input tokens and $0.08 per million output tokens at Groq list price. It accepts up to 131,072 tokens of context and returns up to 131,072 tokens.
- Model id
groq/llama-3.1-8b-instant - Snapshot
What does Llama 3.1 8B cost?
| Input | $0.05 |
|---|---|
| Output | $0.08 |
| Cached input (read) | — |
| Cache write | — |
US dollars per million tokens. A dash means no price is published.
How much can Llama 3.1 8B read and write?
| Context window | 131,072 |
|---|---|
| Max output | 131,072 |
What can Llama 3.1 8B do?
| Vision (image input) | No |
|---|---|
| Tool calling | Yes |
| Structured output | No |
| Reasoning | No |
| Input | text |
| Output | text |
What does a request to Llama 3.1 8B cost?
| A typical request: 1,000 tokens in, 500 out | under $0.0001 |
|---|---|
| A long request: 10,000 tokens in, 1,000 out | $0.00058 |
| 1,000 typical requests | $0.09 |
| 1 million tokens in and 1 million out | $0.13 |
Among 10 Groq models with a published price, Llama 3.1 8B is the 4th cheapest by input price. Its context window is the largest of 14. List prices only; discounts, batch prices and prices above 200K tokens are not shown.
How do I call Llama 3.1 8B through DVARA?
Configure the groq provider in the DVARA LLM Gateway and send the model id groq/llama-3.1-8b-instant. DVARA, the AI governance platform, applies your policies, audit and cost attribution to the call. See LLM cost attribution and budgets.
In DVARA, if you haven't set your own price for a model, its calls are costed at the price in the catalogue that ships with your DVARA version. A price you set in Flightdeck always wins. You can switch catalogue prices off. Then a model with no price you set is counted as costing nothing. Every cost record says which price it used.
Which other Groq models are there?
- Llama 3.3 70B$0.59 in · $0.79 out · 131K context
- Llama Prompt Guard 2 22M$0.03 in · $0.03 out · 512 context
- Compound Mini— in · — out · 131K context
- Compound— in · — out · 131K context
- Canopy Labs Orpheus V1 English— in · — out · 4K context
- Prompt Guard 2 86M$0.04 in · $0.04 out · 512 context
- Canopy Labs Orpheus Arabic Saudi— in · — out · 4K context
- GPT OSS 120B$0.15 in · $0.6 out · 131K context
- ALLaM-2-7b$0 in · $0 out · 4K context
- GPT OSS 20B$0.075 in · $0.3 out · 131K context
- Safety GPT OSS 20B$0.075 in · $0.3 out · 131K context
- Qwen3.6 27B$0.6 in · $3 out · 131K context
Which models from other providers are similar to Llama 3.1 8B?
These are the closest in context window and input price, one per provider.
- NVIDIA Nemotron Nano 9B v2Amazon Bedrock · $0.06 in · $0.23 out · 131K context
- Ministral 3B (latest)Mistral AI · $0.04 in · $0.04 out · 128K context
- Command R7BCohere · $0.0375 in · $0.15 out · 128K context
- Qwen2.5 7B InstructAlibaba Qwen · $0.072 in · $0.144 out · 131K context
- GLM-4.7-FlashXZhipu GLM · $0.07 in · $0.4 out · 200K context