Llama 3.3 70B Instruct vs Llama 3.1 8B Instruct
One line per model: the best value available from any of its providers at each point, which is what a caller routing to the healthy endpoint would see.
CompareLlama 3.3 70B InstructLlama 3.1 8B Instruct
| Model | Providers | Best uptime | Fastest p50 | Best p99 | Throughput | Context | Cheapest $/Mtok |
|---|---|---|---|---|---|---|---|
| Llama 3.3 70B Instruct | 8/13 | 100% CoreWeave | 167ms CoreWeave | 662ms Groq | 97 tps SambaNova | 131K | $0.100 / $0.320 DeepInfra |
| Llama 3.1 8B Instruct | 5/5 | 100% Cloudflare | 114ms CoreWeave | 480ms CoreWeave | 116 tps CoreWeave | 131K | $0.020 / $0.040 DeepInfra |
Measured 2m ago. Each figure is the best available across that model's providers.
History
Availability
Best uptime available from any provider. Axis starts at 90%; it expands to 0 when a model falls below.
Time to first token
Fastest p50 available from any provider. Logarithmic axis.
Throughput
Best median tokens per second available.