Llama 3.3 70B Instruct vs Llama 3.1 8B Instruct
One line per model: the best value available from any of its providers at each point, which is what a caller routing to the healthy endpoint would see.
CompareLlama 3.3 70B InstructLlama 3.1 8B Instruct
| Llama 3.3 70B Instruct | 7/14 | 100% | 99.80% | 99.84% | 350ms | 1.19s | 240 tps | 131K | $0.100 / $0.320 |
| Llama 3.1 8B Instruct | 5/5 | 100% | 100% | 99.96% | 132ms | 1.04s | 358 tps | 131K | $0.020 / $0.040 |
Measured 3m ago. Each figure is the best available across that model's providers.
History
Availability
Best uptime available from any provider. Axis starts at 90%; it expands to 0 when a model falls below.
Time to first token
Fastest P50 available from any provider. Logarithmic axis.
Throughput
Best median tokens per second available.