Llama 3.3 70B Instruct vs Llama 3.2 1B Instruct
One line per model: the best value available from any of its providers at each point, which is what a caller routing to the healthy endpoint would see.
CompareLlama 3.3 70B InstructLlama 3.2 1B Instruct
| Llama 3.3 70B Instruct | 6/14 | 100% | 99.80% | 99.84% | 304ms | 973ms | 251 tps | 131K | $0.100 / $0.320 |
| Llama 3.2 1B Instruct | 1/1 | 100% | 100% | 100% | 291ms | 913ms | 168 tps | 60K | $0.027 / $0.201 |
Measured 3m ago. Each figure is the best available across that model's providers.
History
Availability
Best uptime available from any provider. Axis starts at 90%; it expands to 0 when a model falls below.
Time to first token
Fastest P50 available from any provider. Logarithmic axis.
Throughput
Best median tokens per second available.