Llama 3.3 70B Instruct
meta-llama/llama-3.3-70b-instruct
Compare with Llama 3.2 3B Instruct, Llama 3.2 1B Instruct, Llama 3.1 8B Instruct
CompareLlama 3.3 70B Instruct
| Provider | State | Uptime 5m | 24h | p50 latency | p99 | Throughput | Context | $/Mtok |
|---|---|---|---|---|---|---|---|---|
Cloudflarecloudflare/fp8fp8 | Degraded | 100% | 91.30% | 726ms | 5.33s | 32 tps | 24K | $0.293 / $2.25 |
CoreWeavecoreweave/fp16fp16 | Healthy | 100% | 99.11% | 353ms | 2.04s | 55 tps | 128K | $0.710 / $0.710 |
Crusoecrusoe/bf16bf16 | Healthy | 100% | 97.99% | 355ms | 2.72s | 46 tps | 131K | $0.250 / $0.750 |
Googlegoogle-vertex/us-central1 | Healthy | 100% | 100% | 439ms | 1.70s | 62 tps | 128K | $0.720 / $0.720 |
Groqgroq | Healthy | 100% | 99.89% | 259ms | 785ms | 111 tps | 131K | $0.590 / $0.790 |
AkashMLakashml/fp8fp8 | Healthy | 99.62% | 98.14% | 826ms | 6.61s | 20 tps | 131K | $0.200 / $0.520 |
Novitanovita/bf16bf16 | Degraded | 98.08% | 95.86% | 736ms | 4.98s | 26 tps | 12K | $0.135 / $0.400 |
Parasailparasail/fp8fp8 | Healthy | 97.69% | 97.72% | 743ms | 7.96s | 28 tps | 131K | $0.220 / $0.500 |
DeepInfradeepinfra/turbofp8 | Healthy | 97.50% | 96.89% | 589ms | 7.93s | 14 tps | 131K | $0.100 / $0.320 |
SambaNovasambanova-turbo | Degraded | 92.23% | 96.10% | 1.18s | 7.41s | 95 tps | 131K | $0.450 / $0.900 |
Nebiusnebius/fp8fp8 | Down | 50.00% | 44.70% | 1.79s | 31.0s | 6.0 tps | 131K | $0.130 / $0.400 |
Googlegoogle-vertex | No data | — | 97.98% | 291ms | 1.88s | 81 tps | 128K | $0.720 / $0.720 |
Togethertogether | No data | — | 98.49% | 868ms | 6.11s | 15 tps | 131K | $1.04 / $1.04 |
- Cloudflare100%Degraded24h 91.30%
- p50
- 726ms
- p99
- 5.33s
- Throughput
- 32 tps
- Context
- 24K
- $/Mtok
- $0.293 / $2.25
cloudflare/fp8fp8 - CoreWeave100%Healthy24h 99.11%
- p50
- 353ms
- p99
- 2.04s
- Throughput
- 55 tps
- Context
- 128K
- $/Mtok
- $0.710 / $0.710
coreweave/fp16fp16 - Crusoe100%Healthy24h 97.99%
- p50
- 355ms
- p99
- 2.72s
- Throughput
- 46 tps
- Context
- 131K
- $/Mtok
- $0.250 / $0.750
crusoe/bf16bf16 - Google100%Healthy24h 100%
- p50
- 439ms
- p99
- 1.70s
- Throughput
- 62 tps
- Context
- 128K
- $/Mtok
- $0.720 / $0.720
google-vertex/us-central1 - Groq100%Healthy24h 99.89%
- p50
- 259ms
- p99
- 785ms
- Throughput
- 111 tps
- Context
- 131K
- $/Mtok
- $0.590 / $0.790
groq - AkashML99.62%Healthy24h 98.14%
- p50
- 826ms
- p99
- 6.61s
- Throughput
- 20 tps
- Context
- 131K
- $/Mtok
- $0.200 / $0.520
akashml/fp8fp8 - Novita98.08%Degraded24h 95.86%
- p50
- 736ms
- p99
- 4.98s
- Throughput
- 26 tps
- Context
- 12K
- $/Mtok
- $0.135 / $0.400
novita/bf16bf16 - Parasail97.69%Healthy24h 97.72%
- p50
- 743ms
- p99
- 7.96s
- Throughput
- 28 tps
- Context
- 131K
- $/Mtok
- $0.220 / $0.500
parasail/fp8fp8 - DeepInfra97.50%Healthy24h 96.89%
- p50
- 589ms
- p99
- 7.93s
- Throughput
- 14 tps
- Context
- 131K
- $/Mtok
- $0.100 / $0.320
deepinfra/turbofp8 - SambaNova92.23%Degraded24h 96.10%
- p50
- 1.18s
- p99
- 7.41s
- Throughput
- 95 tps
- Context
- 131K
- $/Mtok
- $0.450 / $0.900
sambanova-turbo - Nebius50.00%Down24h 44.70%
- p50
- 1.79s
- p99
- 31.0s
- Throughput
- 6.0 tps
- Context
- 131K
- $/Mtok
- $0.130 / $0.400
nebius/fp8fp8 - Google—No data24h 97.98%
- p50
- 291ms
- p99
- 1.88s
- Throughput
- 81 tps
- Context
- 128K
- $/Mtok
- $0.720 / $0.720
google-vertex - Together—No data24h 98.49%
- p50
- 868ms
- p99
- 6.11s
- Throughput
- 15 tps
- Context
- 131K
- $/Mtok
- $1.04 / $1.04
together
Measured 3m ago. Latency and throughput are OpenRouter's rolling 30-minute windows.
History
2 endpoints reporting no data are omitted from the charts.
Availability
Axis starts at 90% so small differences stay visible; it expands to 0 when an endpoint falls below.
Time to first token
Logarithmic axis — the fleet spans two orders of magnitude. p50 and p99 are OpenRouter's rolling 30-minute windows.
Throughput
Median tokens per second.