Llama 3.3 70B Instruct
meta-llama/llama-3.3-70b-instruct
Compare with Llama 3.2 3B Instruct, Llama 3.2 1B Instruct, Llama 3.1 8B Instruct
CompareLlama 3.3 70B Instruct
| Provider | State | Uptime 5m | 24h | p50 latency | p99 | Throughput | Context | $/Mtok |
|---|---|---|---|---|---|---|---|---|
CoreWeavecoreweave/fp16fp16 | Healthy | 100% | 99.10% | 167ms | 1.46s | 47 tps | 128K | $0.710 / $0.710 |
Googlegoogle-vertex | Healthy | 100% | 97.24% | 285ms | 1.70s | 80 tps | 128K | $0.720 / $0.720 |
Googlegoogle-vertex/us-central1 | Healthy | 100% | 99.98% | 293ms | 1.81s | 85 tps | 128K | $0.720 / $0.720 |
Groqgroq | Healthy | 100% | 99.89% | 211ms | 662ms | 17 tps | 131K | $0.590 / $0.790 |
Crusoecrusoe/bf16bf16 | Healthy | 99.87% | 98.37% | 420ms | 5.13s | 34 tps | 131K | $0.250 / $0.750 |
Parasailparasail/fp8fp8 | Healthy | 99.53% | 97.36% | 733ms | 6.96s | 34 tps | 131K | $0.220 / $0.500 |
Novitanovita/bf16bf16 | Healthy | 98.98% | 96.11% | 888ms | 4.30s | 23 tps | 12K | $0.135 / $0.400 |
AkashMLakashml/fp8fp8 | Degraded | 98.53% | 98.03% | 1.01s | 7.88s | 17 tps | 131K | $0.200 / $0.520 |
DeepInfradeepinfra/turbofp8 | Healthy | 97.80% | 96.92% | 574ms | 6.37s | 12 tps | 131K | $0.100 / $0.320 |
Cloudflarecloudflare/fp8fp8 | Degraded | 94.38% | 90.67% | 742ms | 7.01s | 29 tps | 24K | $0.293 / $2.25 |
Togethertogether | Down | 88.64% | 98.44% | 802ms | 6.12s | 29 tps | 131K | $1.04 / $1.04 |
SambaNovasambanova-turbo | Down | 88.44% | 97.34% | 746ms | 6.47s | 97 tps | 131K | $0.450 / $0.900 |
Nebiusnebius/fp8fp8 | Down | — | 45.08% | 1.06s | 18.6s | 9.0 tps | 131K | $0.130 / $0.400 |
- CoreWeave100%Healthy24h 99.10%
- p50
- 167ms
- p99
- 1.46s
- Throughput
- 47 tps
- Context
- 128K
- $/Mtok
- $0.710 / $0.710
coreweave/fp16fp16 - Google100%Healthy24h 97.24%
- p50
- 285ms
- p99
- 1.70s
- Throughput
- 80 tps
- Context
- 128K
- $/Mtok
- $0.720 / $0.720
google-vertex - Google100%Healthy24h 99.98%
- p50
- 293ms
- p99
- 1.81s
- Throughput
- 85 tps
- Context
- 128K
- $/Mtok
- $0.720 / $0.720
google-vertex/us-central1 - Groq100%Healthy24h 99.89%
- p50
- 211ms
- p99
- 662ms
- Throughput
- 17 tps
- Context
- 131K
- $/Mtok
- $0.590 / $0.790
groq - Crusoe99.87%Healthy24h 98.37%
- p50
- 420ms
- p99
- 5.13s
- Throughput
- 34 tps
- Context
- 131K
- $/Mtok
- $0.250 / $0.750
crusoe/bf16bf16 - Parasail99.53%Healthy24h 97.36%
- p50
- 733ms
- p99
- 6.96s
- Throughput
- 34 tps
- Context
- 131K
- $/Mtok
- $0.220 / $0.500
parasail/fp8fp8 - Novita98.98%Healthy24h 96.11%
- p50
- 888ms
- p99
- 4.30s
- Throughput
- 23 tps
- Context
- 12K
- $/Mtok
- $0.135 / $0.400
novita/bf16bf16 - AkashML98.53%Degraded24h 98.03%
- p50
- 1.01s
- p99
- 7.88s
- Throughput
- 17 tps
- Context
- 131K
- $/Mtok
- $0.200 / $0.520
akashml/fp8fp8 - DeepInfra97.80%Healthy24h 96.92%
- p50
- 574ms
- p99
- 6.37s
- Throughput
- 12 tps
- Context
- 131K
- $/Mtok
- $0.100 / $0.320
deepinfra/turbofp8 - Cloudflare94.38%Degraded24h 90.67%
- p50
- 742ms
- p99
- 7.01s
- Throughput
- 29 tps
- Context
- 24K
- $/Mtok
- $0.293 / $2.25
cloudflare/fp8fp8 - Together88.64%Down24h 98.44%
- p50
- 802ms
- p99
- 6.12s
- Throughput
- 29 tps
- Context
- 131K
- $/Mtok
- $1.04 / $1.04
together - SambaNova88.44%Down24h 97.34%
- p50
- 746ms
- p99
- 6.47s
- Throughput
- 97 tps
- Context
- 131K
- $/Mtok
- $0.450 / $0.900
sambanova-turbo - Nebius—Down24h 45.08%
- p50
- 1.06s
- p99
- 18.6s
- Throughput
- 9.0 tps
- Context
- 131K
- $/Mtok
- $0.130 / $0.400
nebius/fp8fp8
Measured 42s ago. Latency and throughput are OpenRouter's rolling 30-minute windows.
History
Availability
Axis starts at 90% so small differences stay visible; it expands to 0 when an endpoint falls below.
Time to first token
Logarithmic axis — the fleet spans two orders of magnitude. p50 and p99 are OpenRouter's rolling 30-minute windows, averaged over the hour.
Throughput
Median tokens per second.