Llama 3.3 70B Instruct
meta-llama/llama-3.3-70b-instruct
Compare with Llama 3.2 3B Instruct, Llama 3.2 1B Instruct, Llama 3.1 8B Instruct
CompareLlama 3.3 70B Instruct
| Provider | State | Uptime 5m | 24h | p50 latency | p99 | Throughput | Context | $/Mtok |
|---|---|---|---|---|---|---|---|---|
Googlegoogle-vertex/us-central1 | Healthy | 100% | 99.98% | 309ms | 2.47s | 77 tps | 128K | $0.720 / $0.720 |
Groqgroq | Healthy | 100% | 99.89% | 216ms | 679ms | 17 tps | 131K | $0.590 / $0.790 |
AkashMLakashml/fp8fp8 | Healthy | 99.70% | 97.99% | 999ms | 6.59s | 17 tps | 131K | $0.200 / $0.520 |
CoreWeavecoreweave/fp16fp16 | Healthy | 99.13% | 99.13% | 142ms | 1.10s | 35 tps | 128K | $0.710 / $0.710 |
Parasailparasail/fp8fp8 | Healthy | 98.51% | 97.37% | 741ms | 6.78s | 29 tps | 131K | $0.220 / $0.500 |
Googlegoogle-vertex | Healthy | 98.21% | 97.23% | 310ms | 2.21s | 39 tps | 128K | $0.720 / $0.720 |
DeepInfradeepinfra/turbofp8 | Healthy | 97.39% | 96.94% | 525ms | 8.00s | 12 tps | 131K | $0.100 / $0.320 |
Cloudflarecloudflare/fp8fp8 | Healthy | 96.55% | 90.64% | 795ms | 5.97s | 26 tps | 24K | $0.293 / $2.25 |
Crusoecrusoe/bf16bf16 | Degraded | 96.43% | 98.57% | 378ms | 4.14s | 46 tps | 131K | $0.250 / $0.750 |
SambaNovasambanova-turbo | Degraded | 92.38% | 97.64% | 737ms | 6.23s | 83 tps | 131K | $0.450 / $0.900 |
Nebiusnebius/fp8fp8 | Down | — | 45.07% | 2.00s | 24.3s | 6.0 tps | 131K | $0.130 / $0.400 |
Novitanovita/bf16bf16 | Down | — | 95.14% | 906ms | 5.29s | 20 tps | 12K | $0.135 / $0.400 |
Togethertogether | No data | — | 98.46% | 793ms | 4.87s | 35 tps | 131K | $1.04 / $1.04 |
- Google100%Healthy24h 99.98%
- p50
- 309ms
- p99
- 2.47s
- Throughput
- 77 tps
- Context
- 128K
- $/Mtok
- $0.720 / $0.720
google-vertex/us-central1 - Groq100%Healthy24h 99.89%
- p50
- 216ms
- p99
- 679ms
- Throughput
- 17 tps
- Context
- 131K
- $/Mtok
- $0.590 / $0.790
groq - AkashML99.70%Healthy24h 97.99%
- p50
- 999ms
- p99
- 6.59s
- Throughput
- 17 tps
- Context
- 131K
- $/Mtok
- $0.200 / $0.520
akashml/fp8fp8 - CoreWeave99.13%Healthy24h 99.13%
- p50
- 142ms
- p99
- 1.10s
- Throughput
- 35 tps
- Context
- 128K
- $/Mtok
- $0.710 / $0.710
coreweave/fp16fp16 - Parasail98.51%Healthy24h 97.37%
- p50
- 741ms
- p99
- 6.78s
- Throughput
- 29 tps
- Context
- 131K
- $/Mtok
- $0.220 / $0.500
parasail/fp8fp8 - Google98.21%Healthy24h 97.23%
- p50
- 310ms
- p99
- 2.21s
- Throughput
- 39 tps
- Context
- 128K
- $/Mtok
- $0.720 / $0.720
google-vertex - DeepInfra97.39%Healthy24h 96.94%
- p50
- 525ms
- p99
- 8.00s
- Throughput
- 12 tps
- Context
- 131K
- $/Mtok
- $0.100 / $0.320
deepinfra/turbofp8 - Cloudflare96.55%Healthy24h 90.64%
- p50
- 795ms
- p99
- 5.97s
- Throughput
- 26 tps
- Context
- 24K
- $/Mtok
- $0.293 / $2.25
cloudflare/fp8fp8 - Crusoe96.43%Degraded24h 98.57%
- p50
- 378ms
- p99
- 4.14s
- Throughput
- 46 tps
- Context
- 131K
- $/Mtok
- $0.250 / $0.750
crusoe/bf16bf16 - SambaNova92.38%Degraded24h 97.64%
- p50
- 737ms
- p99
- 6.23s
- Throughput
- 83 tps
- Context
- 131K
- $/Mtok
- $0.450 / $0.900
sambanova-turbo - Nebius—Down24h 45.07%
- p50
- 2.00s
- p99
- 24.3s
- Throughput
- 6.0 tps
- Context
- 131K
- $/Mtok
- $0.130 / $0.400
nebius/fp8fp8 - Novita—Down24h 95.14%
- p50
- 906ms
- p99
- 5.29s
- Throughput
- 20 tps
- Context
- 12K
- $/Mtok
- $0.135 / $0.400
novita/bf16bf16 - Together—No data24h 98.46%
- p50
- 793ms
- p99
- 4.87s
- Throughput
- 35 tps
- Context
- 131K
- $/Mtok
- $1.04 / $1.04
together
Measured 4m ago. Latency and throughput are OpenRouter's rolling 30-minute windows.
History
1 endpoint reporting no data is omitted from the charts.
Availability
Axis starts at 90% so small differences stay visible; it expands to 0 when an endpoint falls below.
Time to first token
Logarithmic axis — the fleet spans two orders of magnitude. p50 and p99 are OpenRouter's rolling 30-minute windows.
Throughput
Median tokens per second.