Llama 3.3 70B Instruct

meta-llama/llama-3.3-70b-instructInputOutput

Compare its 13 providers Incident RSSCompare with Llama 3.2 3B Instruct, Llama 3.2 1B Instruct, Llama 3.1 8B Instruct

CompareLlama 3.3 70B Instruct

	State
CoreWeavecoreweave/fp16fp16	Healthy	100%	99.81%	99.70%	99.84%	416ms	2.83s	71 tps	128K	$0.710 / $0.710
Novitanovita/bf16bf16	Healthy	99.78%	93.79%	93.64%	97.48%	1.06s	3.14s	29 tps	12K	$0.135 / $0.400
Groqgroq	Healthy	99.78%	99.81%	99.80%	99.77%	388ms	1.07s	244 tps	131K	$0.590 / $0.790
Parasailparasail/fp8fp8	Healthy	99.43%	99.06%	98.61%	99.35%	560ms	5.78s	51 tps	131K	$0.220 / $0.500
AkashMLakashml/fp8fp8	Healthy	99.35%	99.56%	99.51%	99.57%	1.08s	6.78s	38 tps	131K	$0.200 / $0.520
SambaNovasambanova-turbo	Healthy	98.86%	99.28%	99.15%	98.86%	721ms	3.92s	111 tps	131K	$0.450 / $0.900
DeepInfradeepinfra/turbofp8	Healthy	98.51%	99.25%	96.45%	98.04%	618ms	5.17s	15 tps	131K	$0.100 / $0.320
Cloudflarecloudflare/fp8fp8	Healthy	98.18%	99.19%	98.81%	97.93%	421ms	3.98s	53 tps	24K	$0.293 / $2.25
Crusoecrusoe/bf16bf16	No data	—	—	—	99.87%	—	—	—	131K	$0.250 / $0.750
Googlegoogle-vertex	No data	—	—	—	99.16%	—	—	—	128K	$0.720 / $0.720
Googlegoogle-vertex/us-central1	No data	—	—	—	99.96%	—	—	—	128K	$0.720 / $0.720
Nebiusnebius/fp8fp8	No data	—	—	—	55.97%	—	—	—	131K	$0.130 / $0.400
Togethertogether	No data	—	98.98%	98.37%	97.98%	726ms	4.44s	37 tps	131K	$1.04 / $1.04

CoreWeave100%
Healthy24h 99.81%
7d
99.70%
30d
99.84%
p50
416ms
p99
2.83s
Throughput
71 tps
Context
128K
$/Mtok
$0.710 / $0.710
coreweave/fp16fp16
Novita99.78%
Healthy24h 93.79%
7d
93.64%
30d
97.48%
p50
1.06s
p99
3.14s
Throughput
29 tps
Context
12K
$/Mtok
$0.135 / $0.400
novita/bf16bf16
Groq99.78%
Healthy24h 99.81%
7d
99.80%
30d
99.77%
p50
388ms
p99
1.07s
Throughput
244 tps
Context
131K
$/Mtok
$0.590 / $0.790
groq
Parasail99.43%
Healthy24h 99.06%
7d
98.61%
30d
99.35%
p50
560ms
p99
5.78s
Throughput
51 tps
Context
131K
$/Mtok
$0.220 / $0.500
parasail/fp8fp8
AkashML99.35%
Healthy24h 99.56%
7d
99.51%
30d
99.57%
p50
1.08s
p99
6.78s
Throughput
38 tps
Context
131K
$/Mtok
$0.200 / $0.520
akashml/fp8fp8
SambaNova98.86%
Healthy24h 99.28%
7d
99.15%
30d
98.86%
p50
721ms
p99
3.92s
Throughput
111 tps
Context
131K
$/Mtok
$0.450 / $0.900
sambanova-turbo
DeepInfra98.51%
Healthy24h 99.25%
7d
96.45%
30d
98.04%
p50
618ms
p99
5.17s
Throughput
15 tps
Context
131K
$/Mtok
$0.100 / $0.320
deepinfra/turbofp8
Cloudflare98.18%
Healthy24h 99.19%
7d
98.81%
30d
97.93%
p50
421ms
p99
3.98s
Throughput
53 tps
Context
24K
$/Mtok
$0.293 / $2.25
cloudflare/fp8fp8
Crusoe—
No data24h —
7d
—
30d
99.87%
p50
—
p99
—
Throughput
—
Context
131K
$/Mtok
$0.250 / $0.750
crusoe/bf16bf16
Google—
No data24h —
7d
—
30d
99.16%
p50
—
p99
—
Throughput
—
Context
128K
$/Mtok
$0.720 / $0.720
google-vertex
Google—
No data24h —
7d
—
30d
99.96%
p50
—
p99
—
Throughput
—
Context
128K
$/Mtok
$0.720 / $0.720
google-vertex/us-central1
Nebius—
No data24h —
7d
—
30d
55.97%
p50
—
p99
—
Throughput
—
Context
131K
$/Mtok
$0.130 / $0.400
nebius/fp8fp8
Together—
No data24h 98.98%
7d
98.37%
30d
97.98%
p50
726ms
p99
4.44s
Throughput
37 tps
Context
131K
$/Mtok
$1.04 / $1.04
together

Measured 5m ago. Latency and throughput are OpenRouter's rolling 30-minute windows.

History

2 endpoints have no chartable data in this range.

Availability

Axis starts at 90% so small differences stay visible; it expands to 0 when an endpoint falls below.

Time to first token

Logarithmic axis — the fleet spans two orders of magnitude. P50 is OpenRouter's rolling 30-minute window, averaged over the hour.

Throughput

Median tokens per second.

Daily availability

One row per endpoint · one dot per day · last 90 days.

Jul

Aug

Sep

Oct

google-vertex/us-central1

groq

worst hour ≥ 95%90–95%< 90%no data

Colour by each endpoint's worst hour of each UTC day · 13 endpoints · 47 days with data, 103 endpoint-days below 90%.

Price changes

Llama 3.3 70B Instruct AkashMLakashml/fp8$0.130 → $0.200 / $0.400 → $0.520cache read — → $0.1002026-08-19 09:50 UTC