gpt-oss-120b

openai/gpt-oss-120b

Compare with GPT Audio, GPT Audio Mini, GPT Chat Latest

Comparegpt-oss-120b

	State
Amazon Bedrockamazon-bedrock	Healthy	100%	99.08%	99.26%	99.26%	432ms	2.33s	241 tps	131K	$0.150 / $0.600
BaseTenbaseten/fp4fp4	Healthy	100%	99.59%	99.15%	99.15%	219ms	679ms	287 tps	128K	$0.100 / $0.500
Cerebrascerebras/fp16fp16	Healthy	100%	99.99%	99.99%	99.99%	168ms	1.53s	989 tps	131K	$0.350 / $0.750
DeepInfradeepinfra/bf16bf16	Degraded	100%	97.44%	98.24%	98.24%	2.21s	11.7s	27 tps	131K	$0.037 / $0.170
DigitalOceandigitalocean	Healthy	100%	99.90%	99.90%	99.90%	844ms	4.73s	25 tps	128K	$0.055 / $0.385
Nebiusnebius/fp4fp4	Healthy	100%	99.52%	98.71%	98.71%	205ms	1.88s	300 tps	131K	$0.150 / $0.600
Parasailparasail/fp4fp4	Healthy	100%	99.65%	99.82%	99.82%	301ms	1.00s	125 tps	131K	$0.100 / $0.750
Phalaphala	Healthy	100%	97.30%	97.37%	97.37%	955ms	5.27s	113 tps	131K	$0.150 / $0.600
Togethertogether	Healthy	100%	96.31%	97.40%	97.40%	412ms	2.62s	119 tps	131K	$0.150 / $0.600
Groqgroq	Healthy	99.96%	99.95%	99.93%	99.93%	225ms	2.34s	361 tps	131K	$0.150 / $0.600
SiliconFlowsiliconflow/fp8fp8	Degraded	99.72%	85.79%	92.40%	92.40%	1.39s	16.3s	12 tps	131K	$0.050 / $0.450
Mancer 2mancer/fp8fp8	Healthy	99.32%	99.46%	99.79%	99.79%	635ms	4.54s	101 tps	131K	$0.085 / $0.500
DeepInfradeepinfra/turbobf16	Healthy	99.15%	99.74%	98.92%	98.92%	422ms	1.29s	134 tps	131K	$0.150 / $0.600
CoreWeavecoreweave/fp4fp4	Healthy	98.92%	94.85%	95.85%	95.85%	389ms	9.55s	34 tps	131K	$0.030 / $0.170
AkashMLakashml/bf16bf16	Healthy	98.68%	99.48%	99.73%	99.73%	1.33s	11.6s	67 tps	131K	$0.037 / $0.490
Maramara	Degraded	92.54%	97.73%	95.27%	95.27%	1.36s	11.9s	168 tps	131K	$0.150 / $0.750
SambaNovasambanova	Down	89.36%	88.25%	86.04%	86.04%	887ms	9.93s	273 tps	131K	$0.140 / $0.950
Googlegoogle-vertex/global	Down	74.55%	90.02%	89.94%	89.94%	432ms	8.41s	114 tps	131K	$0.090 / $0.360
Amazon Bedrockamazon-bedrock/eu-west-1	No data	—	—	100%	100%	—	—	—	131K	$0.150 / $0.600
Novitanovita/fp4fp4	Down	—	92.28%	94.56%	94.56%	627ms	32.5s	45 tps	131K	$0.050 / $0.250

Amazon Bedrock100%
Healthy24h 99.08%
7d
99.26%
30d
99.26%
p50
432ms
p99
2.33s
Throughput
241 tps
Context
131K
$/Mtok
$0.150 / $0.600
amazon-bedrock
BaseTen100%
Healthy24h 99.59%
7d
99.15%
30d
99.15%
p50
219ms
p99
679ms
Throughput
287 tps
Context
128K
$/Mtok
$0.100 / $0.500
baseten/fp4fp4
Cerebras100%
Healthy24h 99.99%
7d
99.99%
30d
99.99%
p50
168ms
p99
1.53s
Throughput
989 tps
Context
131K
$/Mtok
$0.350 / $0.750
cerebras/fp16fp16
DeepInfra100%
Degraded24h 97.44%
7d
98.24%
30d
98.24%
p50
2.21s
p99
11.7s
Throughput
27 tps
Context
131K
$/Mtok
$0.037 / $0.170
deepinfra/bf16bf16
DigitalOcean100%
Healthy24h 99.90%
7d
99.90%
30d
99.90%
p50
844ms
p99
4.73s
Throughput
25 tps
Context
128K
$/Mtok
$0.055 / $0.385
digitalocean
Nebius100%
Healthy24h 99.52%
7d
98.71%
30d
98.71%
p50
205ms
p99
1.88s
Throughput
300 tps
Context
131K
$/Mtok
$0.150 / $0.600
nebius/fp4fp4
Parasail100%
Healthy24h 99.65%
7d
99.82%
30d
99.82%
p50
301ms
p99
1.00s
Throughput
125 tps
Context
131K
$/Mtok
$0.100 / $0.750
parasail/fp4fp4
Phala100%
Healthy24h 97.30%
7d
97.37%
30d
97.37%
p50
955ms
p99
5.27s
Throughput
113 tps
Context
131K
$/Mtok
$0.150 / $0.600
phala
Together100%
Healthy24h 96.31%
7d
97.40%
30d
97.40%
p50
412ms
p99
2.62s
Throughput
119 tps
Context
131K
$/Mtok
$0.150 / $0.600
together
Groq99.96%
Healthy24h 99.95%
7d
99.93%
30d
99.93%
p50
225ms
p99
2.34s
Throughput
361 tps
Context
131K
$/Mtok
$0.150 / $0.600
groq
SiliconFlow99.72%
Degraded24h 85.79%
7d
92.40%
30d
92.40%
p50
1.39s
p99
16.3s
Throughput
12 tps
Context
131K
$/Mtok
$0.050 / $0.450
siliconflow/fp8fp8
Mancer 299.32%
Healthy24h 99.46%
7d
99.79%
30d
99.79%
p50
635ms
p99
4.54s
Throughput
101 tps
Context
131K
$/Mtok
$0.085 / $0.500
mancer/fp8fp8
DeepInfra99.15%
Healthy24h 99.74%
7d
98.92%
30d
98.92%
p50
422ms
p99
1.29s
Throughput
134 tps
Context
131K
$/Mtok
$0.150 / $0.600
deepinfra/turbobf16
CoreWeave98.92%
Healthy24h 94.85%
7d
95.85%
30d
95.85%
p50
389ms
p99
9.55s
Throughput
34 tps
Context
131K
$/Mtok
$0.030 / $0.170
coreweave/fp4fp4
AkashML98.68%
Healthy24h 99.48%
7d
99.73%
30d
99.73%
p50
1.33s
p99
11.6s
Throughput
67 tps
Context
131K
$/Mtok
$0.037 / $0.490
akashml/bf16bf16
Mara92.54%
Degraded24h 97.73%
7d
95.27%
30d
95.27%
p50
1.36s
p99
11.9s
Throughput
168 tps
Context
131K
$/Mtok
$0.150 / $0.750
mara
SambaNova89.36%
Down24h 88.25%
7d
86.04%
30d
86.04%
p50
887ms
p99
9.93s
Throughput
273 tps
Context
131K
$/Mtok
$0.140 / $0.950
sambanova
Google74.55%
Down24h 90.02%
7d
89.94%
30d
89.94%
p50
432ms
p99
8.41s
Throughput
114 tps
Context
131K
$/Mtok
$0.090 / $0.360
google-vertex/global
Amazon Bedrock—
No data24h —
7d
100%
30d
100%
p50
—
p99
—
Throughput
—
Context
131K
$/Mtok
$0.150 / $0.600
amazon-bedrock/eu-west-1
Novita—
Down24h 92.28%
7d
94.56%
30d
94.56%
p50
627ms
p99
32.5s
Throughput
45 tps
Context
131K
$/Mtok
$0.050 / $0.250
novita/fp4fp4

Measured 5m ago. Latency and throughput are OpenRouter's rolling 30-minute windows.

Price changes

gpt-oss-120b Mancer 2mancer/fp8$0.080 / $0.500 → $0.085 / $0.5002026-08-20 23:41 UTC
gpt-oss-120b Mancer 2mancer/fp8$0.083 / $0.500 → $0.080 / $0.5002026-08-20 22:26 UTC
gpt-oss-120b Mancer 2mancer/fp8$0.085 / $0.500 → $0.083 / $0.5002026-08-20 21:56 UTC
gpt-oss-120b Mancer 2mancer/fp8$0.080 / $0.500 → $0.085 / $0.5002026-08-20 21:21 UTC
gpt-oss-120b Mancer 2mancer/fp8$0.085 / $0.500 → $0.080 / $0.5002026-08-19 19:25 UTC

History

1 endpoint reporting no data is omitted from the charts.

Availability

Axis starts at 90% so small differences stay visible; it expands to 0 when an endpoint falls below.

Time to first token

Logarithmic axis — the fleet spans two orders of magnitude. P50 is OpenRouter's rolling 30-minute window.

Throughput

Median tokens per second.