Gemma 4 31B

google/gemma-4-31b-it

Compare with Gemma 4 26B A4B , Gemma 4 26B A4B (free), Gemma 4 31B (free)

CompareGemma 4 31B

	State
Cerebrascerebras/fp16fp16	Healthy	100%	100%	99.99%	99.99%	284ms	1.48s	114 tps	131K	$0.990 / $1.49
Crusoecrusoe	Healthy	100%	98.79%	98.60%	98.60%	619ms	6.69s	37 tps	262K	$0.140 / $0.400
Friendlifriendli	Healthy	100%	99.19%	99.55%	99.55%	603ms	5.56s	90 tps	262K	$0.140 / $0.400
OpenInferenceopen-inference/bf16bf16	Healthy	100%	97.01%	97.44%	97.44%	573ms	18.4s	34 tps	262K	$0.080 / $0.350
Venicevenice/bf16bf16	Healthy	100%	99.75%	99.73%	99.73%	1.21s	8.19s	39 tps	256K	$0.120 / $0.360
DeepInfradeepinfra/turbofp4	Healthy	99.93%	99.85%	99.51%	99.51%	491ms	3.53s	45 tps	262K	$0.090 / $0.340
ModelRunmodelrun/fp4fp4	Healthy	99.91%	99.92%	99.64%	99.64%	194ms	7.17s	94 tps	262K	$0.750 / $1.00
Parasailparasail/fp8fp8	Healthy	99.60%	99.49%	99.27%	99.27%	898ms	13.9s	42 tps	262K	$0.150 / $0.400
Togethertogether	Healthy	99.34%	89.71%	95.30%	95.30%	222ms	64.2s	33 tps	262K	$0.390 / $0.970
Novitanovita/bf16bf16	Healthy	99.29%	99.06%	78.32%	78.32%	900ms	4.74s	10 tps	262K	$0.140 / $0.400
SiliconFlowsiliconflow/fp8fp8	Healthy	99.28%	74.90%	93.86%	93.86%	1.44s	10.4s	27 tps	262K	$0.130 / $0.400
DeepInfradeepinfra/fp8fp8	Healthy	98.27%	98.35%	90.43%	90.43%	729ms	9.72s	46 tps	262K	$0.130 / $0.380
CoreWeavecoreweave/bf16bf16	Healthy	96.40%	98.14%	98.52%	98.52%	700ms	24.7s	28 tps	262K	$0.100 / $0.340
Chuteschutes/fp4fp4	Down	—	86.35%	63.05%	63.05%	16.4s	150s	4.0 tps	131K	$0.120 / $0.370
DeepInfradeepinfra/ultrafp8	No data	—	74.54%	87.73%	87.73%	2.37s	8.86s	21 tps	131K	$0.270 / $0.760
Phalaphala	Down	—	80.45%	88.05%	88.05%	561ms	4.19s	52 tps	262K	$0.150 / $0.460
SambaNovasambanova	No data	—	98.66%	96.98%	96.98%	1.53s	5.55s	25 tps	131K	$0.380 / $1.15

Cerebras100%
Healthy24h 100%
7d
99.99%
30d
99.99%
p50
284ms
p99
1.48s
Throughput
114 tps
Context
131K
$/Mtok
$0.990 / $1.49
cerebras/fp16fp16
Crusoe100%
Healthy24h 98.79%
7d
98.60%
30d
98.60%
p50
619ms
p99
6.69s
Throughput
37 tps
Context
262K
$/Mtok
$0.140 / $0.400
crusoe
Friendli100%
Healthy24h 99.19%
7d
99.55%
30d
99.55%
p50
603ms
p99
5.56s
Throughput
90 tps
Context
262K
$/Mtok
$0.140 / $0.400
friendli
OpenInference100%
Healthy24h 97.01%
7d
97.44%
30d
97.44%
p50
573ms
p99
18.4s
Throughput
34 tps
Context
262K
$/Mtok
$0.080 / $0.350
open-inference/bf16bf16
Venice100%
Healthy24h 99.75%
7d
99.73%
30d
99.73%
p50
1.21s
p99
8.19s
Throughput
39 tps
Context
256K
$/Mtok
$0.120 / $0.360
venice/bf16bf16
DeepInfra99.93%
Healthy24h 99.85%
7d
99.51%
30d
99.51%
p50
491ms
p99
3.53s
Throughput
45 tps
Context
262K
$/Mtok
$0.090 / $0.340
deepinfra/turbofp4
ModelRun99.91%
Healthy24h 99.92%
7d
99.64%
30d
99.64%
p50
194ms
p99
7.17s
Throughput
94 tps
Context
262K
$/Mtok
$0.750 / $1.00
modelrun/fp4fp4
Parasail99.60%
Healthy24h 99.49%
7d
99.27%
30d
99.27%
p50
898ms
p99
13.9s
Throughput
42 tps
Context
262K
$/Mtok
$0.150 / $0.400
parasail/fp8fp8
Together99.34%
Healthy24h 89.71%
7d
95.30%
30d
95.30%
p50
222ms
p99
64.2s
Throughput
33 tps
Context
262K
$/Mtok
$0.390 / $0.970
together
Novita99.29%
Healthy24h 99.06%
7d
78.32%
30d
78.32%
p50
900ms
p99
4.74s
Throughput
10 tps
Context
262K
$/Mtok
$0.140 / $0.400
novita/bf16bf16
SiliconFlow99.28%
Healthy24h 74.90%
7d
93.86%
30d
93.86%
p50
1.44s
p99
10.4s
Throughput
27 tps
Context
262K
$/Mtok
$0.130 / $0.400
siliconflow/fp8fp8
DeepInfra98.27%
Healthy24h 98.35%
7d
90.43%
30d
90.43%
p50
729ms
p99
9.72s
Throughput
46 tps
Context
262K
$/Mtok
$0.130 / $0.380
deepinfra/fp8fp8
CoreWeave96.40%
Healthy24h 98.14%
7d
98.52%
30d
98.52%
p50
700ms
p99
24.7s
Throughput
28 tps
Context
262K
$/Mtok
$0.100 / $0.340
coreweave/bf16bf16
Chutes—
Down24h 86.35%
7d
63.05%
30d
63.05%
p50
16.4s
p99
150s
Throughput
4.0 tps
Context
131K
$/Mtok
$0.120 / $0.370
chutes/fp4fp4
DeepInfra—
No data24h 74.54%
7d
87.73%
30d
87.73%
p50
2.37s
p99
8.86s
Throughput
21 tps
Context
131K
$/Mtok
$0.270 / $0.760
deepinfra/ultrafp8
Phala—
Down24h 80.45%
7d
88.05%
30d
88.05%
p50
561ms
p99
4.19s
Throughput
52 tps
Context
262K
$/Mtok
$0.150 / $0.460
phala
SambaNova—
No data24h 98.66%
7d
96.98%
30d
96.98%
p50
1.53s
p99
5.55s
Throughput
25 tps
Context
131K
$/Mtok
$0.380 / $1.15
sambanova

Measured 3m ago. Latency and throughput are OpenRouter's rolling 30-minute windows.

Price changes

Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 10:50 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 10:45 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 10:40 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 10:35 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 10:30 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 10:25 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 10:20 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 10:15 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 10:10 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 10:05 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 10:00 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 09:55 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 09:50 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 09:45 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 09:40 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 09:35 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 09:30 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 09:25 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 09:20 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 09:15 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 09:10 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 09:05 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 09:00 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 08:55 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 08:50 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 08:45 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 08:40 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 08:35 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 08:30 UTC
Gemma 4 31B Togethertogether$0.390 / $0.970 → $0.280 / $0.8602026-08-21 08:25 UTC

History

2 endpoints reporting no data are omitted from the charts.

Availability

Axis starts at 90% so small differences stay visible; it expands to 0 when an endpoint falls below.

Time to first token

Logarithmic axis — the fleet spans two orders of magnitude. P50 is OpenRouter's rolling 30-minute window.

Throughput

Median tokens per second.