InferenceNet
18 endpoints · all healthy · worst uptime 100%
| State | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Healthy | 100% | 100% | 100% | 99.97% | 245ms | 2.43s | 107 tps | 1.0M | $0.103 / $0.600 | |
| Healthy | 100% | 100% | 100% | 99.97% | 230ms | 1.93s | 79 tps | 1.0M | $0.103 / $0.600 | |
| Healthy | 100% | 100% | 100% | 99.96% | 299ms | 2.13s | 113 tps | 1.0M | $0.080 / $0.550 | |
| Healthy | 100% | 100% | 100% | 99.97% | 269ms | 2.25s | 122 tps | 1.0M | $0.080 / $0.550 | |
| Healthy | 100% | 96.81% | 98.29% | 98.73% | 528ms | 6.17s | 72 tps | 1.0M | $0.150 / $0.600 | |
| Healthy | 100% | 100% | 100% | 99.86% | 776ms | 4.06s | 85 tps | 1.0M | $0.500 / $22.00 | |
| Healthy | 100% | 100% | 100% | 99.91% | 829ms | 9.43s | 69 tps | 1.0M | $0.234 / $15.00 | |
| Healthy | 100% | 100% | 100% | 99.95% | 876ms | 6.74s | 56 tps | 1.0M | $0.234 / $15.00 | |
| Healthy | 100% | 100% | 100% | 99.94% | 770ms | 4.35s | 83 tps | 1.0M | $0.500 / $22.00 | |
| Healthy | 100% | 100% | 100% | 99.96% | 475ms | 5.10s | 110 tps | 1.0M | $0.080 / $3.60 | |
| Healthy | 100% | 100% | 100% | 99.96% | 510ms | 6.27s | 96 tps | 1.0M | $0.080 / $3.60 | |
| Healthy | 100% | 100% | 100% | 99.73% | 459ms | 4.32s | 81 tps | 1.0M | $0.108 / $0.350 | |
| Healthy | 100% | 100% | 100% | 99.70% | 360ms | 2.37s | 88 tps | 1.0M | $0.108 / $0.350 | |
| No data | — | 100% | 97.04% | 99.47% | 350ms | 821ms | 254 tps | 128K | $0.050 / $0.230 | |
| No data | — | 100% | 100% | 100% | 388ms | 753ms | 286 tps | 128K | $0.050 / $0.230 | |
| No data | — | 100% | 92.45% | 98.51% | 257ms | 2.65s | 152 tps | 128K | $0.030 / $0.150 | |
| No data | — | 100% | 96.33% | 97.79% | 278ms | 2.74s | 177 tps | 128K | $0.030 / $0.150 | |
| No data | — | 99.77% | 97.33% | 96.95% | 655ms | 26.2s | 64 tps | 1.0M | $0.150 / $0.600 |
- Healthy24h 100%
- 7d
- 100%
- 30d
- 99.97%
- p50
- 245ms
- p99
- 2.43s
- Throughput
- 107 tps
- Context
- 1.0M
- $/Mtok
- $0.103 / $0.600
inference-net/fp8fp8 - Healthy24h 100%
- 7d
- 100%
- 30d
- 99.97%
- p50
- 230ms
- p99
- 1.93s
- Throughput
- 79 tps
- Context
- 1.0M
- $/Mtok
- $0.103 / $0.600
inference-net/usfp8 - Healthy24h 100%
- 7d
- 100%
- 30d
- 99.96%
- p50
- 299ms
- p99
- 2.13s
- Throughput
- 113 tps
- Context
- 1.0M
- $/Mtok
- $0.080 / $0.550
inference-net/fp8fp8 - Healthy24h 100%
- 7d
- 100%
- 30d
- 99.97%
- p50
- 269ms
- p99
- 2.25s
- Throughput
- 122 tps
- Context
- 1.0M
- $/Mtok
- $0.080 / $0.550
inference-net/usfp8 - Healthy24h 96.81%
- 7d
- 98.29%
- 30d
- 98.73%
- p50
- 528ms
- p99
- 6.17s
- Throughput
- 72 tps
- Context
- 1.0M
- $/Mtok
- $0.150 / $0.600
inference-net/fp4fp4 - Kimi K3100%Healthy24h 100%
- 7d
- 100%
- 30d
- 99.86%
- p50
- 776ms
- p99
- 4.06s
- Throughput
- 85 tps
- Context
- 1.0M
- $/Mtok
- $0.500 / $22.00
inference-net/fastfp4 - Kimi K3100%Healthy24h 100%
- 7d
- 100%
- 30d
- 99.91%
- p50
- 829ms
- p99
- 9.43s
- Throughput
- 69 tps
- Context
- 1.0M
- $/Mtok
- $0.234 / $15.00
inference-net/fp4fp4 - Kimi K3100%Healthy24h 100%
- 7d
- 100%
- 30d
- 99.95%
- p50
- 876ms
- p99
- 6.74s
- Throughput
- 56 tps
- Context
- 1.0M
- $/Mtok
- $0.234 / $15.00
inference-net/usfp4 - Kimi K3100%Healthy24h 100%
- 7d
- 100%
- 30d
- 99.94%
- p50
- 770ms
- p99
- 4.35s
- Throughput
- 83 tps
- Context
- 1.0M
- $/Mtok
- $0.500 / $22.00
inference-net/us/fastfp4 - GLM 5.3100%Healthy24h 100%
- 7d
- 100%
- 30d
- 99.96%
- p50
- 475ms
- p99
- 5.10s
- Throughput
- 110 tps
- Context
- 1.0M
- $/Mtok
- $0.080 / $3.60
inference-net/fp4fp4 - GLM 5.3100%Healthy24h 100%
- 7d
- 100%
- 30d
- 99.96%
- p50
- 510ms
- p99
- 6.27s
- Throughput
- 96 tps
- Context
- 1.0M
- $/Mtok
- $0.080 / $3.60
inference-net/usfp4 - GLM 5.3 Flash100%Healthy24h 100%
- 7d
- 100%
- 30d
- 99.73%
- p50
- 459ms
- p99
- 4.32s
- Throughput
- 81 tps
- Context
- 1.0M
- $/Mtok
- $0.108 / $0.350
inference-net/fp4fp4 - GLM 5.3 Flash100%Healthy24h 100%
- 7d
- 100%
- 30d
- 99.70%
- p50
- 360ms
- p99
- 2.37s
- Throughput
- 88 tps
- Context
- 1.0M
- $/Mtok
- $0.108 / $0.350
inference-net/usfp4 - No data24h 100%
- 7d
- 97.04%
- 30d
- 99.47%
- p50
- 350ms
- p99
- 821ms
- Throughput
- 254 tps
- Context
- 128K
- $/Mtok
- $0.050 / $0.230
inference-net/bf16bf16 - No data24h 100%
- 7d
- 100%
- 30d
- 100%
- p50
- 388ms
- p99
- 753ms
- Throughput
- 286 tps
- Context
- 128K
- $/Mtok
- $0.050 / $0.230
inference-net/usbf16 - No data24h 100%
- 7d
- 92.45%
- 30d
- 98.51%
- p50
- 257ms
- p99
- 2.65s
- Throughput
- 152 tps
- Context
- 128K
- $/Mtok
- $0.030 / $0.150
inference-net/bf16bf16 - No data24h 100%
- 7d
- 96.33%
- 30d
- 97.79%
- p50
- 278ms
- p99
- 2.74s
- Throughput
- 177 tps
- Context
- 128K
- $/Mtok
- $0.030 / $0.150
inference-net/usbf16 - No data24h 99.77%
- 7d
- 97.33%
- 30d
- 96.95%
- p50
- 655ms
- p99
- 26.2s
- Throughput
- 64 tps
- Context
- 1.0M
- $/Mtok
- $0.150 / $0.600
inference-net/fp4/usfp4
Measured 2m ago. Latency and throughput are OpenRouter's rolling 30-minute windows.
History
MiniMax M3.1 Flash inference-net/fp4
MiniMax M3.1 Flash inference-net/fp4/us
Kimi K3 inference-net/fp4
GLM 5.3 inference-net/fp4
GLM 5.3 Flash inference-net/fp4
Kimi K3 inference-net/fast
DeepSeek V4.1 Flash inference-net/fp8
Schematron V2 Small inference-net/bf16
Schematron V2 Turbo inference-net/bf16
DeepSeek V4.1 Flash 1017 inference-net/fp8
Schematron V2 Small inference-net/us
DeepSeek V4.1 Flash inference-net/us
DeepSeek V4.1 Flash 1017 inference-net/us
Kimi K3 inference-net/us
GLM 5.3 inference-net/us
GLM 5.3 Flash inference-net/us
Schematron V2 Turbo inference-net/us
Kimi K3 inference-net/us/fast
Colour by hourly mean uptime:≥ 95%90–95%< 90%no data
Through the live last bucket (raw rounds, updated every collection round) · 18 endpoints with data, sorted worst-first.