Step 5 Preview: providers compared
Every endpoint serving this model, side by side. ◆ marks the best value in each column — per model, never fleet-wide.
Current state
| State | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Healthy | 100%◆ (best) | 98.29% | 99.75% | 99.75% | 1.04s | 21.9s | 129 tps | 1.0M | $1.00 / $2.70◆ (best) | |
| Healthy | 100%◆ (best) | 100% | 100%◆ (best) | 100%◆ (best) | 2.80s | 13.6s | 31 tps | 262K | $1.00 / $2.70◆ (best) | |
| Healthy | 100%◆ (best) | 100% | 100%◆ (best) | 100%◆ (best) | 635ms◆ (best) | 6.86s◆ (best) | 136 tps◆ (best) | 1.0M | $1.00 / $2.70◆ (best) | |
| Healthy | 100%◆ (best) | 98.92% | 99.42% | 99.43% | 5.43s | 84.6s | 34 tps | 1.0M | $1.00 / $2.70◆ (best) | |
Novitanovita | No data | — | — | — | — | — | — | — | 1.0M | $1.00 / $2.70◆ (best) |
- DeepInfra100%◆ (best)Healthy24h 98.29%
- 7d
- 99.75%
- 30d
- 99.75%
- p50
- 1.04s
- p99
- 21.9s
- Throughput
- 129 tps
- Context
- 1.0M
- $/Mtok
- $1.00 / $2.70◆ (best)
deepinfra/fp8fp8 - Featherless100%◆ (best)Healthy24h 100%
- 7d
- 100%◆ (best)
- 30d
- 100%◆ (best)
- p50
- 2.80s
- p99
- 13.6s
- Throughput
- 31 tps
- Context
- 262K
- $/Mtok
- $1.00 / $2.70◆ (best)
featherless/fp4fp4 - InferenceNet100%◆ (best)Healthy24h 100%
- 7d
- 100%◆ (best)
- 30d
- 100%◆ (best)
- p50
- 635ms◆ (best)
- p99
- 6.86s◆ (best)
- Throughput
- 136 tps◆ (best)
- Context
- 1.0M
- $/Mtok
- $1.00 / $2.70◆ (best)
inference-net/fp4fp4 - StepFun100%◆ (best)Healthy24h 98.92%
- 7d
- 99.42%
- 30d
- 99.43%
- p50
- 5.43s
- p99
- 84.6s
- Throughput
- 34 tps
- Context
- 1.0M
- $/Mtok
- $1.00 / $2.70◆ (best)
stepfun/fp8fp8 - No data24h —
- 7d
- —
- 30d
- —
- p50
- —
- p99
- —
- Throughput
- —
- Context
- 1.0M
- $/Mtok
- $1.00 / $2.70◆ (best)
novita
Measured 2m ago. Latency and throughput are OpenRouter's rolling 30-minute windows. ◆ marks the best value in each column among these endpoints.
Price vs latency
One dot per endpoint at the latest round · further left = faster, lower = cheaper · hover a dot for its tag
History
Availability
Axis starts at 90% so small differences stay visible; it expands to 0 when an endpoint falls below.
Time to first token
Logarithmic axis — the fleet spans two orders of magnitude. P50 is OpenRouter's rolling 30-minute window, averaged over the hour.
Throughput
Median tokens per second.