Inkling Small: providers compared
Every endpoint serving this model, side by side. ◆ marks the best value in each column — per model, never fleet-wide.
Current state
- DeepInfra100%Healthy24h 99.98%
- 7d
- 100%
- 30d
- 95.98%
- p50
- 959ms
- p99
- 2.81s
- Throughput
- 51 tps
- Context
- 524K
- $/Mtok
- $0.450 / $1.20◆ (best)
deepinfra/fp8fp8 - No data24h —
- 7d
- —
- 30d
- 99.31%
- p50
- —
- p99
- —
- Throughput
- —
- Context
- 1.0M
- $/Mtok
- $0.500 / $1.20
baseten/fp8fp8 - No data24h —
- 7d
- —
- 30d
- 99.82%◆ (best)
- p50
- —
- p99
- —
- Throughput
- —
- Context
- 524K
- $/Mtok
- $0.500 / $1.20
together
Measured 2m ago. Latency and throughput are OpenRouter's rolling 30-minute windows. ◆ marks the best value in each column among these endpoints.
Price vs latency
One dot per endpoint at the latest round · further left = faster, lower = cheaper · hover a dot for its tag
History
Availability
Axis starts at 90% so small differences stay visible; it expands to 0 when an endpoint falls below.
Time to first token
Logarithmic axis — the fleet spans two orders of magnitude. P50 is OpenRouter's rolling 30-minute window.
Throughput
Median tokens per second.