Inkling
thinkingmachines/inkling
Compare with Inkling Small, Inkling (batch), GLM 5.2
CompareInkling
| Provider | State | Uptime 5m | 24h | p50 latency | p99 | Throughput | Context | $/Mtok |
|---|---|---|---|---|---|---|---|---|
DeepInfradeepinfra/fp8fp8 | Healthy | 100% | 99.53% | 574ms | 1.75s | 47 tps | 524K | $0.950 / $4.05 |
BaseTenbaseten/fp8fp8 | No data | — | 99.76% | 254ms | 1.42s | 63 tps | 1.0M | $1.00 / $4.05 |
Togethertogether | No data | — | 98.18% | 485ms | 4.35s | 113 tps | 524K | $1.00 / $4.05 |
- DeepInfra100%Healthy24h 99.53%
- p50
- 574ms
- p99
- 1.75s
- Throughput
- 47 tps
- Context
- 524K
- $/Mtok
- $0.950 / $4.05
deepinfra/fp8fp8 - BaseTen—No data24h 99.76%
- p50
- 254ms
- p99
- 1.42s
- Throughput
- 63 tps
- Context
- 1.0M
- $/Mtok
- $1.00 / $4.05
baseten/fp8fp8 - Together—No data24h 98.18%
- p50
- 485ms
- p99
- 4.35s
- Throughput
- 113 tps
- Context
- 524K
- $/Mtok
- $1.00 / $4.05
together
Measured 4m ago. Latency and throughput are OpenRouter's rolling 30-minute windows.
History
2 endpoints reporting no data are omitted from the charts.
Availability
Axis starts at 90% so small differences stay visible; it expands to 0 when an endpoint falls below.
Time to first token
Logarithmic axis — the fleet spans two orders of magnitude. p50 and p99 are OpenRouter's rolling 30-minute windows.
Throughput
Median tokens per second.