Hermes 3 70B Instruct
nousresearch/hermes-3-llama-3.1-70b
Compare with Hermes 3 405B Instruct, Hermes 4 405B, Hermes 4 70B
CompareHermes 3 70B Instruct
| Provider | State | Uptime 5m | 24h | p50 latency | p99 | Throughput | Context | $/Mtok |
|---|---|---|---|---|---|---|---|---|
DeepInfradeepinfra/fp8fp8 | Healthy | 100% | 99.99% | 703ms | 4.63s | 24 tps | 131K | $0.700 / $0.700 |
- DeepInfra100%Healthy24h 99.99%
- p50
- 703ms
- p99
- 4.63s
- Throughput
- 24 tps
- Context
- 131K
- $/Mtok
- $0.700 / $0.700
deepinfra/fp8fp8
Measured 4m ago. Latency and throughput are OpenRouter's rolling 30-minute windows.
History
Availability
Axis starts at 90% so small differences stay visible; it expands to 0 when an endpoint falls below.
Time to first token
Logarithmic axis — the fleet spans two orders of magnitude. p50 and p99 are OpenRouter's rolling 30-minute windows.
Throughput
Median tokens per second.