Llama 3.1 8B Instruct
meta-llama/llama-3.1-8b-instructInputOutput
Compare its 5 providersIncident RSSCompare with Llama 3.1 70B Instruct, Llama 3.2 3B Instruct, Llama 3.2 1B Instruct
Showing only the novita/fp8 provider · show all 5
CompareLlama 3.1 8B Instruct
| State | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Down | 64.57% | 98.89% | 99.19% | 98.66% | 544ms | 6.56s | 84 tps | 16K | $0.020 / $0.050 |
- Novita64.57%Down24h 98.89%
- 7d
- 99.19%
- 30d
- 98.66%
- p50
- 544ms
- p99
- 6.56s
- Throughput
- 84 tps
- Context
- 16K
- $/Mtok
- $0.020 / $0.050
novita/fp8fp8
Measured 5m ago. Latency and throughput are OpenRouter's rolling 30-minute windows.
History
Availability
Axis starts at 90% so small differences stay visible; it expands to 0 when an endpoint falls below.
Time to first token
Logarithmic axis — the fleet spans two orders of magnitude. P50 is OpenRouter's rolling 30-minute window.
Throughput
Median tokens per second.
Daily availability
One row per endpoint · one dot per day · last 90 days.
worst hour ≥ 95%90–95%< 90%no data
Colour by each endpoint's worst hour of each UTC day · 5 endpoints · 49 days with data, 24 endpoint-days below 90%. Tables and charts above are filtered to novita/fp8.