Llama Guard 4 12B
meta-llama/llama-guard-4-12b
Compare with Llama 4 Maverick, Llama 4 Scout, Llama 3.3 70B Instruct
CompareLlama Guard 4 12B
| Provider | State | Uptime 5m | 24h | p50 latency | p99 | Throughput | Context | $/Mtok |
|---|---|---|---|---|---|---|---|---|
DeepInfradeepinfra/bf16bf16 | Healthy | 100% | 99.40% | 525ms | 3.86s | 5.0 tps | 164K | $0.180 / $0.180 |
Togethertogether | Healthy | 100% | 99.96% | 146ms | 948ms | 14 tps | 1.0M | $0.200 / $0.200 |
- DeepInfra100%Healthy24h 99.40%
- p50
- 525ms
- p99
- 3.86s
- Throughput
- 5.0 tps
- Context
- 164K
- $/Mtok
- $0.180 / $0.180
deepinfra/bf16bf16 - Together100%Healthy24h 99.96%
- p50
- 146ms
- p99
- 948ms
- Throughput
- 14 tps
- Context
- 1.0M
- $/Mtok
- $0.200 / $0.200
together
Measured 4m ago. Latency and throughput are OpenRouter's rolling 30-minute windows.
History
Availability
Axis starts at 90% so small differences stay visible; it expands to 0 when an endpoint falls below.
Time to first token
Logarithmic axis — the fleet spans two orders of magnitude. p50 and p99 are OpenRouter's rolling 30-minute windows.
Throughput
Median tokens per second.