modelstatus.dev

Llama 3.1 70B Instruct

meta-llama/llama-3.1-70b-instructInputtextOutputtext

Compare its 3 providersIncident RSSCompare with Llama 3.1 8B Instruct, Llama 3.2 3B Instruct, Llama 3.2 1B Instruct

Showing only the amazon-bedrock provider · show all 3

CompareLlama 3.1 70B Instruct
  • Healthy24h 99.98%
    7d
    99.96%
    30d
    99.43%
    p50
    358ms
    p99
    2.77s
    Throughput
    64 tps
    Context
    131K
    $/Mtok
    $0.720 / $0.720
    amazon-bedrock

Measured 4m ago. Latency and throughput are OpenRouter's rolling 30-minute windows.

Availability

Axis starts at 90% so small differences stay visible; it expands to 0 when an endpoint falls below.

Time to first token

Logarithmic axis — the fleet spans two orders of magnitude. P50 is OpenRouter's rolling 30-minute window, averaged over the hour.

Throughput

Median tokens per second.

Daily availability

One row per endpoint · one dot per day · last 90 days.

worst hour ≥ 95%90–95%< 90%no data

Colour by each endpoint's worst hour of each UTC day · 3 endpoints · 50 days with data, 43 endpoint-days below 90%. Tables and charts above are filtered to amazon-bedrock.