modelstatus.dev

Llama 3.2 3B Instruct

meta-llama/llama-3.2-3b-instruct

Compare with Llama 3.2 1B Instruct, Llama 3.3 70B Instruct, Llama 3.1 8B Instruct

CompareLlama 3.2 3B Instruct
  • Cloudflare100%
    Healthy24h 97.28%
    p50
    346ms
    p99
    998ms
    Throughput
    61 tps
    Context
    80K
    $/Mtok
    $0.051 / $0.335
    cloudflare
  • Parasail100%
    Healthy24h 99.99%
    p50
    317ms
    p99
    2.38s
    Throughput
    59 tps
    Context
    131K
    $/Mtok
    $0.050 / $0.330
    parasail/bf16bf16

Measured 1m ago. Latency and throughput are OpenRouter's rolling 30-minute windows.

Availability

Axis starts at 90% so small differences stay visible; it expands to 0 when an endpoint falls below.

Time to first token

Logarithmic axis — the fleet spans two orders of magnitude. p50 and p99 are OpenRouter's rolling 30-minute windows, averaged over the hour.

Throughput

Median tokens per second.