LangWatch
Sign Up

MetaOpen weights model3B parameters

Llama 3.2 3B Instruct benchmarks

All models
  • Cost
    Self-hostedSmall GPU, ~2.6 GBNo hosted price

Comparison summary

A language model (LLM): it reads a prompt and writes text back, so the prompt sets the task.

Specifications

Lab
Meta
Weights
Open weights
Parameters
3B
Licence
Llama 3.2 Community Licence
Type
small LLM

Safety and guardrails

Tested on 5 tasks here, none ranked.

See the 5 tasks

Traces

Not ranked

PII left in, % · Lower is better

  1. Amazon Comprehend10.6, interval 9.4 to 11.9, ahead alone
  2. GLiNER Multi PII v115.3, interval 13.2 to 17.3, tier 2
  3. NVIDIA GLiNER PII19.7, interval 17.4 to 22.0, tier 3
  4. Gemma 4 26B A4B19.8, interval 15.8 to 24.2, tier 3
  5. Qwen3.8 27B20.3, interval 16.5 to 24.3, tier 3
  6. GLiNER2 Large20.4, interval 18.0 to 22.8, tier 3
  7. Gemma 4 12B23.3, interval 19.0 to 27.6, tier 3
  8. Llama 3.2 3B Instruct
    66.2, interval 58.9 to 72.3, not ranked
Tested against 52 PII detectors

Business

Not ranked

PII left in, % · Lower is better

  1. Perplexity PII Tracer2.1, interval 1.2 to 3.0, tied for the lead
  2. Qwen3.8 27B2.4, interval 1.7 to 3.3, tied for the lead
  3. Gemma 4 31B2.9, interval 1.9 to 4.0, tied for the lead
  4. GLiNER Multi PII v14.1, interval 3.1 to 5.3, tier 2
  5. Ministral 3 14B5.4, interval 4.0 to 6.9, tier 2
  6. Gemma 4 12B5.8, interval 4.4 to 7.3, tier 3
  7. Amazon Comprehend5.9, interval 4.6 to 7.2, tier 3
  8. Llama 3.2 3B Instruct
    38.5, interval 33.4 to 43.7, not ranked
Tested against 53 PII detectors

Multilingual

Not ranked

PII left in, % · Lower is better

  1. Perplexity PII Tracer2.9, interval 2.5 to 3.4, ahead alone
  2. Qwen3.8 27B4.2, interval 3.7 to 4.8, tier 2
  3. Gemma 4 31B4.5, interval 3.9 to 5.1, tier 2
  4. GLiNER Multi PII v15.7, interval 5.2 to 6.3, tier 3
  5. bardsai EU PII Multilang6.9, interval 6.3 to 7.5, tier 4
  6. Qwen3.6 35B A3B7.7, interval 7.0 to 8.4, tier 4
  7. Gemma 4 12B8.9, interval 8.1 to 9.7, tier 5
  8. Llama 3.2 3B Instruct
    43.9, interval 38.8 to 48.7, not ranked
Tested against 53 PII detectors

Look-alikes

Not ranked

Look-alikes redacted, % · Lower is better

  1. Gemma 4 31B3.5, interval 2.1 to 5.1, ahead alone
  2. Qwen3.8 27B10.3, interval 7.9 to 12.9, tier 2
  3. NuExtract 319.8, interval 15.9 to 23.6, tier 3
  4. Qwen3.5 9B20.5, interval 16.8 to 24.3, tier 3
  5. Ministral 3 14B30.5, interval 26.5 to 34.8, tier 4
  6. NVIDIA GLiNER PII42.0, interval 38.2 to 46.1, tier 5
  7. Gemma 3 4B IT45.0, interval 41.0 to 49.0, tier 5
  8. Llama 3.2 3B Instruct
    68.7, interval 63.4 to 73.9, not ranked
Tested against 53 PII detectors

LangWatch policy

Not ranked

PII left in, % · Lower is better

  1. Gemma 4 31B6.9, interval 2.8 to 11.3, ahead alone
  2. Ministral 3 14B10.2, interval 5.8 to 15.4, tier 2
  3. Llama 3.2 3B Instruct
    12.0, interval 8.0 to 17.0, not ranked
  4. Gemma 4 12B16.5, interval 10.3 to 23.2, tier 3
  5. Qwen3.8 27B16.7, interval 9.8 to 25.0, tier 3
  6. Gemma 4 26B A4B20.5, interval 13.3 to 28.8, tier 4
  7. Qwen3.5 9B21.5, interval 13.4 to 30.6, tier 4
  8. Gemma 3 4B IT22.4, interval 14.3 to 32.1, tier 4
Tested against 57 PII detectors

Cost

Self-hosted · GPU memory needed, among small LLMs · lower is better

  1. Qwen3 0.6B~1 GB
  2. Qwen3.5 0.8B~1.1 GB
  3. LFM2 1.2B~1.3 GB
  4. LFM2.5 1.2B Instruct~1.3 GB
  5. Gemma 3 1B IT~1.4 GB
  6. Llama 3.2 1B Instruct~1.4 GB
  7. GDPR Anonymization 0.5B~1.5 GB
  8. Llama 3.2 3B Instruct
    ~2.6 GB
How we count

A model leads a task when it is in the task's leading tie tier. Each task counts inside its own benchmark, against that benchmark's models; no score is averaged. An area chart shows the models ranked on at least 2 of the area's tasks in a benchmark this model is in too. The overall standing counts every non-coding tasks and needs 5 for a rank. Latency is compared only on one hardware tier.

Llama 3.2 3B InstructOther modelsWhisker: 95% interval