Phi-3-medium

By Microsoft, in the Phi family.

Category scores

Out of 100, from independent and third-party results only, by method category-2026-09-29.1.

Not enough independent results yet

Only independent and third-party results rank a model; self-reported and unattributed numbers never do.

Every result we hold for this model, with who ran it and where it was published.

Knowledge & reasoning results
Benchmark	Metric	Value	Provenance	Setting	Evaluated	Source
Adversarial NLI (ANLI)	Accuracy	55.8%	Self-reported	—	—	Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
AI2 Reasoning Challenge (ARC)	Challenge set accuracy	91.6%	Self-reported	—	—	Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
BIG-Bench Hard (BBH)	Average accuracy	81.4%	Self-reported	—	—	Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
HellaSwag	Accuracy	82.4%	Self-reported	—	—	Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
MMLU	Accuracy	77.5%	Third party	—	—	Stanford CRFM Leaderboard via Epoch AI
MMLU	Accuracy	78.0%	Self-reported	—	—	Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
MMLU	Accuracy	77.9%	Self-reported	—	—	Phi-4 Technical Report via Epoch AI
MMLU-Pro	Accuracy	51.9%	Self-reported	—	—	EvalEval via Hugging Face Community Evals
OpenBookQA	Accuracy	87.4%	Self-reported	—	—	Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
OpenBookQA	Accuracy	87.4%	Self-reported	—	—	Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
WinoGrande	Accuracy	81.5%	Self-reported	—	—	Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI

Scientific reasoning results
Benchmark	Metric	Value	Provenance	Setting	Evaluated	Source
GPQA Diamond	Accuracy	27.6%	Independent	—	31 Jan 2025	Epoch AI

Mathematics results
Benchmark	Metric	Value	Provenance	Setting	Evaluated	Source
MATH Level 5	Accuracy	17.6%	Independent	—	31 Jan 2025	Epoch AI

Factuality & hallucination results
Benchmark	Metric	Value	Provenance	Setting	Evaluated	Source
TriviaQA	Exact match	73.9%	Self-reported	—	—	Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI