Language

Phi-2

By Microsoft, in the Phi family.

Released
12 Dec 2023
Status
Legacy
Context
2K
Max output
—
Input per 1M tokens
—
Output per 1M tokens
—
Open weights
Yes
License
mit
Parameters
2.78B
Knowledge cutoff
—
Reasoning
No
Modalities
text → text

Category scores

Out of 100, from independent and third-party results only, by method category-2026-09-29.1.

Not enough independent results yet

Only independent and third-party results rank a model; self-reported and unattributed numbers never do.

Benchmark results

Every result we hold for this model, with who ran it and where it was published.

Knowledge & reasoning

Knowledge & reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Adversarial NLI (ANLI)Accuracy42.5%Self-reported——Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
AI2 Reasoning Challenge (ARC)Challenge set accuracy75.9%Self-reported——Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
BIG-Bench Hard (BBH)Average accuracy59.4%Self-reported——Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
HellaSwagAccuracy53.6%Self-reported——Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
MMLUAccuracy58.4%Third party——Stanford CRFM Leaderboard via Epoch AI
MMLUAccuracy56.3%Self-reported——Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
OpenBookQAAccuracy73.6%Self-reported——Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
OpenBookQAAccuracy73.6%Self-reported——Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
WinoGrandeAccuracy54.7%Self-reported——Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI

Factuality & hallucination

Factuality & hallucination results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
TriviaQAExact match45.2%Self-reported——Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI

Other Phi versions

Sources