Language

Mistral 7B v0.1

By Mistral AI, in the Mistral 7B family.

Released
27 Sep 2023
Status
Retired
Retired
30 Mar 2025
Context
8.2K
Max output
—
Input per 1M tokens
—
Output per 1M tokens
—
Open weights
Yes
License
apache-2.0
Parameters
7B
Knowledge cutoff
—
Reasoning
No
Modalities
text → text

Category scores

Out of 100, from independent and third-party results only, by method category-2026-09-29.1.

Not enough independent results yet

Only independent and third-party results rank a model; self-reported and unattributed numbers never do.

Benchmark results

Every result we hold for this model, with who ran it and where it was published.

Knowledge & reasoning

Knowledge & reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Adversarial NLI (ANLI)Accuracy47.1%Self-reported——Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
AI2 Reasoning Challenge (ARC)Challenge set accuracy54.9%Third party——Gemma: Open Models Based on Gemini Research and Technology via Epoch AI
AI2 Reasoning Challenge (ARC)Challenge set accuracy54.9%Third party——Mixtral of Experts via Epoch AI
AI2 Reasoning Challenge (ARC)Challenge set accuracy78.6%Self-reported——Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
AI2 Reasoning Challenge (ARC)Challenge set accuracy55.5%Self-reported——Nemotron-4 15B Technical Report via Epoch AI
BIG-Bench Hard (BBH)Average accuracy56.1%Third party——Gemma: Open Models Based on Gemini Research and Technology via Epoch AI
BIG-Bench Hard (BBH)Average accuracy39.5%Self-reported——Nemotron-4 15B Technical Report via Epoch AI
HellaSwagAccuracy81.0%Third party——Mixtral of Experts via Epoch AI
MMLUAccuracy62.5%Third party——Mixtral of Experts via Epoch AI
MMLUAccuracy56.6%Third party——Stanford CRFM Leaderboard via Epoch AI
MMLUAccuracy61.7%Self-reported——Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
MMLUAccuracy60.1%Self-reported——Nemotron-4 15B Technical Report via Epoch AI
OpenBookQAAccuracy79.8%Self-reported——Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
PIQAAccuracy82.2%Third party——Mixtral of Experts via Epoch AI
PIQAAccuracy83.0%Self-reported——Nemotron-4 15B Technical Report via Epoch AI
PIQAAccuracy73.4%Self-reported——Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
WinoGrandeAccuracy75.3%Third party——Training Compute-Optimal Large Language Models via Epoch AI
WinoGrandeAccuracy74.2%Third party——Mixtral of Experts via Epoch AI
WinoGrandeAccuracy74.2%Third party——Gemma: Open Models Based on Gemini Research and Technology via Epoch AI
WinoGrandeAccuracy75.3%Self-reported——Nemotron-4 15B Technical Report via Epoch AI
WinoGrandeAccuracy54.2%Self-reported——Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI

Mathematics

Mathematics results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GSM8KExact match50.0%Third party——Mixtral of Experts via Epoch AI
GSM8KExact match47.5%Third party——Yi: Open Foundation Models by 01.AI via Epoch AI
GSM8KExact match38.1%Third party——Stanford HELM via Epoch AI
GSM8KExact match54.4%Self-reported——Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI
GSM8KExact match35.4%Self-reported——Nemotron-4 15B Technical Report via Epoch AI

Factuality & hallucination

Factuality & hallucination results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
TriviaQAExact match62.5%Third party——Gemma: Open Models Based on Gemini Research and Technology via Epoch AI
TriviaQAExact match75.2%Self-reported——Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone via Epoch AI

Other Mistral 7B versions

Sources