supermarket

Language

Qwen3-235B-A22B

By Alibaba Group, in the Qwen family.

Released
29 Apr 2025
Status
Legacy
Context
131.1K
Max output
8.2K
Input per 1M tokens
$0.70
Output per 1M tokens
$2.80
Open weights
Yes
License
apache-2.0
Parameters
235B, 22B active
Knowledge cutoff
—
Reasoning
Yes
Modalities
text → text

Category scores

Out of 100, from independent and third-party results only, by method category-2026-09-29.1.

Category scores
CategoryScoreRankCoverage
Knowledge & reasoning23.3722 of 4
Coding & software engineering59.6Not ranked1 of 5
Human preference46.5Not ranked1 of 5

Benchmark results

Every result we hold for this model, with who ran it and where it was published.

Knowledge & reasoning

Knowledge & reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
DTBench (Decision Theory Benchmark)Accuracy (capability questions)75.7%Third party——https://conceptualreasoning.ai/dtbench via Epoch AI
LMCA (Language Model Conceptual Argumentation)Correlation with expert ratings (Pearson r)0.25Third party——https://conceptualreasoning.ai/lmca via Epoch AI
MMLU-ProAccuracy68.2%Self-reported——EvalEval via Hugging Face Community Evals
SimpleBenchScore (AVG@5)31.0%Third party——SimpleBench Leaderboard via Epoch AI

Scientific reasoning

Scientific reasoning results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
GPQA DiamondAccuracy70.7%Independent—3 Jun 2025Epoch AI

Mathematics

Mathematics results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
MATH Level 5Accuracy68.9%Independent—3 Jun 2025Epoch AI

Coding & software engineering

Coding & software engineering results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Aider PolyglotPercent correct59.6%Third party——Aider LLM Leaderboards via Epoch AI
WeirdML (v2)Average accuracy37.3%Third party——WeirdML Leaderboard via Epoch AI

Long context

Long context results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Fiction.LiveBench% correct at 16K tokens (Epoch's column)67.7%Third party——Fiction.live leaderboard via Epoch AI

Writing

Writing results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
LLM Creative Story-Writing Benchmark V1 (Lech Mazur)Mean rubric score (percent of the 10-point scale)83.0%Third party——lechmazur/writing Github repository via Epoch AI

Human preference

Human preference results
BenchmarkMetricValueProvenanceSettingEvaluatedSource
Text Arena (arena.ai)Arena score (Elo scale)1375Independent—25 Sep 2026Arena
Text Arena (arena.ai)Votes25827Independent—25 Sep 2026Arena

Other Qwen versions

Sources