Benchmark

CL-bench

Measures: Context learning: 1,899 expert tasks where the model must learn knowledge absent from pretraining (invented legal systems, game rules, financial instruments) from its context and apply it; a task counts only if every rubric passes.

Maintainer
Tencent Hunyuan and Fudan University NLP group
Introduced
2026
Status
Active
Saturation
Headroom
Typical provenance
Independent
In scoring set
No

PaperOfficial leaderboard

Every result we hold, whoever ran it. Only independent and third-party rows count towards a score.

Leaderboard
ModelTasks solvedProvenanceSourceEvaluated
MiniMax-M2.511.4%Source not statedEpoch AI via Epoch AI—
Kimi K2 Thinking11.9%Source not statedEpoch AI via Epoch AI—
DeepSeek-V3.212.4%Source not statedEpoch AI via Epoch AI—
DeepSeek-V3.2-Exp
DeepSeek · Thinking effort
13.2%Source not statedEpoch AI via Epoch AI—
Qwen3-Max14.5%Source not statedEpoch AI via Epoch AI—
MiMo-V2-Pro15.7%Source not statedEpoch AI via Epoch AI—
Gemini 3 Pro15.8%Source not statedEpoch AI via Epoch AI—
GLM-4.715.9%Source not statedEpoch AI via Epoch AI—
Kimi K2 Thinking17.6%Source not statedEpoch AI via Epoch AI—
o3
OpenAI · High effort
17.8%Source not statedEpoch AI via Epoch AI—
GPT-5.2
OpenAI · High effort
18.1%Source not statedEpoch AI via Epoch AI—
GPT-5.2
OpenAI · Unknown effort
18.2%Source not statedEpoch AI via Epoch AI—
GLM-518.7%Source not statedEpoch AI via Epoch AI—
Kimi K2.519.3%Source not statedEpoch AI via Epoch AI—
Qwen3.5-Plus19.8%Source not statedEpoch AI via Epoch AI—
Qwen3.6-Plus20.3%Source not statedEpoch AI via Epoch AI—
Claude Opus 4.6
Anthropic · Unknown effort
20.7%Source not statedEpoch AI via Epoch AI—
Gemini 3.1 Pro20.8%Source not statedEpoch AI via Epoch AI—
Claude Opus 4.5
Anthropic · Unknown effort
21.1%Source not statedEpoch AI via Epoch AI—
GPT-5.1
OpenAI · Unknown effort
21.1%Source not statedEpoch AI via Epoch AI—
Grok 4.2022.2%Source not statedEpoch AI via Epoch AI—
GPT-5.1
OpenAI · High effort
23.7%Source not statedEpoch AI via Epoch AI—
GPT-5.4
OpenAI · Xhigh effort
27.9%Source not statedEpoch AI via Epoch AI—
  • Epoch AI, 'Capabilities & benchmarking', epoch.ai/benchmarks, CC BY 4.0.

Sources