Updated daily at 05:00 UTC
- Released
- 25 Jun 2023
- Status
- Legacy
- Context
- 32.8K
- Max output
- —
- Input per 1M tokens
- —
- Output per 1M tokens
- —
- Open weights
- Yes
- License
- chatglm-model-license
- Parameters
- 6.2B
- Knowledge cutoff
- —
- Reasoning
- No
- Modalities
- text → text
Category scores
Out of 100, from independent and third-party results only, by method category-2026-09-29.1.
| Category | Score | Rank | Coverage |
|---|---|---|---|
| Human preference | 10.3 | Not ranked | 1 of 5 |
Benchmark results
Every result we hold for this model, with who ran it and where it was published.
Knowledge & reasoning
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| AI2 Reasoning Challenge (ARC) | Challenge set accuracy | 61.0% | Self-reported | — | — | Qwen Technical Report via Epoch AI |
| BIG-Bench Hard (BBH) | Average accuracy | 33.7% | Third party | — | — | Baichuan 2: Open Large-scale Language Models via Epoch AI |
| BIG-Bench Hard (BBH) | Average accuracy | 33.7% | Self-reported | — | — | Qwen Technical Report via Epoch AI |
| HellaSwag | Accuracy | 57.0% | Self-reported | — | — | Qwen Technical Report via Epoch AI |
| LAMBADA | Accuracy | 54.3% | Self-reported | — | — | Qwen Technical Report via Epoch AI |
| LAMBADA | Accuracy | 54.3% | Self-reported | — | — | Qwen Technical Report via Epoch AI |
| MMLU | Accuracy | 47.9% | Self-reported | — | — | Qwen Technical Report via Epoch AI |
| PIQA | Accuracy | 69.6% | Self-reported | — | — | Qwen Technical Report via Epoch AI |
Mathematics
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| GSM8K | Exact match | 28.9% | Third party | — | — | Baichuan 2: Open Large-scale Language Models via Epoch AI |
| GSM8K | Exact match | 32.4% | Self-reported | — | — | Qwen Technical Report via Epoch AI |
| GSM8K | Exact match | 28.8% | Self-reported | — | — | Qwen Technical Report via Epoch AI |
Human preference
| Benchmark | Metric | Value | Provenance | Setting | Evaluated | Source |
|---|---|---|---|---|---|---|
| Text Arena (arena.ai) | Arena score (Elo scale) | 1025 | Independent | — | 25 Sep 2026 | Arena |
| Text Arena (arena.ai) | Votes | 2658 | Independent | — | 25 Sep 2026 | Arena |
Other ChatGLM versions
- ChatGLM3-6B27 Oct 2023
- ChatGLM-6B14 Mar 2023