自定义评测选择
+
+
| 模型名称 | 参数数量 | 开源情况 | 发布机构 | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| OpenAI o1 | 91.04 | 91.80 | 0.00 | 96.40 | 77.30 | 0.00 | 0.00 | 0.00 | 未知 |
|
|
| DeepSeek-R1 | 84.00 | 90.80 | 0.00 | 0.00 | 71.50 | 0.00 | 0.00 | 0.00 | 6710.0 |
|
|
| OpenAI o1-mini | 80.30 | 85.20 | 0.00 | 0.00 | 60.00 | 0.00 | 92.40 | 0.00 | 未知 |
|
|
| Hunyuan-TurboS | 79.00 | 89.50 | 0.00 | 89.70 | 57.50 | 92.20 | 91.00 | 0.00 | 未知 |
|
|
| QwQ-32B | 76.00 | 0.00 | 0.00 | 0.00 | 58.00 | 0.00 | 19.00 | 0.00 | 325.0 |
|
|
| QwQ-32B-Preview | 70.97 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 320.0 |
|
|
| DeepSeek-R1-Distill-Llama-70B | 0.00 | 0.00 | 0.00 | 0.00 | 65.20 | 0.00 | 0.00 | 0.00 | 700.0 |
|
|
| OpenAI o3-mini (high) | 0.00 | 86.90 | 0.00 | 97.90 | 79.70 | 0.00 | 97.60 | 0.00 | 未知 |
|
|
| Kimi k1.5 (Short-CoT) | 0.00 | 87.40 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 未知 |
|
|
| Grok-3 mini - Reasoning | 0.00 | 0.00 | 0.00 | 0.00 | 84.00 | 0.00 | 0.00 | 0.00 | 未知 |
|
|
| Grok-3 - Reasoning Beta | 0.00 | 0.00 | 0.00 | 0.00 | 85.00 | 0.00 | 0.00 | 0.00 | 未知 |
|
|
| Claude Sonnet 3.7-64K Extended Thinking | 0.00 | 0.00 | 0.00 | 0.00 | 84.80 | 0.00 | 0.00 | 0.00 | 未知 |
|
|
| Phi-4-instruct (reasoning-trained) | 0.00 | 0.00 | 0.00 | 0.00 | 49.00 | 0.00 | 0.00 | 0.00 | 38.0 |
|
|
| DeepSeek-R1-Distill-Qwen-7B | 0.00 | 0.00 | 0.00 | 0.00 | 49.50 | 0.00 | 0.00 | 0.00 | 70.0 |
|
MMLU Pro
91.04
MMLU
91.80
GSM8K
0.00
MATH
96.40
GPQA Diamond
77.30
BBH
0.00
HumanEval
0.00
MBPP
0.00
MMLU Pro
84.00
MMLU
90.80
GSM8K
0.00
MATH
0.00
GPQA Diamond
71.50
BBH
0.00
HumanEval
0.00
MBPP
0.00
MMLU Pro
80.30
MMLU
85.20
GSM8K
0.00
MATH
0.00
GPQA Diamond
60.00
BBH
0.00
HumanEval
92.40
MBPP
0.00
MMLU Pro
79.00
MMLU
89.50
GSM8K
0.00
MATH
89.70
GPQA Diamond
57.50
BBH
92.20
HumanEval
91.00
MBPP
0.00
MMLU Pro
76.00
MMLU
0.00
GSM8K
0.00
MATH
0.00
GPQA Diamond
58.00
BBH
0.00
HumanEval
19.00
MBPP
0.00
MMLU Pro
70.97
MMLU
0.00
GSM8K
0.00
MATH
0.00
GPQA Diamond
0.00
BBH
0.00
HumanEval
0.00
MBPP
0.00
MMLU Pro
0.00
MMLU
0.00
GSM8K
0.00
MATH
0.00
GPQA Diamond
65.20
BBH
0.00
HumanEval
0.00
MBPP
0.00
MMLU Pro
0.00
MMLU
86.90
GSM8K
0.00
MATH
97.90
GPQA Diamond
79.70
BBH
0.00
HumanEval
97.60
MBPP
0.00
MMLU Pro
0.00
MMLU
87.40
GSM8K
0.00
MATH
0.00
GPQA Diamond
0.00
BBH
0.00
HumanEval
0.00
MBPP
0.00
MMLU Pro
0.00
MMLU
0.00
GSM8K
0.00
MATH
0.00
GPQA Diamond
84.00
BBH
0.00
HumanEval
0.00
MBPP
0.00
MMLU Pro
0.00
MMLU
0.00
GSM8K
0.00
MATH
0.00
GPQA Diamond
85.00
BBH
0.00
HumanEval
0.00
MBPP
0.00
MMLU Pro
0.00
MMLU
0.00
GSM8K
0.00
MATH
0.00
GPQA Diamond
84.80
BBH
0.00
HumanEval
0.00
MBPP
0.00
MMLU Pro
0.00
MMLU
0.00
GSM8K
0.00
MATH
0.00
GPQA Diamond
49.00
BBH
0.00
HumanEval
0.00
MBPP
0.00
MMLU Pro
0.00
MMLU
0.00
GSM8K
0.00
MATH
0.00
GPQA Diamond
49.50
BBH
0.00
HumanEval
0.00
MBPP
0.00