本页面展示了多个主流大模型在各项评测基准上的表现，包括MMLU、GSM8K、HumanEval等多个标准数据集。我们通过实时更新的评测结果，帮助开发者和研究人员了解不同大模型在各种任务下的表现。用户可以选择自定义模型与评测基准进行对比，快速获取不同模型在实际应用中的优劣势。
各个评测基准的详细介绍可见： LLM 评测基准列表与介绍
| 模型名称 | ||||||||
|---|---|---|---|---|---|---|---|---|
| OpenAI o1 | 91.04 | 91.80 | 0.00 | 96.40 | 77.30 | 0.00 | 0.00 | 0.00 |
| DeepSeek-R1 | 84.00 | 90.80 | 0.00 | 0.00 | 71.50 | 0.00 | 0.00 | 0.00 |
| OpenAI o1-mini | 80.30 | 85.20 | 0.00 | 0.00 | 60.00 | 0.00 | 92.40 | 0.00 |
| Gemini 2.0 Pro Experimental | 79.10 | 86.50 | 0.00 | 91.80 | 64.70 | 0.00 | 0.00 | 0.00 |
| Claude 3.5 Sonnet New | 78.00 | 88.30 | 0.00 | 78.30 | 65.00 | 0.00 | 93.70 | 0.00 |
| GPT-4o | 77.90 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| GPT-4o(2024-11-20) | 77.90 | 85.70 | 0.00 | 68.50 | 0.00 | 0.00 | 90.20 | 0.00 |
| Claude 3.5 Sonnet | 77.64 | 88.30 | 0.00 | 71.10 | 59.40 | 0.00 | 92.00 | 0.00 |
| Gemini 2.0 Flash Experimental | 76.24 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| Gemini 1.5 Pro | 76.10 | 87.10 | 0.00 | 82.90 | 53.50 | 0.00 | 89.00 | 87.80 |
| DeepSeek-V3 | 75.90 | 88.50 | 0.00 | 0.00 | 59.10 | 0.00 | 0.00 | 0.00 |
| Grok 2 | 75.50 | 87.50 | 0.00 | 76.10 | 56.00 | 0.00 | 88.40 | 0.00 |
| Llama3.1-405B Instruct | 73.40 | 88.60 | 0.00 | 73.90 | 49.00 | 0.00 | 89.00 | 88.60 |
| QwQ-32B-Preview | 70.97 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| Phi 4 - 14B | 70.40 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| Qwen2.5-32B | 69.23 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| Qwen2.5-Max | 69.00 | 87.90 | 94.50 | 68.50 | 0.00 | 0.00 | 73.20 | 80.60 |
| Llama3.3-70B-Instruct | 68.90 | 86.00 | 0.00 | 77.00 | 50.50 | 0.00 | 88.40 | 87.60 |
| Claude3-Opus | 68.45 | 86.80 | 95.00 | 60.10 | 50.40 | 0.00 | 84.90 | 0.00 |
| Llama3.1-70B-Instruct | 66.40 | 86.00 | 0.00 | 67.80 | 48.00 | 0.00 | 80.50 | 86.00 |
| Qwen2.5-14B | 63.69 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| GPT-4o mini | 63.09 | 82.00 | 0.00 | 70.20 | 0.00 | 0.00 | 87.20 | 0.00 |
| Claude 3.5 Haiku | 62.12 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| Llama3.1-405B | 61.60 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| Qwen2.5-72B | 58.10 | 86.10 | 91.50 | 62.10 | 45.90 | 86.30 | 59.10 | 84.70 |
| Claude3-Sonnet | 56.80 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| Gemma2-27B | 56.54 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| Mixtral-8x22B-Instruct-v0.1 | 56.33 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| Llama3-70B-Instruct | 56.20 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| Llama3-70B | 52.78 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| Llama3.1-70B | 52.47 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| Grok-1.5 | 51.00 | 81.30 | 0.00 | 50.60 | 35.90 | 0.00 | 74.10 | 0.00 |
| OpenAI o3-mini (high) | 0.00 | 86.90 | 0.00 | 97.90 | 0.00 | 0.00 | 97.60 | 0.00 |
| Amazon Nova Pro | 0.00 | 85.90 | 0.00 | 76.60 | 0.00 | 0.00 | 89.00 | 0.00 |
| Kimi k1.5 (Short-CoT) | 0.00 | 87.40 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| DeepSeek-R1-Distill-Llama-70B | 0.00 | 0.00 | 0.00 | 0.00 | 65.20 | 0.00 | 0.00 | 0.00 |
| Grok 3 | 0.00 | 0.00 | 0.00 | 0.00 | 75.00 | 0.00 | 0.00 | 0.00 |
| Grok 3 mini | 0.00 | 0.00 | 0.00 | 0.00 | 65.00 | 0.00 | 0.00 | 0.00 |
| Grok-3 mini - Reasoning | 0.00 | 0.00 | 0.00 | 0.00 | 84.00 | 0.00 | 0.00 | 0.00 |
| Grok-3 - Reasoning Beta | 0.00 | 0.00 | 0.00 | 0.00 | 85.00 | 0.00 | 0.00 | 0.00 |