Mostly Basic Python Problems
一个包含 974 个简单的 Python 编程问题的基准,用于评估模型生成代码的能力。
模型简称 | 得分 | 发布机构 | 发布时间 | 参数规模(亿) |
---|---|---|---|---|
Llama3.1-405B Instruct | 88.6 |
![]() |
2024-07-23 | 4050.0 |
Gemini 1.5 Pro | 87.8 |
![]() |
2024-02-15 | 0.0 |
Llama3.3-70B-Instruct | 87.6 |
![]() |
2024-12-06 | 700.0 |
GPT-4o mini | 87.2 |
![]() |
2024-07-18 | 0.0 |
Llama3.1-70B-Instruct | 86.0 |
![]() |
2024-07-23 | 700.0 |
Claude 3.5 Haiku | 85.6 |
![]() |
2024-10-22 | 0.0 |
Qwen2.5-72B | 84.7 |
![]() |
2024-09-18 | 727.0 |
Qwen2.5-Max | 80.6 |
![]() |
2025-01-28 | 未知 |
Llama 4 Maverick | 77.6 |
![]() |
2025-04-05 | 4000.0 |
Qwen2.5-7B | 74.9 |
![]() |
2024-09-18 | 70.0 |
Mistral-Small-3.1-24B-Instruct-2503 | 74.71 |
![]() |
2025-03-17 | 240.0 |
Gemma 3 - 27B (IT) | 74.4 |
![]() |
2025-03-12 | 270.0 |
C4AI Aya Vision 32B | 70.43 |
![]() |
2025-03-04 | 320.0 |
Llama3.1-8B-Instruct | 69.4 |
![]() |
2024-07-23 | 80.0 |
Llama 4 Scout | 67.8 |
![]() |
2025-04-05 | 1090.0 |
Phi-4-mini-instruct (3.8B) | 65.3 |
![]() |
2025-02-27 | 38.0 |
Moonlight-16B-A3B-Instruct | 63.8 |
![]() |
2025-02-23 | 160.0 |
Gemma 2 - 9B | 62.2 |
![]() |
2024-06-27 | 90.0 |
Qwen2.5-3B | 57.1 |
![]() |
2024-09-18 | 30.0 |
Llama3.1-8B | 53.9 |
![]() |
2024-07-23 | 80.0 |
Mistral-7B-Instruct-v0.3 | 51.1 |
![]() |
2024-05-22 | 70.0 |
Llama-3.2-3B | 48.7 |
![]() |
2024-09-18 | 32.0 |
Amazon Nova Pro | 0.0 |
![]() |
2024-12-03 | 未知 |