#12
DeepSeek V3.2
Deepseek ยท Release: 2025-12-01 ยท deepseek/deepseek-v3.2::medium
Avg Score
6.99
Cost per result
0.193
Consistency
8.75
Total Cost
$0.018
Tests Correct
9
A test is fully passed only if every run passed for that test.
Wrong Tests
5
Attempt pass rate: 71.4%
Flaky tests
2
Response time: avg 36.24s ยท total 507.30s ยท max 79.03s
Wrong answer: 3
Did not follow instructions: 1
Timed out: 1
Top Models by Score
Choose the first model, then click a second model to open a side-by-side page.
Quick Compare
DeepSeek V3.2mediumvsStep 3.5 FlashmediumFree AvailableDeepSeek V3.2mediumvsGPT-5.2mediumDeepSeek V3.2mediumvsGemini 3 Flash PreviewnoneDeepSeek V3.2mediumvsQwen3.5-122B-A10BmediumDeepSeek V3.2mediumvsGLM 5mediumDeepSeek V3.2mediumvsClaude Sonnet 4.6noneDeepSeek V3.2mediumvsGemini 3 Flash PreviewmediumDeepSeek V3.2mediumvsGemini 3.1 Pro Previewmedium
Category Breakdown
| Category | Avg Score | Consistency | Tests Correct |
|---|---|---|---|
| Anti-AI Tricks | 7.00 | 9.86 | 2/3 |
| Data parsing and extraction | 9.88 | 10.00 | 2/2 |
| Domain specific | 4.00 | 7.21 | 1/3 |
| Instructions following | 7.00 | 9.84 | 1/2 |
| Puzzle Solving | 7.00 | 7.21 | 2/3 |
| Tool Calling | 10.00 | 10.00 | 1/1 |