AI BENCHY
Compare Charts
โค๏ธ Made by XCS
Your ad here

#30

DeepSeek V3.2

Deepseek ยท Release: 2025-12-01 ยท deepseek/deepseek-v3.2::none

Avg Score

4.70

Cost per result

0.132

Consistency

8.20

Total Cost

$0.007

Tests Correct

5

A test is fully passed only if every run passed for that test.

Wrong Tests

9

Attempt pass rate: 47.6%

Flaky tests

3

Response time: avg 6.22s ยท total 87.03s ยท max 16.20s

Wrong answer: 6 Extra formatting: 2 Did not follow instructions: 1

Top Models by Score

Choose the first model, then click a second model to open a side-by-side page.

Quick Compare

Category Breakdown

Category Avg Score Consistency Tests Correct
Anti-AI Tricks 1.00 9.68 0/3
Data parsing and extraction 5.38 5.81 1/2
Domain specific 1.00 7.21 0/3
Instructions following 8.00 9.99 1/2
Puzzle Solving 7.67 7.50 2/3
Tool Calling 10.00 10.00 1/1