AI BENCHY
Compare Charts
โค๏ธ Made by XCS
Your ad here

#12

DeepSeek V3.2

Deepseek ยท Release: 2025-12-01 ยท deepseek/deepseek-v3.2::medium

Avg Score

6.99

Cost per result

0.193

Consistency

8.75

Total Cost

$0.018

Tests Correct

9

A test is fully passed only if every run passed for that test.

Wrong Tests

5

Attempt pass rate: 71.4%

Flaky tests

2

Response time: avg 36.24s ยท total 507.30s ยท max 79.03s

Wrong answer: 3 Did not follow instructions: 1 Timed out: 1

Top Models by Score

Choose the first model, then click a second model to open a side-by-side page.

Quick Compare

Category Breakdown

Category Avg Score Consistency Tests Correct
Anti-AI Tricks 7.00 9.86 2/3
Data parsing and extraction 9.88 10.00 2/2
Domain specific 4.00 7.21 1/3
Instructions following 7.00 9.84 1/2
Puzzle Solving 7.00 7.21 2/3
Tool Calling 10.00 10.00 1/1