#22
Qwen: Qwen3.5-35B-A3B
Qwen · qwen/qwen3.5-35b-a3b::medium
Avg Score
5.93
Cost per result
5.169
Consistency
6.62
Total Cost
$0.362
Tests Correct
7/14
A test is fully passed only if every run passed for that test.
Wrong Tests
7
Attempt pass rate: 73.8%
Flaky tests
6
Response time: avg 44.87s · total 628.19s · max 106.00s
Did not follow instructions: 2
Timed out: 2
Wrong answer: 2
API error: 1
Top Models by Score
Choose the first model, then click a second model to open a side-by-side page.
Category Breakdown
| Category | Avg Score | Consistency | Tests Correct |
|---|---|---|---|
| Anti-AI Tricks | 10.00 | 10.00 | 3/3 |
| Data parsing and extraction | 5.50 | 5.87 | 1/2 |
| Domain specific | 1.00 | 4.42 | 0/3 |
| Instructions following | 8.00 | 6.80 | 1/2 |
| Puzzle Solving | 4.34 | 4.70 | 1/3 |
| Tool Calling | 10.00 | 10.00 | 1/1 |