#30
Qwen: Qwen3.5-35B-A3B
Qwen · qwen/qwen3.5-35b-a3b::none
Avg Score
4.63
Cost per result
0.165
Consistency
9.40
Total Cost
$0.009
Tests Correct
5/14
A test is fully passed only if every run passed for that test.
Wrong Tests
9
Attempt pass rate: 40.5%
Flaky tests
1
Response time: avg 1.17s · total 16.43s · max 4.39s
Wrong answer: 8
Did not follow instructions: 1
Top Models by Score
Choose the first model, then click a second model to open a side-by-side page.
Category Breakdown
| Category | Avg Score | Consistency | Tests Correct |
|---|---|---|---|
| Anti-AI Tricks | 1.00 | 7.21 | 0/3 |
| Data parsing and extraction | 9.88 | 10.00 | 2/2 |
| Domain specific | 7.00 | 10.00 | 2/3 |
| Instructions following | 3.50 | 9.99 | 0/2 |
| Puzzle Solving | 1.34 | 10.00 | 0/3 |
| Tool Calling | 10.00 | 10.00 | 1/1 |