#24
Qwen: Qwen3.5-Flash
Qwen · qwen/qwen3.5-flash-02-23::medium
Avg Score
5.79
Cost per result
0.650
Consistency
7.61
Total Cost
$0.046
Tests Correct
7/14
A test is fully passed only if every run passed for that test.
Wrong Tests
7
Attempt pass rate: 66.7%
Flaky tests
4
Response time: avg 86.89s · total 1216.50s · max 234.29s
Timed out: 3
API error: 2
Did not follow instructions: 1
Wrong answer: 1
Top Models by Score
Choose the first model, then click a second model to open a side-by-side page.
Category Breakdown
| Category | Avg Score | Consistency | Tests Correct |
|---|---|---|---|
| Anti-AI Tricks | 10.00 | 10.00 | 3/3 |
| Data parsing and extraction | 5.50 | 5.87 | 1/2 |
| Domain specific | 1.00 | 4.42 | 0/3 |
| Instructions following | 7.50 | 9.91 | 1/2 |
| Puzzle Solving | 4.00 | 7.21 | 1/3 |
| Tool Calling | 10.00 | 10.00 | 1/1 |