#5
Qwen: Qwen3.5-27B
Qwen · qwen/qwen3.5-27b::medium
Avg Score
8.56
Cost per result
2.950
Consistency
9.56
Total Cost
$0.325
Tests Correct
11/14
A test is fully passed only if every run passed for that test.
Wrong Tests
3
Attempt pass rate: 83.3%
Flaky tests
1
Response time: avg 33.79s · total 473.12s · max 95.52s
Did not follow instructions: 1
Timed out: 1
Wrong answer: 1
Top Models by Score
Choose the first model, then click a second model to open a side-by-side page.
Category Breakdown
| Category | Avg Score | Consistency | Tests Correct |
|---|---|---|---|
| Anti-AI Tricks | 10.00 | 10.00 | 3/3 |
| Data parsing and extraction | 9.88 | 10.00 | 2/2 |
| Domain specific | 4.00 | 10.00 | 1/3 |
| Instructions following | 9.00 | 6.88 | 1/2 |
| Puzzle Solving | 10.00 | 10.00 | 3/3 |
| Tool Calling | 10.00 | 10.00 | 1/1 |