#29
Qwen: Qwen3.5-27B
Qwen · qwen/qwen3.5-27b::none
Avg Score
4.70
Cost per result
0.190
Consistency
9.94
Total Cost
$0.010
Tests Correct
5/14
A test is fully passed only if every run passed for that test.
Wrong Tests
9
Attempt pass rate: 35.7%
Flaky tests
0
Response time: avg 1.14s · total 16.01s · max 3.54s
Wrong answer: 7
Did not follow instructions: 2
Top Models by Score
Choose the first model, then click a second model to open a side-by-side page.
Category Breakdown
| Category | Avg Score | Consistency | Tests Correct |
|---|---|---|---|
| Anti-AI Tricks | 4.00 | 10.00 | 1/3 |
| Data parsing and extraction | 9.88 | 10.00 | 2/2 |
| Domain specific | 1.00 | 10.00 | 0/3 |
| Instructions following | 4.00 | 10.00 | 0/2 |
| Puzzle Solving | 4.34 | 9.68 | 1/3 |
| Tool Calling | 10.00 | 10.00 | 1/1 |