#8

Qwen3.5-27B

Qwen · Release: 2026-02-24 · qwen/qwen3.5-27b::medium

8.4

Consistency

8.8

$0.497

Total Output Tokens

245,000

Input Price

$0.195 / 1M

Output Price

$1.560 / 1M

Wrong Tests: 5

Attempt pass rate: 81.5%

Flaky tests

3

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

53.03s

Response Time (max): 163.96s

Response Time (total): 954.46s

Did not follow instructions: 2 Extra formatting: 1 Timed out: 1 Wrong answer: 1

Charts

Choose the first model, then click a second model to open a side-by-side page.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Qwen3.5-27BmediumvsQwen3.6 Plus PreviewmediumFree Available Qwen3.5-27BmediumvsQwen3.5 Plus 2026-02-15medium Qwen3.5-27BmediumvsGemini 3 PRO Previewmedium Qwen3.5-27BmediumvsGPT-5.3-Codexmedium Qwen3.5-27BmediumvsGLM 5medium Qwen3.5-27BmediumvsGemini 3 Flash Previewmedium Qwen3.5-27BmediumvsGemini 3.1 Pro Previewmedium

Category Breakdown

Category	Score	Consistency	Tests Correct
Anti-AI Tricks	8.7	7.9
Coding	10.0	10.0
Combined	10.0	10.0
Data parsing and extraction	10.0	10.0
Domain specific	5.3	10.0
General Intelligence	6.1	3.1
Instructions following	10.0	10.0
Puzzle Solving	8.2	7.7
Tool Calling	10.0	10.0

Compared models