AI BENCHY
Advertise here

#72

Qwen3.5-27B

Qwen Release: 2026-02-24 Tested on: 2026-04-11 01:19 qwen/qwen3.5-27b::none
(medium) (none)

Score

5.9

Consistency

9.2

Reliability

N/A

Total Cost (Current Price)

$0.016

Total Output Tokens

3,545

Input Price

$0.195 / 1M

Output Price

$1.560 / 1M

Tests Correct

Wrong Tests: 12

Attempt pass rate: 38.9%

Flaky tests

2

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

1.74s

Response Time (max): 9.39s

Response Time (total): 31.32s

Wrong answer: 10 Did not follow instructions: 2

Run history

Tested on Score Reliability Tests Correct Total Cost Compare
2026-05-21 23:59 Suite changed 5.8 10.0 $0.017 Compare
2026-04-11 01:19 First recorded run 5.9 N/A $0.016 Current run

Charts

Choose the first model, then click a second model to open a side-by-side page.

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Qwen3.5-27BnonevsQwen3.5 Plus 2026-02-15noneQwen3.5-27BnonevsGLM 5noneQwen3.5-27BnonevsGemma 4 26B A4BnoneFree AvailableQwen3.5-27BnonevsMercury 2mediumQwen3.5-27BnonevsMiMo-V2-OmninoneQwen3.5-27BnonevsGemini 3 Flash PreviewmediumQwen3.5-27BnonevsGemini 3.5 FlashhighQwen3.5-27BnonevsRing-2.6-1TmediumQwen3.5-27BnonevsGemini 3.5 Flashlow

Category Breakdown

Category Score Consistency Tests Correct
Anti-AI Tricks 4.8 10.0
Coding 10.0 10.0
Combined 2.8 1.6
Data parsing and extraction 10.0 10.0
Domain specific 3.0 10.0
General Intelligence 5.0 10.0
Instructions following 4.8 10.0
Puzzle Solving 6.7 7.9
Tool Calling 10.0 10.0

Compared models