#20

Qwen3.5 Plus 2026-04-20

Qwen Release: 2026-04-20 Tested on: 2026-04-27 23:09 qwen/qwen3.5-plus-20260420::medium

(medium) (none)

Score

8.2

Consistency

9.0

Reliability

9.7

Total Cost (Current Price)

$0.269

Total Output Tokens

106,011

Input Price

$0.400 / 1M

Output Price

$2.400 / 1M

Tests Correct

Wrong Tests: 5

Attempt pass rate: 77.8%

Flaky tests

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

32.81s

Response Time (max): 92.41s

Response Time (total): 590.65s

Wrong answer: 5

Run history

Tested on	Score	Reliability	Total Cost	Compare
2026-05-21 23:53 Suite changed	7.6	9.6	$0.363	Compare
2026-05-08 14:34 Suite changed	7.8	9.6	$0.305	Compare
2026-05-08 14:34 Suite changed	7.8	9.6	$0.305	Compare
2026-04-27 23:09 Initial run	8.2	9.7	$0.269	Current run

Run comparison

Run	Score	Consistency	Reliability	Tests Correct	Flaky tests	Total Output Tokens	Total Cost	Response Time (avg)
2026-04-27 23:09 · Initial run	8.2	9.0	9.7	13/18	2	106,011	$0.269	32.81s
2026-05-08 14:34 · Suite changed	7.8	9.1	9.6	13/19	2	121,204	$0.305	35.96s
Difference	+0.4	-0.1	+0.1	0	0	-15193	-$0.037	-3145ms

These two runs used different benchmark suites, so the deltas reflect both model changes and suite changes.

Charts

Choose the first model, then click a second model to open a side-by-side page.

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Category Breakdown

Category	Score	Consistency
Anti-AI Tricks	10.0	10.0
Coding	10.0	10.0
Combined	10.0	10.0
Data parsing and extraction	10.0	10.0
Domain specific	2.9	7.2
General Intelligence	4.9	9.6
Instructions following	10.0	10.0
Puzzle Solving	8.2	7.2
Tool Calling	10.0	10.0

Qwen3.5 Plus 2026-04-20

Charts

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Category Breakdown

Compared models