AI BENCHY
Advertise here
#159

Qwen3.5-9B

Qwen Release: 2026-03-02 Tested on: 2026-06-04 13:41 qwen/qwen3.5-9b::medium
(medium) (none)

Summary

Qwen3.5-9B scores 4.2 on AI BENCHY and ranks #159. It has 5.6 reliability, a 27.0% pass rate, $0.035 total cost, and 82.24s average response time.

What makes Qwen3.5-9B unique: It uses unusually many reasoning tokens, which can help explain its slower or more expensive runs.

Score

4.2

Consistency

8.0

Reliability

5.6

Total Cost (Current Price)

$0.035 ↓ -2.5%

Tested at: $0.036

Total Output Tokens

238,561

Total Input Tokens

17,070

Input Price

$0.040 / 1M

Output Price

$0.150 / 1M

Tests Correct

Wrong Tests: 18

Attempt pass rate: 27.0%

Flaky tests

5

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

82.24s

Response Time (max): 226.38s

Response Time (total): 1315.88s

Timed out: 11 No answer: 2 Wrong answer: 2 API error: 1 Extra formatting: 1 Did not follow instructions: 1

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#159 Qwen3.5-9B

medium
Cost
$0.001
Time
35.9s
Tokens
3,030 tok

Run history

Tested on Score Reliability Tests Correct Total Cost Compare
2026-07-16 23:12 New test added 3.8 5.0 $0.036 ↑ Compare
2026-06-04 13:41 New test added 4.2 5.6 $0.035 ↓ Current run
2026-05-22 00:18 Suite changed 4.2 1.7 $0.035 Compare
2026-05-08 14:44 Suite changed 4.3 3.3 $0.035 Compare
2026-05-08 14:44 Suite changed 4.3 3.3 $0.035 Compare
2026-04-20 17:48 First recorded run 4.4 N/A $0.030 Compare

This run used a different benchmark suite. Keep suite changes in mind when reading historical movement.

Price History

Historical pricing data for this model from OpenRouter.

Date Input Price Output Price
2026-06-04 14:42 $0.040 / 1M $0.150 / 1M

Charts

Choose the first model, then click a second model to open a side-by-side page.

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Qwen3.5-9BmediumvsGranite 4.1 8BnoneQwen3.5-9Bmediumvsgpt-oss-120bnoneFree AvailableQwen3.5-9BmediumvsGrok 4.20noneQwen3.5-9BmediumvsGLM 4.7 FlashmediumQwen3.5-9BmediumvsLaguna S 2.1noneFree AvailableQwen3.5-9BmediumvsMiniMax M2.5mediumQwen3.5-9BmediumvsMercury 2noneQwen3.5-9BmediumvsCobuddymediumQwen3.5-9BmediumvsQwen3 Coder NextmediumQwen3.5-9BmediumvsTrinity Large Previewnone

Category Breakdown

Category Score Consistency Tests Correct
Anti-AI Tricks 5.1 5.8
Coding 2.9 10.0
Combined 3.0 10.0
Data parsing and extraction 3.6 5.6
Domain specific 3.6 7.2
General Intelligence 2.8 1.6
Instructions following 6.5 10.0
Puzzle Solving 3.0 10.0
Tool Calling 10.0 10.0
Trivia 3.0 10.0

Compared models