AI BENCHY
Advertise here
#106

Qwen3.5-9B

Qwen Release: 2026-03-02 Tested on: 2026-04-20 17:48 qwen/qwen3.5-9b::medium
(medium) (none)

Summary

Qwen3.5-9B scores 4.4 on AI BENCHY and ranks #106. It has N/A reliability, a 33.3% pass rate, $0.030 total cost, and 73.64s average response time.

What makes Qwen3.5-9B unique: It uses unusually many reasoning tokens, which can help explain its slower or more expensive runs.

Score

4.4

Consistency

7.2

Reliability

N/A

Total Cost (Current Price)

$0.030

Total Output Tokens

196,888

Total Input Tokens

0

Input Price

$0.100 / 1M

Output Price

$0.150 / 1M

Tests Correct

Wrong Tests: 15

Attempt pass rate: 33.3%

Flaky tests

6

Flaky tests had mixed outcomes across runs (at least one pass and one fail).

Response Time (avg)

73.64s

Response Time (max): 226.38s

Response Time (total): 1104.60s

Timed out: 11 Did not follow instructions: 2 Extra formatting: 1 Wrong answer: 1

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#106 Qwen3.5-9B

medium
Cost
$0.001
Time
35.9s
Tokens
3,030 tok

Run history

Tested on Score Reliability Tests Correct Total Cost Compare
2026-06-04 13:41 New test added 4.2 5.6 $0.035 ↓ Compare
2026-05-22 00:18 Suite changed 4.2 1.7 $0.035 Compare
2026-05-08 14:44 Suite changed 4.3 3.3 $0.035 Compare
2026-05-08 14:44 Suite changed 4.3 3.3 $0.035 Compare
2026-04-20 17:48 First recorded run 4.4 N/A $0.030 Current run

Charts

Choose the first model, then click a second model to open a side-by-side page.

Total Output Tokens

Score vs Total Output Tokens

Quick Compare

Qwen3.5-9BmediumvsQwen3.6 FlashnoneQwen3.5-9BmediumvsMiniMax M2.7mediumQwen3.5-9BmediumvsGrok 4.20noneQwen3.5-9BmediumvsQwen3.5-122B-A10BnoneQwen3.5-9Bmediumvsgpt-oss-120bnoneFree AvailableQwen3.5-9BmediumvsMistral Small 4mediumQwen3.5-9BmediumvsGemini 3 Flash PreviewmediumQwen3.5-9BmediumvsGemini 3.5 FlashhighQwen3.5-9BmediumvsNemotron 3 Ultra 550b A55bmediumFree AvailableQwen3.5-9BmediumvsGemini 3.5 Flashlow

Category Breakdown

Category Score Consistency Tests Correct
Anti-AI Tricks 5.1 5.8
Coding 2.6 10.0
Combined 3.0 10.0
Data parsing and extraction 3.6 5.6
Domain specific 3.6 7.2
General Intelligence 2.8 1.6
Instructions following 6.4 5.8
Puzzle Solving 3.1 10.0
Tool Calling 10.0 10.0

Compared models