Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Qwen: Qwen3.5-9B vs Qwen: Qwen3.5-9B

Last updated at: 2026-04-26

Metric Qwen3.5-9B Qwen3.5-9B medium Release: 2026-03-02 Qwen3.5-9B Qwen3.5-9B none Release: 2026-03-02
Score 4.4 4.8
Rank #114 #105
Reliability N/A N/A
Consistency 7.2 9.6
Tests Correct
Attempt pass rate 33.3% 24.1%
Flaky tests 6 1
Total Runs 54 54
Cost per result 0.976 0.116
Total Cost $0.030 $0.005
Input Price $0.100 / 1M $0.100 / 1M
Output Price $0.150 / 1M $0.150 / 1M
Output Tokens 24,291 3,951
Reasoning Tokens 172,597 0
Response Time (avg) 73.64s 1.47s
Response Time (max) 226.38s 5.91s
Response Time (total) 1104.60s 26.43s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-9B 5.1 5.8 50.0% 2 34.44s 2,621 12,411
Qwen3.5-9B 3.1 9.9 0.0% 0 1.71s 582 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-9B 2.6 10.0 0.0% 0 135.61s 6,150 31,393
Qwen3.5-9B 5.2 3.4 33.3% 1 5.69s 1,006 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-9B 3.0 10.0 0.0% 0 0ms 0 0
Qwen3.5-9B 3.0 10.0 0.0% 0 5.91s 1,255 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-9B 3.6 5.6 33.3% 1 87.31s 1,383 32,113
Qwen3.5-9B 10.0 10.0 100.0% 0 847ms 249 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-9B 3.6 7.2 22.2% 1 137.75s 11,549 48,475
Qwen3.5-9B 3.0 10.0 0.0% 0 464ms 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-9B 2.8 1.6 33.3% 1 226.38s 0 30,695
Qwen3.5-9B 4.4 9.9 0.0% 0 552ms 99 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-9B 6.4 5.8 66.7% 1 17.15s 599 4,517
Qwen3.5-9B 6.5 10.0 50.0% 0 514ms 75 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-9B 3.1 10.0 0.0% 0 33.38s 1,545 11,844
Qwen3.5-9B 3.2 9.9 0.0% 0 683ms 388 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-9B 10.0 10.0 100.0% 0 4.31s 444 1,149
Qwen3.5-9B 10.0 10.0 100.0% 0 1.27s 273 0

Quick Compare

Switch Comparison Pair

GPT-5.4 NanononevsQwen3.5-9BmediumLing 2.6 1tnoneFree AvailablevsQwen3.5-9BmediumQwen3.5-9BmediumvsGrok 4.1 FastnoneQwen3.5-9BmediumvsMiMo-V2-FlashnoneQwen3.5-9BnonevsGLM 4.7 FlashmediumQwen3.5-9BmediumvsHY3 PreviewnoneFree AvailableMercury 2nonevsQwen3.5-9BmediumElephant AlphamediumvsQwen3.5-9BnoneMiniMax M2.7mediumvsQwen3.5-9BnoneGPT-4o-mininonevsQwen3.5-9BmediumNemotron 3 SupernoneFree AvailablevsQwen3.5-9BmediumQwen3.5-9BmediumvsMiMo-V2.5none