Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Qwen: Qwen3.5-27B vs Qwen: Qwen3.6 Flash

Last updated at: 2026-04-27

Metric Qwen3.5-27B Qwen3.5-27B none Release: 2026-02-24 Qwen3.6 Flash Qwen3.6 Flash none Release: 2026-04-20
Score 5.9 5.8
Rank #85 #90
Reliability N/A 10.0
Consistency 9.2 10.0
Tests Correct
Attempt pass rate 38.9% 38.9%
Flaky tests 2 0
Total Runs 54 54
Cost per result 0.265 0.250
Total Cost $0.016 $0.018
Input Price $0.195 / 1M $0.250 / 1M
Output Price $1.560 / 1M $1.500 / 1M
Output Tokens 3,545 4,161
Reasoning Tokens 0 0
Response Time (avg) 1.74s 1.65s
Response Time (max) 9.39s 4.60s
Response Time (total) 31.32s 29.78s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 4.8 10.0 25.0% 0 788ms 267 0
Qwen3.6 Flash 3.1 10.0 0.0% 0 1.63s 1,554 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 2.51s 381 0
Qwen3.6 Flash 10.0 10.0 100.0% 0 2.23s 867 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 2.8 1.6 33.3% 1 9.39s 1,461 0
Qwen3.6 Flash 3.0 10.0 0.0% 0 4.22s 315 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 1.43s 243 0
Qwen3.6 Flash 10.0 10.0 100.0% 0 2.13s 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 3.0 10.0 0.0% 0 540ms 15 0
Qwen3.6 Flash 5.3 10.0 33.3% 0 1.11s 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 5.0 10.0 0.0% 0 2.51s 126 0
Qwen3.6 Flash 10.0 10.0 100.0% 0 947ms 132 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 4.8 10.0 0.0% 0 815ms 69 0
Qwen3.6 Flash 6.3 10.0 50.0% 0 1.10s 66 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 6.7 7.9 55.6% 1 1.37s 680 0
Qwen3.6 Flash 3.5 10.0 0.0% 0 1.20s 697 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 3.54s 303 0
Qwen3.6 Flash 10.0 10.0 100.0% 0 2.49s 272 0

Quick Compare

Switch Comparison Pair

gpt-oss-120bmediumFree AvailablevsQwen3.5-27Bnonegpt-oss-120bmediumFree AvailablevsQwen3.6 FlashnoneMiniMax M2.5mediumFree AvailablevsQwen3.6 FlashnoneMistral Small 4mediumvsQwen3.6 FlashnoneMiniMax M2.5mediumFree AvailablevsQwen3.5-27BnoneMistral Small 4mediumvsQwen3.5-27BnoneGPT-5 NanomediumvsQwen3.5-27BnoneGPT-5 NanomediumvsQwen3.6 FlashnoneMiniMax M2.7mediumvsQwen3.6 FlashnoneElephant AlphamediumvsQwen3.6 FlashnoneMiniMax M2.7mediumvsQwen3.5-27BnoneMercury 2mediumvsQwen3.5-27Bnone