Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Qwen: Qwen3.5-35B-A3B vs Qwen: Qwen3.6 27B

Last updated at: 2026-04-27

Metric Qwen3.5-35B-A3B Qwen3.5-35B-A3B none Release: 2026-02-24 Qwen3.6 27B Qwen3.6 27B none Release: 2026-04-20
Score 6.1 6.0
Rank #80 #81
Reliability N/A 10.0
Consistency 8.7 7.2
Tests Correct
Attempt pass rate 50.0% 55.6%
Flaky tests 3 6
Total Runs 54 54
Cost per result 0.215 0.433
Total Cost $0.016 $0.031
Input Price $0.163 / 1M $0.500 / 1M
Output Price $1.300 / 1M $2.000 / 1M
Output Tokens 4,300 3,775
Reasoning Tokens 0 0
Response Time (avg) 3.82s 4.00s
Response Time (max) 47.43s 12.08s
Response Time (total) 68.74s 72.01s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 3.4 7.9 16.7% 1 1.43s 574 0
Qwen3.6 27B 3.8 3.7 41.7% 3 2.83s 490 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 2.67s 539 0
Qwen3.6 27B 10.0 10.0 100.0% 0 10.18s 505 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 47.43s 1,833 0
Qwen3.6 27B 3.0 10.0 0.0% 0 9.95s 1,401 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 1.16s 243 0
Qwen3.6 27B 7.3 5.8 83.3% 1 2.06s 248 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 7.7 10.0 66.7% 0 485ms 15 0
Qwen3.6 27B 7.7 10.0 66.7% 0 3.03s 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 6.5 3.4 66.7% 1 1.19s 114 0
Qwen3.6 27B 5.2 9.9 0.0% 0 1.07s 72 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 6.3 10.0 50.0% 0 809ms 63 0
Qwen3.6 27B 6.2 5.8 66.7% 1 1.92s 49 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 3.9 7.4 22.2% 1 1.34s 655 0
Qwen3.6 27B 5.3 7.2 44.4% 1 5.24s 647 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 2.30s 264 0
Qwen3.6 27B 9.5 10.0 100.0% 0 6.74s 339 0

Quick Compare

Switch Comparison Pair

GPT-5 NanomediumvsQwen3.5-35B-A3Bnonegpt-oss-120bmediumFree AvailablevsQwen3.6 27BnoneGPT-5 NanomediumvsQwen3.6 27Bnonegpt-oss-120bmediumFree AvailablevsQwen3.5-35B-A3BnoneMiniMax M2.5mediumFree AvailablevsQwen3.6 27BnoneMercury 2mediumvsQwen3.5-35B-A3BnoneMistral Small 4mediumvsQwen3.6 27BnoneMiniMax M2.5mediumFree AvailablevsQwen3.5-35B-A3BnoneMercury 2mediumvsQwen3.6 27BnoneMistral Small 4mediumvsQwen3.5-35B-A3BnoneQwen3.5-35B-A3BnonevsGrok 4.1 FastmediumNemotron 3 SupermediumFree AvailablevsQwen3.5-35B-A3Bnone