Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Qwen: Qwen3.6 35B A3B vs Qwen: Qwen3.6 Flash

Last updated at: 2026-04-27

Metric Qwen3.6 35B A3B Qwen3.6 35B A3B medium Release: 2026-04-20 Qwen3.6 Flash Qwen3.6 Flash medium Release: 2026-04-20
Score 8.8 8.1
Rank #9 #24
Reliability 10.0 10.0
Consistency 9.5 8.2
Tests Correct
Attempt pass rate 83.3% 79.6%
Flaky tests 1 4
Total Runs 54 54
Cost per result 0.800 1.449
Total Cost $0.104 $0.174
Input Price $0.162 / 1M $0.250 / 1M
Output Price $0.966 / 1M $1.500 / 1M
Output Tokens 14,256 2,804
Reasoning Tokens 98,005 107,210
Response Time (avg) 11.98s 9.90s
Response Time (max) 45.02s 26.85s
Response Time (total) 191.76s 178.26s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 6.02s 1,154 12,385
Qwen3.6 Flash 10.0 10.0 100.0% 0 6.10s 624 14,024
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 32.58s 3,294 15,116
Qwen3.6 Flash 6.7 3.5 66.7% 1 25.84s 435 17,044
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 0.0 0.0 0.0% 0 0ms 0 0
Qwen3.6 Flash 10.0 10.0 100.0% 0 20.28s 483 13,839
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 12.99s 2,591 9,968
Qwen3.6 Flash 10.0 10.0 100.0% 0 9.65s 270 13,155
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 5.3 7.2 44.4% 1 22.50s 6,193 39,116
Qwen3.6 Flash 3.5 4.4 33.3% 2 14.65s 60 24,409
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 4.4 9.9 0.0% 0 8.66s 129 4,569
Qwen3.6 Flash 4.8 9.9 0.0% 0 9.88s 140 5,445
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 7.50s 219 7,404
Qwen3.6 Flash 10.0 10.0 100.0% 0 6.05s 102 7,423
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 10.0 10.0 100.0% 0 5.98s 676 9,447
Qwen3.6 Flash 8.2 7.2 88.9% 1 6.17s 355 10,683
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 35B A3B 0.0 0.0 0.0% 0 0ms 0 0
Qwen3.6 Flash 10.0 10.0 100.0% 0 4.00s 335 1,188

Quick Compare

Switch Comparison Pair