Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Qwen: Qwen3.5-122B-A10B vs Qwen: Qwen3.5-27B

Last updated at: 2026-06-01

Metric Qwen3.5-122B-A10B Qwen3.5-122B-A10B none Release: 2026-02-24 Qwen3.5-27B Qwen3.5-27B none Release: 2026-02-24
Score 5.4 5.8
Rank #131 #112
Reliability 10.0 10.0
Consistency 9.5 9.3
Tests Correct
Attempt pass rate 33.3% 40.0%
Flaky tests 1 2
Total Runs 60 60
Cost per result 0.380 0.241
Total Cost $0.019 $0.014
Input Price $0.260 / 1M $0.195 / 1M
Output Price $2.080 / 1M $1.560 / 1M
Output Tokens 3,374 3,585
Reasoning Tokens 0 0
Response Time (avg) 3.38s 1.69s
Response Time (max) 46.00s 9.39s
Response Time (total) 67.55s 33.82s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-122B-A10B 4.8 10.0 25.0% 0 1.59s 312 0
Qwen3.5-27B 4.8 10.0 25.0% 0 788ms 267 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-122B-A10B 4.0 5.5 33.3% 1 2.14s 684 0
Qwen3.5-27B 7.3 10.0 50.0% 0 1.98s 408 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-122B-A10B 3.0 10.0 0.0% 0 46.00s 1,137 0
Qwen3.5-27B 2.8 1.6 33.3% 1 9.39s 1,461 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 1.01s 243 0
Qwen3.5-27B 10.0 10.0 100.0% 0 1.43s 243 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-122B-A10B 5.3 10.0 33.3% 0 465ms 15 0
Qwen3.5-27B 3.0 10.0 0.0% 0 540ms 15 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-122B-A10B 5.0 10.0 0.0% 0 1.12s 66 0
Qwen3.5-27B 5.0 10.0 0.0% 0 2.51s 126 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-122B-A10B 6.3 10.0 50.0% 0 513ms 69 0
Qwen3.5-27B 6.3 10.0 50.0% 0 1.03s 69 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-122B-A10B 3.8 10.0 0.0% 0 1.00s 575 0
Qwen3.5-27B 6.7 7.9 55.6% 1 1.38s 683 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-122B-A10B 10.0 10.0 100.0% 0 2.04s 264 0
Qwen3.5-27B 10.0 10.0 100.0% 0 3.54s 303 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-122B-A10B 3.0 10.0 0.0% 0 295ms 9 0
Qwen3.5-27B 3.0 10.0 0.0% 0 599ms 10 0

Quick Compare

Switch Comparison Pair