Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Qwen: Qwen3.5-27B vs Z.ai: GLM 5.2

Summary

Qwen3.5-27B (medium) vs GLM 5.2 (high) benchmark comparison: GLM 5.2 (high) leads on average score with 8.0 vs 7.9. Qwen3.5-27B (medium) has the lower benchmark cost at $0.536 vs $0.554. GLM 5.2 (high) is faster at 37.09s vs 68.39s, with pass rates of 73.0% vs 77.8%.

Recommended model: GLM 5.2 (high) - It has the best score here (8.0), while responding about 1.8x faster than Qwen3.5-27B (medium).

Last updated at: 2026-07-10

Metric Qwen3.5-27B Qwen3.5-27B medium Release: 2026-02-24 GLM 5.2 GLM 5.2 high Release: 2026-06-17
Score 7.9 8.0
Rank #35 #32
Reliability 10.0 9.3
Consistency 8.5 7.6
Tests Correct
Attempt pass rate 73.0% 77.8%
Flaky tests 4 6
Total Runs 63 63
Cost per result 4.901 4.255
Total Cost $0.536 $0.554
Input Price $0.195 / 1M $0.770 / 1M
Output Price $1.560 / 1M $2.420 / 1M
Total Input Tokens 42,164 34,993
Output Tokens 8,534 51,575
Reasoning Tokens 329,289 166,065
Response Time (avg) 68.39s 37.09s
Response Time (max) 234.36s 180.69s
Response Time (total) 1436.24s 778.91s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#35 Qwen3.5-27B

medium
Cost
$0.008
Time
62.0s
Tokens
3,099 tok

#32 GLM 5.2

high
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 8.7 7.9 91.7% 1 19.75s 672 569 31,505
GLM 5.2 10.0 10.0 100.0% 0 5.80s 639 406 2,660
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 6.2 7.1 55.6% 1 160.69s 7,895 6,381 89,388
GLM 5.2 6.4 4.4 77.8% 2 73.03s 5,124 2,302 22,546
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 163.96s 14,946 483 9,991
GLM 5.2 10.0 10.0 100.0% 0 43.51s 12,696 711 4,267
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 30.26s 7,782 270 16,150
GLM 5.2 10.0 10.0 100.0% 0 5.81s 7,143 435 1,414
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 5.3 10.0 33.3% 0 79.53s 553 43 52,368
GLM 5.2 3.5 4.4 33.3% 2 73.97s 551 46,693 90,566
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 6.1 3.1 66.7% 1 101.41s 524 70 23,147
GLM 5.2 10.0 10.0 100.0% 0 12.90s 498 63 1,743
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 19.66s 699 97 11,638
GLM 5.2 10.0 10.0 100.0% 0 4.26s 678 151 1,210
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 8.2 7.7 77.8% 1 59.60s 696 242 70,096
GLM 5.2 6.0 4.6 66.7% 2 33.71s 665 568 22,392
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 7.45s 8,193 348 1,323
GLM 5.2 10.0 10.0 100.0% 0 9.25s 6,861 246 503
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 3.0 10.0 0.0% 0 85.11s 204 31 23,683
GLM 5.2 3.0 10.0 0.0% 0 127.82s 138 0 18,764

Quick Compare

Switch Comparison Pair