Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Qwen: Qwen3.5-27B vs Z.ai: GLM 5

Last updated at: 2026-06-02

Metric Qwen3.5-27B Qwen3.5-27B medium Release: 2026-02-24 GLM 5 GLM 5 medium Release: 2026-02-12
Score 7.9 8.2
Rank #27 #19
Reliability 10.0 10.0
Consistency 8.9 8.4
Tests Correct
Attempt pass rate 73.3% 81.7%
Flaky tests 3 4
Total Runs 60 60
Cost per result 4.532 1.676
Total Cost $0.488 $0.228
Input Price $0.195 / 1M $0.600 / 1M
Output Price $1.560 / 1M $2.080 / 1M
Total Input Tokens 39,329 32,626
Output Tokens 2,569 21,558
Reasoning Tokens 304,894 95,772
Response Time (avg) 60.09s 32.67s
Response Time (max) 177.36s 99.85s
Response Time (total) 1201.89s 392.01s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 8.7 7.9 91.7% 1 19.75s 672 569 31,505
GLM 5 10.0 10.0 100.0% 0 23.66s 555 480 7,056
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 7.0 9.8 50.0% 0 123.86s 5,060 416 64,993
GLM 5 10.0 10.0 100.0% 0 89.47s 4,656 2,985 45,706
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 163.96s 14,946 483 9,991
GLM 5 10.0 10.0 100.0% 0 28.96s 12,804 662 3,242
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 30.26s 7,782 270 16,150
GLM 5 7.1 5.6 83.3% 1 8.90s 5,508 567 3,734
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 5.3 10.0 33.3% 0 79.53s 553 43 52,368
GLM 5 3.5 4.4 33.3% 2 0ms 260 13,176 14,137
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 6.1 3.1 66.7% 1 101.41s 524 70 23,147
GLM 5 6.1 3.1 66.7% 1 14.69s 477 2,020 2,248
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 19.66s 699 97 11,638
GLM 5 10.0 10.0 100.0% 0 7.25s 636 1,001 2,129
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 8.2 7.7 77.8% 1 59.60s 696 242 70,096
GLM 5 10.0 10.0 100.0% 0 11.33s 609 33 4,076
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 7.45s 8,193 348 1,323
GLM 5 10.0 10.0 100.0% 0 15.93s 6,935 233 994
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-27B 3.0 10.0 0.0% 0 85.11s 204 31 23,683
GLM 5 3.0 10.0 0.0% 0 67.37s 186 401 12,450

Quick Compare

Switch Comparison Pair

Gemini 3.5 FlashminimalvsQwen3.5-27BmediumGPT-5.2 ChatnonevsQwen3.5-27BmediumGemini 3.5 FlashminimalvsGLM 5mediumGemini 3 Flash PreviewnonevsQwen3.5-27BmediumDeepSeek V4 FlashhighvsQwen3.5-27BmediumGemini 3.1 Flash Lite PreviewlowvsQwen3.5-27BmediumQwen3.7 MaxnonevsGLM 5mediumGPT-5.2 ChatnonevsGLM 5mediumGemini 3 Flash PreviewlowvsGLM 5mediumGemini 3.1 Flash Lite PreviewnonevsQwen3.5-27BmediumGemini 3.1 Flash LitelowvsQwen3.5-27BmediumGPT-5.3 ChatnonevsQwen3.5-27Bmedium