Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Qwen: Qwen3.5-27B vs Z.ai: GLM 5

Last updated at: 2026-04-14

Metric Qwen3.5-27B Qwen3.5-27B medium Release: 2026-02-24 GLM 5 GLM 5 medium Release: 2026-02-12
Score 8.4 8.4
Rank #8 #11
Consistency 8.8 8.2
Tests Correct
Attempt pass rate 81.5% 85.2%
Flaky tests 3 4
Total Runs 54 54
Cost per result 3.822 1.188
Total Cost $0.497 $0.155
Input Price $0.195 / 1M $0.720 / 1M
Output Price $1.560 / 1M $2.300 / 1M
Output Tokens 2,500 20,163
Reasoning Tokens 242,500 58,337
Response Time (avg) 53.03s 23.34s
Response Time (max) 163.96s 79.09s
Response Time (total) 954.46s 233.40s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 8.7 7.9 91.7% 1 19.75s 569 31,505
GLM 5 10.0 10.0 100.0% 0 23.66s 480 7,056
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 70.35s 375 19,165
GLM 5 10.0 10.0 100.0% 0 79.09s 330 19,814
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 163.96s 483 9,991
GLM 5 10.0 10.0 100.0% 0 28.96s 662 3,242
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 30.26s 270 16,150
GLM 5 7.1 5.6 83.3% 1 8.90s 567 3,734
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 5.3 10.0 33.3% 0 79.53s 43 52,368
GLM 5 3.5 4.4 33.3% 2 0ms 13,176 14,137
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 6.1 3.1 66.7% 1 101.41s 70 23,147
GLM 5 6.1 3.1 66.7% 1 14.69s 2,020 2,248
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 19.66s 97 11,638
GLM 5 10.0 10.0 100.0% 0 7.25s 1,001 2,129
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 8.2 7.7 77.8% 1 64.61s 245 77,213
GLM 5 10.0 10.0 100.0% 0 15.64s 1,694 4,983
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 7.45s 348 1,323
GLM 5 10.0 10.0 100.0% 0 15.93s 233 994

Quick Compare

Switch Comparison Pair

Gemini 3 Flash PreviewnonevsGLM 5mediumGemini 3.1 Flash Lite PreviewlowvsGLM 5mediumGemini 3 Flash PreviewnonevsQwen3.5-27BmediumGemini 3.1 Flash Lite PreviewlowvsQwen3.5-27BmediumGemini 3 Flash PreviewlowvsQwen3.5-27BmediumGemini 3 Flash PreviewlowvsGLM 5mediumGPT-5.2 ChatnonevsGLM 5mediumGemini 3.1 Flash Lite PreviewnonevsGLM 5mediumGPT-5.2 ChatnonevsQwen3.5-27BmediumGemini 3.1 Flash Lite PreviewnonevsQwen3.5-27BmediumGPT-5.3 ChatnonevsGLM 5mediumGPT-5.3 ChatnonevsQwen3.5-27Bmedium