Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Qwen: Qwen3.5-Flash vs Z.ai: GLM 5.1

Summary

Qwen3.5-Flash (medium) vs GLM 5.1 (medium) benchmark comparison: GLM 5.1 (medium) leads on average score with 7.1 vs 6.8. Qwen3.5-Flash (medium) has the lower benchmark cost at $0.080 vs $0.288. GLM 5.1 (medium) is faster at 33.67s vs 63.29s, with pass rates of 71.4% vs 68.3%.

Recommended model: Qwen3.5-Flash (medium) - Its score stays close to the best score here (6.8 vs 7.1), while costing about 3.6x less than GLM 5.1 (medium).

Last updated at: 2026-07-10

Metric Qwen3.5-Flash Qwen3.5-Flash medium Release: 2026-02-24 GLM 5.1 GLM 5.1 medium Release: 2026-04-07
Score 6.8 7.1
Rank #84 #77
Reliability 10.0 6.7
Consistency 8.1 8.3
Tests Correct
Attempt pass rate 71.4% 68.3%
Flaky tests 5 4
Total Runs 63 63
Cost per result 0.871 2.496
Total Cost $0.080 $0.288
Input Price $0.065 / 1M $0.966 / 1M
Output Price $0.260 / 1M $3.036 / 1M
Total Input Tokens 38,926 32,995
Output Tokens 2,088 11,655
Reasoning Tokens 294,598 75,421
Response Time (avg) 63.29s 33.67s
Response Time (max) 234.29s 172.60s
Response Time (total) 1265.85s 673.41s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#84 Qwen3.5-Flash

medium
Cost
$0.002
Time
25.8s
Tokens
4,294 tok

#77 GLM 5.1

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-Flash 10.0 10.0 100.0% 0 59.11s 672 383 32,992
GLM 5.1 10.0 10.0 100.0% 0 8.31s 555 401 5,122
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-Flash 3.7 7.2 22.2% 1 58.87s 6,685 302 90,081
GLM 5.1 4.6 3.7 44.5% 2 109.63s 5,702 4,871 37,826
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-Flash 10.0 10.0 100.0% 0 17.78s 14,934 483 8,270
GLM 5.1 9.5 10.0 100.0% 0 43.11s 17,298 327 4,206
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-Flash 7.3 5.9 83.3% 1 56.99s 6,061 235 16,237
GLM 5.1 10.0 10.0 100.0% 0 9.33s 7,107 991 4,552
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-Flash 5.3 7.2 44.4% 1 146.50s 581 58 43,615
GLM 5.1 5.3 10.0 33.3% 0 29.77s 489 969 11,314
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-Flash 6.1 3.1 66.7% 1 40.05s 516 99 38,486
GLM 5.1 10.0 10.0 100.0% 0 20.95s 477 2,875 2,875
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-Flash 10.0 10.0 100.0% 0 63.49s 699 98 14,139
GLM 5.1 6.4 5.8 66.7% 1 7.47s 634 204 1,617
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-Flash 8.2 7.2 88.9% 1 27.61s 381 89 12,457
GLM 5.1 8.2 7.2 88.9% 1 31.64s 609 935 5,730
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-Flash 10.0 10.0 100.0% 0 10.33s 8,193 309 1,284
GLM 5.1 3.0 10.0 0.0% 0 0ms 0 0 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-Flash 3.0 10.0 0.0% 0 48.98s 204 32 37,037
GLM 5.1 3.0 10.0 0.0% 0 29.40s 124 82 2,179

Quick Compare

Switch Comparison Pair

Step 3.7 FlashhighvsGLM 5.1mediumGemini 3.5 FlashminimalvsQwen3.5-FlashmediumGemini 3 Flash PreviewnonevsQwen3.5-FlashmediumQwen3.7 PlusnonevsGLM 5.1mediumDeepSeek V4 PrononevsGLM 5.1mediumGemini 3.5 FlashnonevsGLM 5.1mediumClaude Opus 4.8nonevsGLM 5.1mediumGemini 3.5 FlashnonevsQwen3.5-FlashmediumGemini 3 Flash PreviewnonevsGLM 5.1mediumClaude Sonnet 4.6nonevsGLM 5.1mediumQwen3.7 MaxnonevsGLM 5.1mediumQwen3.5-FlashmediumvsStep 3.7 Flashhigh