Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Qwen: Qwen3.5-Flash vs Z.ai: GLM 5.1

Last updated at: 2026-04-07

Metric Qwen3.5-Flash Qwen3.5-Flash medium Release: 2026-02-24 GLM 5.1 GLM 5.1 medium Release: 2026-04-07
Score 8.0 8.0
Rank #24 #23
Consistency 7.6 9.0
Tests Correct
Attempt pass rate 82.4% 76.5%
Flaky tests 5 2
Total Runs 51 51
Cost per result 0.688 1.270
Total Cost $0.076 $0.153
Input Price $0.065 / 1M $1.000 / 1M
Output Price $0.260 / 1M $3.200 / 1M
Output Tokens 1,827 6,666
Reasoning Tokens 179,299 35,313
Response Time (avg) 67.96s 18.23s
Response Time (max) 234.29s 43.11s
Response Time (total) 1155.28s 291.73s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-Flash 10.0 10.0 100.0% 0 59.11s 383 32,992
GLM 5.1 10.0 10.0 100.0% 0 8.31s 401 5,122
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-Flash 10.0 10.0 100.0% 0 17.78s 483 8,270
GLM 5.1 9.5 10.0 100.0% 0 43.11s 327 4,206
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-Flash 7.3 5.9 83.3% 1 56.99s 235 16,237
GLM 5.1 10.0 10.0 100.0% 0 9.33s 991 4,552
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-Flash 5.3 7.2 44.4% 1 146.50s 58 43,615
GLM 5.1 5.3 10.0 33.3% 0 29.77s 969 11,314
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-Flash 6.1 3.1 66.7% 1 40.05s 99 38,486
GLM 5.1 10.0 10.0 100.0% 0 20.95s 2,875 2,875
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-Flash 10.0 10.0 100.0% 0 63.49s 98 14,139
GLM 5.1 6.4 5.8 66.7% 1 7.47s 204 1,617
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-Flash 6.4 4.4 77.8% 2 56.74s 162 24,276
GLM 5.1 8.2 7.2 88.9% 1 23.85s 899 5,627
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-Flash 10.0 10.0 100.0% 0 10.33s 309 1,284
GLM 5.1 3.0 10.0 0.0% 0 0ms 0 0

Quick Compare

Switch Comparison Pair

Gemini 3 Flash PreviewnonevsGLM 5.1mediumGemini 3.1 Flash Lite PreviewlowvsGLM 5.1mediumGemini 3 Flash PreviewnonevsQwen3.5-FlashmediumGemini 3.1 Flash Lite PreviewlowvsQwen3.5-FlashmediumGemini 3.1 Flash Lite PreviewnonevsQwen3.5-FlashmediumGemini 3.1 Flash Lite PreviewnonevsGLM 5.1mediumGPT-5.2 ChatnonevsQwen3.5-FlashmediumGPT-5.2 ChatnonevsGLM 5.1mediumGPT-5.3 ChatnonevsQwen3.5-FlashmediumGPT-5.3 ChatnonevsGLM 5.1mediumGemini 3 Flash PreviewlowvsGLM 5.1mediumGemini 3 Flash PreviewlowvsQwen3.5-Flashmedium