Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Qwen: Qwen3.5-27B vs Z.ai: GLM 4.7 Flash

Last updated at: 2026-04-29

Metric Qwen3.5-27B Qwen3.5-27B none Release: 2026-02-24 GLM 4.7 Flash GLM 4.7 Flash none Release: 2026-01-19
Score 5.9 5.6
Rank #87 #97
Reliability N/A N/A
Consistency 9.2 8.6
Tests Correct
Attempt pass rate 38.9% 37.0%
Flaky tests 2 3
Total Runs 54 54
Cost per result 0.265 0.059
Total Cost $0.016 $0.003
Input Price $0.195 / 1M $0.060 / 1M
Output Price $1.560 / 1M $0.400 / 1M
Output Tokens 3,545 2,489
Reasoning Tokens 0 0
Response Time (avg) 1.74s 3.35s
Response Time (max) 9.39s 7.05s
Response Time (total) 31.32s 36.90s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 4.8 10.0 25.0% 0 788ms 267 0
GLM 4.7 Flash 5.2 7.9 41.7% 1 5.51s 438 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 2.51s 381 0
GLM 4.7 Flash 6.4 9.9 0.0% 0 5.57s 626 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 2.8 1.6 33.3% 1 9.39s 1,461 0
GLM 4.7 Flash 3.0 10.0 0.0% 0 3.22s 704 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 1.43s 243 0
GLM 4.7 Flash 7.3 5.8 83.3% 1 4.82s 196 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 3.0 10.0 0.0% 0 540ms 15 0
GLM 4.7 Flash 7.7 10.0 66.7% 0 744ms 19 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 5.0 10.0 0.0% 0 2.51s 126 0
GLM 4.7 Flash 4.0 10.0 0.0% 0 1.59s 134 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 4.8 10.0 0.0% 0 815ms 69 0
GLM 4.7 Flash 6.5 10.0 50.0% 0 888ms 62 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 6.7 7.9 55.6% 1 1.37s 680 0
GLM 4.7 Flash 4.4 10.0 0.0% 0 1.00s 98 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-27B 10.0 10.0 100.0% 0 3.54s 303 0
GLM 4.7 Flash 2.8 1.6 33.3% 1 7.05s 212 0

Quick Compare

Switch Comparison Pair