Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Qwen: Qwen3.5-9B vs Z.ai: GLM 4.7 Flash

Last updated at: 2026-03-12

Metric Qwen3.5-9B Qwen3.5-9B medium Release: 2026-03-02 GLM 4.7 Flash GLM 4.7 Flash none Release: 2026-01-19
Rank #66 #57
Avg Score 2.6 3.9
Consistency 7.4 8.4
Cost per result 0.779 0.066
Total Cost $0.024 $0.003
Tests Correct
Attempt pass rate 35.4% 35.4%
Flaky tests 5 3
Total Runs 48 48
Output Tokens 17,930 1,855
Reasoning Tokens 139,706 0
Response Time (avg) 71.44s 2.99s
Response Time (max) 226.38s 7.05s
Response Time (total) 928.77s 26.90s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Avg Score vs Response Time (avg)

Total Output Tokens

Avg Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-9B 4.0 7.2 55.6% 1 31.54s 2,410 10,913
GLM 4.7 Flash 10.0 7.2 22.2% 1 6.59s 430 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-9B 10.0 10.0 0.0% 0 0ms 0 0
GLM 4.7 Flash 10.0 10.0 0.0% 0 3.22s 704 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-9B 5.0 5.6 33.3% 1 87.31s 1,383 32,113
GLM 4.7 Flash 5.4 5.8 83.3% 1 4.82s 196 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-9B 10.0 7.2 22.2% 1 137.75s 11,549 48,475
GLM 4.7 Flash 7.0 10.0 66.7% 0 744ms 19 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-9B 10.0 1.6 33.3% 1 226.38s 0 30,695
GLM 4.7 Flash 3.0 10.0 0.0% 0 1.59s 134 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-9B 5.5 5.8 66.7% 1 17.15s 599 4,517
GLM 4.7 Flash 5.5 10.0 50.0% 0 888ms 62 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-9B 10.0 10.0 0.0% 0 33.38s 1,545 11,844
GLM 4.7 Flash 3.7 10.0 0.0% 0 1.00s 98 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-9B 10.0 10.0 100.0% 0 4.31s 444 1,149
GLM 4.7 Flash 10.0 1.6 33.3% 1 7.05s 212 0

Quick Compare

Switch Comparison Pair

Qwen3.5-9BmediumvsMiMo-V2-FlashnoneQwen3.5-9BmediumvsGrok 4.1 FastnoneQwen3 Coder NextmediumvsGLM 4.7 FlashnoneMercury 2nonevsQwen3.5-9BmediumNemotron 3 Super 120b A12bnoneFree AvailablevsQwen3.5-9BmediumMiniMax M2.5mediumvsGLM 4.7 FlashnoneGrok 4.20 Multi-Agent BetamediumvsGLM 4.7 Flashnonegpt-oss-120bmediumFree AvailablevsGLM 4.7 FlashnoneGPT-4o-mininonevsQwen3.5-9BmediumMercury 2mediumvsGLM 4.7 FlashnoneKimi K2.5nonevsQwen3.5-9BmediumTrinity Large PreviewnoneFree AvailablevsQwen3.5-9Bmedium