Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Qwen: Qwen3.5-9B vs Z.ai: GLM 4.7 Flash

Summary

Qwen3.5-9B vs GLM 4.7 Flash benchmark comparison: Qwen3.5-9B leads on average score with 4.6 vs 4.4. Qwen3.5-9B has the lower benchmark cost at $0.006 vs $0.054. Qwen3.5-9B is faster at 1.89s vs 35.10s, with pass rates of 20.6% vs 33.3%.

Recommended model: Qwen3.5-9B - It has the best score here (4.6), while costing about 9.9x less than GLM 4.7 Flash.

Last updated at: 2026-06-10

Metric Qwen3.5-9B Qwen3.5-9B none Release: 2026-03-02 GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19
Score 4.6 4.4
Rank #155 #159
Reliability 10.0 6.7
Consistency 9.7 6.8
Tests Correct
Attempt pass rate 20.6% 33.3%
Flaky tests 1 8
Total Runs 63 63
Cost per result 0.123 1.337
Total Cost $0.006 $0.054
Input Price $0.100 / 1M $0.060 / 1M
Output Price $0.150 / 1M $0.400 / 1M
Total Input Tokens 48,041 37,206
Output Tokens 3,952 43,754
Reasoning Tokens 0 89,079
Response Time (avg) 1.89s 35.10s
Response Time (max) 6.03s 174.55s
Response Time (total) 39.68s 456.24s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#155 Qwen3.5-9B

none
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

#159 GLM 4.7 Flash

medium
Invalid SVG
Cost
$0.000
Time
186.2s
Tokens
12,112 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-9B 3.1 9.9 0.0% 0 1.71s 696 582 0
GLM 4.7 Flash 4.7 5.9 41.7% 2 14.95s 555 1,122 6,110
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-9B 3.9 7.8 11.1% 1 5.60s 7,913 1,042 0
GLM 4.7 Flash 3.2 7.4 11.1% 1 55.33s 3,106 4,981 22,387
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-9B 3.0 10.0 0.0% 0 5.91s 20,397 1,255 0
GLM 4.7 Flash 2.8 2.1 33.3% 1 65.57s 17,185 2,585 20,648
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-9B 10.0 10.0 100.0% 0 847ms 7,788 249 0
GLM 4.7 Flash 6.3 10.0 50.0% 0 1.51s 7,107 584 2,755
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-9B 3.0 10.0 0.0% 0 464ms 789 24 0
GLM 4.7 Flash 3.5 4.4 33.3% 2 174.55s 643 33,000 25,394
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-9B 4.4 9.9 0.0% 0 552ms 522 99 0
GLM 4.7 Flash 3.6 9.7 0.0% 0 18.14s 318 18 2,138
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-9B 6.5 10.0 50.0% 0 514ms 711 75 0
GLM 4.7 Flash 6.2 5.8 66.7% 1 2.97s 636 388 2,181
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-9B 3.2 10.0 0.0% 0 621ms 714 347 0
GLM 4.7 Flash 2.9 7.2 11.1% 1 12.93s 521 781 5,255
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-9B 10.0 10.0 100.0% 0 1.27s 8,301 273 0
GLM 4.7 Flash 10.0 10.0 100.0% 0 15.95s 6,949 224 1,014
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.5-9B 3.0 10.0 0.0% 0 2.32s 210 6 0
GLM 4.7 Flash 3.0 10.0 0.0% 0 11.13s 186 71 1,197

Quick Compare

Switch Comparison Pair

Ling-2.6-1TnonevsGLM 4.7 FlashmediumMercury 2nonevsGLM 4.7 FlashmediumQwen3.6 35B A3BnonevsGLM 4.7 FlashmediumMiMo-V2-FlashnonevsGLM 4.7 FlashmediumTrinity Large PreviewnonevsGLM 4.7 FlashmediumGPT-5.4 NanononevsGLM 4.7 FlashmediumGranite 4.1 8BnonevsGLM 4.7 FlashmediumGPT-4o-mininonevsGLM 4.7 FlashmediumGPT-5.4 MininonevsGLM 4.7 FlashmediumMiMo-V2.5nonevsGLM 4.7 FlashmediumMistral Small 4nonevsGLM 4.7 FlashmediumNemotron 3 SupernoneFree AvailablevsGLM 4.7 Flashmedium