Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Qwen: Qwen3.5-35B-A3B vs Z.ai: GLM 5.1

Last updated at: 2026-05-22

Metric Qwen3.5-35B-A3B Qwen3.5-35B-A3B none Release: 2026-02-24 GLM 5.1 GLM 5.1 none Release: 2026-04-07
Score 5.8 5.6
Rank #102 #113
Reliability 10.0 10.0
Consistency 8.9 8.1
Tests Correct
Attempt pass rate 45.0% 40.0%
Flaky tests 3 5
Total Runs 60 60
Cost per result 0.224 0.941
Total Cost $0.016 $0.057
Input Price $0.139 / 1M $0.980 / 1M
Output Price $1.000 / 1M $3.080 / 1M
Output Tokens 4,334 3,749
Reasoning Tokens 0 0
Response Time (avg) 3.50s 4.16s
Response Time (max) 47.43s 32.57s
Response Time (total) 69.99s 83.23s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 3.4 7.9 16.7% 1 1.43s 574 0
GLM 5.1 4.0 6.3 25.0% 2 2.11s 305 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 6.8 10.0 50.0% 0 1.72s 562 0
GLM 5.1 4.3 9.5 0.0% 0 6.33s 519 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 47.43s 1,833 0
GLM 5.1 2.8 2.1 33.3% 1 32.57s 2,129 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 1.16s 243 0
GLM 5.1 10.0 10.0 100.0% 0 1.08s 204 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 7.7 10.0 66.7% 0 485ms 15 0
GLM 5.1 2.9 7.2 11.1% 1 1.99s 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 6.5 3.4 66.7% 1 1.19s 114 0
GLM 5.1 5.0 10.0 0.0% 0 790ms 39 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 6.3 10.0 50.0% 0 809ms 63 0
GLM 5.1 9.8 10.0 100.0% 0 1.58s 66 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 3.7 7.4 22.2% 1 1.34s 655 0
GLM 5.1 6.1 7.8 44.4% 1 1.48s 152 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 10.0 10.0 100.0% 0 2.30s 264 0
GLM 5.1 10.0 10.0 100.0% 0 10.68s 300 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.5-35B-A3B 3.0 10.0 0.0% 0 493ms 11 0
GLM 5.1 3.0 10.0 0.0% 0 2.34s 11 0

Quick Compare

Switch Comparison Pair

gpt-oss-120bmediumFree AvailablevsGLM 5.1noneOwl AlphamediumvsQwen3.5-35B-A3BnoneCobuddymediumFree AvailablevsQwen3.5-35B-A3BnoneNemotron 3 SupermediumFree AvailablevsQwen3.5-35B-A3BnoneMiniMax M2.5mediumFree AvailablevsGLM 5.1noneCobuddymediumFree AvailablevsGLM 5.1noneMistral Small 4mediumvsGLM 5.1noneElephant AlphamediumvsGLM 5.1nonegpt-oss-120bmediumFree AvailablevsQwen3.5-35B-A3BnoneOwl AlphamediumvsGLM 5.1noneGPT-5 NanomediumvsQwen3.5-35B-A3BnoneNemotron 3 SupermediumFree AvailablevsGLM 5.1none