Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

Qwen: Qwen3.6 27B vs Z.ai: GLM 5.1

Last updated at: 2026-05-22

Metric Qwen3.6 27B Qwen3.6 27B medium Release: 2026-04-20 GLM 5.1 GLM 5.1 none Release: 2026-04-07
Score 6.6 5.6
Rank #83 #113
Reliability 9.9 10.0
Consistency 8.1 8.1
Tests Correct
Attempt pass rate 58.3% 40.0%
Flaky tests 5 5
Total Runs 60 60
Cost per result 3.015 0.941
Total Cost $0.272 $0.057
Input Price $0.317 / 1M $0.980 / 1M
Output Price $3.200 / 1M $3.080 / 1M
Output Tokens 13,007 3,749
Reasoning Tokens 105,697 0
Response Time (avg) 57.65s 4.16s
Response Time (max) 168.22s 32.57s
Response Time (total) 1153.04s 83.23s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 27B 8.3 10.0 75.0% 0 12.62s 582 4,311
GLM 5.1 4.0 6.3 25.0% 2 2.11s 305 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 27B 6.6 10.0 50.0% 0 165.39s 4,760 26,668
GLM 5.1 4.3 9.5 0.0% 0 6.33s 519 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 27B 7.0 3.7 66.7% 1 83.07s 2,088 14,689
GLM 5.1 2.8 2.1 33.3% 1 32.57s 2,129 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 27B 3.5 1.4 50.0% 2 37.30s 568 9,404
GLM 5.1 10.0 10.0 100.0% 0 1.08s 204 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 27B 2.9 7.2 11.1% 1 73.38s 3,510 20,352
GLM 5.1 2.9 7.2 11.1% 1 1.99s 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 27B 6.5 3.4 66.7% 1 39.53s 81 3,045
GLM 5.1 5.0 10.0 0.0% 0 790ms 39 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 27B 10.0 10.0 100.0% 0 37.96s 346 6,548
GLM 5.1 9.8 10.0 100.0% 0 1.58s 66 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 27B 7.7 10.0 66.7% 0 60.21s 281 11,919
GLM 5.1 6.1 7.8 44.4% 1 1.48s 152 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 27B 10.0 10.0 100.0% 0 16.88s 390 2,954
GLM 5.1 10.0 10.0 100.0% 0 10.68s 300 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Qwen3.6 27B 3.0 10.0 0.0% 0 80.99s 401 5,807
GLM 5.1 3.0 10.0 0.0% 0 2.34s 11 0

Quick Compare

Switch Comparison Pair

gpt-oss-120bmediumFree AvailablevsGLM 5.1noneQwen3.6 27BmediumvsGrok Build 0.1noneGemini 3.1 Flash LitenonevsQwen3.6 27BmediumGPT-5.5nonevsQwen3.6 27BmediumDeepSeek V4 ProhighvsQwen3.6 27BmediumGemini 3.1 Flash LiteminimalvsQwen3.6 27BmediumGemma 4 31BnoneFree AvailablevsQwen3.6 27BmediumMiniMax M2.5mediumFree AvailablevsGLM 5.1noneCobuddymediumFree AvailablevsGLM 5.1noneMistral Small 4mediumvsGLM 5.1noneElephant AlphamediumvsGLM 5.1noneOwl AlphamediumvsGLM 5.1none