Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

Google: Gemini 3.1 Pro Preview vs Z.ai: GLM 5

Last updated at: 2026-04-14

Metric Gemini 3.1 Pro Preview Gemini 3.1 Pro Preview medium Release: 2026-02-19 GLM 5 GLM 5 medium Release: 2026-02-12
Score 9.6 8.4
Rank #2 #11
Consistency 10.0 8.2
Tests Correct
Attempt pass rate 94.4% 85.2%
Flaky tests 0 4
Total Runs 54 54
Cost per result 3.400 1.188
Total Cost $0.578 $0.155
Input Price $2.000 / 1M $0.720 / 1M
Output Price $12.000 / 1M $2.300 / 1M
Output Tokens 1,932 20,163
Reasoning Tokens 40,542 58,337
Response Time (avg) 15.96s 23.34s
Response Time (max) 40.61s 79.09s
Response Time (total) 175.52s 233.40s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 10.0 10.0 100.0% 0 7.90s 112 3,218
GLM 5 10.0 10.0 100.0% 0 23.66s 480 7,056
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 10.0 10.0 100.0% 0 19.88s 405 4,201
GLM 5 10.0 10.0 100.0% 0 79.09s 330 19,814
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 9.5 10.0 100.0% 0 40.61s 432 9,281
GLM 5 10.0 10.0 100.0% 0 28.96s 662 3,242
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 10.0 10.0 100.0% 0 7.72s 279 3,904
GLM 5 7.1 5.6 83.3% 1 8.90s 567 3,734
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 7.7 10.0 66.7% 0 32.73s 18 12,424
GLM 5 3.5 4.4 33.3% 2 0ms 13,176 14,137
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 10.0 10.0 100.0% 0 11.77s 108 1,179
GLM 5 6.1 3.1 66.7% 1 14.69s 2,020 2,248
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 10.0 10.0 100.0% 0 9.56s 72 2,236
GLM 5 10.0 10.0 100.0% 0 7.25s 1,001 2,129
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 10.0 10.0 100.0% 0 7.15s 232 3,117
GLM 5 10.0 10.0 100.0% 0 15.64s 1,694 4,983
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemini 3.1 Pro Preview 10.0 10.0 100.0% 0 23.15s 274 982
GLM 5 10.0 10.0 100.0% 0 15.93s 233 994

Quick Compare

Switch Comparison Pair