Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

Google: Gemini 3 Flash Preview vs Z.ai: GLM 5

Last updated at: 2026-04-14

Metric Gemini 3 Flash Preview Gemini 3 Flash Preview medium Release: 2025-12-17 GLM 5 GLM 5 medium Release: 2026-02-12
Score 10.0 8.4
Rank #1 #11
Consistency 10.0 8.2
Tests Correct
Attempt pass rate 100.0% 85.2%
Flaky tests 0 4
Total Runs 54 54
Cost per result 1.740 1.188
Total Cost $0.314 $0.155
Input Price $0.500 / 1M $0.720 / 1M
Output Price $3.000 / 1M $2.300 / 1M
Output Tokens 2,072 20,163
Reasoning Tokens 97,041 58,337
Response Time (avg) 17.60s 23.34s
Response Time (max) 79.71s 79.09s
Response Time (total) 193.57s 233.40s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemini 3 Flash Preview 10.0 10.0 100.0% 0 4.13s 305 3,490
GLM 5 10.0 10.0 100.0% 0 23.66s 480 7,056
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemini 3 Flash Preview 10.0 10.0 100.0% 0 79.71s 432 48,771
GLM 5 10.0 10.0 100.0% 0 79.09s 330 19,814
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemini 3 Flash Preview 10.0 10.0 100.0% 0 50.16s 351 12,645
GLM 5 10.0 10.0 100.0% 0 28.96s 662 3,242
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemini 3 Flash Preview 10.0 10.0 100.0% 0 4.72s 279 5,333
GLM 5 7.1 5.6 83.3% 1 8.90s 567 3,734
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemini 3 Flash Preview 10.0 10.0 100.0% 0 21.12s 12 14,908
GLM 5 3.5 4.4 33.3% 2 0ms 13,176 14,137
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemini 3 Flash Preview 10.0 10.0 100.0% 0 4.09s 111 1,285
GLM 5 6.1 3.1 66.7% 1 14.69s 2,020 2,248
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemini 3 Flash Preview 10.0 10.0 100.0% 0 6.10s 72 4,558
GLM 5 10.0 10.0 100.0% 0 7.25s 1,001 2,129
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemini 3 Flash Preview 10.0 10.0 100.0% 0 4.43s 276 4,921
GLM 5 10.0 10.0 100.0% 0 15.64s 1,694 4,983
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
Gemini 3 Flash Preview 10.0 10.0 100.0% 0 10.55s 234 1,130
GLM 5 10.0 10.0 100.0% 0 15.93s 233 994

Quick Compare

Switch Comparison Pair