Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-4o-mini vs Z.ai: GLM 4.7 Flash

Last updated at: 2026-05-29

Metric GPT-4o-mini GPT-4o-mini none Release: 2024-07-18 GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19
Score 4.9 4.5
Rank #144 #154
Reliability 10.0 10.0
Consistency 9.9 6.7
Tests Correct
Attempt pass rate 25.0% 35.0%
Flaky tests 0 8
Total Runs 60 60
Cost per result 0.111 1.337
Total Cost $0.006 $0.054
Input Price $0.150 / 1M $0.060 / 1M
Output Price $0.600 / 1M $0.400 / 1M
Output Tokens 1,977 43,754
Reasoning Tokens 0 89,079
Response Time (avg) 1.85s 35.10s
Response Time (max) 7.58s 174.55s
Response Time (total) 24.00s 456.24s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 4.8 10.0 25.0% 0 1.34s 186 0
GLM 4.7 Flash 4.7 5.9 41.7% 2 14.95s 1,122 6,110
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 3.2 9.3 0.0% 0 2.05s 362 0
GLM 4.7 Flash 3.4 6.0 16.7% 1 55.33s 4,981 22,387
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 3.0 10.0 0.0% 0 7.58s 568 0
GLM 4.7 Flash 2.8 2.1 33.3% 1 65.57s 2,585 20,648
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 10.0 10.0 100.0% 0 1.27s 183 0
GLM 4.7 Flash 6.3 10.0 50.0% 0 1.51s 584 2,755
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 3.0 10.0 0.0% 0 637ms 15 0
GLM 4.7 Flash 3.5 4.4 33.3% 2 174.55s 33,000 25,394
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 4.0 10.0 0.0% 0 909ms 66 0
GLM 4.7 Flash 3.6 9.7 0.0% 0 18.14s 18 2,138
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 6.3 10.0 50.0% 0 1.11s 69 0
GLM 4.7 Flash 6.2 5.8 66.7% 1 2.97s 388 2,181
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 3.5 10.0 0.0% 0 1.21s 308 0
GLM 4.7 Flash 2.9 7.2 11.1% 1 12.93s 781 5,255
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 10.0 10.0 100.0% 0 2.51s 205 0
GLM 4.7 Flash 10.0 10.0 100.0% 0 15.95s 224 1,014
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-4o-mini 3.0 10.0 0.0% 0 794ms 15 0
GLM 4.7 Flash 3.0 10.0 0.0% 0 11.13s 71 1,197

Quick Compare

Switch Comparison Pair

Ling-2.6-1TnonevsGLM 4.7 FlashmediumGPT-4o-mininonevsQwen3 Coder NextmediumMercury 2nonevsGLM 4.7 FlashmediumMiMo-V2-FlashnonevsGLM 4.7 FlashmediumQwen3.5-9BnonevsGLM 4.7 FlashmediumGPT-5.4 NanononevsGLM 4.7 FlashmediumTrinity Large PreviewnonevsGLM 4.7 FlashmediumGranite 4.1 8BnonevsGLM 4.7 FlashmediumQwen3.6 35B A3BnonevsGLM 4.7 FlashmediumGPT-5.4 MininonevsGLM 4.7 FlashmediumMiMo-V2.5nonevsGLM 4.7 FlashmediumMistral Small 4nonevsGLM 4.7 Flashmedium