Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5 Nano vs Z.ai: GLM 5.1

Last updated at: 2026-05-22

Metric GPT-5 Nano GPT-5 Nano medium Release: 2025-08-07 GLM 5.1 GLM 5.1 none Release: 2026-04-07
Score 6.1 5.6
Rank #94 #113
Reliability 10.0 10.0
Consistency 7.1 8.1
Tests Correct
Attempt pass rate 55.0% 40.0%
Flaky tests 7 5
Total Runs 60 60
Cost per result 0.945 0.941
Total Cost $0.076 $0.057
Input Price $0.050 / 1M $0.980 / 1M
Output Price $0.400 / 1M $3.080 / 1M
Output Tokens 5,338 3,749
Reasoning Tokens 179,584 0
Response Time (avg) 43.11s 4.16s
Response Time (max) 204.02s 32.57s
Response Time (total) 560.45s 83.23s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 6.5 7.9 58.3% 1 25.50s 1,221 21,184
GLM 5.1 4.0 6.3 25.0% 2 2.11s 305 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 5.4 6.6 33.3% 1 47.80s 604 30,144
GLM 5.1 4.3 9.5 0.0% 0 6.33s 519 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 10.0 10.0 100.0% 0 65.96s 578 17,984
GLM 5.1 2.8 2.1 33.3% 1 32.57s 2,129 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 3.7 1.7 50.0% 2 21.42s 453 10,560
GLM 5.1 10.0 10.0 100.0% 0 1.08s 204 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 5.2 4.4 55.6% 2 204.02s 237 64,448
GLM 5.1 2.9 7.2 11.1% 1 1.99s 24 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 4.1 10.0 0.0% 0 17.51s 202 4,608
GLM 5.1 5.0 10.0 0.0% 0 790ms 39 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 9.8 10.0 100.0% 0 11.90s 382 4,096
GLM 5.1 9.8 10.0 100.0% 0 1.58s 66 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 5.3 7.2 44.4% 1 19.81s 869 13,440
GLM 5.1 6.1 7.8 44.4% 1 1.48s 152 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 10.0 10.0 100.0% 0 33.30s 558 6,976
GLM 5.1 10.0 10.0 100.0% 0 10.68s 300 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5 Nano 3.0 10.0 0.0% 0 20.13s 234 6,144
GLM 5.1 3.0 10.0 0.0% 0 2.34s 11 0

Quick Compare

Switch Comparison Pair

gpt-oss-120bmediumFree AvailablevsGLM 5.1noneGPT-5 NanomediumvsMiMo-V2-OmninoneDeepSeek V4 PrononevsGPT-5 NanomediumGemini 2.5 FlashnonevsGPT-5 NanomediumGemma 4 26B A4BnoneFree AvailablevsGPT-5 NanomediumMiniMax M2.5mediumFree AvailablevsGLM 5.1noneCobuddymediumFree AvailablevsGLM 5.1noneMistral Small 4mediumvsGLM 5.1noneGPT-5 NanomediumvsQwen3.5-FlashnoneGPT-5 NanomediumvsGLM 5noneElephant AlphamediumvsGLM 5.1noneGPT-5 NanomediumvsGLM 5V Turbonone