Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.4 Nano vs Z.ai: GLM 4.7 Flash

Summary

GPT-5.4 Nano vs GLM 4.7 Flash benchmark comparison: GPT-5.4 Nano leads on average score with 4.8 vs 4.3. GPT-5.4 Nano has the lower benchmark cost at $0.011 vs $0.054. GPT-5.4 Nano is faster at 1.48s vs 35.10s, with pass rates of 30.2% vs 33.3%.

Recommended model: GPT-5.4 Nano - It has the best score here (4.8), while costing about 5.2x less than GLM 4.7 Flash.

Last updated at: 2026-06-12

Metric GPT-5.4 Nano GPT-5.4 Nano none Release: 2026-03-17 GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19
Score 4.8 4.3
Rank #149 #159
Reliability 10.0 6.7
Consistency 8.2 6.8
Tests Correct
Attempt pass rate 30.2% 33.3%
Flaky tests 5 8
Total Runs 63 63
Cost per result 0.259 1.337
Total Cost $0.011 $0.054
Input Price $0.200 / 1M $0.060 / 1M
Output Price $1.250 / 1M $0.400 / 1M
Total Input Tokens 34,212 37,206
Output Tokens 2,784 43,754
Reasoning Tokens 0 89,079
Response Time (avg) 1.48s 35.10s
Response Time (max) 4.47s 174.55s
Response Time (total) 31.01s 456.24s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#149 GPT-5.4 Nano

none
Cost
$0.008
Time
46.1s
Tokens
5,735 tok

#159 GLM 4.7 Flash

medium
Invalid SVG
Cost
$0.000
Time
186.2s
Tokens
12,112 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Nano 3.5 8.0 16.7% 1 1.18s 606 800 0
GLM 4.7 Flash 4.7 5.9 41.7% 2 14.95s 555 1,122 6,110
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Nano 4.6 7.9 22.2% 1 2.22s 7,305 613 0
GLM 4.7 Flash 3.2 7.4 11.1% 1 55.33s 3,106 4,981 22,387
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Nano 3.0 10.0 0.0% 0 3.84s 11,019 280 0
GLM 4.7 Flash 2.8 2.1 33.3% 1 65.57s 17,185 2,585 20,648
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Nano 6.5 10.0 50.0% 0 1.11s 7,140 219 0
GLM 4.7 Flash 6.3 10.0 50.0% 0 1.51s 7,107 584 2,755
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Nano 2.9 4.4 22.2% 2 926ms 723 52 0
GLM 4.7 Flash 3.5 4.4 33.3% 2 174.55s 643 33,000 25,394
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Nano 3.8 2.5 33.3% 1 1.31s 477 180 0
GLM 4.7 Flash 3.6 9.7 0.0% 0 18.14s 318 18 2,138
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Nano 6.3 10.0 50.0% 0 784ms 660 89 0
GLM 4.7 Flash 6.2 5.8 66.7% 1 2.97s 636 388 2,181
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Nano 5.4 10.0 33.3% 0 1.25s 642 308 0
GLM 4.7 Flash 2.9 7.2 11.1% 1 12.93s 521 781 5,255
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Nano 10.0 10.0 100.0% 0 3.40s 5,445 222 0
GLM 4.7 Flash 10.0 10.0 100.0% 0 15.95s 6,949 224 1,014
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.4 Nano 3.0 10.0 0.0% 0 773ms 195 21 0
GLM 4.7 Flash 3.0 10.0 0.0% 0 11.13s 186 71 1,197

Quick Compare

Switch Comparison Pair

MiMo-V2-FlashnonevsGLM 4.7 FlashmediumMiniMax M2.5mediumvsGPT-5.4 NanononeGPT-5.4 NanononevsQwen3 Coder NextmediumCobuddymediumvsGPT-5.4 NanononeGranite 4.1 8BnonevsGLM 4.7 FlashmediumMistral Small 4mediumvsGPT-5.4 NanononeMercury 2nonevsGLM 4.7 FlashmediumMiniMax M2.7mediumvsGPT-5.4 NanononeLing-2.6-1TnonevsGLM 4.7 Flashmediumgpt-oss-120bnoneFree AvailablevsGLM 4.7 FlashmediumRing-2.6-1TnonevsGLM 4.7 FlashmediumLing-2.6-flashnonevsGLM 4.7 Flashmedium