Navigate
AI BENCHY
Your ad here

AI BENCHY Compare

OpenAI: GPT-5.4 Nano vs Z.ai: GLM 4.7 Flash

Last updated at: 2026-03-17

Metric GPT-5.4 Nano GPT-5.4 Nano none Release: 2026-03-17 GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19
Rank #73 #69
Score 4.3 4.7
Consistency 7.3 6.6
Cost per result 0.404 1.046
Total Cost $0.009 $0.042
Tests Correct
Attempt pass rate 29.4% 39.2%
Flaky tests 6 7
Total Runs 51 51
Output Tokens 2,185 38,719
Reasoning Tokens 0 65,465
Response Time (avg) 1.39s 33.44s
Response Time (max) 3.84s 174.55s
Response Time (total) 23.70s 334.39s

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Nano 3.5 8.0 16.7% 1 1.18s 800 0
GLM 4.7 Flash 4.7 5.9 41.7% 2 14.95s 1,122 6,110
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Nano 3.0 10.0 0.0% 0 3.84s 280 0
GLM 4.7 Flash 2.8 2.1 33.3% 1 65.57s 2,585 20,648
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Nano 6.5 10.0 50.0% 0 1.11s 219 0
GLM 4.7 Flash 6.3 10.0 50.0% 0 1.51s 584 2,755
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Nano 2.9 4.4 22.2% 2 926ms 52 0
GLM 4.7 Flash 3.5 4.4 33.3% 2 174.55s 33,000 25,394
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Nano 3.8 2.5 33.3% 1 1.31s 180 0
GLM 4.7 Flash 3.6 9.7 0.0% 0 18.14s 18 2,138
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Nano 5.0 6.8 33.3% 1 787ms 84 0
GLM 4.7 Flash 6.2 5.8 66.7% 1 2.97s 388 2,181
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Nano 3.7 7.3 22.2% 1 1.29s 348 0
GLM 4.7 Flash 2.9 7.2 11.1% 1 12.90s 798 5,225
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Output Tokens Reasoning Tokens
GPT-5.4 Nano 10.0 10.0 100.0% 0 3.40s 222 0
GLM 4.7 Flash 10.0 10.0 100.0% 0 15.95s 224 1,014

Quick Compare

Switch Comparison Pair

Qwen3.5-9BnonevsGLM 4.7 FlashmediumGPT-5.4 MininonevsGLM 4.7 FlashmediumMercury 2nonevsGLM 4.7 FlashmediumGPT-5.4 NanononevsQwen3.5-9BmediumGrok 4.1 FastnonevsGLM 4.7 FlashmediumMiMo-V2-FlashnonevsGLM 4.7 FlashmediumQwen3 Coder NextnonevsGLM 4.7 FlashmediumGPT-4o-mininonevsGLM 4.7 FlashmediumGPT-5.4 NanononevsQwen3 Coder NextmediumNemotron 3 Super 120b A12bnoneFree AvailablevsGLM 4.7 FlashmediumMistral Small 4nonevsGLM 4.7 FlashmediumTrinity Large PreviewnoneFree AvailablevsGLM 4.7 Flashmedium