Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

AI BENCHY Compare

OpenAI: gpt-oss-120b vs Z.ai: GLM 4.7 Flash

Summary

gpt-oss-120b vs GLM 4.7 Flash (medium) benchmark comparison: GLM 4.7 Flash (medium) leads on average score with 4.3 vs 4.0. gpt-oss-120b has the lower benchmark cost at $0.010 vs $0.054. gpt-oss-120b is faster at 21.61s vs 35.10s, with pass rates of 34.9% vs 33.3%.

Recommended model: gpt-oss-120b - Its score stays close to the best score here (4.0 vs 4.3), while costing about 5.6x less than GLM 4.7 Flash (medium).

Last updated at: 2026-07-09

Metric gpt-oss-120b gpt-oss-120b none Release: 2025-08-05 Free Available GLM 4.7 Flash GLM 4.7 Flash medium Release: 2026-01-19
Score 4.0 4.3
Rank #183 #176
Reliability 10.0 6.7
Consistency 8.2 6.8
Tests Correct
Attempt pass rate 34.9% 33.3%
Flaky tests 2 8
Total Runs 57 63
Cost per result 0.168 1.337
Total Cost $0.010 $0.054
Input Price $0.036 / 1M $0.060 / 1M
Output Price $0.180 / 1M $0.400 / 1M
Total Input Tokens 9,081 37,206
Output Tokens 51,664 43,754
Reasoning Tokens 0 89,079
Response Time (avg) 21.61s 35.10s
Response Time (max) 113.71s 174.55s
Response Time (total) 345.79s 456.24s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#183 gpt-oss-120b

none
No showcase result has been generated for this model yet.
Cost
$0.000
Time
-
Tokens
0 tok

#176 GLM 4.7 Flash

medium
Invalid SVG
Cost
$0.000
Time
186.2s
Tokens
12,112 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
gpt-oss-120b 6.5 10.0 50.0% 0 32.84s 1,336 8,676 0
GLM 4.7 Flash 4.7 5.9 41.7% 2 14.95s 555 1,122 6,110
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
gpt-oss-120b 1.5 4.0 22.2% 1 9.57s 901 3,232 0
GLM 4.7 Flash 3.2 7.4 11.1% 1 55.33s 3,106 4,981 22,387
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
gpt-oss-120b 3.0 10.0 0.0% 0 0ms 0 0 0
GLM 4.7 Flash 2.8 2.1 33.3% 1 65.57s 17,185 2,585 20,648
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
gpt-oss-120b 6.5 10.0 50.0% 0 7.12s 2,421 598 0
GLM 4.7 Flash 6.3 10.0 50.0% 0 1.51s 7,107 584 2,755
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
gpt-oss-120b 3.0 10.0 0.0% 0 34.98s 1,294 29,483 0
GLM 4.7 Flash 3.5 4.4 33.3% 2 174.55s 643 33,000 25,394
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
gpt-oss-120b 4.8 10.0 0.0% 0 10.79s 584 615 0
GLM 4.7 Flash 3.6 9.7 0.0% 0 18.14s 318 18 2,138
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
gpt-oss-120b 9.8 10.0 100.0% 0 5.06s 1,043 1,940 0
GLM 4.7 Flash 6.2 5.8 66.7% 1 2.97s 636 388 2,181
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
gpt-oss-120b 6.0 7.2 55.6% 1 8.21s 1,188 3,982 0
GLM 4.7 Flash 2.9 7.2 11.1% 1 12.93s 521 781 5,255
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
gpt-oss-120b 3.0 10.0 0.0% 0 0ms 0 0 0
GLM 4.7 Flash 10.0 10.0 100.0% 0 15.95s 6,949 224 1,014
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
gpt-oss-120b 3.0 10.0 0.0% 0 47.29s 314 3,138 0
GLM 4.7 Flash 3.0 10.0 0.0% 0 11.13s 186 71 1,197

Quick Compare

Switch Comparison Pair