Navigate
AI BENCHY
Advertise here

GPT-5.5 vs GLM 5.1 (medium)

The average score is effectively tied at 7.0 vs 7.0. GPT-5.5 has the lower benchmark cost at $0.544 vs $0.727. GPT-5.5 is faster at 2.35s vs 58.80s, with pass rates of 59.1% vs 65.2%.

Last updated at: 2026-08-15

Rank
#118
Total Output Tokens
4,915
Response Time (avg)
2.35s
Total Cost
$0.544
Rank
#117
Total Output Tokens
215,889
Response Time (avg)
58.80s
Total Cost
$0.727
Recommended model GPT-5.5

It has the best score here (7.0), while responding about 25.0x faster than GLM 5.1 (medium).

Detailed comparison

Metric GPT-5.5 GPT-5.5 none Release: 2026-04-24 GLM 5.1 GLM 5.1 medium Release: 2026-04-07
Score 7.0 7.0
Rank #118 #117
Reliability 10.0 8.1
Consistency 9.2 8.4
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 59.1% 65.2%
Flaky tests 2 4
Total Runs 66 66
Cost per result 4.533 6.923
Total Cost $0.544 $0.727
Input Price $5.000 / 1M $0.966 / 1M
Output Price $30.000 / 1M $3.036 / 1M
Total Input Tokens 79,294 82,592
Output Tokens 4,915 16,089
Reasoning Tokens 0 199,800
Response Time (avg) 2.35s 58.80s
Response Time (max) 12.24s 308.75s
Response Time (total) 51.78s 1234.72s
Parameters ~1.5T total (~100B active) 744B total (40B active)
Availability Closed Open source

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#118 GPT-5.5

none
Cost
$0.090
Time
54.3s
Tokens
3,063 tok

#117 GLM 5.1

medium
Invalid SVG
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 5.5 10.0 33.3% 0 1.35s 7,305 462 0
GLM 5.1 4.6 3.7 44.5% 2 109.63s 5,702 4,871 37,826

Quick Compare

Switch Comparison Pair

Mercury 2mediumvsGPT-5.5noneGPT-5.5nonevsGrok 4.20mediumDeepSeek V3.2mediumvsGPT-5.5noneSeed-2.0-MinimediumvsGPT-5.5noneKimi K2.5mediumvsGPT-5.5noneGPT-5.6 SolnonevsGLM 5.1mediumGPT-5.5nonevsGrok 4.3mediumKAT-Coder-Pro V2.5mediumvsGPT-5.5noneGPT-5.5nonevsQwen3.7 FlashmediumSeed-2.0-CodehighvsGPT-5.5noneSeed-2.0-CodehighvsGLM 5.1mediumSolar Pro 4highvsGLM 5.1medium