Navigate
Advertise here

GPT-6.1 Sol (low) vs GLM 5.3 (high)

GPT-6.1 Sol (low) leads on average score with 9.6 vs 7.8. GPT-6.1 Sol (low) has the lower benchmark cost at $0.460 vs $0.610. GPT-6.1 Sol (low) is faster at 7.15s vs 28.38s, with pass rates of 92.8% vs 75.4%.

Last updated at: 2026-10-03

Compared models

Rank
#16
Total Output Tokens
13,138
Response Time (avg)
7.15s
Total Cost
$0.460
Rank
#107
Total Output Tokens
68,482
Response Time (avg)
28.38s
Total Cost
$0.610
Recommended model GPT-6.1 Sol (low)

It has the best score here (9.6), while responding about 4.0x faster than GLM 5.3 (high).

Detailed comparison

Metric GPT-6.1 Sol GPT-6.1 Sol low Release: 2026-09-29 GLM 5.3 GLM 5.3 high Release: 2026-08-20
Score 9.6 7.8
Rank #16 #107
Reliability 10.0 10.0
Consistency 9.6 7.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 92.8% 75.4%
Flaky tests 1 7
Total Runs 69 69
Cost per result 2.187 4.351
Total Cost $0.460 $0.610
Input Price $2.000 / 1M $1.400 / 1M
Output Price $10.000 / 1M $4.400 / 1M
Cache Read Price $0.100 / 1M $0.140 / 1M
Cache Write Price $2.500 / 1M N/A
Total Input Tokens 163,900 219,811
Output Tokens 4,958 8,811
Reasoning Tokens 8,180 59,671
Response Time (avg) 7.15s 28.38s
Response Time (max) 46.57s 159.91s
Response Time (total) 164.47s 652.78s
Parameters ~2T total (~150B active) 744B total (40B active)
Availability Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#16 GPT-6.1 Sol

low
Cost
$0.028
Time
44.6s
Tokens
2,881 tok

#107 GLM 5.3

high
Cost
$0.085
Time
362.5s
Tokens
19,310 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-6.1 Sol 10.0 10.0 100.0% 0 4.48s 7,302 388 1,286
GLM 5.3 6.6 5.0 66.7% 2 18.89s 7,317 473 8,190

Quick Compare

Switch Comparison Pair