Navigate
Advertise here

Compared models

GPT-5.6 Sol (low) vs Grok 4.6 (high) vs Claude Opus 5 (high) benchmark comparison: GPT-5.6 Sol (low) leads on Score with 9.6. GPT-5.6 Sol (low) leads on Reliability with 10.0. GPT-5.6 Sol (low) has the lowest Total Cost at $1.244. GPT-5.6 Sol (low) is fastest at 11.13s.

Last updated at: 2026-11-22

Compared models

Rank
#25
Total Output Tokens
22,557
Response Time (avg)
11.13s
Total Cost
$1.244
Rank
#124
Total Output Tokens
312,614
Response Time (avg)
87.48s
Total Cost
$2.629
Rank
#44
Total Output Tokens
105,662
Response Time (avg)
25.31s
Total Cost
$4.524
Recommended model GPT-5.6 Sol (low)

It has the best score here (9.6), while costing about 2.9x less than the other models in this comparison.

Detailed comparison

Metric GPT-5.6 Sol GPT-5.6 Sol low Release: 2026-07-09 Grok 4.6 Grok 4.6 high Release: 2026-08-12 Claude Opus 5 Claude Opus 5 high Release: 2026-07-25
Score 9.6 8.5 9.4
Rank #25 #124 #44
Reliability 10.0 10.0 10.0
Consistency 9.3 10.0 10.0
Attempts 69/69 69/69 69/69
Tests Correct
Attempt pass rate 87.0% 82.6% 82.6%
Flaky tests 2 0 0
Total Runs 69 69 69
Cost per result 6.545 13.833 23.809
Total Cost $1.244 $2.629 $4.524
Input Price $2.000 / 1M $2.000 / 1M $5.000 / 1M
Output Price $10.000 / 1M $6.000 / 1M $25.000 / 1M
Cache Read Price $0.200 / 1M $0.500 / 1M $0.500 / 1M
Cache Write Price $2.500 / 1M N/A $6.250 / 1M
Total Input Tokens 191,653 376,233 376,421
Output Tokens 5,473 6,687 67,688
Reasoning Tokens 17,084 305,927 37,974
Response Time (avg) 11.13s 87.48s 25.31s
Response Time (max) 57.11s 618.49s 159.01s
Response Time (total) 256.08s 2012.15s 582.11s
Parameters ~2T total (~150B active) ~1.7T total (~170B active) ~5T total (~500B active)
Availability Closed Closed Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#25 GPT-5.6 Sol

low
Cost
$0.062
Time
26.7s
Tokens
2,150 tok

#124 SpaceXAI: Grok 4.6

high
Cost
$0.107
Time
265.1s
Tokens
18,001 tok

#44 Claude Opus 5

high
Cost
$0.265
Time
144.5s
Tokens
10,741 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 10.0 10.0 100.0% 0 11.25s 7,302 412 3,482
Grok 4.6 10.0 10.0 100.0% 0 102.20s 9,579 379 51,829
Claude Opus 5 10.0 10.0 100.0% 0 12.73s 10,590 7,547 1,721

Switch Comparison Pair