Navigate
Advertise here

GPT-5.6 Sol vs Step 3.7 Flash (low)

Step 3.7 Flash (low) leads on average score with 7.2 vs 6.7. Step 3.7 Flash (low) has the lower benchmark cost at $0.449 vs $0.795. GPT-5.6 Sol is faster at 4.61s vs 20.72s, with pass rates of 60.9% vs 63.8%.

Last updated at: 2026-10-24

Compared models

Rank
#219
Total Output Tokens
5,555
Response Time (avg)
4.61s
Total Cost
$0.795
Rank
#179
Total Output Tokens
339,108
Response Time (avg)
20.72s
Total Cost
$0.449
Recommended model Step 3.7 Flash (low)

It has the best score here (7.2), while costing about 1.8x less than GPT-5.6 Sol.

Detailed comparison

Metric GPT-5.6 Sol GPT-5.6 Sol none Release: 2026-07-09 Step 3.7 Flash Step 3.7 Flash low Release: 2026-05-29
Score 6.7 7.2
Rank #219 #179
Reliability 10.0 10.0
Consistency 9.1 7.9
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 60.9% 63.8%
Flaky tests 3 6
Total Runs 69 69
Cost per result 6.619 4.078
Total Cost $0.795 $0.449
Input Price $2.000 / 1M $0.200 / 1M
Output Price $10.000 / 1M $1.150 / 1M
Cache Read Price $0.200 / 1M $0.040 / 1M
Cache Write Price $2.500 / 1M N/A
Total Input Tokens 207,852 292,685
Output Tokens 5,555 339,108
Reasoning Tokens 0 0
Response Time (avg) 4.61s 20.72s
Response Time (max) 58.28s 124.75s
Response Time (total) 105.93s 476.67s
Parameters ~2T total (~150B active) 198B total (11B active)
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#219 GPT-5.6 Sol

none
Cost
$0.116
Time
78.7s
Tokens
3,944 tok

#179 Step 3.7 Flash

low
Invalid SVG
Cost
$0.004
Time
25.3s
Tokens
3,072 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.6 Sol 5.5 10.0 33.3% 0 1.39s 7,302 390 0
Step 3.7 Flash 8.2 7.2 88.9% 1 9.46s 7,437 18,685 0

Quick Compare

Switch Comparison Pair

Ember-1maxvsGPT-5.6 SolnoneStep 3.7 FlashlowvsGLM 5mediumApodex 1.1 MinihighFree AvailablevsGPT-5.6 SolnoneMiniMax M3mediumvsGPT-5.6 SolnoneGPT-5.6 SolnonevsGrok 4.7highLongCat 2.0mediumvsStep 3.7 FlashlowQwen3.6 27BmediumvsStep 3.7 FlashlowGPT-5.6 SolnonevsSolar Pro 4lowQwen3.7 FlashhighvsStep 3.7 FlashlowClaude Opus 5nonevsStep 3.7 FlashlowGPT-5.6 SolnonevsGLM 5.3 FlashlowQwen3.8 27BmediumFree AvailablevsStep 3.7 Flashlow