Navigate
AI BENCHY
Advertise here

AI BENCHY Compare

OpenAI: GPT-5.5 vs OpenAI: GPT-5.6 Sol

Summary

GPT-5.5 (low) vs GPT-5.6 Sol benchmark comparison: GPT-5.5 (low) leads on average score with 9.3 vs 6.3. GPT-5.6 Sol has the lower benchmark cost at $0.225 vs $0.907. GPT-5.6 Sol is faster at 1.66s vs 9.76s, with pass rates of 85.7% vs 57.1%.

Recommended model: GPT-5.5 (low) - It has the strongest score in this comparison (9.3) and the best overall balance of cost and response time across all 2 models.

Last updated at: 2026-07-09

Metric GPT-5.5 GPT-5.5 low Release: 2026-04-24 GPT-5.6 Sol GPT-5.6 Sol none Release: 2026-07-09
Score 9.3 6.3
Rank #7 #101
Reliability 10.0 10.0
Consistency 10.0 9.0
Tests Correct
Attempt pass rate 85.7% 57.1%
Flaky tests 0 3
Total Runs 63 63
Cost per result 5.035 2.244
Total Cost $0.907 $0.225
Input Price $5.000 / 1M $5.000 / 1M
Output Price $30.000 / 1M $30.000 / 1M
Total Input Tokens 34,209 34,218
Output Tokens 2,046 1,776
Reasoning Tokens 22,460 0
Response Time (avg) 9.76s 1.66s
Response Time (max) 56.19s 3.93s
Response Time (total) 204.92s 34.81s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#7 GPT-5.5

low
Cost
$0.068
Time
37.0s
Tokens
2,339 tok

#101 GPT-5.6 Sol

none
Cost
$0.116
Time
78.7s
Tokens
3,944 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Anti-AI Tricks Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.41s 606 238 1,020
GPT-5.6 Sol 8.3 10.0 75.0% 0 1.27s 606 154 0
Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 15.04s 7,302 423 6,402
GPT-5.6 Sol 5.5 10.0 33.3% 0 1.39s 7,302 390 0
Combined Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 9.56s 11,019 303 717
GPT-5.6 Sol 3.0 10.0 0.0% 0 3.93s 11,019 300 0
Data parsing and extraction Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 3.28s 7,140 228 157
GPT-5.6 Sol 10.0 10.0 100.0% 0 1.53s 7,140 222 0
Domain specific Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 5.3 10.0 33.3% 0 28.05s 723 69 11,609
GPT-5.6 Sol 3.6 7.2 22.2% 1 1.43s 723 54 0
General Intelligence Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 5.17s 477 133 245
GPT-5.6 Sol 6.5 3.4 66.7% 1 1.52s 477 91 0
Instructions following Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 9.9 10.0 100.0% 0 3.74s 660 93 415
GPT-5.6 Sol 8.5 6.8 83.3% 1 1.33s 660 84 0
Puzzle Solving Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.74s 642 279 954
GPT-5.6 Sol 7.7 10.0 66.7% 0 1.49s 642 211 0
Tool Calling Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 4.96s 5,445 250 101
GPT-5.6 Sol 10.0 10.0 100.0% 0 3.70s 5,454 246 0
Trivia Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 3.0 10.0 0.0% 0 10.06s 195 30 840
GPT-5.6 Sol 3.0 10.0 0.0% 0 1.95s 195 24 0

Quick Compare

Switch Comparison Pair

Nemotron 3 SupermediumFree AvailablevsGPT-5.6 SolnoneGemma 4 31BmediumFree AvailablevsGPT-5.6 SolnoneGPT-5.6 SolnonevsQwen3.5-35B-A3BmediumGPT-5.5lowvsQwen3.7 MaxmediumGemini 3.1 Flash LitelowvsGPT-5.6 SolnoneClaude Fable 5mediumvsGPT-5.5lowGemini 3.1 Pro PreviewmediumvsGPT-5.5lowGemini 3.1 Flash Lite PreviewlowvsGPT-5.6 SolnoneGemini 3.1 Flash LiteminimalvsGPT-5.6 SolnoneGemini 3.5 FlashmediumvsGPT-5.5lowGemini 3 Flash PreviewmediumvsGPT-5.5lowGPT-5.6 SolnonevsQwen3.6 27Bmedium