AI BENCHY Compare

OpenAI: GPT-5.5 vs OpenAI: GPT-5.6 Sol

Summary

GPT-5.6 Sol (low) leads on average score with 9.5 vs 9.3. GPT-5.6 Sol (low) has the lower benchmark cost at $0.649 vs $0.907. GPT-5.6 Sol (low) is faster at 8.29s vs 9.76s, with pass rates of 85.7% vs 85.7%.

Recommended modelGPT-5.6 Sol (low)It has the strongest score in this comparison (9.5) and the best overall balance of cost and response time across all 2 models.

Last updated at: 2026-07-14

Metric	GPT-5.5 GPT-5.5 low Release: 2026-04-24	GPT-5.6 Sol GPT-5.6 Sol low Release: 2026-07-09

Metric	GPT-5.5 GPT-5.5 low Release: 2026-04-24	GPT-5.6 Sol GPT-5.6 Sol low Release: 2026-07-09
Score	9.3	9.5
Rank	#7	#3
Reliability	10.0	10.0
Consistency	10.0	9.2
Tests Correct
Attempt pass rate	85.7%	85.7%
Flaky tests	0	2
Total Runs	63	63
Cost per result	5.035	3.816
Total Cost	$0.907	$0.649
Input Price	$5.000 / 1M	$5.000 / 1M
Output Price	$30.000 / 1M	$30.000 / 1M
Total Input Tokens	34,209	34,218
Output Tokens	2,046	1,898
Reasoning Tokens	22,460	14,023
Response Time (avg)	9.76s	8.29s
Response Time (max)	56.19s	53.91s
Response Time (total)	204.92s	174.04s

Generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#7 GPT-5.5

low

Cost: $0.068
Time: 37.0s
Tokens: 2,339 tok

#3 GPT-5.6 Sol

low

Cost: $0.062
Time: 26.7s
Tokens: 2,150 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		4.41s	606	238	1,020
GPT-5.6 Sol	8.3	10.0	75.0%	0		2.60s	606	174	492

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		15.04s	7,302	423	6,402
GPT-5.6 Sol	10.0	10.0	100.0%	0		11.25s	7,302	412	3,482

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		9.56s	11,019	303	717
GPT-5.6 Sol	10.0	10.0	100.0%	0		9.87s	11,019	318	792

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		3.28s	7,140	228	157
GPT-5.6 Sol	10.0	10.0	100.0%	0		1.82s	7,140	222	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	5.3	10.0	33.3%	0		28.05s	723	69	11,609
GPT-5.6 Sol	5.3	7.2	44.4%	1		29.07s	723	71	7,822

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		5.17s	477	133	245
GPT-5.6 Sol	10.0	10.0	100.0%	0		3.07s	477	99	135

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	9.9	10.0	100.0%	0		3.74s	660	93	415
GPT-5.6 Sol	10.0	10.0	100.0%	0		2.27s	660	90	146

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		4.74s	642	279	954
GPT-5.6 Sol	8.2	7.2	88.9%	1		3.44s	642	224	534

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		4.96s	5,445	250	101
GPT-5.6 Sol	10.0	10.0	100.0%	0		7.56s	5,454	258	294

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	3.0	10.0	0.0%	0		10.06s	195	30	840
GPT-5.6 Sol	10.0	10.0	100.0%	0		3.67s	195	30	326

Quick Compare

Switch Comparison Pair

GPT-5.5lowvsQwen3.7 Maxmedium Gemini 3 Flash PreviewmediumvsGPT-5.6 Sollow Claude Fable 5mediumvsGPT-5.5low Gemini 3.1 Pro PreviewmediumvsGPT-5.5low GPT-5.6 SollowvsQwen3.7 Maxmedium Gemini 3.5 FlashmediumvsGPT-5.5low Gemini 3 Flash PreviewmediumvsGPT-5.5low Gemini 3.5 FlashhighvsGPT-5.6 Sollow Claude Fable 5mediumvsGPT-5.6 Sollow Gemini 3.1 Pro PreviewmediumvsGPT-5.6 Sollow Gemini 3.5 FlashmediumvsGPT-5.6 Sollow GPT-5.5lowvsQwen3.6 Max Previewmedium