GPT-5.6 Sol — low vs medium

Recommended model low

It has the strongest score in this comparison (9.5) and the best overall balance of cost and response time across all 2 models.

Detailed comparison

Metric	GPT-5.6 Sol GPT-5.6 Sol low Release: 2026-07-09	GPT-5.6 Sol GPT-5.6 Sol medium Release: 2026-07-09

Metric	GPT-5.6 Sol GPT-5.6 Sol low Release: 2026-07-09	GPT-5.6 Sol GPT-5.6 Sol medium Release: 2026-07-09
Score	9.5	9.4
Rank	#5	#6
Reliability	10.0	10.0
Consistency	9.2	8.9
Benchmark coverage	22/22 tests · 66/66 attempts	22/22 tests · 66/66 attempts
Tests Correct
Attempt pass rate	86.4%	90.9%
Flaky tests	2	3
Total Runs	66	66
Cost per result	5.391	7.311
Total Cost	$0.971	$1.316
Input Price	$5.000 / 1M	$5.000 / 1M
Output Price	$30.000 / 1M	$30.000 / 1M
Total Input Tokens	78,571	78,997
Output Tokens	4,476	4,696
Reasoning Tokens	14,770	26,002
Response Time (avg)	8.79s	11.35s
Response Time (max)	53.91s	79.40s
Response Time (total)	193.33s	249.73s

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

low

medium

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	8.3	10.0	75.0%	0		2.60s	606	174	492
GPT-5.6 Sol	10.0	10.0	100.0%	0		2.81s	606	173	572

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		11.25s	7,302	412	3,482
GPT-5.6 Sol	10.0	10.0	100.0%	0		9.40s	7,302	394	4,706

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		14.58s	55,372	2,896	1,539
GPT-5.6 Sol	10.0	10.0	100.0%	0		17.65s	55,798	3,119	2,616

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		1.82s	7,140	222	0
GPT-5.6 Sol	10.0	10.0	100.0%	0		1.38s	7,140	222	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	5.3	7.2	44.4%	1		29.07s	723	71	7,822
GPT-5.6 Sol	5.9	7.2	55.6%	1		47.86s	723	71	16,201

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		3.07s	477	99	135
GPT-5.6 Sol	10.0	10.0	100.0%	0		3.48s	477	99	214

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		2.27s	660	90	146
GPT-5.6 Sol	10.0	10.0	100.0%	0		2.50s	660	96	249

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	8.2	7.2	88.9%	1		3.44s	642	224	534
GPT-5.6 Sol	8.2	7.2	88.9%	1		2.98s	642	228	566

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		7.56s	5,454	258	294
GPT-5.6 Sol	10.0	10.0	100.0%	0		6.30s	5,454	264	361

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		3.67s	195	30	326
GPT-5.6 Sol	4.7	1.6	66.7%	1		4.94s	195	30	517

Switch Comparison Pair