GPT-5.6 Sol — low vs medium

Recommended model low

It has the strongest score in this comparison (9.5) and the best overall balance of cost and response time across all 2 models.

Detailed comparison

Metric	GPT-5.6 Sol GPT-5.6 Sol low Release: 2026-07-09	GPT-5.6 Sol GPT-5.6 Sol medium Release: 2026-07-09

Metric	GPT-5.6 Sol GPT-5.6 Sol low Release: 2026-07-09	GPT-5.6 Sol GPT-5.6 Sol medium Release: 2026-07-09
Score	9.5	9.4
Rank	#4	#8
Reliability	10.0	10.0
Consistency	9.2	8.9
Attempts	66/66	66/66
Tests Correct
Attempt pass rate	86.4%	90.9%
Flaky tests	2	3
Total Runs	66	66
Cost per result	5.508	8.025
Total Cost	$0.496	$0.723
Input Price	$2.500 / 1M	$2.500 / 1M
Output Price	$15.000 / 1M	$15.000 / 1M
Total Input Tokens	78,580	79,006
Output Tokens	4,476	4,696
Reasoning Tokens	15,470	30,281
Response Time (avg)	9.04s	12.63s
Response Time (max)	53.91s	79.40s
Response Time (total)	198.97s	277.88s
Parameters	~2T total (~150B active)	~2T total (~150B active)
Availability	Closed	Closed

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

low

medium

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	8.3	10.0	75.0%	0		2.60s	606	174	492
GPT-5.6 Sol	10.0	10.0	100.0%	0		2.81s	606	173	572

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		11.25s	7,302	412	3,482
GPT-5.6 Sol	10.0	10.0	100.0%	0		9.40s	7,302	394	4,706

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		14.58s	55,372	2,896	1,539
GPT-5.6 Sol	10.0	10.0	100.0%	0		17.65s	55,798	3,119	2,616

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		1.82s	7,140	222	0
GPT-5.6 Sol	10.0	10.0	100.0%	0		1.38s	7,140	222	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	5.3	7.2	44.4%	1		30.95s	732	71	8,522
GPT-5.6 Sol	5.9	7.2	55.6%	1		57.24s	732	71	20,480

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		3.07s	477	99	135
GPT-5.6 Sol	10.0	10.0	100.0%	0		3.48s	477	99	214

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		2.27s	660	90	146
GPT-5.6 Sol	10.0	10.0	100.0%	0		2.50s	660	96	249

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	8.2	7.2	88.9%	1		3.44s	642	224	534
GPT-5.6 Sol	8.2	7.2	88.9%	1		2.98s	642	228	566

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		7.56s	5,454	258	294
GPT-5.6 Sol	10.0	10.0	100.0%	0		6.30s	5,454	264	361

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		3.67s	195	30	326
GPT-5.6 Sol	4.7	1.6	66.7%	1		4.94s	195	30	517

Switch Comparison Pair