GPT-5.6 Sol — high vs medium

Compared models

Rank: #21
Total Output Tokens: 32,071
Response Time (avg): 13.59s
Total Cost: $1.595

Rank: #19
Total Output Tokens: 38,005
Response Time (avg): 14.57s
Total Cost: $1.700

Recommended model high

It has the strongest score in this comparison (9.5) and the best overall balance of cost and response time across 2 models.

Detailed comparison

Metric	GPT-5.6 Sol GPT-5.6 Sol high Release: 2026-07-09	GPT-5.6 Sol GPT-5.6 Sol medium Release: 2026-07-09

Metric	GPT-5.6 Sol GPT-5.6 Sol high Release: 2026-07-09	GPT-5.6 Sol GPT-5.6 Sol medium Release: 2026-07-09
Score	9.5	9.5
Rank	#21	#19
Reliability	10.0	10.0
Consistency	8.9	8.9
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	89.9%	91.3%
Flaky tests	3	3
Total Runs	69	69
Cost per result	8.020	8.944
Total Cost	$1.595	$1.700
Input Price	$2.000 / 1M	$2.000 / 1M
Output Price	$10.000 / 1M	$10.000 / 1M
Cache Read Price	$0.200 / 1M	$0.200 / 1M
Cache Write Price	$2.500 / 1M	$2.500 / 1M
Total Input Tokens	195,567	191,341
Output Tokens	5,841	5,665
Reasoning Tokens	26,230	32,340
Response Time (avg)	13.59s	14.57s
Response Time (max)	59.99s	79.40s
Response Time (total)	312.61s	335.16s
Parameters	~2T total (~150B active)	~2T total (~150B active)
Availability	Closed	Closed

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#21 GPT-5.6 Sol

high

Cost: $0.151
Time: 201.9s
Tokens: 5,100 tok

#19 GPT-5.6 Sol

medium

Cost: $0.124
Time: 57.2s
Tokens: 4,199 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		59.99s	116,309	986	2,377
GPT-5.6 Sol	10.0	10.0	100.0%	0		57.28s	112,335	969	2,059

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	8.7	7.9	91.7%	1		3.39s	606	171	644
GPT-5.6 Sol	10.0	10.0	100.0%	0		2.81s	606	173	572

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		12.52s	7,302	404	5,656
GPT-5.6 Sol	10.0	10.0	100.0%	0		9.40s	7,302	394	4,706

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		24.99s	56,154	3,298	4,866
GPT-5.6 Sol	10.0	10.0	100.0%	0		17.65s	55,798	3,119	2,616

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		1.16s	7,140	222	0
GPT-5.6 Sol	10.0	10.0	100.0%	0		1.38s	7,140	222	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	5.3	7.2	44.4%	1		37.67s	628	62	10,365
GPT-5.6 Sol	5.9	7.2	55.6%	1		57.24s	732	71	20,480

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		4.40s	477	97	238
GPT-5.6 Sol	10.0	10.0	100.0%	0		3.48s	477	99	214

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		2.73s	660	96	331
GPT-5.6 Sol	10.0	10.0	100.0%	0		2.50s	660	96	249

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		4.10s	642	211	675
GPT-5.6 Sol	8.2	7.2	88.9%	1		2.98s	642	228	566

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	10.0	10.0	100.0%	0		7.08s	5,454	264	393
GPT-5.6 Sol	10.0	10.0	100.0%	0		6.30s	5,454	264	361

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.6 Sol	4.7	1.6	66.7%	1		6.97s	195	30	685
GPT-5.6 Sol	4.7	1.6	66.7%	1		4.94s	195	30	517

Switch Comparison Pair

Gemini 3.7 FlashmediumvsGPT-5.6 Solhigh Claude Opus 5.5lowvsGPT-5.6 Solhigh Claude Opus 5.5lowvsGPT-5.6 Solmedium Claude Opus 5.5highvsGPT-5.6 Solmedium Gemini 3 Flash PreviewmediumvsGPT-5.6 Solhigh Gemini 3.7 FlashlowvsGPT-5.6 Solhigh Gemini 3.7 FlashlowvsGPT-5.6 Solmedium Claude Opus 5mediumvsGPT-5.6 Solhigh Claude Opus 5highvsGPT-5.6 Solmedium Seed 2.1 TurbolowvsGPT-5.6 Solhigh Seed 2.1 TurbolowvsGPT-5.6 Solmedium Claude Opus 5.5mediumvsGPT-5.6 Solhigh