GPT-5.5 vs Grok 4.20 (medium)

Rank: #118
Total Output Tokens: 4,915
Response Time (avg): 2.35s
Total Cost: $0.544

Rank: #120
Total Output Tokens: 270,259
Response Time (avg): 32.56s
Total Cost: $0.805

Recommended model GPT-5.5

It has the best score here (7.0), while responding about 13.8x faster than Grok 4.20 (medium).

Detailed comparison

Metric	GPT-5.5 GPT-5.5 none Release: 2026-04-24	Grok 4.20 Grok 4.20 medium Release: 2026-03-31

Metric	GPT-5.5 GPT-5.5 none Release: 2026-04-24	Grok 4.20 Grok 4.20 medium Release: 2026-03-31
Score	7.0	7.0
Rank	#118	#120
Reliability	10.0	10.0
Consistency	9.2	8.2
Attempts	66/66	66/66
Tests Correct
Attempt pass rate	59.1%	60.6%
Flaky tests	2	5
Total Runs	66	66
Cost per result	4.533	10.365
Total Cost	$0.544	$0.805
Input Price	$5.000 / 1M	$1.250 / 1M
Output Price	$30.000 / 1M	$2.500 / 1M
Total Input Tokens	79,294	102,986
Output Tokens	4,915	5,860
Reasoning Tokens	0	264,399
Response Time (avg)	2.35s	32.56s
Response Time (max)	12.24s	199.66s
Response Time (total)	51.78s	716.36s
Parameters	~1.5T total (~100B active)	~1T total (~100B active)
Availability	Closed	Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#118 GPT-5.5

none

Cost: $0.090
Time: 54.3s
Tokens: 3,063 tok

#120 SpaceXAI: Grok 4.20

medium

Cost: $0.041
Time: 110.3s
Tokens: 16,336 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	6.9	7.9	66.7%	1		1.31s	606	213	0
Grok 4.20	8.2	7.9	83.3%	1		3.95s	2,010	287	8,312

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	5.5	10.0	33.3%	0		1.35s	7,305	462	0
Grok 4.20	6.3	6.6	55.6%	1		109.93s	8,307	268	103,150

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	6.5	10.0	50.0%	0		8.90s	56,092	3,244	0
Grok 4.20	8.7	6.9	83.3%	1		42.25s	71,267	3,776	44,009

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		1.18s	7,140	222	0
Grok 4.20	10.0	10.0	100.0%	0		4.17s	7,761	180	5,333

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	5.3	10.0	33.3%	0		1.27s	732	52	0
Grok 4.20	2.9	7.2	11.1%	1		49.71s	1,959	872	59,761

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		3.41s	477	124	0
Grok 4.20	3.9	2.6	33.3%	1		24.48s	825	65	6,440

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	6.2	5.8	66.7%	1		1.15s	660	81	0
Grok 4.20	9.8	10.0	100.0%	0		4.26s	1,362	57	6,419

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	7.7	10.0	66.7%	0		1.29s	642	252	0
Grok 4.20	7.7	10.0	66.7%	0		6.22s	1,689	149	7,913

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		3.90s	5,445	247	0
Grok 4.20	3.0	10.0	0.0%	0		13.68s	7,275	197	6,620

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	3.0	10.0	0.0%	0		5.01s	195	18	0
Grok 4.20	3.0	10.0	0.0%	0		63.48s	531	9	16,442

Quick Compare

Switch Comparison Pair

Mercury 2mediumvsGPT-5.5none GPT-5.5nonevsGLM 5.1medium DeepSeek V3.2mediumvsGPT-5.5none Seed-2.0-MinimediumvsGPT-5.5none Kimi K2.5mediumvsGPT-5.5none GPT-5.5nonevsGrok 4.3medium GPT-5.6 SolnonevsGrok 4.20medium KAT-Coder-Pro V2.5mediumvsGPT-5.5none Seed-2.0-CodehighvsGrok 4.20medium GPT-5.5nonevsQwen3.7 Flashmedium Seed-2.0-CodehighvsGPT-5.5none GPT-5.5nonevsSolar Pro 4high