OpenAI: GPT-5.5 vs Thinking Machines: Inkling

GPT-5.5 (low) leads on average score with 9.3 vs 5.2. Inkling has the lower benchmark cost at $0.147 vs $1.253. Inkling is faster at 3.50s vs 10.13s, with pass rates of 86.4% vs 28.8%.

Recommended modelGPT-5.5 (low)It has the strongest score in this comparison (9.3) and the best overall balance of cost and response time across all 2 models.

Last updated at: 2026-07-18

Metric	GPT-5.5 GPT-5.5 low Release: 2026-04-24	Inkling Inkling none Release: 2026-07-18

Metric	GPT-5.5 GPT-5.5 low Release: 2026-04-24	Inkling Inkling none Release: 2026-07-18
Score	9.3	5.2
Rank	#6	#160
Reliability	10.0	9.9
Consistency	10.0	9.6
Tests Correct
Attempt pass rate	86.4%	28.8%
Flaky tests	0	1
Total Runs	66	66
Cost per result	6.594	2.448
Total Cost	$1.253	$0.147
Input Price	$5.000 / 1M	$1.000 / 1M
Output Price	$30.000 / 1M	$4.050 / 1M
Total Input Tokens	80,058	104,111
Output Tokens	5,378	10,551
Reasoning Tokens	23,040	0
Response Time (avg)	10.13s	3.50s
Response Time (max)	56.19s	48.02s
Response Time (total)	222.82s	77.09s

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#6 GPT-5.5

low

Cost: $0.068
Time: 37.0s
Tokens: 2,339 tok

#160 Thinking Machines: Inkling

none

Provider returned error

Cost: $0.000
Time: 5.3s
Tokens: 0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		4.41s	606	238	1,020
Inkling	4.8	10.0	25.0%	0		1.43s	678	261	0

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		15.04s	7,302	423	6,402
Inkling	4.5	10.0	0.0%	0		1.01s	7,356	436	0

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		13.73s	56,868	3,635	1,297
Inkling	2.9	5.8	16.7%	1		25.74s	80,195	8,777	0

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		3.28s	7,140	228	157
Inkling	10.0	10.0	100.0%	0		1.14s	7,056	279	0

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	5.3	10.0	33.3%	0		28.05s	723	69	11,609
Inkling	5.3	10.0	33.3%	0		1.45s	777	42	0

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		5.17s	477	133	245
Inkling	5.0	10.0	0.0%	0		859ms	495	156	0

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	9.9	10.0	100.0%	0		3.74s	660	93	415
Inkling	6.3	10.0	50.0%	0		1.72s	696	72	0

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		4.74s	642	279	954
Inkling	5.6	9.9	33.3%	0		931ms	696	291	0

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	10.0	10.0	100.0%	0		4.96s	5,445	250	101
Inkling	3.0	10.0	0.0%	0		2.50s	5,949	213	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.5	3.0	10.0	0.0%	0		10.06s	195	30	840
Inkling	3.0	10.0	0.0%	0		670ms	213	24	0

Quick Compare

Switch Comparison Pair

Gemini 3.1 Pro PreviewmediumvsGPT-5.5low Mistral Small 4mediumvsInklingnone KAT-Coder-Air V2.5lowvsInklingnone MiniMax M2.7mediumvsInklingnone GPT-5.5lowvsQwen3.7 Maxmedium Gemini 3.5 FlashmediumvsGPT-5.5low Gemini 3.5 FlashhighvsGPT-5.5low Gemini 3 Flash PreviewmediumvsGPT-5.5low KAT-Coder-Air V2.5mediumvsInklingnone GPT-5.5lowvsGrok 4.5high KAT-Coder-Air V2.5highvsInklingnone Claude Opus 4.8mediumvsGPT-5.5low