OpenAI: GPT-5.2 vs Thinking Machines: Inkling

GPT-5.2 (medium) leads on average score with 8.4 vs 8.0. GPT-5.2 (medium) has the lower benchmark cost at $0.951 vs $1.006. GPT-5.2 (medium) is faster at 22.62s vs 64.16s, with pass rates of 72.7% vs 77.3%.

Recommended modelGPT-5.2 (medium)It has the best score here (8.4), while responding about 2.8x faster than Inkling (high).

Last updated at: 2026-07-18

Metric	GPT-5.2 GPT-5.2 medium Release: 2025-12-11	Inkling Inkling high Release: 2026-07-18

Metric	GPT-5.2 GPT-5.2 medium Release: 2025-12-11	Inkling Inkling high Release: 2026-07-18
Score	8.4	8.0
Rank	#21	#28
Reliability	10.0	9.8
Consistency	8.5	8.9
Tests Correct
Attempt pass rate	72.7%	77.3%
Flaky tests	4	3
Total Runs	66	66
Cost per result	6.791	6.704
Total Cost	$0.951	$1.006
Input Price	$1.750 / 1M	$1.000 / 1M
Output Price	$14.000 / 1M	$4.050 / 1M
Total Input Tokens	105,004	86,746
Output Tokens	9,914	6,055
Reasoning Tokens	44,868	220,791
Response Time (avg)	22.62s	64.16s
Response Time (max)	102.93s	327.51s
Response Time (total)	339.28s	1411.59s

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#21 GPT-5.2

medium

Cost: $0.047
Time: 49.2s
Tokens: 3,396 tok

#28 Thinking Machines: Inkling

high

Cost: $0.005
Time: 32.2s
Tokens: 1,275 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2	6.5	8.0	58.3%	1		7.81s	606	567	2,002
Inkling	10.0	10.0	100.0%	0		12.68s	702	455	7,204

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2	10.0	10.0	100.0%	0		22.73s	7,302	511	11,912
Inkling	8.5	10.0	66.7%	0		148.36s	7,374	430	78,982

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2	10.0	10.0	100.0%	0		58.50s	82,056	7,304	14,693
Inkling	7.3	5.8	83.3%	1		63.78s	61,296	3,854	19,895

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2	10.0	10.0	100.0%	0		3.15s	7,140	234	420
Inkling	10.0	10.0	100.0%	0		8.19s	7,068	216	2,349

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2	5.9	7.2	55.6%	1		77.80s	473	42	10,342
Inkling	7.7	10.0	66.7%	0		186.39s	683	59	76,777

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2	3.7	9.7	0.0%	0		4.32s	477	162	269
Inkling	10.0	10.0	100.0%	0		6.53s	501	182	1,151

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2	9.9	10.0	100.0%	0		3.12s	660	94	614
Inkling	9.8	10.0	100.0%	0		7.00s	708	93	2,098

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2	7.5	7.3	77.8%	1		5.80s	642	735	924
Inkling	6.9	4.9	77.8%	2		10.69s	714	429	4,623

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2	4.7	1.6	66.7%	1		10.30s	5,453	239	469
Inkling	3.0	10.0	0.0%	0		6.52s	7,481	307	601

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-5.2	3.0	10.0	0.0%	0		28.18s	195	26	3,223
Inkling	3.0	10.0	0.0%	0		153.57s	219	30	27,111

Quick Compare

Switch Comparison Pair

Step 3.7 FlashmediumvsInklinghigh GPT-5.2 ChatnonevsInklinghigh GPT-5.2mediumvsGrok 4.5low GPT-5 MinimediumvsInklinghigh Kimi K3maxvsInklinghigh Muse Spark 1.1lowvsGPT-5.2medium Seed-2.0-LitemediumvsInklinghigh Qwen3.7 PlusmediumvsInklinghigh Gemini 2.5 FlashmediumvsInklinghigh Qwen3.6 PlusmediumvsInklinghigh InklinghighvsGLM 5.2medium GPT-5.6 TerramediumvsInklinghigh