GPT-6 Sol vs Inkling (low)

Compared models

Recommended model Inkling (low)

It has the best score here (6.8), while costing about 1.8x less than GPT-6 Sol.

Metric	GPT-6 Sol GPT-6 Sol none Release: 2026-09-23	Inkling Inkling low Release: 2026-07-18 Free Available

Metric	GPT-6 Sol GPT-6 Sol none Release: 2026-09-23	Inkling Inkling low Release: 2026-07-18 Free Available
Score	6.8	6.8
Rank	#172	#170
Reliability	10.0	10.0
Consistency	8.5	8.6
Attempts	69/69	69/69
Tests Correct
Attempt pass rate	63.8%	56.5%
Flaky tests	4	4
Total Runs	69	69
Cost per result	4.232	2.756
Total Cost	$0.551	$0.304
Input Price	$2.000 / 1M	$1.000 / 1M
Output Price	$10.000 / 1M	$4.050 / 1M
Total Input Tokens	235,086	213,901
Output Tokens	7,989	9,623
Reasoning Tokens	0	12,414
Response Time (avg)	9.02s	6.81s
Response Time (max)	57.02s	44.24s
Response Time (total)	207.45s	156.70s
Parameters	~2T total (~150B active)	975B total (41B active)
Availability	Closed	Open source

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

none

low

Category:

Agentic	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	5.0	10.0	0.0%	0		57.02s	128,754	1,293	0
Inkling	10.0	10.0	100.0%	0		44.24s	104,008	1,043	2,090

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	6.9	5.8	75.0%	2		1.23s	606	141	0
Inkling	8.3	10.0	75.0%	0		2.51s	702	172	1,024

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	5.5	10.0	33.3%	0		12.23s	7,302	389	0
Inkling	5.1	7.2	22.2%	1		8.71s	7,374	355	4,961

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	6.5	10.0	50.0%	0		10.61s	83,124	5,296	0
Inkling	2.9	5.8	16.7%	1		22.73s	85,854	6,920	1,367

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		20.98s	7,140	222	0
Inkling	10.0	10.0	100.0%	0		2.07s	7,068	216	344

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	5.3	7.2	44.4%	1		3.41s	732	52	0
Inkling	5.3	10.0	33.3%	0		1.68s	804	67	485

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		23.89s	477	81	0
Inkling	10.0	10.0	100.0%	0		3.44s	501	160	213

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		1.23s	660	81	0
Inkling	9.8	10.0	100.0%	0		1.81s	708	93	379

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	7.6	7.2	77.8%	1		1.40s	642	187	0
Inkling	6.4	5.0	66.7%	2		2.97s	714	347	908

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	10.0	10.0	100.0%	0		3.43s	5,454	226	0
Inkling	3.0	10.0	0.0%	0		2.57s	5,949	219	0

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
GPT-6 Sol	3.0	10.0	0.0%	0		1.45s	195	21	0
Inkling	3.0	10.0	0.0%	0		3.12s	219	31	643

Switch Comparison Pair