Inkling — high vs medium

Recommended model medium

Its score stays close to the best score here (8.0 vs 8.0), while costing about 2.8x less than Inkling (high).

Detailed comparison

Metric	Inkling Inkling high Release: 2026-07-18	Inkling Inkling medium Release: 2026-07-18

Metric	Inkling Inkling high Release: 2026-07-18	Inkling Inkling medium Release: 2026-07-18
Score	8.0	8.0
Rank	#51	#56
Reliability	10.0	10.0
Consistency	8.9	8.5
Attempts	66/66	66/66
Tests Correct
Attempt pass rate	77.3%	75.8%
Flaky tests	3	4
Total Runs	66	66
Cost per result	6.968	2.551
Total Cost	$1.041	$0.377
Input Price	$0.950 / 1M	$0.950 / 1M
Output Price	$4.050 / 1M	$4.050 / 1M
Total Input Tokens	86,755	124,062
Output Tokens	6,057	12,190
Reasoning Tokens	230,570	51,652
Response Time (avg)	62.57s	15.66s
Response Time (max)	327.51s	85.12s
Response Time (total)	1376.46s	344.52s
Parameters	975B total (41B active)	975B total (41B active)
Availability	Open source	Open source

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

high

medium

Category:

Anti-AI Tricks	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Inkling	10.0	10.0	100.0%	0		12.68s	702	455	7,204
Inkling	8.7	9.5	75.0%	0		6.49s	645	333	3,091

Coding	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Inkling	8.5	10.0	66.7%	0		148.36s	7,374	430	78,982
Inkling	8.4	7.8	77.8%	1		25.20s	7,374	525	14,457

Combined	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Inkling	7.3	5.8	83.3%	1		63.78s	61,296	3,854	19,895
Inkling	7.3	5.8	83.3%	1		41.15s	98,542	10,088	4,626

Data parsing and extraction	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Inkling	10.0	10.0	100.0%	0		8.19s	7,068	216	2,349
Inkling	10.0	10.0	100.0%	0		3.60s	7,068	216	813

Domain specific	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Inkling	7.7	10.0	66.7%	0		174.68s	692	61	86,556
Inkling	5.3	7.2	44.4%	1		31.59s	804	69	18,378

General Intelligence	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Inkling	10.0	10.0	100.0%	0		6.53s	501	182	1,151
Inkling	10.0	10.0	100.0%	0		4.65s	501	170	699

Instructions following	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Inkling	9.8	10.0	100.0%	0		7.00s	708	93	2,098
Inkling	9.8	10.0	100.0%	0		6.17s	708	93	1,886

Puzzle Solving	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Inkling	6.9	4.9	77.8%	2		10.69s	714	429	4,623
Inkling	10.0	10.0	100.0%	0		5.18s	714	370	2,310

Tool Calling	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Inkling	3.0	10.0	0.0%	0		6.52s	7,481	307	601
Inkling	3.0	10.0	0.0%	0		4.48s	7,487	296	298

Trivia	Score	Consistency	Attempt pass rate	Flaky tests	Tests Correct	Response Time (avg)	Input Tokens	Output Tokens	Reasoning Tokens
Inkling	3.0	10.0	0.0%	0		153.57s	219	30	27,111
Inkling	2.8	1.6	33.3%	1		21.69s	219	30	5,094

Switch Comparison Pair