Navigate
Advertise here

Inkling (high) vs Grok 4.7 (medium)

The average score is effectively tied at 8.0 vs 8.1. Inkling (high) has the lower benchmark cost at $1.046 vs $2.254. Inkling (high) is faster at 62.57s vs 106.09s, with pass rates of 77.3% vs 81.8%.

Last updated at: 2026-09-21

Compared models

Rank
#74
Total Output Tokens
236,627
Response Time (avg)
62.57s
Total Cost
$1.046
Rank
#73
Total Output Tokens
433,733
Response Time (avg)
106.09s
Total Cost
$2.254
Recommended model Inkling (high)

It has the best score here (8.0), while costing about 2.2x less than Grok 4.7 (medium).

Detailed comparison

Metric Inkling Inkling high Release: 2026-07-18 Grok 4.7 Grok 4.7 medium Release: 2026-09-21
Score 8.0 8.1
Rank #74 #73
Reliability 10.0 9.9
Consistency 8.9 8.3
Attempts 66/66 66/66
Tests Correct
Attempt pass rate 77.3% 81.8%
Flaky tests 3 5
Total Runs 66 66
Cost per result 6.968 15.023
Total Cost $1.046 $2.254
Input Price $1.000 / 1M $1.600 / 1M
Output Price $4.050 / 1M $4.800 / 1M
Total Input Tokens 86,755 107,193
Output Tokens 6,057 4,661
Reasoning Tokens 230,570 429,072
Response Time (avg) 62.57s 106.09s
Response Time (max) 327.51s 660.89s
Response Time (total) 1376.46s 2333.94s
Parameters 975B total (41B active) ~1.7T total (~170B active)
Availability Open source Closed

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#74 Thinking Machines: Inkling

high
Cost
$0.005
Time
32.2s
Tokens
1,275 tok

#73 SpaceXAI: Grok 4.7

medium
Cost
$0.047
Time
132.3s
Tokens
9,954 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Inkling 8.5 10.0 66.7% 0 148.36s 7,374 430 78,982
Grok 4.7 6.6 4.6 77.8% 2 312.17s 10,266 349 172,347

Quick Compare

Switch Comparison Pair