Navigate
AI BENCHY
AD
Track all your projects in one dashboard. Get 📊stats, 🔥heatmaps and 👀recordings in one self-hosted dashboard.
uxwizz.com

Thinking Machines: Inkling vs xAI: Grok 4.5

Grok 4.5 (medium) leads on average score with 8.3 vs 8.0. Inkling (high) has the lower benchmark cost at $1.006 vs $1.928. Grok 4.5 (medium) is faster at 61.71s vs 64.16s, with pass rates of 77.3% vs 78.8%.

Recommended modelInkling (high)Its score stays close to the best score here (8.0 vs 8.3), while costing about 1.9x less than Grok 4.5 (medium).

Last updated at: 2026-07-22

Metric Inkling Inkling high Release: 2026-07-18 Grok 4.5 Grok 4.5 medium Release: 2026-07-08
Score 8.0 8.3
Rank #32 #25
Reliability 9.8 10.0
Consistency 8.9 8.9
Tests Correct
Attempt pass rate 77.3% 78.8%
Flaky tests 3 3
Total Runs 66 66
Cost per result 6.704 12.049
Total Cost $1.006 $1.928
Input Price $1.000 / 1M $2.000 / 1M
Output Price $4.050 / 1M $6.000 / 1M
Total Input Tokens 86,746 122,146
Output Tokens 6,055 5,514
Reasoning Tokens 220,791 275,053
Response Time (avg) 64.16s 61.71s
Response Time (max) 327.51s 436.38s
Response Time (total) 1411.59s 1357.56s

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#32 Thinking Machines: Inkling

high
Cost
$0.005
Time
32.2s
Tokens
1,275 tok

#25 xAI: Grok 4.5

medium
Cost
$0.044
Time
59.4s
Tokens
7,512 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Inkling 8.5 10.0 66.7% 0 148.36s 7,374 430 78,982
Grok 4.5 7.6 7.2 77.8% 1 155.69s 9,579 390 104,634

Quick Compare

Switch Comparison Pair