Navigate
AI BENCHY
Advertise here

OpenAI: GPT-5.5 vs Thinking Machines: Inkling

GPT-5.5 (low) leads on average score with 9.3 vs 8.0. Inkling (medium) has the lower benchmark cost at $0.391 vs $1.253. GPT-5.5 (low) is faster at 10.13s vs 16.21s, with pass rates of 86.4% vs 78.8%.

Recommended modelGPT-5.5 (low)It has the best score here (9.3), while responding about 1.6x faster than Inkling (medium).

Last updated at: 2026-07-18

Metric GPT-5.5 GPT-5.5 low Release: 2026-04-24 Inkling Inkling medium Release: 2026-07-18
Score 9.3 8.0
Rank #6 #32
Reliability 10.0 9.8
Consistency 10.0 8.2
Tests Correct
Attempt pass rate 86.4% 78.8%
Flaky tests 0 5
Total Runs 66 66
Cost per result 6.594 2.604
Total Cost $1.253 $0.391
Input Price $5.000 / 1M $1.000 / 1M
Output Price $30.000 / 1M $4.050 / 1M
Total Input Tokens 80,058 124,053
Output Tokens 5,378 12,189
Reasoning Tokens 23,040 53,597
Response Time (avg) 10.13s 16.21s
Response Time (max) 56.19s 85.12s
Response Time (total) 222.82s 356.54s

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#6 GPT-5.5

low
Cost
$0.068
Time
37.0s
Tokens
2,339 tok

#32 Thinking Machines: Inkling

medium
Cost
$0.004
Time
11.2s
Tokens
852 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
GPT-5.5 10.0 10.0 100.0% 0 15.04s 7,302 423 6,402
Inkling 8.4 7.8 77.8% 1 25.20s 7,374 525 14,457

Quick Compare

Switch Comparison Pair