Navigate
Advertise here

Step 3.5 Flash (medium) vs Inkling 2 Mini

The average score is effectively tied at 5.4 vs 5.3. Step 3.5 Flash (medium) has the lower benchmark cost at $0.105 vs $0.315. Inkling 2 Mini is faster at 42.15s vs 190.48s, with pass rates of 49.3% vs 37.7%.

Last updated at: 2026-11-22

Compared models

Rank
#403
Total Output Tokens
454,482
Response Time (avg)
190.48s
Total Cost
$0.105
Rank
#405
Total Output Tokens
707,676
Response Time (avg)
42.15s
Total Cost
$0.315
Recommended model Step 3.5 Flash (medium)

It has the best score here (5.4), while costing about 3.0x less than Inkling 2 Mini.

Detailed comparison

Metric Step 3.5 Flash Step 3.5 Flash medium Release: 2026-02-01 Inkling 2 Mini Inkling 2 Mini none Release: 2026-11-20
Score 5.4 5.3
Rank #403 #405
Reliability 10.0 10.0
Consistency 8.3 7.0
Attempts 66/69 69/69
Tests Correct
Attempt pass rate 49.3% 37.7%
Flaky tests 3 8
Total Runs 66 69
Cost per result 1.047 6.292
Total Cost $0.105 $0.315
Input Price $0.100 / 1M $0.100 / 1M
Output Price $0.300 / 1M $0.400 / 1M
Cache Read Price N/A $0.020 / 1M
Cache Write Price N/A N/A
Total Input Tokens 139,086 315,037
Output Tokens 193,584 707,676
Reasoning Tokens 413,546 0
Response Time (avg) 190.48s 42.15s
Response Time (max) 1597.85s 175.48s
Response Time (total) 3238.23s 969.34s
Parameters 196B total (11B active) 26.4B total (3.4B active)
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#403 Step 3.5 Flash

medium
Cost
$0.008
Time
277.1s
Tokens
23,695 tok

#405 Thinking Machines: Inkling 2 Mini

none
Cost
$0.001
Time
18.3s
Tokens
1,606 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Step 3.5 Flash 2.4 5.2 0.0% 0 258.38s 2,211 13,207 22,429
Inkling 2 Mini 3.8 3.8 33.3% 2 89.57s 8,804 131,820 0

Switch Comparison Pair