Navigate
Advertise here

Claude Haiku 5.5 (medium) vs Inkling 2 Mini (local Q4) (low)

Claude Haiku 5.5 (medium) leads on average score with 7.7 vs 7.6. Claude Haiku 5.5 (medium) has the lower benchmark cost at $0.063 vs ~$0.292. Claude Haiku 5.5 (medium) is faster at 7.71s vs 153.99s, with pass rates of 71.0% vs 66.7%.

Last updated at: 2026-11-22

Compared models

Rank
#197
Total Output Tokens
66,174
Response Time (avg)
7.71s
Total Cost
$0.063
Rank
#202
Total Output Tokens
129,600
Response Time (avg)
153.99s
Total Cost
~$0.292
Recommended model Claude Haiku 5.5 (medium)

It has the best score here (7.7), while costing about 4.6x less than Inkling 2 Mini (local Q4) (low).

Detailed comparison

Metric Claude Haiku 5.5 Claude Haiku 5.5 medium Release: 2026-10-07 Inkling 2 Mini (local Q4) Inkling 2 Mini (local Q4) low Release: 2026-11-20
Score 7.7 7.6
Rank #197 #202
Reliability 10.0 9.7
Consistency 7.5 9.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 71.0% 66.7%
Flaky tests 7 1
Total Runs 69 69
Cost per result 0.485 ~1.946
Total Cost $0.063 ~$0.292
Input Price $0.100 / 1M N/A
Output Price $0.500 / 1M N/A
Cache Read Price $0.010 / 1M N/A
Cache Write Price $0.125 / 1M N/A
Total Input Tokens 298,334 312,366
Output Tokens 10,328 1,631
Reasoning Tokens 55,846 127,969
Response Time (avg) 7.71s 153.99s
Response Time (max) 47.70s 1963.67s
Response Time (total) 177.29s 3541.85s
Parameters ~50B 26.4B total (3.4B active)
Availability Closed Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#197 Claude Haiku 5.5

medium
Cost
$0.002
Time
17.2s
Tokens
3,524 tok

#202 Thinking Machines: Inkling 2 Mini (local Q4)

low
Cost
~$0.003
Time
85.5s
Tokens
2,977 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Claude Haiku 5.5 6.3 4.8 66.7% 2 7.16s 10,608 518 11,415
Inkling 2 Mini (local Q4) 5.3 7.2 44.4% 1 831.97s 5,668 524 34,490

Switch Comparison Pair

Claude Haiku 5.5mediumvsMuse Glimmer 30BhighClaude Haiku 5.5mediumvsQwen3.7 FlashlowClaude Haiku 5.5mediumvsGPT-6 LunahighClaude Haiku 5.5mediumvsMuse WonderhighQwen3.8 Flash NextmediumvsInkling 2 Mini (local Q4)lowMuse WonderxhighvsInkling 2 Mini (local Q4)lowClaude Haiku 5.5mediumvsMuse WonderxhighSpace Bunny AlphahighvsInkling 2 Mini (local Q4)lowInkling 2 Mini (local Q4)lowvsGLM 5.1mediumMuse Glimmer 30BmediumvsInkling 2 Mini (local Q4)lowClaude Haiku 5.5mediumvsGrok 4.5lowClaude Haiku 5.5mediumvsQwen3.7 Plusnone