Navigate
Advertise here

Inkling 2 Mini (local Q4) (low) vs GLM 5.1 (medium)

Inkling 2 Mini (local Q4) (low) leads on average score with 7.6 vs 7.5. Inkling 2 Mini (local Q4) (low) has the lower benchmark cost at ~$0.292 vs $1.546. GLM 5.1 (medium) is faster at 66.38s vs 153.99s, with pass rates of 66.7% vs 66.7%.

Last updated at: 2026-11-22

Compared models

Rank
#202
Total Output Tokens
129,600
Response Time (avg)
153.99s
Total Cost
~$0.292
Rank
#207
Total Output Tokens
245,833
Response Time (avg)
66.38s
Total Cost
$1.546
Recommended model Inkling 2 Mini (local Q4) (low)

It has the best score here (7.6), while costing about 5.3x less than GLM 5.1 (medium).

Detailed comparison

Metric Inkling 2 Mini (local Q4) Inkling 2 Mini (local Q4) low Release: 2026-11-20 GLM 5.1 GLM 5.1 medium Release: 2026-04-07
Score 7.6 7.5
Rank #202 #207
Reliability 9.7 9.2
Consistency 9.6 8.4
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 66.7% 66.7%
Flaky tests 1 4
Total Runs 69 69
Cost per result ~1.946 9.004
Total Cost ~$0.292 $1.546
Input Price N/A $1.400 / 1M
Output Price N/A $4.400 / 1M
Cache Read Price N/A $0.260 / 1M
Cache Write Price N/A N/A
Total Input Tokens 312,366 331,577
Output Tokens 1,631 17,919
Reasoning Tokens 127,969 230,789
Response Time (avg) 153.99s 66.38s
Response Time (max) 1963.67s 308.75s
Response Time (total) 3541.85s 1460.31s
Parameters 26.4B total (3.4B active) 744B total (40B active)
Availability Open source Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#202 Thinking Machines: Inkling 2 Mini (local Q4)

low
Cost
~$0.003
Time
85.5s
Tokens
2,977 tok

#207 GLM 5.1

medium
Reached the allocated time limit (300 seconds) without receiving showcase output.
Cost
$0.000
Time
300.0s
Tokens
0 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Inkling 2 Mini (local Q4) 5.3 7.2 44.4% 1 831.97s 5,668 524 34,490
GLM 5.1 4.6 3.7 44.5% 2 109.63s 5,702 4,871 37,826

Switch Comparison Pair

Space Bunny AlphahighvsGLM 5.1mediumQwen3.8 27BlowFree AvailablevsGLM 5.1mediumGPT-6 LunalowvsGLM 5.1mediumQwen3.8 Flash NextmediumvsInkling 2 Mini (local Q4)lowMistral Large 4highvsGLM 5.1mediumMuse WonderxhighvsInkling 2 Mini (local Q4)lowSpace Bunny AlphahighvsInkling 2 Mini (local Q4)lowSeed-2.0-CodehighvsGLM 5.1mediumMuse Glimmer 30BmediumvsInkling 2 Mini (local Q4)lowSeed-2.0-MinimediumvsInkling 2 Mini (local Q4)lowQwen3.5 Plus 2026-04-20mediumvsInkling 2 Mini (local Q4)lowClaude Haiku 5.5mediumvsInkling 2 Mini (local Q4)low