Navigate
Advertise here

Qwen3.8 27B (low) vs Inkling 2 Mini (local Q4) (low)

The average score is effectively tied at 7.6 vs 7.6. Qwen3.8 27B (low) has the lower benchmark cost at ~$0.089 vs ~$0.292. Qwen3.8 27B (low) is faster at 46.60s vs 153.99s, with pass rates of 68.1% vs 66.7%.

Last updated at: 2026-11-22

Compared models

Rank
#205
Total Output Tokens
209,143
Response Time (avg)
46.60s
Total Cost
~$0.089
Rank
#202
Total Output Tokens
129,600
Response Time (avg)
153.99s
Total Cost
~$0.292
Recommended model Qwen3.8 27B (low)

It has the best score here (7.6), while costing about 3.3x less than Inkling 2 Mini (local Q4) (low).

Detailed comparison

Metric Qwen3.8 27B Qwen3.8 27B low Release: 2026-08-14 Free Available Inkling 2 Mini (local Q4) Inkling 2 Mini (local Q4) low Release: 2026-11-20
Score 7.6 7.6
Rank #205 #202
Reliability 10.0 9.7
Consistency 9.7 9.6
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 68.1% 66.7%
Flaky tests 1 1
Total Runs 69 69
Cost per result ~0.589 ~1.946
Total Cost ~$0.089 ~$0.292
Input Price N/A N/A
Output Price N/A N/A
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 315,290 312,366
Output Tokens 1,607 1,631
Reasoning Tokens 207,536 127,969
Response Time (avg) 46.60s 153.99s
Response Time (max) 376.04s 1963.67s
Response Time (total) 1071.83s 3541.85s
Parameters 27.3B 26.4B total (3.4B active)
Availability Weights available Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#205 Qwen3.8 27B

low
Cost
~$0.003
Time
92.8s
Tokens
6,902 tok

#202 Thinking Machines: Inkling 2 Mini (local Q4)

low
Cost
~$0.003
Time
85.5s
Tokens
2,977 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.8 27B 7.7 10.0 66.7% 0 140.92s 8,127 585 86,694
Inkling 2 Mini (local Q4) 5.3 7.2 44.4% 1 831.97s 5,668 524 34,490

Switch Comparison Pair

Qwen3.8 27BlowFree AvailablevsSpace Bunny AlphahighQwen3.8 27BlowFree AvailablevsGLM 5.1mediumQwen3.8 Flash NextmediumvsInkling 2 Mini (local Q4)lowMuse WonderxhighvsInkling 2 Mini (local Q4)lowSeed-2.0-MinimediumvsQwen3.8 27BlowFree AvailableSpace Bunny AlphahighvsInkling 2 Mini (local Q4)lowInkling 2 Mini (local Q4)lowvsGLM 5.1mediumMistral Large 4highvsQwen3.8 27BlowFree AvailableMuse Glimmer 30BmediumvsInkling 2 Mini (local Q4)lowMuse WonderxhighvsQwen3.8 27BlowFree AvailableSeed-2.0-MinimediumvsInkling 2 Mini (local Q4)lowQwen3.5 Plus 2026-04-20mediumvsInkling 2 Mini (local Q4)low