Navigate
Advertise here

Qwen3.8 27B (high) vs Inkling 2 Mini (local Q4) (minimal)

The average score is effectively tied at 8.7 vs 8.7. Inkling 2 Mini (local Q4) (minimal) has the lower benchmark cost at ~$0.206 vs ~$0.298. Inkling 2 Mini (local Q4) (minimal) is faster at 108.28s vs 166.34s, with pass rates of 78.3% vs 73.9%.

Last updated at: 2026-11-22

Compared models

Rank
#104
Total Output Tokens
677,080
Response Time (avg)
166.34s
Total Cost
~$0.298
Rank
#108
Total Output Tokens
219,084
Response Time (avg)
108.28s
Total Cost
~$0.206
Recommended model Inkling 2 Mini (local Q4) (minimal)

It has the best score here (8.7), while responding about 1.5x faster than Qwen3.8 27B (high).

Detailed comparison

Metric Qwen3.8 27B Qwen3.8 27B high Release: 2026-08-14 Free Available Inkling 2 Mini (local Q4) Inkling 2 Mini (local Q4) minimal Release: 2026-11-20
Score 8.7 8.7
Rank #104 #108
Reliability 9.7 9.8
Consistency 9.2 10.0
Attempts 69/69 69/69
Tests Correct
Attempt pass rate 78.3% 73.9%
Flaky tests 2 0
Total Runs 69 69
Cost per result ~1.751 ~1.207
Total Cost ~$0.298 ~$0.206
Input Price N/A N/A
Output Price N/A N/A
Cache Read Price N/A N/A
Cache Write Price N/A N/A
Total Input Tokens 348,967 309,808
Output Tokens 1,005 1,579
Reasoning Tokens 676,075 217,505
Response Time (avg) 166.34s 108.28s
Response Time (max) 640.85s 1322.88s
Response Time (total) 3825.81s 2490.37s
Parameters 27.3B 26.4B total (3.4B active)
Availability Weights available Open source

Cache prices apply to input tokens. Reads reuse cached prompts; writes store them and can cost extra. Output tokens use the output price.

Model generation showcase

Hamster playing table tennis

Prompt: Create a detailed SVG illustration of a hamster playing table tennis.

#104 Qwen3.8 27B

high
Cost
~$0.008
Time
270.1s
Tokens
18,963 tok

#108 Thinking Machines: Inkling 2 Mini (local Q4)

minimal
Cost
~$0.002
Time
67.8s
Tokens
2,348 tok

Top Models by Score

Score vs Total Cost

Response Time (avg)

Score vs Response Time (avg)

Total Output Tokens

Score vs Total Output Tokens

Category Breakdown

Coding Score Consistency Attempt pass rate Flaky tests Tests Correct Response Time (avg) Input Tokens Output Tokens Reasoning Tokens
Qwen3.8 27B 8.1 7.0 88.9% 1 248.62s 8,235 346 143,335
Inkling 2 Mini (local Q4) 10.0 10.0 100.0% 0 225.36s 8,814 512 47,862

Switch Comparison Pair

Qwen4 MaxlowvsInkling 2 Mini (local Q4)minimalClaude Fable 5.2highvsInkling 2 Mini (local Q4)minimalGPT-5.2mediumvsQwen3.8 27BhighFree AvailableGPT-6 SollowvsInkling 2 Mini (local Q4)minimalQwen3.8 27BhighFree AvailablevsMiMo-V2.6-PromediumSeed 2.1 TurbomediumvsQwen3.8 27BhighFree AvailableSeed 2.1 TurbomediumvsInkling 2 Mini (local Q4)minimalInkling 2 Mini (local Q4)minimalvsMiMo-V2.6-PromediumGPT-6 SollowvsQwen3.8 27BhighFree AvailableParticle-1xhighvsQwen3.8 27BhighFree AvailableMuse EmberlowvsInkling 2 Mini (local Q4)minimalMuse EmbermaxvsInkling 2 Mini (local Q4)minimal